Browsing Tag
Custom AI Chips
4 posts
Custom AI accelerators, ASICs, in-house chip programs, model-serving hardware, and AI infrastructure supply strategy.
OpenAI’s Jalapeño Benchmarks Turn Inference Power Into the AI Chip Fight
OpenAI published first benchmark results for Jalapeño, its Broadcom-built inference chip, claiming higher performance per watt and lower latency than leading commercial AI systems. The useful question is not whether it replaces Nvidia immediately, but whether custom inference silicon can turn power limits into a product advantage for ChatGPT, Codex, and agentic AI workloads.
Apple’s Broadcom Deal Makes Edge AI a Supply-Chain Commitment
Broadcom’s July 6 SEC filing says it will supply custom ASIC silicon for multiple generations of Apple products through 2031. The sparse disclosure does not confirm specific Apple Intelligence hardware, but it locks in a key supplier relationship as Apple tries to make more AI run locally on phones, Macs, watches, and tablets.
Etched’s $1B Sohu Backlog Turns AI Inference Into the Next Chip Fight
Etched says it has raised $800 million, signed more than $1 billion in customer contracts, and started production of its Sohu-based inference racks. The startup’s transformer-specialized chip is a serious bet that AI’s next hardware fight will be won on serving models, not just training them.
OpenAI’s Jalapeño Chip Puts Inference Costs at the Center of the AI Race
OpenAI and Broadcom unveiled Jalapeño, OpenAI’s first custom inference accelerator for large language models. The chip is less about replacing Nvidia overnight than controlling the cost, latency, and supply of the compute that runs products like ChatGPT, Codex, and the API.