Browsing Tag
Custom AI Chips
1 post
Custom AI accelerators, ASICs, in-house chip programs, model-serving hardware, and AI infrastructure supply strategy.
OpenAI’s Jalapeño Chip Puts Inference Costs at the Center of the AI Race
OpenAI and Broadcom unveiled Jalapeño, OpenAI’s first custom inference accelerator for large language models. The chip is less about replacing Nvidia overnight than controlling the cost, latency, and supply of the compute that runs products like ChatGPT, Codex, and the API.
