OpenAI reveals its first AI processor: Jalapeño

OpenAI revealed its first AI server chip, Jalapeño, an “intelligence processor” built with Broadcom and designed as an ASIC for AI inference in current and future large language models. It matters because it marks OpenAI’s move into custom silicon for serving products like ChatGPT and Codex, following its chip partnership announcement just nine months earlier.

OpenAI has just revealed a new "intelligence processor" chip for AI servers made in partnership with Broadcom. The chip, called Jalapeño, is designed to power current and future large language models, according to an announcement on Wednesday. Jalapeño is an ASIC (Application-Specific Integrated Circuit), meaning it's designed for a specific purpose: AI inference. With AI inference, models process a user's request to run an agent like Codex or offer a response from ChatGPT, while AI training involves a model consuming vast amounts of data to inform its responses. It comes just nine months after OpenAI revealed that it would team up with Br … Read the full story at The Verge.