How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip
发生了什么
On 25 August, OpenAI fully unveiled Jalapeño, the company’s debut AI accelerator chip. Jalapeño delivers up to 13.4 petaflops of 4-bit compute and accesses 232 gigabytes of the most advanced memory available, linking to it at a blazing 15.4 terabytes per second. Benchmarks cited by OpenAI show that Jalapeño can reduce end-to-end latency (the time between prompt to last token) by up to 3.6x when compared to Nvidia’s…
摘要按规则整理自下方来源原文
为什么在扩散
时间线
- IEEE Spectrum AI 最先出现IEEE Spectrum AI
- Hacker News 出现讨论Hacker News
来源
新闻报道
- How OpenAI Used Its Own LLMs to Design Its Jalapeño ChipIEEE Spectrum AI