Today’s tidal wave of queries is forcing hardware makers to pivot
Note: ### The AI Inference Revolution Is Here [IEEE Spectrum article](#rid:1854764141) — a survey of how the shift from AI training to AI **inference** is reshaping chip and memory design. **The shift** Since 2020, the AI story was about training ever-bigger models. In 2026 the spotlight has moved to inference — putting trained models to work. People actually use LLMs now, reasoning models run…
InferenceX, Up to 50% Better Performance per Dollar, Rapid Externalization of TPU stack, Growing Customer Base, Ironwood, TPUv8i, Reducing CUDA Moat
A look at AI Chip Architectures. NVIDIA, AMD, TPUs, Trainium, Groq, Cerebras.
A sample of the designs that followed Google's first Tensor Processing Unit.
Learning from a classic AI accelerator - Eyeriss
Alphabet runs the most enviable AI infrastructure stack in the industry. The success of the third-party deals with Anthropic and Meta is the reason internal access has become a competitive resource. Google has spent a decade quietly building the most enviable position in AI…
Google is preparing two brand new chips under its TPUv8 belt, one for training & one for inference AI workloads.
Why Anthropic’s integration into hyperscaler silicon programs may give it a lasting advantage in the economics of frontier AI.
Designing AI Chip Hardware and Software Bjarke Hammersholt Roune 2026 This document is, for now, open for comments. You can use the Google Docs comment feature to add comments anywhere. Thanks! What is this document? I was going to start an AI chip company and this document…
Is GPU vs TPU the CISC vs RISC contest of the modern era?
TPUv7 offers a viable alternative to the GPU-centric AI stack has already arrived — one with real implications for the economics and architecture of frontier-scale training.
Explore the Google vs OpenAI AI ecosystem battle post-o3. Deep dive into Google's huge cost advantage (TPU vs GPU), agent strategies & model risks for enterprise
Google Poxel 11s Tensor G6 codename leaks along with the Tensor G5 chip, expected to be built on TSMC's 2nm manufacturing process.
Google's sixth-generation tensor processing unit (TPU) stole the company's I/O developer conference stage with its higher-than-ever computing performance.
Google revealed the sixth iteration of its Tensor Processing Unit (TPU), named Trillium, for data centers at the I/O 2024
An analysis of Google’s unique approach to AI hardware
Google’s new AI chip is a rival to Nvidia, and its Arm-based CPU will compete with Microsoft and Amazon
Startup Groq has developed an machine learning processor that it claims blows GPUs away in large language model workloads – 10x faster than an Nvidia GPU at 10 percent of the cost, and needing a tenth of the electricity. Update: Groq model compilation time and time from access…
A new technical paper titled “TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings” was published by researchers at Google. Abstract: “In response to innovations in machine learning (ML) models, production workloads changed…
As we previously reported, Google unveiled its second-generation TensorFlow Processing Unit (TPU2) at Google I/O last week. Google calls this new
In this work, we analyze the performance of neural networks on a variety of heterogenous platforms. We strive to find the best platform in terms of raw benchmark performance, performance per watt a…
Google did its best to impress this week at its annual IO conference. While Google rolled out a bunch of benchmarks that were run on its current Cloud TPU
Four years ago, Google started to see the real potential for deploying neural networks to support a large number of new services. During that time it was
Google detailed TPUv4 at Google I/O 2021. They're accelerator chips that deliver high performance on AI workloads.
The inception of Google’s effort to build its own AI chips is quite well known by now but in the interests of review, we’ll note that as early 2013 the