Meet the kitchen crew
Welcome behind the counter of the busiest kitchen in the world. Instead of food, The AI Café serves intelligence — answers, images, translations — to millions of hungry customers every second. A kitchen this big can't run on one kind of worker. So let's meet the crew, each hired for one very specific set of skills.
CPU · Central Processing Unit
The general manager. Brilliant, knows every dish on the menu, and keeps the whole restaurant running. But Chef CPU has only two hands and works one task at a time — ask for 10,000 chopped carrots and they'll chop them one… by… one. Perfect for running the place; slow at heavy, repetitive labour.
sequential · runs the whole showGPU · Graphics Processing Unit
Ten thousand junior cooks on one giant assembly line. Not one of them could run the restaurant — but hand them 10,000 carrots and they each grab one and finish in a single second. That's parallel processing. It's also how the kitchen builds a brand-new menu from scratch: the heavy lifting we call training an AI.
parallel processing · trainingNPU · Neural Processing Unit
While the kitchen sweats, the NPU works the dining room — a battery-powered helper living right inside your phone or laptop. A little more pepper? A water refill? It handles small jobs locally, right at the table (inference), without the long walk to the main kitchen. Fast, frugal, and easy on your battery.
on-device · inferenceASIC & TPU · Application-Specific Integrated Circuit
Bolted into the back wall sits a machine welded from steel to do exactly one thing: make the perfect bowl of spaghetti. It can't toss a salad or even switch to linguini — but because every wire is hardwired for that one dish, it's ten times faster and cheaper than the prep cooks. (Google's own version is called the TPU.)
hardwired · one job, masteredFPGA · Field-Programmable Gate Array
Tastes change fast — tacos this week, sushi the next. The FPGA is a magic kitchen island with modular counters, removable stoves and re-wireable power. Invent a smarter way to cook and an engineer can physically rewire the station overnight to fit the new recipe perfectly. The ultimate adaptable hardware.
reconfigurable · rewired overnightLPU · Language Processing Unit
The newest hire doesn't cook — it tells stories, recites the specials, and generates text. When the GPU army reads the menu, it keeps running back to the pantry (external memory) for the next word, causing a small traffic jam. The LPU has the entire menu, dictionary and wine list memorised on-chip — so it spits words out, in order, at blistering, almost unbelievable speed.
on-chip memory · blistering speed