Sergii Potapov

6 posts

Flash-MoE: Running a 397B Parameter Model on a Laptop

TL;DR: A new Mixture-of-Experts implementation lets you run a 397 billion parameter model on consumer hardware. No cloud. No API costs. Just your laptop and patience. The Breakthrough Yesterday,

The $12,000 AI Independence Box

TL;DR: George Hotz's tiny corp is now shipping tinybox — a $12,000 computer that runs 120B parameter models offline. No API costs. No rate limits. No data