Flash-MoE: Running a 397B Parameter Model on a Laptop
TL;DR: A new Mixture-of-Experts implementation lets you run a 397 billion parameter model on consumer hardware. No cloud. No API costs. Just your laptop and patience. The Breakthrough Yesterday,
Technical
1 post