~ / blog / series / 洋垃圾跑大模型
❯ ls ~/blog/series/洋垃圾跑大模型
1 post
- partdatetitle
- 12026-07-21[Junk-Tier Big Models #1] Running a 119B MoE at 74 tok/s on Three 2080 Tis
A US$1.6k junk EPYC + 3× 2080 Ti 22G box (66G VRAM) runs a quantized 119B MoE at 74 tok/s. Expert offload to RAM costs about 2.4× decode — plus a multi-card OOM gotcha.