#moe — Blog — ai-muninn

~ / blog / tag / moe

❯ grep -r "#moe" ~/blog

15 matches

datereadtitle
2026-10-0613m
Qwen3.8-Flash-Next 177B on One RTX 2080 Ti: Strata Runs Code at 70 tok/s
#strata #moe #2080-ti #qwen3.8
2026-09-1610m
[LLM Deep Dive] What actually happens inside one transformer layer — four real models, four data flows
#llm #transformer #moe #qwen3
2026-08-2816m
[Benchmark] A 177B MoE at Full 262K Context on a DGX Spark: 76.65 tok/s on a File Edit
#dgx-spark #gb10 #llama.cpp #moe
2026-08-2826m
[Benchmark] A 177B MoE on Three Modded 2080 Tis: 23 tok/s at 128K, 77 on a File Edit
#llama.cpp #2080-ti #moe #speculative-decoding
2026-08-0220m
[Junk-Tier Big Models #4] A frontier-class open model on hardware you already own: DeepSeek-V4-Flash-0731 on one 22GB 2080 Ti
#deepseek-v4-flash #0731 #moe #2080-ti
2026-07-2918m
[Junk-Tier Big Models #3] A 284B MoE on ONE 2080 Ti — and it beats my DGX Spark
#deepseek-v4-flash #moe #2080-ti #llama.cpp
2026-07-2210m
[Junk-Tier Big Models #2] Running Poolside Laguna S 2.1, a 118B Coding MoE, on ONE 22GB 2080 Ti
#laguna #poolside #moe #2080-ti
2026-07-2112m
[Junk-Tier Big Models #1] Running a 119B MoE at 74 tok/s on Three 2080 Tis
#llama.cpp #moe #expert-offload #2080-ti
2026-06-0110m
[Benchmark] NVFP4 W4A4 beats FP8 on a DGX Spark MoE: 67 vs 52 tok/s once CUDA graphs fire
#nvfp4 #w4a4 #fp8 #dgx-spark
2026-05-0114m
[vLLM] Nemotron 3 Nano on DGX Spark: 74.75 tok/s NVFP4 — 11.5% Past the Public Baseline
#nemotron-3 #nvfp4 #vllm #dgx-spark
2026-04-2814m
[llm-compressor] Self-Quantizing a 35B Abliterated MoE to FP8 on DGX Spark: 4 OOMs, 3 Prefix Bugs, and Why the First Success Wasn't Actually FP8
#dgx-spark #gb10 #sm121 #llm-compressor
2026-04-136m
[Benchmark] Gemma 4 on DGX Spark — Which Model Should You Pick?
#gemma-4 #dgx-spark #gb10 #benchmark
2026-04-088m
[LLM 101 #2] Dense, MoE, PLE, SSM — Four AI Model Architectures Explained Simply
#dense #moe #ple #ssm
2026-04-059m
Gemma 4 26B-A4B on DGX Spark: 52 tok/s with NVFP4, skip the 31B
#gemma-4 #nvfp4 #vllm #dgx-spark
2026-03-018m
[Benchmark] Pure MoE vs SSM Hybrid: Context Decay and Why It Matters for Agents
#benchmark #ssm #moe #dgx-spark

← back to all posts