#vllm — Blog — ai-muninn

~ / blog / tag / vllm

❯ grep -r "#vllm" ~/blog

17 matches

datereadtitle
2026-04-0710m
[Benchmark] From 19 to 50 tok/s: We Quantized Gemma 4 E4B to NVFP4 Before Anyone Else
#gemma-4 #e4b #nvfp4 #fp8
2026-04-078m
[LLM 101] Ollama vs vLLM: Two Ways to Run AI on Your Own Computer
#ollama #vllm #llm #local-ai
2026-04-058m
[vLLM] Gemma 4 26B-A4B NVFP4 on DGX Spark: 52 tok/s with 16 GB of Weights
#gemma-4 #nvfp4 #vllm #dgx-spark
2026-04-056m
[Benchmark] Gemma 4 31B Dense on DGX Spark: 7 tok/s and the Bandwidth Wall
#gemma-4 #nvfp4 #vllm #dgx-spark
2026-04-057m
[Benchmark] vLLM vs Ollama on the Same Model: Why 30% Faster on GB10
#vllm #ollama #benchmark #dgx-spark
2026-04-025m
[vLLM] GX10 Power Delivery: The 30W Safety Mode No Firmware Can Fix
#gx10 #gb10 #dgx-spark #power-delivery
2026-03-308m
[Benchmark] TurboQuant on GX10: Is 3-bit KV Cache Compression Actually Lossless?
#turboquant #kv-cache #quantization #vllm
2026-03-247m
[AI Agent] NemoClaw Without the Cloud: Swapping Nemotron for a Local Ollama Model
#nemoclaw #openclaw #openshell #ollama
2026-03-216m
[vLLM] FP8 KV Cache on GB10: Why Outputs Collapse into Repetition Loops
#vllm #fp8 #kv-cache #gb10
2026-03-216m
[AI Agent] openclaw + 131K Context: When max_tokens Goes Negative
#openclaw #context-window #vllm #gpt-oss
2026-03-1911m
[vLLM] Running a 120B Model on DGX Spark at 60 tok/s — Zero API Cost, Six Bugs
#dgx-spark #sm121 #vllm #gpt-oss
2026-03-196m
[vLLM] Qwen3.5-122B Runs. But at 14 tok/s.
#dgx-spark #sm121 #qwen3.5-122b #vllm
2026-03-1710m
[vLLM] Why Your DGX Spark Only Says "!!!!!": Debugging NVFP4 on SM121
#dgx-spark #sm121 #vllm #nvfp4
2026-03-139m
[vLLM] Nemotron-3-Super-120B on a Single GB10: Full Day Debug Log
#dgx-spark #gb10 #sm121 #nemotron
2026-03-077m
[vLLM] Ollama's KEEP_ALIVE Is Silently Eating Your vLLM Headroom
#vllm #ollama #gpu-memory #dgx-spark
2026-03-067m
[vLLM] Don't Add --enable-chunked-prefill to SSM Models
#vllm #ssm #qwen #dgx-spark
2026-03-0512m
[vLLM] Qwen3.5-35B at 47 tok/s on a Desktop: Migrating from Ollama to vLLM
#dgx-spark #gb10 #vllm #ollama

← back to all posts