#llama-cpp
5 articles
- 2026-10-17
Tokens Per Second Is Two Benchmarks Wearing a Trench Coat
A single tokens-per-second score hides prompt ingestion, decoding, and the workload that actually matters. Benchmark both halves or stop comparing machines.
- 2026-04-02
M5 Max vs AMD Strix Halo: Which Is Better for Running Local LLMs?
Apple's M5 Max has 460 GB/s memory bandwidth. My AMD Ryzen AI Max+ 395 has ~256 GB/s. The numbers seem to favor Apple — until you think about what actually matters for running large models locally.
- 2026-03-14
Mamba Meets Vulkan: Running Nemotron-3-Super on Consumer AMD Hardware
NVIDIA's 120B Mamba-2 hybrid model just became runnable on consumer AMD GPUs. Here's why that matters.
- 2026-03-05
Which Local LLM Is Fastest on Ryzen AI Max+ 395? I Benchmarked 10 of Them
Real prefill and generation speeds for 10 local LLMs on Strix Halo — and the winner surprised me.
- 2026-02-22
The Full Stack: Running LLM, Image, and Video Generation on One Machine
How I set up a complete local AI stack — text, image, and video generation — on a single machine with zero cloud dependency. All Vulkan, all coexisting, all free.