ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsQuick take2 min readDisconfirmAI Editorial

Three Retired V100 GPUs Outpace $5,399 Mac Studio in Long-Context Inference for $1,042

Self-tested benchmarks show a $1,042 rig with three used Nvidia V100s beats a high-end M5 Max Mac Studio on Qwen 3.6 35B at long contexts.

2026-11-19

According to Tom's Hardware, a homelab builder known as esologic benchmarked three used Nvidia Tesla V100 GPUs, finding that the ~$1,042 setup outperformed a $5,399 Apple M5 Max Mac Studio in inference speed for the Qwen 3.6 35B mixture-of-experts (MoE) model at long context lengths.

The tests, conducted using the llama.cpp framework, compared generation speeds across different quantization levels and context sizes. With 8-bit quantization (Q8), the three V100s achieved 100.8 tokens per second at 4K context, dropping to 72.7 tokens per second at 128K. The M5 Max Mac Studio, equipped with a 40-core GPU and 128GB of unified memory, was slightly faster at 4K (105.5 tokens per second) but fell behind at 64K and 128K, where the V100 cluster was approximately 19% faster at the longest context tested.

The V100s represent older 'e-waste' enterprise GPUs, whose advantage lies in combining VRAM capacity and bandwidth through multi-GPU parallelism, enabling larger models or longer contexts. While modern consumer devices like the Mac Studio may excel in short-context performance and energy efficiency, they were surpassed by the low-cost legacy hardware in this specific long-text workload. The builder also noted that the V100s consumed about half the energy of an equivalent number of P100s. Due to the use of different runtimes (llama.cpp vs. MLX), these figures should be taken as indicative rather than independently verified.

Sources

Sign in / Sign up
ReadingResearchRadarInvestment framework
tomshardware.comTom's Hardware↗
Continue researching →