Cloud Provider Nebius Claims Internal RL Auto-Tuner Achieves Up to 4.93x Training Speedup on Nvidia B300s
Nebius published a blog post stating its internal reinforcement learning auto-tuning system sped up training steps by 1.42 to 4.93 times (median ~3.5x) across four models and two workloads on fixed GPU budgets. The results are vendor-reported and have not been independently verified.
AI infrastructure company Nebius released a technical blog post on November 12, 2026, detailing an internally developed reinforcement learning (RL) auto-tuning system. According to the company, the system was tested on NVIDIA B300 Tensor Core GPUs across four models and two workloads, achieving training step speedups of 1.42 to 4.93 times on fixed GPU budgets, with a median speedup of approximately 3.5 times.
The tests covered dense and mixture-of-experts models including Qwen3.8-27B, Qwen3.6-35B-A3B, GLM-5.3-Flash, and DeepSeek-V4.1-Flash, running on math reasoning (DAPO) and agentic coding (SWE-bench Verified) workloads. The highest gain, nearly 5x, was observed for GLM-5.3-Flash on coding tasks. Nebius noted that DeepSeek-V4.1-Flash coding jobs ran faster on 40 GPUs than an early setup did on 56, reducing GPU-seconds per step by 38%.
The auto-tuning system works by profiling each job to identify bottlenecks, forecasting promising changes, and testing them in real runs. Nebius reported that its prediction subagent had a median step-time error of 5.7% in retrospective evaluation. All optimal configurations remained within the job's trainer-rollout gap limits, accompanied by numerical checks and reward comparisons to ensure training quality was preserved.
It is important to note that these figures are self-reported by Nebius under specific hardware conditions and model combinations, with no third-party independent replication or public benchmark code currently available. For developers relying on large-scale RL post-training, this efficiency gain could significantly reduce computational costs and time if reproducible in other environments.