NVIDIA Releases Daviator: Eliminating GPU Bottlenecks in Small-System DFT via k-Point Batching and Mixed Precision
Training machine learning interatomic potentials requires tens of millions to hundreds of millions of density functional theory (DFT) calculations. NVIDIA explains why VASP runs slower on GPUs than CPUs for small systems—due to sequential k-point processing causing kernel launch overhead—and how it systematically addresses this issue through a batched Davidson solver and per-kernel precision analysis workflow.
Training next-generation machine learning interatomic potentials (MLIPs) requires tens to hundreds of millions of density functional theory (DFT) calculations as training data. Plane-wave DFT is the gold standard for generating this data, with VASP being its dominant implementation. However, an counter-intuitive phenomenon has long plagued researchers: running small-system DFT calculations on GPUs is actually slower than on CPUs. In a technical blog post released by NVIDIA in November 2026, the root cause of this bottleneck was explained, along with how its new library, Daviator, resolves it through two layers of mechanisms.
The core of the problem lies in the k-point processing mode. The electronic wavefunctions of periodic systems are parameterized by crystal momentum; small unit cells require hundreds to thousands of irreducible k-points to achieve convergence accuracy. Each k-point solve is independent within the Davidson eigensolver step, requiring no inter-k-point communication. However, VASP’s OpenACC GPU port processes k-points sequentially one by one. For large systems, the workload per k-point is sufficient to saturate the GPU; but for small systems paired with dense k-point grids, hundreds of small GPU dispatches per step cause kernel launch overhead to dominate computation time. The article provides a specific case: a single-atom iron system with 752 k-points ran 8 times slower on more expensive GPU hardware than on CPU.
Daviator’s solution replaces sequential loops with batch operations. Its core is a batched Davidson eigensolver that batches FFTs, matrix multiplications, and custom kernels, drastically reducing the number of GPU kernel launches and increasing stream multiprocessor occupancy from partial capacity to near saturation. Data remains resident in GPU memory throughout. VASP retains full control over self-consistent field (SCF) loops, mixing, symmetry, and I/O; Daviator intervenes only at well-defined call boundaries on data already located on the device.