NVIDIA DAQIRI: How NIC Hardware Reordering and Direct Polling Enable 500 Gbps Scientific Data to Enter GPUs During Acquisition
An NVIDIA technical blog post introduces three new capabilities of the DAQIRI data acquisition library: ConnectX-7 network interface card (NIC) hardware packet reordering, an ibverbs engine that increases small-packet throughput by approximately two times, and a direct polling mode achieving 2–4 microsecond send-to-receive latency. Using a high-dynamic-range electron microscopy camera from Lawrence Berkeley National Laboratory (producing a 500 Gbps data stream) as a case study, the article explains that data movement order, throughput, and latency are critical constraints for real-time AI processing of scientific instruments.
For real-time AI analysis of scientific instruments, the intuitive bottleneck is often perceived as insufficient GPU compute power. However, an NVIDIA technical blog published on November 19 states that what actually limits instrument design is frequently data movement: sensor-generated data must arrive at GPU memory in the correct order, at sufficient speed, and with sufficiently low latency to support immediate processing during acquisition. DAQIRI is a software-defined data acquisition library designed specifically for this constraint; it routes high-bandwidth instrument data directly into GPU-ready workflows, allowing developers to process measurement results during acquisition without first writing them to disk and reading them back.
The core case study in this article is a high-dynamic-range electron microscopy camera developed at the Molecular Foundry at Lawrence Berkeley National Laboratory. Traditional electron energy-loss spectroscopy (EELS) requires two separately optimized acquisition processes executed rapidly in succession to capture intensity differences between strong and weak signals—this demands precise coordination of electron optics, exposure timing, and detector readout, followed by alignment and merging after acquisition, which adds complexity to both experimentation and processing. The new camera captures strong and weak signals simultaneously in a single acquisition, but at the cost of data volume surging to over 500 Gbps, more than 500 times faster than traditional EELS data streams. If the data cannot be moved effectively, this hardware advantage becomes meaningless.