ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

NVIDIA DAQIRI: How NIC Hardware Reordering and Direct Polling Enable 500 Gbps Scientific Data to Enter GPUs During Acquisition

An NVIDIA technical blog post introduces three new capabilities of the DAQIRI data acquisition library: ConnectX-7 network interface card (NIC) hardware packet reordering, an ibverbs engine that increases small-packet throughput by approximately two times, and a direct polling mode achieving 2–4 microsecond send-to-receive latency. Using a high-dynamic-range electron microscopy camera from Lawrence Berkeley National Laboratory (producing a 500 Gbps data stream) as a case study, the article explains that data movement order, throughput, and latency are critical constraints for real-time AI processing of scientific instruments.

2026-11-20 01:00 GMT+8

For real-time AI analysis of scientific instruments, the intuitive bottleneck is often perceived as insufficient GPU compute power. However, an NVIDIA technical blog published on November 19 states that what actually limits instrument design is frequently data movement: sensor-generated data must arrive at GPU memory in the correct order, at sufficient speed, and with sufficiently low latency to support immediate processing during acquisition. DAQIRI is a software-defined data acquisition library designed specifically for this constraint; it routes high-bandwidth instrument data directly into GPU-ready workflows, allowing developers to process measurement results during acquisition without first writing them to disk and reading them back.

The core case study in this article is a high-dynamic-range electron microscopy camera developed at the Molecular Foundry at Lawrence Berkeley National Laboratory. Traditional electron energy-loss spectroscopy (EELS) requires two separately optimized acquisition processes executed rapidly in succession to capture intensity differences between strong and weak signals—this demands precise coordination of electron optics, exposure timing, and detector readout, followed by alignment and merging after acquisition, which adds complexity to both experimentation and processing. The new camera captures strong and weak signals simultaneously in a single acquisition, but at the cost of data volume surging to over 500 Gbps, more than 500 times faster than traditional EELS data streams. If the data cannot be moved effectively, this hardware advantage becomes meaningless.

Sign in / Sign up
ReadingResearchRadarInvestment framework

NVIDIA’s solution is divided into three layers, each addressing a specific data movement problem. The first layer is order: in network transmission, packets may arrive out of sequence. Traditional approaches rely on protocol processing or receive-side buffering to reorder them, which adds latency and memory overhead. DAQIRI can now offload reordering tasks to ConnectX-7 or newer NIC hardware; the NIC parses sequence fields directly and places each payload into its correct position in memory, so the application receives already-ordered data without requiring additional software-based reorder copy steps.

The second layer is throughput: DAQIRI has introduced an ibverbs engine based on libibverbs and NVIDIA DevX for high-speed sending and receiving of raw Ethernet packets. NVIDIA claims that under conditions of small packets (under 1024 bytes) and extremely high speeds (greater than 200 Gbps), the ibverbs engine delivers per-core throughput approximately twice that of the previous default DPDK backend. This figure comes from vendor benchmark tests conducted on DGX Spark, IGX Thor, and RTX PRO platforms and represents self-reported results.

The third layer is latency: intelligent instruments may require feedback from GPU analysis to adjust acquisition parameters or control settings, making communication latency sensitive. DAQIRI’s direct polling mode allows application threads to send and receive packets directly, eliminating the handoff step to independent I/O worker threads. NVIDIA reported application-layer send-to-receive latencies of 2–4 microseconds in wired loopback benchmark tests. Developers can enable direct polling for latency-sensitive control queues while retaining batched processing modes for high-throughput data streams.

Through this pipeline, the Lawrence Berkeley National Laboratory team achieved data inspection, parameter adjustment, and region-of-interest selection during acquisition while 500 Gbps of data flowed continuously. GPU processing also improved spatial information recovery—achieving submicron spatial resolution from sensor pixels measuring 5 micrometers wide.

It should be noted that all these performance figures are self-reported benchmark results from NVIDIA, with no independent third-party reproduction. The case involves only one specific camera and one laboratory environment. The architecture relies on ConnectX-7-class NICs and GPU platforms, meaning not all scientific instruments possess these hardware conditions. Nevertheless, the constraint decomposition it reveals—where order, throughput, and latency each require different engineering approaches—offers reference value for any real-time processing pipeline moving high-bandwidth sensor data to GPUs.

Sources

  • developer.nvidia.comNVIDIA Technical Blog↗
Continue researching →