ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial4 min readDisconfirmAI Editorial

How Slurm HRES Plugins Integrate Quantum Processors into Supercomputing Scheduling: Why Traditional Resource Models Fail to Adapt to QPUs

A NVIDIA Technical Blog post details how the Hierarchical Resources (HRES) plugin in Slurm 26.11 models quantum processing units (QPUs) as cluster-level schedulable resources, addressing structural flaws in existing scheduling models such as generic resource binding to single nodes and license-based schemes causing compute node idling. It also outlines the implementation paths for two community plugins, QRMI and QDMI.

2026-11-18 01:00 GMT+8

Quantum processors are being installed in supercomputing centers worldwide, running alongside high-performance computing systems. For scientists in fields such as chemistry, weather modeling, and engineering simulation, the QPU is simply another accelerator—like CPUs and GPUs—that they wish to request, reserve, and execute using familiar methods. However, prior to Slurm 26.11, the scheduler lacked a native way to model QPUs as schedulable resources. Integration solutions at each site were repeatedly customized, users faced different interfaces depending on the site, administrators struggled to maintain proprietary code that was difficult to upgrade, and QPU vendors had to rebuild integrations for every customer.

The root of the problem lies in the structural mismatch between the physical attributes of QPUs and Slurm's existing resource models. QPUs are typically cluster-wide accelerators and do not belong to any single compute node. Slurm's Generic Resource (GRES) mechanism, used for GPUs, binds devices to specific nodes—if that node fails, the QPU becomes unreachable until an administrator reconfigures the cluster. Another common approach combines licenses with SPANK plugins: while licenses represent cluster-wide resources, SPANK only intervenes after a node has been allocated, meaning a job can hold compute nodes idle while waiting for the QPU. Furthermore, multiple SPANK plugins for different QPUs compete for the same command-line options, and many rely on Slurm's internal APIs, creating a risk of breakage with every upgrade. Crucially, Slurm itself cannot detect whether a QPU is undergoing calibration or is offline, leading it to launch jobs that cannot utilize the device.

Sign in / Sign up
ReadingResearchRadarInvestment framework

The Hierarchical Resources (HRES) plugin interface introduced in Slurm 26.11 addresses these gaps. HRES was added to Slurm 25.05 as a test feature and represents an evolution of licenses. Like a license, an HRES is a count of a cluster-level resource that does not belong to any single node; unlike a license, this count is associated with a specific set of nodes—the ones permitted to use the resource. Sites describe the QPU as a cluster-level HRES in resources.yaml, specify which nodes can access the device, and point to a short Lua script for the resource logic. This division of labor, with resources.yaml holding site-specific endpoints and policies and the Lua plugin handling device logic, allows the plugin to be written once and reused across sites.

The core capabilities of the plugin manifest during key callbacks in the job lifecycle. The maintenance callback queries middleware for QPU status at set intervals, setting or clearing disable_layer flags to stop or resume allocation. The controller job prerun callback performs admission checks after a job is scheduled but before nodes are allocated, ensuring that jobs do not hold idle nodes while waiting for the QPU. Because the prerun holds the controller's job lock, time-consuming reservation operations are placed in an optional asynchronous prerun, with the payload sent by Slurm to the job nodes. If a job fails to start, a revoke callback cancels the reservation, and a controller epilog callback releases the resources upon job completion.

At the architectural boundary, neither Slurm nor the Lua plugin communicates directly with the QPU. Third-party access middleware sits between the HPC system and the QPU, providing a unified interface to various quantum hardware APIs. Slurm treats the QPU as a single schedulable unit, deciding its availability, holder, duration, and source nodes; calibration, error correction, and device control remain within the QPU's own software runtime. This design applies to both current Noisy Intermediate-Scale Quantum (NISQ) devices and future fault-tolerant systems.

Two open-source implementations already exist within the community. The QRMI plugin reserves QPU access using the user's own credentials before the job runs, completing this process in a separate thread outside the scheduler's critical path, and releases it after the job ends; existing applications run without modification. The QDMI plugin, conversely, does not reserve the device but only admits the job; each job submits its work via QDMI, where the provider's queue schedules it on the device. From the user's perspective, both integrations present a consistent interface: job scripts request the QPU via SBATCH --resources, and Slurm keeps the job pending until the plugin reports the device is available.

Notable limitations include the fact that the article is published by the NVIDIA Technical Blog, constituting vendor-explanatory material regarding its own product features. The performance improvements cited (such as eliminating idle nodes) are logical deductions based on architectural design and lack actual pre- and post-deployment comparative data. Furthermore, Slurm 26.11 itself remains in an early adoption phase, and the reliability of community plugins in production environments awaits verification.

Sources

  • developer.nvidia.comNVIDIA Technical Blog↗
Continue researching →