Higress Integrates Qwen3Guard for Zero-Code AI Safety Gateway

Alibaba Cloud's open-source cloud-native API gateway, Higress, has recently integrated the Tongyi Qianwen safety model Qwen3Guard-Gen as a Wasm plugin to provide AI content security capabilities. This solution allows enterprises to implement unified input and output safety moderation at the gateway layer without modifying application code or upstream model services.

In traditional AI application development, security policies are often scattered across individual application SDKs, making it difficult to manage risk thresholds and refusal logic centrally. Each model upgrade or policy adjustment requires redeploying applications. Higress places content extraction, safety calls, risk decisions, and streaming buffering logic within the data plane path, achieving decoupling and reuse of security capabilities.

The plugin defaults to calling the Qwen/Qwen3Guard-Gen-4B model and supports real-time moderation of non-streaming JSON responses and SSE streaming outputs. For streaming responses, the plugin uses a segmented buffering mechanism, triggering a moderation check every time a certain number of characters accumulate (default 1000 Unicode characters), balancing latency and security. If a risk is detected above the threshold, the gateway can directly return a refusal response, preventing the request from consuming backend inference resources.

Qwen3Guard is a family of safety moderation models launched by Alibaba's Tongyi Lab, trained on the Qwen3 architecture, covering risks such as violence, illegal acts, and privacy leaks. This integration emphasizes "self-hosting" features, allowing enterprises to independently deploy and scale safety models without relying on cloud-based content safety services, thereby better controlling data privacy and risk policies.