독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스간단한 요점1 분 소요DisconfirmAI 편집부

Iterate Launches Lifeboat Engine

Vendor claims new engine doubles agent concurrency per GPU with confidential computing.

2026-10-05 21:00 GMT+8

Iterate.ai launched Lifeboat, an inference engine claiming to support 2,048 concurrent AI agent sessions on a single Nvidia RTX PRO 6000 GPU.

The engine boosts effective capacity by two to six times through key-value cache optimization and fair scheduling. It addresses memory overflow in long-context tasks by loading only necessary experts from mixture-of-experts models while keeping weights at full precision.

Each session runs in an isolated security capsule with hardware attestation for confidential computing. A free developer license is available, with the top-tier Confidential Computing edition priced at $499.99 per month.

출처

  • siliconangle.com↗
리서치 계속하기 →
로그인 / 회원가입
독서리서치레이더투자 프레임워크