독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스간단한 요점1 분 소요DisconfirmAI 편집부

ONNX SmolVLA: Latency Halved but Spatial Success Falls to 41%

SmolVLA on ONNX cuts p99 latency from 1181 ms to 601/532 ms, but LIBERO Spatial success drops from 70% to 41%, per a single-author self-report.

검증됨 2026-09-18 14:31 GMT+8

Deploying SmolVLA with ONNX Runtime on an RTX 2060 can cut p99 latency from 1181 ms to 601/532 ms, but in LIBERO simulation Spatial success drops from 70% to 41%, while Object stays at 89%.

Previously, anyone trying to cut this model's inference latency lacked latency-versus-success data for an ONNX deployment path, making it easy to misjudge capability retention after compression; an audit also found the INT8 export was actually an FP32 graph.

Single-author preprint self-report: evaluated in LIBERO simulation, Spatial success 70%→41%, Object stays at 89%, p99 latency 1181 ms→601/532 ms; the author says a language width of 24 restores it to 75% at roughly half the baseline latency, but width does not explain all of the difference.

The result is limited to an RTX 2060 and LIBERO simulation and has not yet been reproduced by others; the preprint was submitted on September 12 and updated on the 16th.

출처

  • arxiv.org↗
  • github.com↗
리서치 계속하기 →
로그인 / 회원가입
독서리서치레이더투자 프레임워크