독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스주제 · 英伟达机器人训练流간단한 요점2 분 소요DisconfirmAI 편집부

NVIDIA Demonstrates a Phased Workflow for AI Agent Collaborative Training of Robots

The NVIDIA team used three AI agents—Hermes, Nemotron 3.5 Bolt, and Astra—to start from a single prompt and sequentially complete simulation environment planning, 3D asset creation, Isaac Sim environment assembly, Isaac Lab reinforcement learning training (with 4,096 parallel environments), and local policy validation, demonstrating the specific practices for structured handoff packages between multi-agents.

2026-10-23 22:58 GMT+8

Teaching a simulated robot to navigate an obstacle course requires multiple stages: environment planning, 3D asset modeling, physics simulation assembly, policy training, and validation. The NVIDIA team demonstrated how three AI agents divide labor to complete this pipeline.

The process begins with a natural language prompt. On an RTX Spark local development machine, Hermes and Nemotron 3.5 Bolt translate the prompt into a step-by-step project plan, including task definition, resource inventory, expected outputs, and instructions for each stage. Once the plan is complete, Hermes packages all outputs into a handoff package: the project plan, a summary and source links for robot documentation research, concept images, an asset inventory (including identifiers, visible feature descriptions, and crop reference images), and execution instructions for the next stage. Hermes then automatically delegates the work to Astra.

Upon receiving the handoff package, Astra begins creating 3D assets. It first uses cloud image editing to enhance low-resolution objects cropped from the concept image into clear references, then compares the enhanced images with the original crops to confirm consistency in silhouette, proportion, and color. Dimensions and hidden surfaces that cannot be determined from the images are recorded as modeling assumptions. Astra then directs FreeCAD to construct the base geometry, uses Blender to add details and materials, and finally exports USD assets.

로그인 / 회원가입
독서리서치레이더투자 프레임워크

The training phase is conducted in the cloud using Isaac Lab. This experiment starts with the Microduck example environment from Isaac Lab, performing additional training on a pre-trained walking policy for traversing ramps and obstacles. Using head-camera depth and robot state as observation inputs, it runs on an NVIDIA RTX PRO 6000 Blackwell Workstation GPU with 4,096 parallel environments. The trained policy returns to RTX Spark for local validation in Isaac Sim, checking obstacle detection, movement adjustment, and track completion.

The core reference value of this tutorial lies in the specific form of the handoff mechanism: Hermes does not simply pass a text description to Astra but packages a structured asset inventory (including occlusion records), research summaries, and execution instructions, enabling Astra to begin modeling directly without re-understanding the original prompt. However, this is a vendor demonstration by NVIDIA for its own product stack; the article provides no time or quality comparison with non-AI-assisted processes, nor does it discuss where agents might fail.

출처

  • developer.nvidia.comNVIDIA Technical Blog↗
주제

英伟达机器人训练流

英伟达(NVIDIA)于2026年10月下旬展示了基于多AI智能体协作的机器人训练新工作流,旨在解决通用机器人开发中工具链割裂的问题。该流程利用Hermes和Nemotron 3.5 Bolt进行任务规划,通过Astra生成3D资产,并在I…

3 단계2 건업데이트됨 2026-10-25 03:39

현재까지의 과정

  1. 2026-10-21英伟达CEO黄仁勋在GTC柏林大会上介绍Microduck机器人,并宣布Agile Robots推出基于Isaac GR00T和Jetson Thor的人形参考平台Agile ONE SN。neoteo.com ↗
  2. 2026-10-23英伟达发布技术博客,详细拆解了使用Hermes、Nemotron和Astra等AI智能体协作训练Microduck机器人的分阶段工作流,涵盖从提示词到仿真验证的全过程。developer.nvidia.com ↗
  3. 2026-10-24英伟达发布视频及技术文档,展示如何利用RTX Spark进行本地规划与验证,并结合Isaac Lab在云端完成大规模强化学习训练,最后通过Agile ONE SN部署至物理机器人。youtube.com ↗

아직 해결되지 않은 문제

  • Agile ONE SN在2027年初正式交付后,其实际集成时间与官方宣称的“从数周缩短至数天”是否相符?
  • 英伟达提出的Better Actuator Models和域随机化技术在复杂动态环境中的Sim-to-Real迁移成功率具体数据是多少?
  • 除了英伟达推荐的RTX Spark和DGX Station,第三方硬件能否无缝接入这套多智能体协作训练工作流?

이 스레드의 다른 내용

  • NVIDIA Demonstrates Phased Workflow for Training Robots with AI Agents2026-10-24
전체 주제 읽기 →
리서치 계속하기 →