Maum AI’s Son Byung-hee: Standardizing Robot Behavior Data Formats Is Essential for Cross-Robot Experience Sharing
Son Byung-hee, Head of Defense and Robotics at South Korean AI company Maum AI, argues that a key bottleneck in physical AI is the inability to aggregate data because different robots record it in incompatible ways. He proposes standardizing robot behavior data through an 'episode' structure—capturing tasks, observations, states, actions, and outcomes—to enable experience transfer between robots of different morphologies.
Large language models can learn from the text and images already available on the internet, but data regarding robots grasping objects, operating equipment, or avoiding obstacles is scarce online. Son Byung-hee, Head of Defense and Robotics at the South Korean AI company Maum AI, points out that robots must collect this data using their own bodies, and that collection is merely the first step.
Son Byung-hee believes that while bottlenecks exist at every stage of the physical AI learning loop, a critical hurdle lies in data aggregation: because different robots record data in disparate formats, information from various manufacturers is difficult to merge into a single training set. As Chairman of the Standards Council of the Korea Physical AI Association, he is collaborating with the Electronics and Telecommunications Research Institute (ETRI) to discuss standardization benchmarks for robot behavior data.
His solution centers on a core data structure called the 'episode.' An episode records the complete experience of a task from start to finish, comprising five elements: Task (what needs to be done), Observation (what was seen), State (the conditions of the robot and environment at that moment), Action (what operation was executed), and Outcome (whether it succeeded or failed, and at which stage). Son Byung-hee emphasizes that simply labeling success or failure is insufficient. He cites the example of a robot picking up a cup: whether it gripped it stably, succeeded by chance, or recovered after slipping mid-air carries vastly different implications for training. Therefore, episodes must link context, action, and outcome, enabling AI to learn causal relationships beyond mere action sequences.