In his talk at the AI Engineer World's Fair 2026, Suchet Bargoti, Skydio's Director of Inspection and Mapping, began with a live demonstration rather than slides. From a laptop, he launched docked drones in San Mateo and Colorado, and had one autonomously track a car. This setup introduced his central thesis: scaling "drones as infrastructure" requires solving the operator attention bottleneck and distributing intelligence between edge devices and the cloud.
Bargoti argued that the traditional model of assigning a skilled pilot to each drone does not scale as alerts and tasks increase, creating cognitive load. Consequently, Skydio's autonomy stack keeps immediate safety actions, such as obstacle avoidance and basic tracking, on the drone's edge hardware. Heavier reasoning, long-term planning, and Vision-Language Model (VLM) analysis are offloaded to the cloud. This split relies on high-quality video transmission, requiring optimized encoding to ensure sufficient visual information reaches the server even under bandwidth constraints.
A key mechanism described is "maps as world models." Drones do not rely solely on local perception but integrate building, road, and power-line vector data into a global map for path planning. Crucially, this map is dynamic: when the fleet observes environmental changes, such as new construction sites, these observations feed back into a map synchronization process. The updated map is then shared across all drones, creating a data flywheel that allows the system to self-maintain as the environment changes.
Regarding object tracking, Bargoti explained how the system handles occlusion by maintaining an implicit representation of hidden objects and predicting their emergence to adjust movement. For complex semantic tasks, such as finding a "white Jeep," the system uses a VLM agent to access the drone API, command search trajectories, and invoke tracking tools upon detection. This approach avoids hard-coding rules for every scenario, allowing the agent to compose existing capabilities.
However, Bargoti delineated the boundaries of end-to-end learning. While feeding raw sensor data directly into action outputs is a long-term goal, physical systems demand extremely high reliability (he cited 99.9999%, though without defining the denominator). Currently, pure end-to-end systems struggle with fault diagnosis and establishing reliability guarantees. Therefore, Skydio's strategy involves using reinforcement learning or end-to-end methods in specific segments while retaining explicit world model representations and structured control where high reliability and interpretability are required.