LectureRechercheRadarCadre d'investissement
Connexion / Inscription
← Retour à la lecture
ActualitésSujet · Meta短视频审核智能体Prise rapide1 min de lectureRédaction DisconfirmAI

Meta Engineer Aditya Gautam Details Three-Agent Architecture for Short-Form Video Misalignment and Attribution

In an AI Engineer talk, Meta engineer Aditya Gautam presented a specialized system for short-form video moderation. He described a three-agent pipeline using small VLMs to address cross-modal temporal misalignment and originality attribution challenges.

2026-09-23 22:00 GMT+8

Meta engineer Aditya Gautam presented a talk on the AI Engineer channel detailing two core problems he works on at scale: cross-modal temporal misalignment within single videos (e.g., sports content shifting to political topics) and the difficulty of attributing originality amidst AI-generated content.

Gautam outlined a three-agent architecture to tackle these issues. The Perceiver splits videos at points of temporal change, emitting clip-level embeddings, tags, and OCR. The Reviewer analyzes this JSON output alongside live comments and sentiment. The Retriever indexes topics, embeddings, and entities into inverted, vector, and graph stores to pull similar clips and authors during inference.

Each agent runs on a small, specialized Vision-Language Model (VLM) rather than a frontier model. The team pretrained the vision encoder on internal images, instruction-tuned it to a JSON schema, and optimized it via a DPO loop using production samples. Evaluation metrics extended beyond precision and recall to include per-node latency, reasoning budgets, token cost, and judge drift.

Sources

  • youtube.com↗
Connexion / Inscription
LectureRechercheRadarCadre d'investissement
Sujet

Meta短视频审核智能体

Meta工程师Aditya Gautam披露了针对1亿+规模短视频的专用多智能体审核系统,旨在解决“模态错位”与“原创性归因”两大完整性危机。该系统摒弃通用大模型,转而采用由感知者(Perceiver)、检索者(Retriever)和审查者…

4 étapes1 piècesMis à jour 2026-10-15 11:37

Comment on en est arrivé là

  1. 2026-09-23Meta工程师Aditya Gautam在AI Engineer播客中首次公开介绍其短视频多智能体审核架构,阐述为何放弃单体大模型而选择特化小模型组合。finance.biggo.com ↗
  2. 2026-09-25Sean Weldon发布深度分析文章,详细拆解Meta系统中感知者、检索者与审查者的具体分工,以及空间时间压缩、缓存等成本控制杠杆。sean-weldon.com ↗
  3. 2026-10-15Meta官方频道发布Gautam的技术演讲视频,进一步展示从预训练到DPO优化的工程细节,确认该架构已在生产环境中运行。youtube.com ↗

Ce qui reste non résolu

  • Meta的多智能体系统在应对全新类型的对抗性攻击(如深度伪造导致的模态完全解耦)时,其检索与推理模块的延迟表现如何?
  • TikTok提出的自动策略生成方法是否会引发过度敏感或误杀正常创意内容的风险,其人工复核比例是多少?
  • 随着硬件成本变化,4-bit量化的小型VLM是否会在精度上遇到瓶颈,从而迫使平台重新引入更大规模的模型?
Lire le sujet complet →
Continuer la recherche →