LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
← Voltar para a leitura
TópicoEditorial DisconfirmAIAtualizado 2026-11-17 09:25

廖弘源模块化视觉理解

2 etapas1 peças2 Fontes

台湾中央研究院资讯科学研究所所长廖弘源指出,尽管大型视觉语言模型(VLM)已具备影像描述能力,但在判断人物行为意图与环境关系上仍存在缺口。为此,中研院提出“模块化视觉理解”路线,不重造通用大模型,而是开发Taiwan GBA行为分析与G-YOLO环境理解两种专用模块,旨在让AI从“描述世界”转向“理解世界”,以支持居家照护等边缘端应用。

【背景】廖弘源强调自主掌握模型模组的重要性,认为这是避免依赖外部大型模型的关键策略。目前Taiwan GBA可辨识跌倒、打架等12种行为,在实验室数据集中识别率达80%-90%,但真实场景部署仍面临数据差异挑战。

Como chegamos aqui

  1. 2026-11-12

    iThome报道,中研院资讯所所长廖弘源分享多模态AI研究成果,提出通过Taiwan GBA和G-YOLO补全VLM的行为与环境理解缺口。

    ithome.com.tw ↗
  2. 2024-11-01

    廖弘源团队发表综述文章《YOLOv1 to YOLOv10》,梳理实时目标检测系统演进,为G-YOLO的环境理解基础提供学术支撑。

    homepage.iis.sinica.edu.tw ↗

O que ainda está indefinido

  • Taiwan GBA在真实非模拟犯罪或居家场景中的实际误报率与漏报率如何?
  • G-YOLO加入深度估计后,对算力受限的边缘设备具体性能影响为何?
  • 中研院模块化方案与商业闭源大模型的API集成标准是否已确立?

Fontes

  • ithome.com.twiThome:中研院廖弘源谈模块化视觉理解↗
  • homepage.iis.sinica.edu.tw
Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento
中研院资讯所廖弘源个人主页出版物列表
↗

Cobertura neste tópico

  • Liao Hung-yuan, Director of the Institute of Information Science, Academia Sinica: Large Models Can Describe Images but Fail to Understand Human Actions; Modular Visual Understanding Is Needed to Bridge the Gap2026-11-12Notícias

    Liao Hung-yuan, Director of the Institute of Information Science at Taiwan's Academia Sinica, explains that while current large vision-language models can generate image descriptions, they cannot determine if a person has fallen or understand relationships between objects. Academia Sinica’s approach is not to rebuild a large general-purpose model, but to develop modular visual capabilities—Behavior Analysis (Taiwan GBA) and Environmental Understanding (G-YOLO)—that work in tandem with large language models on edge devices, enabling AI to move from describing the world to understanding it.