ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · 推理语用丢失研究1 min read·2026-10-16

Preprint: Increased Reasoning Compute Causes LLMs to Cancel Pragmatic Implicatures of 'Some' and 'Or'

A new study finds that allowing AI models to think longer leads them to interpret 'some' strictly logically (at least one), losing the human conversational implication of 'not all'.

ImportanceMaterialEvidenceE2 unreplicatedWrite-upQuick

2026-10-16 12:00 GMT+8

A newly released arXiv preprint indicates that increasing the thinking budget in large reasoning models leads to overly literal interpretations of everyday logical words. When a speaker says "some students passed," human listeners typically infer that not all did. However, the study found that as internal reasoning steps increase, most tested open-source reasoning models and GPT-5 cancel this "conversational implicature," adopting a strict logical definition where "some" means only "at least one," without implying "not all."

The research team conducted experiments by keeping model weights fixed and varying only the amount of thinking time, recording which interpretation the model chose. They observed that models initially entertain the enriched pragmatic reading but cancel it in later reasoning steps. In contrast, context-driven inferences like indirect answers improved with more thinking. The authors propose an exploratory remedy: answering from the early stage of reasoning before the implicature is cancelled can recover these meanings without sacrificing literal accuracy.

Sources

  • 原始出处arxiv.org↗
Sign in / Sign up
ReadingResearchRadarInvestment framework
Topic

推理语用丢失研究

最新预印本研究发现,当用户增加大语言模型的推理计算量(即让模型“思考”更久)时,模型倾向于将“有些”和“或者”等逻辑词理解为纯字面含义,从而丢失人类对话中隐含的“并非全部”或“并非两者”等语用信息。该研究指出,虽然更多思考能提升数学和代码准…

3 steps1 piecesUpdated 2026-10-16 18:39

How it got here

  1. 2026-10-15港科大等机构发布预印本《Entertain, then Cancel》,证实增加推理Token会导致GPT-5及多数开源模型取消“some”和“or”的语用含义。
  2. 2026-07-28Redis博客探讨Token预算感知推理,指出简单问题过度思考造成成本浪费,但未涉及语用含义丢失问题。
  3. 2026-05-01台大团队发表《The Coupling Tax》论文,揭示固定输出预算下,长思维链可能因截断而降低最终答案准确率,非思考模式在特定预算下表现更优。

What is still unsettled

  • 如何在保持推理模型高准确率的同时,强制其保留默认的语用隐含意义?
  • 不同架构的推理模型(如Qwen3 vs GPT-5)在语用丢失程度上的差异是否源于训练数据中的逻辑偏好?
  • 现有的评估基准是否普遍缺乏对“解释性准确性”而非仅“事实准确性”的测试?
Read the full topic →
Continue researching →