読書

This recommendation is based on publisher episode information. In TWIML AI Podcast Episode 777, titled "From Voice Agents to AI Avatars," Alexander Smola, identified by the publisher as the co-founder and CEO of Boson AI, discusses the path from current voice agents to audiovisual agents and AI avatars. The episode description highlights that while voice AI has improved, natural conversation remains challenging due to delays, interruptions, and tone issues, which become more complex when adding visual presence.

The publisher lists specific technical subjects covered in the discussion, including the tradeoffs behind real-time voice such as audio tokenization, latency, model size, and inference cost. It also mentions exploring what changes when systems can both see and be seen, the role of emotional intelligence in AI, and how agents learn from human interactions. The description notes resources related to these topics, such as Higgs Realtime, ProactBench, and IHBench.

This resource is selected for readers interested in the engineering challenges of multimodal AI interfaces. The specific question to listen for is how Smola addresses the technical constraints of moving beyond impressive demos toward interactions that feel natural, particularly regarding the balance between latency, model size, and visual fidelity.

This recommendation is based on publisher episode information. On October 13, 2026, Google DeepMind published a video titled "Applying Gemini 4 for large-scale codebase maintenance in Chromium," detailing how Google engineer Erik Chen uses the Gemini 4 Argon model to manage the Chromium codebase. The codebase is millions of lines long and decades old, where touching one component can unexpectedly affect another.

According to the episode description, Erik Chen is using Gemini 4 Argon to 'untangle' the architecture. The model's coding capabilities allow multiple agents to work independently to refactor the codebase, with all changes verified by Chromium's test suites and engineer code reviews. This application highlights the potential role of AI in maintaining large legacy systems.

Meta announced on October 13 the introduction of "Your algorithm," a new AI-powered tool in Facebook's Feed and Reels that allows users to directly input their interests using natural language to fine-tune what they see.

Previously, Facebook relied primarily on implicit behavioral signals like likes and comments to infer user preferences. This new feature aims to address that indirectness by letting users explicitly state their intent.

According to Meta, the tool leverages large language models (LLMs) to understand context and intent from freeform text, enabling ranking systems to adapt in real-time within the same session.

The feature is currently rolling out gradually; specific coverage areas and actual response latency have not been independently verified through technical benchmarks.

Large unsupervised language models possess broad world knowledge but are difficult to precisely control in their behavior. Traditional methods such as Reinforcement Learning from Human Feedback (RLHF) align preferences by fitting a reward model and fine-tuning the policy using reinforcement learning, but this process is complex and unstable. This paper proposes Direct Preference Optimization (DPO), proving that this constrained reward maximization problem can be solved exactly through single-stage policy training, essentially reducing it to solving a classification problem on human preference data.

The core insight of DPO lies in leveraging the mapping relationship between the reward function and the optimal policy. It implicitly optimizes the same objective as existing RLHF algorithms (reward maximization with KL divergence constraints) but without explicitly fitting a reward model, sampling from the language model during the training loop, or requiring extensive hyperparameter tuning. This simplification makes the algorithm stable, high-performing, and computationally lightweight.

In terms of specific mechanisms, DPO relies on theoretical preference models such as Bradley-Terry to measure the fit between the reward function and empirical preference data. Unlike the traditional path of first training a reward model and then optimizing the policy, DPO defines the preference loss as a direct function of the policy via variable substitution. Given a dataset of human preferences for model responses, DPO directly optimizes the policy using a simple binary cross-entropy objective, avoiding explicit learning of the reward function or sampling from the policy during training.

Experiments show that DPO is at least as effective as existing PPO-based RLHF methods in sentiment adjustment, summarization, and dialogue tasks. Notably, fine-tuning with DPO exceeds the capability of RLHF in controlling generated sentiment and improves response quality in summarization and single-turn dialogues, while being significantly simpler to implement and train.

For current readers, understanding DPO helps grasp the evolution logic of large model alignment techniques: shifting from complex two-stage RL processes to more direct supervised preference learning. For example, if a team wishes to quickly iterate on the tone style of a chatbot, adopting DPO can eliminate the engineering burden of building a reward model and running an RL environment, allowing them to directly utilize paired preference data for efficient fine-tuning, thereby accelerating product deployment.

"Direct Preference Optimization: Your Language Model is Secretly a Reward Model" was published in 2023. It is suitable for engineers and researchers engaged in large model training, alignment research, and AI application development. It is recommended to start with the abstract and Section 1 Introduction, focusing on Section 4 regarding the derivation of the DPO algorithm, to deeply understand how it transforms RLHF into a classification problem.

In the "Berkshire Hathaway Shareholder Letter 1994," Warren Buffett redefined the core metrics of investing. He pointed out that while book value is easy to calculate, it has limited utility, whereas intrinsic value is the discounted value of cash that can be extracted from a business over its remaining life. Although difficult to quantify precisely, it is the only logical way to assess investment attractiveness. The case of Berkshire's early textile operations demonstrates that when assets have neither going-concern value nor liquidation value, book value severely overstates actual value.

To illustrate the divergence between historical inputs and future outputs, the letter analyzes the acquisition of Scott Fetzer in detail. Berkshire acquired the company for $315.2 million, at a time when its book value was only $172.6 million. This premium reflected a judgment that its intrinsic value was nearly twice its book value. Over time, although dividends prevented book value from growing in tandem, profitability increased significantly, making return on net worth exceptionally strong and proving the importance of focusing on cash flows rather than static accounting data.

Furthermore, Buffett reiterated the principle of ignoring political and economic forecasts. He listed major events of the past thirty years that no one could have predicted, such as the escalation of the Vietnam War, oil crises, and presidential resignations, noting that these macro shocks did not impair Graham's investment principles. On the contrary, fear is often the enemy of trend-followers but the friend of fundamentalists. The best buying opportunities often arise when concerns about certain macro events reach their peak.

For today's readers, understanding this mechanism helps distinguish between accounting metrics and a company's true economic value. For example, suppose a technology company possesses substantial intangible assets and R&D capabilities; its traditional balance sheet might show low book value, but if its future cash flows are strong, its intrinsic value may far exceed the book figures. Investors should focus on a company's ability to generate cash rather than merely staring at static accounting data, while avoiding letting short-term macro news interfere with long-term capital allocation decisions.

The "Berkshire Hathaway Shareholder Letter 1994" was written by Warren E. Buffett and published in 1994. It is suitable for investors who wish to deeply understand the core definitions of value investing, distinguish between accounting data and economic substance, and learn how to maintain composure amidst macro uncertainty. It is recommended to start with the section on "Book Value and Intrinsic Value," studying it alongside the specific case analysis of Scott Fetzer.