Reading

In the field of computer vision, although Convolutional Neural Networks (CNNs) have achieved great success, their computational costs are high. As pointed out in the paper "Recurrent Models of Visual Attention," applying CNNs to large images causes the computation to grow linearly with the number of pixels, resulting in extremely long training and testing times. To address this issue, researchers at Google DeepMind, inspired by human visual perception, proposed a new recurrent neural network model.

When humans observe a scene, they do not process the entire image at once; instead, they selectively focus attention on specific parts of the visual space, gradually accumulating information to build an internal representation. This mechanism not only saves "bandwidth" but also reduces task complexity by ignoring irrelevant backgrounds (i.e., "clutter"). The core contribution of this paper is modeling visual attention as a sequential decision-making process. The model, known as the Recurrent Attention Model (RAM), interacts with the environment like an agent. At each step, it extracts local high-resolution information through a bandwidth-limited sensor (Glimpse Sensor) and determines the next fixation point based on previous gaze positions.

Since the process of selecting fixation points is non-differentiable, the research team employed reinforcement learning for end-to-end training. Specifically, backpropagation was used to train the neural network components, while Policy Gradient methods were utilized to solve the non-differentiability issues in control problems. Experiments showed that this model significantly outperformed CNN baselines on cluttered image classification tasks and could dynamically track objects without explicit supervision signals. This method demonstrates the potential of attention-based models in handling complex backgrounds and scaling to large input images.

For researchers and engineers interested in understanding how to introduce reinforcement learning into visual systems or explore efficient image processing architectures, "Recurrent Models of Visual Attention" is an important classic literature. It clearly shows how simulating biological visual mechanisms can optimize the efficiency and robustness of deep learning models. It is recommended to start reading from the abstract and Section 3, "Recurrent Attention Model (RAM)," focusing on its architecture design and training process. Published in 2014, this paper remains a cornerstone for understanding the combination of attention mechanisms and reinforcement learning today.

In the 1995 letter to shareholders, Warren Buffett detailed Berkshire Hathaway's unique capital allocation philosophy. This letter not only recorded the year's financial performance but, more importantly, revealed how the company built its business empire through a "dual-track" strategy.

First, Buffett introduced a key concept: the double-barrelled approach. He stated that Charlie Munger and he aimed to build a collection of companies with excellent economic characteristics and outstanding management. Their preference was to acquire 100% ownership through negotiation at a fair price. However, they were equally satisfied when the stock market offered the opportunity to buy small stakes in outstanding businesses at prices below what would be required for full acquisition. This method of negotiating to buy entire businesses or buying partial interests via the stock market gave Berkshire an important advantage over capital allocators who stick to only one path. The core of this strategy lies in flexibility, allowing investors to capture the best value under different market conditions, whether through controlling stakes or minority investments.

Second, the letter emphasized the discipline of comparing acquisitions with passive investments. Buffett noted that when considering any action, they mentally compared it with dozens of other opportunities, including buying tiny shares of the world's best businesses through the stock market. This practice of contrasting acquisitions with passive investment is a discipline rarely used by managers focused solely on simple expansion. He cited Peter Drucker's view that transactions are often more attractive than work, but this can lead to meaningless deals. Therefore, one of Berkshire's advantages is having no fixed strategic plan, thereby avoiding paying foolish prices just to follow a predetermined direction. This strict comparison based on opportunity cost ensures that every capital expenditure undergoes the most rigorous value test.

For modern readers, understanding this mechanism helps reflect on the "anchoring effect" in personal portfolios or corporate decisions. Suppose an investor faces two choices: directly buying all shares of a startup and participating in operations, or buying stock in a listed industry leader. Without the discipline of weighing both options against each other in terms of opportunity cost, as Berkshire does, an investor might ignore the potentially higher risk-adjusted returns of the latter due to a pursuit of "control" or the "excitement of the deal." This mental framework reminds us that investment decisions should not be driven solely by emotion but by a rational assessment of alternatives.

The Berkshire Hathaway 1995 Shareholder Letter, written by Warren Buffett, was published on March 1, 1996 (reviewing fiscal year 1995). It is suitable for investors seeking to deeply understand long-term value investment strategies, capital allocation logic, and how to make rational choices between controlling and non-controlling stakes. It is recommended to start reading from the "Acquisitions" section of the letter, focusing on paragraphs regarding the dual-track strategy and opportunity cost comparisons.