Lectura

Anthropic launched the "Cyber Mission" program on October 8, featuring a new tool called OSS Scanner that uses its most capable models to regularly scan open-source projects for vulnerabilities.

The tool aims to address resource shortages among open-source maintainers, particularly small volunteer teams supporting critical infrastructure. It automatically flags vulnerabilities, explains them, and suggests patches. However, Anthropic acknowledges that these reports are shipped without human review and may contain errors.

The company states an expected accuracy above 90 percent. This figure is based on internal testing and has not been independently verified. Eligible open-source projects can opt in via GitHub.

Nikon disqualified Dr. Ning Xu's winning microscopic video for using generative AI in post-processing.

Xu admitted on LinkedIn to using an unsupervised neural network to visualize features in super-resolution optical images. The video originally depicted cilia moving in a child's airway.

Nguyen Nam Nhat's video now holds first place. Nikon stated it will revisit rules and evaluation procedures for future competitions, noting the decision does not judge the entrant's professional reputation or scientific contributions.

The 2017 paper "Attention Is All You Need" poses an architectural question: When processing a sentence, can attention primarily associate different positions, replacing the way recurrent networks pass information step-by-step from the input end? The paper proposes the Transformer and compares translation quality and training efficiency on two machine translation tasks. This introduction is based on excerpts actually read from the publicly available paper.

The first concept is aggregating information by relevance. Attention constructs a query for the current position, compares it with keys at other positions, and then aggregates their values according to the resulting weights. Keys and values are vector representations within the model, not manually filled semantic labels; this weighted process allows a position to directly utilize information from other positions, rather than relying solely on the state passed from the previous position.

The second concept is multi-head attention. The model does not compute only one set of associations but computes multiple sets in parallel across different representation subspaces, then combines the results. This allows simultaneous attention to information at different positions and aspects; however, it does not guarantee that each head corresponds to a fixed linguistic rule, nor should the division of labor shown in diagrams be taken as the inevitable division of labor learned by the model.

For example, suppose a sentence contains "After the company acquired the factory, it expanded its production capacity." A reader needs to link "it" with the preceding object and also pay attention to relationships such as "acquired" and "expanded." This scenario is merely intended to help understand why multiple sets of associations are useful; it is not a specific test case reported in the paper, nor does it prove that the model will necessarily understand this sentence correctly.

Parallel training also has clear boundaries. The decoder in the paper still generates outputs token by token, masking positions that have not yet been generated, so predictions can only rely on outputs already known. Therefore, "not using recurrent networks" does not mean "all text can be generated simultaneously at once." When reading descriptions of today's AI models, distinguishing between parallel computation during training and the actual generation order is more useful than simply remembering an architecture name.

Recommended reading: Vaswani et al.'s "Attention Is All You Need" (2017). To understand why the Transformer became an important sequence modeling method, you can start by reading Section 3.2 on attention and multi-head attention, then compare it with the encoder and decoder structures in Section 3.1; the focus is on how information is connected and the boundaries of parallel computation.

In his 1997 shareholder letter, Warren Buffett did not rest on the laurels of that year's 34.1% increase in book value. He explicitly pointed out that high returns during bull markets often stem from overall market appreciation rather than managerial excellence. Using the metaphor of "show-off ducks" boasting about their swimming skills after a rainstorm, he emphasized the need to rationally distinguish between luck and skill, avoiding the mistake of attributing market beta returns to alpha.

Facing the then-high market prices, Buffett introduced "Ted Williams-style discipline." In The Science of Hitting, Williams divided the strike zone into 77 squares, maintaining a high batting average only by swinging at pitches in the best zones. Similarly, when business and stock prices are at the "edges of the strike zone," indiscriminate action locks in low returns. This strategy requires managers to possess extreme patience, feeling no anxiety even if they do not swing for long periods, because bad trades are more destructive than holding cash.

For future net savers, Buffett proposed a counterintuitive view: one should welcome stock market declines. Using hamburgers as an example, he noted that non-producers want beef prices to be low. Likewise, if shareholders plan to continue buying or retaining shares over many years, falling stock prices mean accumulating more equity at a lower cost. Only those about to sell cheer for rising prices; true long-term owners benefit from low prices.

Consider a young investor planning to invest monthly in index funds for the next ten years. If the market remains depressed, each contribution buys more units, and the compounding effect will be significantly amplified when the market recovers. Conversely, frequent trading at highs in an attempt to time the market not only increases friction costs but may also miss out on accumulating assets at low levels. This logic applies to any asset holder with long-term cash flow expectations.

The Berkshire Hathaway Shareholder Letter 1997 was published by Warren Buffett in February 1998. It is suitable for investors who feel anxious amidst market volatility and struggle to adhere to long-termism. It is recommended to start with the sections on "Thinking About Market Volatility" and "Capital Allocation Discipline" to understand how to maintain restraint in high-price environments and courage in low-price environments.