ReadingResearchRadarInvestment framework
Sign in / Sign up
AllTechnologyProductsInvestingPublic marketsOther

Reading

2026-11-2088 posts

Refresh

Weaviate Agent Experience Engineer Joon-Pil Hwang: Coding Agents Encounter Silent Failures Invisible to Humans When Reading Documentation

Material
2026-11-19 08:00 GMT+8

When coding agents read technical documentation on behalf of humans, a class of failures emerges that human readers never encounter. Joon-Pil Hwang, Lead Developer and Agent Experience Engineer at Weaviate, describes this problem: pages are truncated, code examples are missing for certain languages, and sections are lost—and the agent will not tell you about it. It quietly searches elsewhere or writes incorrect code based on incomplete context.

Hwang points out that the root cause of these issues lies in the fact that agents read web pages in a completely different way than humans using browsers. Fetch tools in different coding environments return different parts of a page and often do not notify the site that content is missing. More critically, even if an agent notices that information is incomplete, it is unlikely to report the problem to document maintainers—it simply works around it. This means documentation defects can persist unnoticed because the affected class of readers rarely provides feedback.

To discover what agents actually see, the Hwang team did not adopt traditional user interviews but instead directly observed agent behavior. They set up multiple agents to execute the same task in a repeatable manner, then examined their logs and outputs—not just the final answers, but the paths they took to reach those answers: which tools were used, which searches were run, and which pages were read.

This allowed them to identify specific failure modes. Before modifying the documentation, one fetch tool returned the correct language example in only 7 of 15 TypeScript runs and 3 of 15 Go runs. After the modification, every run returned the correct code snippet. They also found that an outdated sentence on a concepts page caused agents to use an older client library, even though the code examples were not on that page—after correcting it, every answer they checked used the current client.

Another finding was that when useful content is missing, agents attempt to bypass the issue by searching for raw source files or downloading the page and writing a parser. In one example, when the required code was hidden, the agent took 23 turns to find a solution; with the Markdown version of the page, it took only 6 turns. The team subsequently released Markdown versions of the documentation pages, reducing token usage for page loads by approximately 20%.

These tests also helped them detect regressions. A change that fixed hidden code tabs caused one fetch tool to return only part of the Quickstart while discarding the rest. Re-running the tests exposed the problem, which was resolved with a small layout adjustment.

From this, Hwang proposes a core judgment: agents should be treated as a distinct class of reader. The goal of developer experience has never been simply to make writing code faster, but to reduce friction between developers and value creation. When agents intervene between developers and products, good experience must serve both: for developers, it means helping them make sound architectural decisions, communicate intent to agents, and verify results; for agents, it means ensuring information is complete and discoverable, providing agent-appropriate tools, reducing ambiguity, and making correctness observable.

Sources:weaviate.io

Research

Germany's NRW State Announces First Central AI Search Portal Using Gemma 4, Costing €1.8M Annually

Material
2026-11-19 23:18 GMT+8

North Rhine-Westphalia (NRW) Digital Minister Ina Scharrenbach announced on November 19 that the state is launching a new central web portal, "Nordrhein-Westfalen-Portal," which uses artificial intelligence search to help citizens and businesses find government services more easily. According to reports from iX Magazin and WDR, this is the first central administrative portal in Germany to feature such natural language search capabilities.

The system was developed in collaboration with d-NRW, the state's IT service provider, agency flowconcept, and Deutsche Telekom. Its core function is a single search box allowing users to input requests in everyday language, such as "lost ID card" or "I want to start a company." The AI identifies the intent and retrieves relevant applications and services from over 600 whitelisted official pages, removing the need for users to understand complex administrative terminology.

Technically, the portal utilizes Gemma 4 26B A4B, an open-weight model developed by Alphabet subsidiary Google DeepMind. The model employs a Mixture-of-Experts (MoE) architecture with 25.2 billion parameters, activating only 3.8 billion per token for efficiency. It runs within Deutsche Telekom's LLM Hub in Munich to ensure data sovereignty and EU legal compliance. Scharrenbach emphasized that the technology is "sovereign" and not tied to a single vendor, allowing for future model switches if needed.

The project illustrates the specific cost structure of deploying AI in the public sector: initial software development costs were €1.5 million, AI technology development added €700,000, and annual operation and maintenance are estimated at €1.8 million, with roughly half allocated to AI infrastructure. Despite highlighting AI capabilities, the chatbot currently limits itself to providing context for search tasks rather than generating advice or answering detailed queries, and promises not to store personal data or search queries.

Sources:iX Magazin

Research

LoRA: Low-Rank Adaptation of Large Language Models

Verified 2026-11-20 00:01 GMT+8

Long-term reading · 《LoRA: Low-Rank Adaptation of Large Language Models》(2021)

In the field of natural language processing, adapting large pre-trained models to specific tasks typically relies on full fine-tuning. However, as model parameter scales reach hundreds of billions (e.g., GPT-3), storing and deploying independent fine-tuned copies for each downstream task becomes extremely costly and difficult to maintain. Microsoft Research proposed LoRA (Low-Rank Adaptation) to address this efficiency bottleneck.

The core assumption of LoRA is that weight changes during adaptation to new tasks exhibit an "intrinsic low-rank" property. This method freezes the original weights of the pre-trained model and injects trainable low-rank decomposition matrices at every layer of the Transformer architecture. By optimizing only these small incremental matrices rather than all parameters, LoRA significantly reduces the number of trainable parameters. Experiments show that compared to full fine-tuning of GPT-3 175B using Adam optimization, LoRA can reduce trainable parameters by a factor of 10,000, lower GPU memory requirements by threefold, while maintaining model quality on RoBERTa, DeBERTa, GPT-2, and GPT-3 equal to or better than full fine-tuning.

Compared to other parameter-efficient methods, LoRA avoids the inference latency introduced by adapters. Adapters insert modules by increasing network depth, which leads to significant computational overhead in online inference scenarios. In contrast, LoRA employs a simple linear design that allows trainable matrices to be merged with frozen weights during deployment, achieving efficient adaptation without increasing inference latency. Additionally, LoRA is orthogonal to many existing methods and can be combined with techniques such as prefix tuning.

For engineers and researchers seeking to customize large language models but constrained by computational resources, LoRA provides a practical solution balancing efficiency and performance. It is recommended to start with Section 4 of the paper regarding the description of low-rank parameterized update matrices to understand the mathematical principles, followed by referring to the code implementation in the appendix for practice. This work was published by Edward Hu et al. in 2021 under the title "LoRA: Low-Rank Adaptation of Large Language Models".

Sources:《LoRA: Low-Rank Adaptation of Large Language Models》(2021)

Research

Buffett's 2018 Letter to Shareholders: Why Investors Should Ignore Accounting Noise and Focus on Operating Earnings

Verified 2026-11-20 00:01 GMT+8

Long-term reading · 《Berkshire Hathaway Shareholder Letter 2018》(2018)

In the 2018 letter to shareholders, Warren Buffett, Chairman of Berkshire Hathaway Inc., presented his core views on how investors should evaluate corporate value: they should exclude short-term profit fluctuations driven by changes in accounting standards and concentrate on the company's true operational capabilities. This philosophy is critical for understanding long-term value investing.

First, Buffett noted that new Generally Accepted Accounting Principles (GAAP) require unrealized capital gains or losses on stock portfolios to be included in current earnings, resulting in "wild and erratic swings" in the "bottom line." He wrote in the letter: "We have always believed that mark-to-market changes in Berkshire produce what I call 'wild and erratic swings' in the 'bottom line.'" These fluctuations do not stem from deterioration or improvement in the underlying businesses but are immediate reflections of market sentiment on asset valuations. Therefore, he advised readers: "Focus on operating earnings; pay almost no attention to various types of gains and losses." This means that when evaluating a business, one should filter out market noise and assess whether its core operations generate stable and growing cash flow.

Second, based on this logic, Buffett announced the abandonment of "book value per share" as the primary metric for measuring the company's progress. He argued that this metric has lost relevance because Berkshire has transitioned from a company primarily holding tradable stocks to a conglomerate whose main value lies in operating enterprises. He explained in the letter: "In fact, the annual change in Berkshire’s book value—last appearing on page 2—is a measure that has lost the relevance it once had." As the company's structure evolved, book value could no longer accurately reflect the true intrinsic value of numerous non-listed subsidiaries, whereas operating earnings more directly demonstrate management's capital allocation efficiency.

Finally, Buffett attributed part of Berkshire’s success to "The American Tailwind." He emphasized that the prosperity of the U.S. economy was a result of bipartisan efforts; despite inflation, wars, and financial crises, productivity gains driven by savings and investment served as long-term drivers. He stated: "Remember how I described retained earnings as key to Berkshire’s prosperity earlier in this letter? The same applies to America." This reminder urges investors to consider whether the macro-institutional environment supporting their chosen high-quality companies fosters long-term wealth accumulation.

Consider a modern investor facing a tech giant whose stock price has plummeted due to fair value adjustments in quarterly earnings reports. Following the principles outlined in this letter, the investor would not panic-sell but would instead verify whether the company’s core revenue streams and user retention remain healthy. If the operating fundamentals are solid, temporary accounting losses are merely reflections of market volatility rather than destruction of value. This mindset helps investors navigate economic cycles without being distracted by noise.

Sources:《Berkshire Hathaway Shareholder Letter 2018》(2018)

Research

You’re all caught up in this view

Sign in / Sign up
ReadingResearchRadarInvestment framework

He cites Don Norman's concepts of the "gulf of execution" and "gulf of evaluation" to illustrate this: people need to understand how to act and whether their actions were effective. Agents change the interfaces and mechanisms involved, but these underlying needs remain unchanged. In practice, the Hwang team is applying these principles to Weaviate's tools and workflows—for example, when asked to update a Go service using the v5 client, some agents attempted to call the server's gRPC API directly rather than seeking the updated Go v6 client; they are also measuring agents' ability to build Weaviate applications from scratch, including using current features such as HFresh indexing, Rotational Quantization, and PathSeer filtering.

The core practices have not changed: find where people get stuck, improve the experience, and verify that the improvement is effective. What has changed is the set of users and tools that need to be measured. Developers now work through coding agents as well as IDEs and browsers, and agents rarely tell you when they cannot find or understand something. This makes measurement more important, not less. By testing how agents use documentation and tools before and after changes, we can simultaneously reduce friction for both developers and agents, helping developers derive more value from their work.

The "Berkshire Hathaway Shareholder Letter 2018," written by Warren Buffett and published in 2019, is suitable for investors seeking to deeply understand how to distinguish accounting profits from economic reality and how to assess a company’s long-term competitiveness from a macro perspective. It is recommended to begin with sections discussing GAAP rule changes and their impacts, then gradually expand to discussions on the evolution of valuation metrics.