LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
TudoTecnologiaProdutosInvestimentoBolsaOutros

Leitura

2026-11-0813 posts

Atualizar

Investigation: Two Chinese firms cleared to buy Nvidia H200 chips have empty offices and ties to sanctioned military suppliers

Material
2026-11-08 21:00 GMT+8

According to Tom's Hardware, an investigation by The New York Times found that two Chinese companies—New Matrix and Maginfra—that received approval from the U.S. Department of Commerce to purchase Nvidia H200 artificial intelligence chips had addresses leading to empty offices, with building receptionists unfamiliar with the firms.

The report states that New Matrix was founded by Li Bin, who along with two other primary owners is connected to Wise Road, a Chinese private equity firm sanctioned by the U.S. for helping Beijing acquire sensitive chip technologies. Furthermore, Li chairs Tsinghua Unigroup, a tech conglomerate partly owned by the Chinese government, and owns New H3C Semiconductor Technologies, which has also been added to the Commerce Department’s Entity List for cooperating with the Chinese military.

Maginfra is suspected of being linked to Inspur, which Washington blacklisted in 2023 for supporting the People’s Liberation Army, with both companies sharing personnel, patents, and a similar government ownership structure. These two firms are not listed as the final users of Nvidia’s AI chips; instead, they are supposed to assemble them into AI servers, which would then be forwarded to a final user, although their customers remain unclear.

These findings have heightened concerns that the U.S. Department of Commerce may be rubber-stamping GPU export license applications without scrutinizing each one for potential links to Beijing. Liza Tobin, former China director for the White House National Security Council, stated: “I have a ton of concerns that neither the Commerce Department or Nvidia is doing the due diligence needed to ensure that the licensing terms are being followed.”

Beyond these questionable non-entities, another company that received a license to purchase H200 GPUs has suspicious links. Executives at Zhejiang Yindun Cloud Technology are reportedly related to the founder of Range Intelligent Computing Technology Group, a data center operator that has sold compute capacity to Chinese military contractors. It is also reportedly partly operating out of a Range data center.

Fontes:Tom's Hardware

Pesquisa

Homelabber Runs 2.8-Trillion-Parameter Kimi K3 on CPU Using Intel Optane, Warns of Heat Risks

Visão rápida
2026-11-08 20:20 GMT+8

According to Tom's Hardware, a Reddit user in the r/homelab community demonstrated an experimental build running Moonshot AI's 2.8-trillion-parameter Kimi K3 model entirely on a CPU. The system utilizes a 40-core 3rd-generation Xeon Scalable processor paired with discontinued second-generation Intel Optane Persistent Memory 200 (PMem 200) modules. This configuration aims to bypass skyrocketing DRAM prices by leveraging cheaper secondhand Optane memory to reach the minimum 610GB capacity required for such large models.

However, the build faces significant thermal challenges. Optane DIMMs generate extreme heat during sustained inference, with individual modules consuming 12W to 15W. Without adequate cooling, this heat can endanger neighboring DDR4 server memory, potentially causing it to overheat or "burn out." To mitigate this, the builder installed dual 12W blower fans directed at the memory modules, advising others to treat active DIMM cooling as mandatory.

Performance remains sluggish, achieving only 0.85 tokens per second even with 1-bit quantization. This is significantly slower than previous builds using first-generation Optane combined with GPUs, which reached approximately 4 tokens per second. While too slow for real-time interaction, the setup may still serve overnight batch processing tasks. The current results are pre-tuning, and the developer plans to add GPU acceleration and optimize memory tiering in future iterations.

Fontes:Tom's Hardware

Pesquisa

Korea Electronics Association: AI Vision Inspection Replaces Manual Checks, But Industry Adoption Remains at 11.7%

Material
2026-11-08 13:00 GMT+8

The Korea Electronics Association (KEA) released its 'AI Utilization and Job Changes in the Electronics Industry Field' report on November 8, 2026, detailing specific applications of artificial intelligence in South Korea's electronics manufacturing sector and their impact on workflows. While AI demonstrates significant potential in enhancing production efficiency and shortening development cycles, overall industry adoption remains in the early stages.

The report highlights that a domestic manufacturer supplying refrigerator doors to major home appliance companies (referred to as Company A) implemented an AI vision inspection system. This system captures images of the four corners of refrigerator doors via cameras and uses AI to determine defects, replacing two previous manual visual inspectors who were reassigned to other processes. The role of quality management personnel also shifted from direct product inspection to verifying AI judgments and handling exceptions. However, the implementation revealed new challenges: whenever product models or specifications changed, camera positions and inspection criteria had to be adjusted, and additional training data was required. Ensuring data accuracy between the AI system and existing production management systems also became critical.

In the R&D phase, another home appliance control device developer (Company B) used AI to assist in circuit design and component selection, reducing the product development cycle from approximately three months to three weeks to one month. Additionally, an electronic device development and manufacturing company (Company C) automated code writing and review using AI, lowering the proportion of manually written code by developers to less than 10%. These cases indicate that AI is changing the nature of repetitive work, increasing the demand for advanced skills such as condition setting, verification, and exception handling.

Despite these success stories, KEA's survey found that only 11.7% of Korean electronics companies currently use AI, while 67.9% have no plans for AI adoption. KEA emphasized that spreading the productivity gains brought by AI across the entire industry requires addressing issues such as enterprise data acquisition, integration with existing systems, and building educational frameworks to support workforce transition.

Fontes:미래를 보는 창 - 전자신문

Pesquisa

Richard Borcherds, Mathematics Professor at the University of California, Berkeley: AI Renders Homework Grading Meaningless

Tópico · 伯克利AI批改争议Material
2026-11-08 17:35 GMT+8

Richard Borcherds, a mathematics professor at the University of California, Berkeley, recently stated publicly that he no longer grades his students' homework. His reasoning is straightforward: students widely use AI to complete assignments, and AI capabilities are continuing to improve rapidly, making it impossible to assess students' true mathematical proficiency by checking the correctness of these submissions. He admitted that he currently only verifies whether assignments have been submitted in full, acknowledging that this is not an ideal system but noting there is no alternative available at present.

Borcherds's assessment is based on a specific observation: he has noticed that many students have long relied on AI to complete their homework and consistently achieve top grades. Meanwhile, OpenAI recently announced that its AI models had solved a series of mathematical problems, including the existence and smoothness problem for Navier-Stokes equations. From this, Borcherds concluded that if AI continues to advance at its current pace, there will soon be nothing human mathematicians can do that AI cannot do better.

This assessment also touches on more practical institutional realities. The University of California, Berkeley previously tested AI detection tools such as Turnitin and Rumi, ultimately determining they were unsuitable for standardized use. A case from an Australian university further illustrates the issue: that institution's AI detector flagged nearly 6,000 suspected cases of misconduct in 2024, 90% of which were later confirmed to be false positives. This means that attempting to distinguish between human-written and AI-generated work through technological means is currently unfeasible.

Borcherds's stance thus extends to a more fundamental question: whether young people should still be encouraged to pursue mathematics as a major. He recalled that at the beginning of the AI boom five years ago, mathematics was considered one of the safest career choices. Now, even he is unsure how to advise. He even posed this question to ChatGPT, which replied that it, too, did not know what the future held.

It should be noted that Borcherds's claim that AI will surpass human mathematicians within a few years is a prediction, not an established fact. The specific scope and verification status of OpenAI's claimed solution to the Navier-Stokes problem have not yet received independent confirmation. Furthermore, the value of mathematics as a discipline—including understanding structure, the aesthetics of proof, and cross-domain modeling capabilities—is not entirely equivalent to problem-solving speed. Borcherds's position is closer to an honest acknowledgment of the current failure of assessment systems rather than a final verdict on the future of the field of mathematics.

Fontes:t3n.de

Pesquisa

Geek Park's Zhang Peng: Personal Agents Are Not Exclusive to Tech Giants; Value Can Grow Beyond Foundation Models

Material
2026-11-08 10:40 GMT+8

Zhang Peng, an author at Geek Park, published a long-form article on November 8, 2026, with the core argument that opportunities for Personal Agents do not belong exclusively to large tech companies; entrepreneurs still have a slim chance because a product's ultimate value can be built outside of foundation models.

He first outlines the current consensus—that after several rounds of discussion, the prevailing view seems to be that Personal Agent opportunities are reserved for big tech, leaving little room for startups. He then poses a key counter-question: Is Personal Agent really just an issue of being an "entry point"?

Zhang Peng uses a metaphor to explain why this is exciting: general-purpose large models are like nutrient-rich "eggs," and most AI applications essentially fail to break free from this "eggshell." Whether it was early "wrapper" apps or later Environment Engineering and Harness Engineering aimed at enabling models to use tools and execute longer tasks, a product's intelligence, responsiveness, and behavioral boundaries are largely determined by the underlying model. If a product can only "absorb nutrients" from the foundation model without breaking out to grow independently, it risks becoming a "token distributor" for model vendors—when models upgrade, competitors catch up; when prices rise, costs spiral; when models iterate, the product may be swallowed by the foundation model's capabilities.

Personal Agents offer a possibility of "breaking the shell." Zhang Peng believes a product's ultimate value depends more on factors outside large models: high-density personal context, deep modeling of user understanding, and trust relationships accumulated through long-term value delivery. This is akin to building one's own "core supply chain," where the focus is not on owning every link initially, but on gradually mastering key capabilities that determine delivery quality and service costs.

However, he does not shy away from realistic difficulties. Zhang Peng mentions two entrepreneurs who previously attempted to explore Personal Agents, both reaching the same conclusion: constrained by financing capabilities, they could not sustain operations using standard ARR (Annual Recurring Revenue) growth tactics. One equipped each user with a cloud virtual environment but found that the monthly revenue per user covered only a quarter of the underlying compute, token, and cloud resource costs. The other discovered that the digital and physical environments were extremely hostile to agents—page changes, permission restrictions, and task interruptions led to repeated retries and sharply rising token consumption.

Zhang Peng acknowledges that today's technology stack, infrastructure, and business models are not yet naturally aligned. However, he believes that identifying things that seem impossible today but whose key enabling conditions are gradually forming is itself a crucial part of seizing entrepreneurial opportunities.

Regarding future landscape, he offers a judgment different from internet platform models: Personal AI may see "winners not taking all." Human preferences are discrete; there is no universal "heartthrob" that satisfies everyone. Users may not be willing to entrust all personal information and affairs to a single tech company. A social structure of "specialized handling for specialized matters" may also hold true in the digital world.

Fontes:GeekPark

Pesquisa

South Korean AI Infrastructure Firm Xiilab Raises 10 Billion Won via Convertible Bonds from National Growth Fund to Expand Data Center Business

Tópico · Xiilab数据中心扩张Material
2026-11-06

Xiilab, a South Korean AI infrastructure specialist, resolved on November 6, 2026, to issue 10 billion won in private placement convertible bonds (CBs). According to the company's disclosure, the subscribers include sub-funds of the "National Growth Fund" managed by Korea Investment Value Asset Management, DB Asset Management, SuSeong Asset Management, and Orion Asset Management (8 billion won), as well as Orion Asset Management's KOSDAQ Venture Fund and others (2 billion won). The National Growth Fund is a policy fund established by the South Korean government to cultivate advanced strategic industries such as AI, semiconductors, and biotechnology.

The financing terms are favorable to existing shareholders: both the coupon rate and the maturity guarantee yield are set at 0%, and there is no "refixing" clause that would adjust the conversion price downward if the stock price falls. Additionally, Xiilab has secured a call option to repurchase up to 50% of the subscribed amount, allowing it to mitigate potential dilution from new share issuance if the stock price rises. Investors may exercise their early redemption right (put option) after 30 months from issuance. The acquisition contract is scheduled for signing on November 10, with payment due on November 16.

Xiilab plans to use these funds to expand its AI Data Center (AIDC) business. The company noted that domestic investment in AI computing infrastructure in South Korea is simultaneously expanding across three fronts: government-led national AI computing centers, regional AI data centers, and corporate self-built GPU clusters. As an NVIDIA Elite Partner, Xiilab aims to secure working capital in advance to prepare for the anticipated surge in demand for latest-generation GPUs like NVIDIA's Vera Rubin platform.

The company's mid-term strategy involves expanding from hardware cluster construction alone to integrated "construction + operation" solutions. Xiilab plans to deploy its proprietary GPU cluster management software, "AstraGo," within the infrastructure it builds, thereby generating recurring revenue from operations and management services. Currently, the company is continuously enhancing AstraGo 2.1, released this year, to improve its capabilities in AI inference operations and comprehensive data center management.

Fontes:씨이랩

Pesquisa

Econbrowser Blogger Menzie Chinn: The Neutrality of US AI Investment Retreat on GDP Does Not Equal Consumption Neutrality

Material
2026-11-07 07:17 GMT+8

The direct impact of the retreat in AI capital investment on US GDP may be nearly neutral in an accounting sense. Menzie Chinn notes that the surge in capital expenditure was largely offset by imports in US GDP accounting—the contribution of imports of computers, peripherals, and semiconductors to quarterly data was opposite in direction and similar in magnitude to the contribution of investment. Although data center construction is not included in the capital expenditure component, adding it in would not change the overall picture. If the investment multiplier and import multiplier are roughly equivalent, then the retreat in investment represents an approximate zero-sum accounting event at the US GDP level.

But this is not the whole story. Chinn distinguishes between two transmission channels: one is the mechanical offset in GDP accounting, and the other is the behavioral channel—where changes in expectations drive asset price revaluation, declining asset prices erode household net worth, and shrinking net worth depresses consumption growth through wealth effects. He cites research by Bigot and Espic (2026), estimating that of the approximately 2% US consumption growth in 2025, about half came from increases in stock market wealth; this estimate is based on a marginal propensity to consume out of wealth of approximately 0.027, meaning that for every additional dollar of stock market wealth, consumption increases by about 2.7 cents.

Chinn uses the fourth quarter of 2026 as a scenario benchmark: assuming that stock market capitalization does not recover, household net worth will decline, leading to a slowdown in consumption growth. He estimates that if stock market capitalization decreases by $3 trillion, consumption growth will be dragged down given the 0.027 marginal propensity to consume. However, he also points out that starting from a consumption growth rate of 2.5% annualized through the third quarter, this transmission effect will not cause US GDP growth to turn negative—a view that seems to represent a market consensus.

The real risk lies in second-order effects. Chinn admits he cannot judge the trajectory of AI-related asset prices, but he believes that if financial markets experience disorderly adjustments due to the revaluation of AI valuations, the resulting elevated uncertainty itself will suppress aggregate demand. His conclusion is open-ended: no one knows what the final outcome will be.

Fontes:econbrowser.com

Pesquisa

AI Data Center Developer Crusoe Sells Unfinished Wyoming Project to Google, Which Plans $17 Billion Investment

Tópico · CrusoeMaterial
2026-11-07 09:40 GMT+8

Crusoe, a Denver-based AI data center developer founded eight years ago, confirmed that it has sold an unfinished data center project in southeastern Wyoming to Google. The site was initially planned in partnership with Blackstone-backed infrastructure company Tallgrass, with ambitions to eventually scale to 10 gigawatts of power capacity.

According to TechCrunch, Google had previously attempted to become a customer for the project but raised concerns about costs and construction timelines under Crusoe’s management. This acquisition marks Google taking direct control of the site's development. While Google did not disclose the purchase price paid to Crusoe, it announced plans to invest $17 billion to develop the data center campus.

The deal underscores the difficulties independent data center developers face in delivering massive projects on time and within budget, citing challenges such as securing equipment, power availability, and growing local community opposition. Notably, Crusoe has not lost all business with Google; the company is still developing another data center for Google near Amarillo, Texas.

Crusoe recently completed a $3.9 billion funding round, valuing the company at $30.9 billion. Its business model involves leasing data center space, renting GPUs, and selling inference compute. Beyond the Wyoming site, Crusoe is building campuses for Oracle and OpenAI in Abilene, Texas, and a separate 900-megawatt campus for Microsoft.

Fontes:TechCrunch

Pesquisa

Envision Energy's Vertical Integration: How China's AI Data Centers Can Build 120MW in One Year at One-Fifth the US Cost

Estrutural
2026-11-08 03:01 GMT+8

In September 2026, SemiAnalysis authors Everlyn Tan, Dylan Patel, and others traveled to Ulanqab, Inner Mongolia, to conduct an on-site visit of Envision Group's Galaxy data center campus. This campus, with a planned total capacity of 800MW, rivals the scale of the Stargate core campus in Abilene, Texas, USA—built by Crusoe for Oracle and OpenAI, featuring approximately 820MW of critical IT capacity. However, SemiAnalysis argues that what truly warrants attention is not the scale itself, but the depth of vertical integration demonstrated by Envision Energy: it simultaneously possesses wind farms, dedicated transmission lines, blade manufacturing plants, energy storage systems, low-voltage power modules, 800V solid-state transformer (SST) systems, and the design and integration capabilities for prefabricated substations. The authors explicitly state that it is too early to determine whether this integrated model constitutes a meaningful competitive advantage.

How does this integration translate into actual advantages? Phase I of Galaxy, with a capacity of 120MW, was delivered in less than one year at a cost approximately one-fifth that of the United States. Its power supply adopts the Source-Grid-Load-Storage (SGLS) model unique to China: the project builds its own wind and solar farms, pairs them with energy storage, constructs the data center, and connects via dedicated lines rather than the public grid. Envision selected two plots with strong wind resources, located about two hours' drive from the campus and roughly 80 kilometers apart—a distance that reduces the probability of simultaneous calm winds throughout the year. The combined installed capacity of the two wind farms is 420MW, approximately 1.75 times the data center's 240MW load. Excess power during windy periods is stored in four-hour batteries and released when winds are weak. Envision aims to cover more than 60% of the electricity consumption for the first two phases with its own wind power, but the article frames this as a target rather than an achieved result.

Vertical integration is equally evident within the campus. Envision's affiliate, AESC, manufactures all core components of the energy storage systems, from battery cells to power conversion to software, completing full system commissioning before leaving the factory. Most suppliers only cover one segment—high voltage, low voltage, or generators—requiring 3 to 6 months of on-site commissioning to integrate parts. In a 5MW pilot hall, solid-state transformers directly convert 10kV AC from the grid to 800V DC to supply the racks, eliminating the low-voltage transformers, UPS, and rectifier stages. This architecture aligns with the direction Nvidia is pushing for next-generation high-density racks; however, while the US industry remains in the roadmap phase, approximately one-quarter of Chinese data centers built over the past decade already operate on DC power supply.

SemiAnalysis's core argument is that power access is becoming the central condition for data center development. In the United States, developers bridge power gaps using on-site gas turbines and fuel cells; in Southeast Asia, governments are beginning to require data centers to generate their own power; in China, approvals increasingly favor projects that synergize computing power with electricity. When energy access itself becomes part of the product, enterprises possessing full-chain capabilities gain cost and schedule control that traditional developers cannot easily replicate. Envision's prefabricated substation takes less than three months from factory module production to grid connection, compared to approximately six months for conventional indoor substations.

Fontes:newsletter.semianalysis.com

Pesquisa

Web Perception: Three Months of Tinkering with Model Bounding Boxes Was Less Effective Than Coding My Own Judgment

Material
2026-11-07 21:30 GMT+8

The earliest motivation for building EH was simply laziness. There are too many repetitive operations in a browser: viewing pages, finding content, clicking controls, and switching pages—I wanted the computer to do it for me. When V2EX user niuheishou built the web perception system EH, the first engineering decision he faced was: should the model look, or should the code look?

He initially chose the model. He built a complete set of YOLO annotation tools for himself, designed annotation rules, and manually annotated them one by one. During his most intense three days, he slept only twelve hours, accumulating approximately 2,300 basic training samples. The training results looked good, but problems arose when actually applied to pages: the samples were mostly from fixed browser resolutions and zoom levels, and the bias from his manual annotations was seriously learned by the model. Large elements could be handled roughly, but the boxes for small elements often deviated wildly—a seemingly small error landing on a button could determine exactly what gets clicked.

For the next three full months, he struggled against this jitter in the boxes. He added geometric priors, tried GNN correction, performed morphological dilation; re-annotated, re-trained, and supplemented data under different zooms and resolutions. Each time he felt closer to solving the problem, changing the page state would reveal new biases.

The turning point came from the DOM. He later described his feelings at the time: the browser already knew some things, yet he was still making the model guess again from pixels. After the DOM entered the system, the first thing that changed was annotation—the boxes that used to require painstaking manual drawing could now be generated by code according to unified rules. Inconsistencies in manual annotation decreased, and the work of patching around annotations became much lighter.

But the inherent problems of the model were not solved. The trained model still jittered; increasing the model size and input resolution did not completely eliminate deviations on the page. The question gradually shifted: how much longer must I patch along this path to achieve the stable results I want?

So the prototype began to shift. He broke down his own judgments about the page, writing them out as code line by line—which parts are content, which are controls, under what conditions action can be taken, and under what conditions it should stop. Subjective judgments that previously existed only in his mind gradually became rules that could be executed repeatedly and checked.

This process was slow, but for the first time it showed him another possibility: instead of constantly chasing and correcting deviations in the model's output boxes, he could first clearly articulate his process of understanding the page, and then let the code execute it. After the single-site version finally ran successfully, he faced the next problem—generalizability. One site required about a 200KB JSON configuration file; switching to another site meant continuing adaptation. It took about a month to analyze what could be reused across sites versus what was just site-specific experience, and two more months before the first cross-site reusable engine finally took shape.

Fontes:V2EX

Pesquisa

NVIDIA Dory 4B Loop Inference Block: Predicting Costs from the GGUF Header, and a Trap with the Default Four Loops

Tópico · 英伟达Dory推理模型Material
2026-11-08 03:22 GMT+8

The core architecture of NVIDIA Dory 1.0 4B is a shared loop inference block: middle layers form a module that can be applied repeatedly, allowing each token to be processed once, twice, three times, or four times. Each additional loop increases computation without adding any parameters, so the same 3.7 GB GGUF file can run under four different compute budgets without retraining. This effectively turns test-time compute into a load-time setting.

A tutorial by practitioner Sana Hassan at MarkTechPost showcases a reproducible verification method: first reading architecture metadata from the GGUF file header to predict costs for each configuration, then starting a server to verify predictions against actual logs. Dory’s 72 layer entries are divided into 16 input layers, 40 shared recurrent layers, and 16 output layers; the recurrent block accounts for 1.84 billion of the model's 3.98 billion parameters. A token passes through the input block, the recurrent block (once per loop), the output block, and the language model head, meaning four loops apply 2.51 times the parameters of a single loop and read 2.28 times the weight bytes.

KV cache behavior depends on the combination of loop count and cache mode. The per_loop mode retains independent caches for every loop of every attention layer within the recurrent block, growing from 306 MiB at one loop to 816 MiB at four loops for a 4096 context length; the last_loop mode retains only one cache, maintaining 306 MiB regardless of the loop count. This difference has measurable consequences during chunked processing of long prompts: when a prompt is split into small chunks of 16 tokens, the next-token distributions of last_loop and per_loop diverge because early chunks retain only the keys and values from the final loop.

The tutorial exposes the first trap: defaults. The built-in loop count in the GGUF file header is 4, whereas the NVIDIA model card recommends 2. Without explicitly overriding this setting, the server silently runs the most expensive configuration. The second trap is version locking: support for Dory in the llama.cpp upstream remains an open draft PR (number 30306), and no released binary can load this model; it must be built from a specific commit of a specific fork.

Evaluations on 30 paired GSM8K questions show that four loops generate fewer tokens than a single loop—the upper bound of the 95% confidence interval for the median ratio is below 1, meaning the entire interval lies below 1—but decode speed drops significantly. Due to the small sample size, differences in accuracy cannot be distinguished statistically. The author explicitly marks untestable claims: benchmarks on the model card such as SWE-bench, Terminal-Bench, GPQA, 256K context, and NVFP4 pre-training cannot be verified in this tutorial.

Two practical lessons do not depend on specific measurement numbers: always set the loop count explicitly, because the GGUF defaults to four loops; and always pin the fork commit hash, because upstream support has not yet been merged.

Fontes:MarkTechPost

Pesquisa

XLNet: Breaking BERT's Pre-training Limitations via Permutation Language Modeling

Verificado 2026-11-08 00:02 GMT+8

Leitura de longo prazo · 《XLNet: Generalized Autoregressive Pretraining for Language Understanding》(2019)

In the field of natural language processing, unsupervised pre-training is key to improving downstream task performance. For a long time, autoregressive (AR) language models and denoising autoencoder-based models (such as BERT) have been the two most successful approaches. However, each has distinct limitations. Traditional AR models can only encode context unidirectionally, making it difficult to capture deep bidirectional information; while BERT leverages bidirectional context, its reliance on mask tokens leads to a data distribution inconsistency between the pre-training and fine-tuning stages (the "pre-training/fine-tuning discrepancy"), and it assumes that predicted words are independent of one another, ignoring the long-range dependencies prevalent in natural language.

To address these pain points, the Carnegie Mellon University and Google AI teams proposed XLNet. This is a generalized autoregressive pre-training method designed to combine the strengths of AR models and BERT while avoiding their defects. XLNet's core innovation lies in "permutation language modeling." Unlike traditional AR models with fixed forward or backward decomposition orders, XLNet maximizes the expected log-likelihood across all possible permutation orders. This means that for every position in the sequence, the context can include words from both the left and right sides. Statistically, the model learns to utilize information from all positions, thereby achieving bidirectional context capture without compromising the autoregressive nature.

Furthermore, because XLNet maintains an autoregressive form, it does not rely on input data corruption (such as BERT's [MASK] operation), thus eliminating the discrepancy between pre-training and fine-tuning. Simultaneously, the autoregressive objective allows the use of the product rule to decompose joint probabilities, naturally modeling dependencies between words and overcoming the simplification problem of BERT's independence assumption. To further enhance performance, XLNet integrates the segment-recurrence mechanism and relative positional encoding from Transformer-XL, enabling better performance when processing long text sequences. Experiments show that under comparable settings, XLNet outperforms BERT in 20 tasks including question answering, natural language inference, sentiment analysis, and document ranking, often with significant advantages.

Recommended reading: "XLNet: Generalized Autoregressive Pretraining for Language Understanding" (2019). This paper provides an in-depth analysis of the pros and cons of BERT and traditional autoregressive models, and demonstrates how clever design through permutation language modeling enables bidirectional context learning while maintaining autoregressive characteristics. For readers hoping to understand the evolution of large-scale language model pre-training mechanisms, particularly how to balance bidirectionality and autoregressive advantages, this is a must-read classic technical literature.

Fontes:《XLNet: Generalized Autoregressive Pretraining for Language Understanding》(2019)

Pesquisa
Próxima →
Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento

This leads to a discussion on core barriers: the barrier for Personal AI lies not in Context Ownership, but in Deep Entanglement—the relationship formed with users through continuous understanding, proactive service, and feedback verification, evolving together above the user's context. Enclosing user data within walls to raise migration thresholds may instead damage the core foundation of Personal AI: trust.

For entrepreneurial paths, Zhang Peng presents two strategies: Rush-type approaches acquire user volume and ARR quickly through marketing, but without the ability to process user tasks and feedback into product capabilities, it resembles a "resource country"—possessing raw materials but lacking industrial capacity to convert them into stable value. Build-type approaches start from a narrower niche, delaying expansion to steadily improve delivery capabilities in vertical scenarios. He emphasizes these mechanisms are not mutually exclusive but require constant switching and dynamic adjustment.

He cites two specific examples. OPPO's "Xinli Qiu" (Heart Power Sphere) targets personal growth needs, listening to user conversations to help them "look inward," positioning itself as a thinking partner rather than a secretary assistant. Alloop.ai's practice among "health hackers" involves continuously tracking health data, proactively capturing connections behind fluctuations, and encouraging better lifestyles—for instance, starting discussions from "a significant increase in your deep sleep duration last night" to help users realize that avoiding alcohol at night aids sleep, eventually leading users to voluntarily quit drinking. Zhang Peng considers this action, where AI and users jointly initiate goals and push them forward, very close to the essential definition of Personal AI.

Finally, he summarizes: Is Personal AI the Next Big Thing? He believes yes, not because it is a contested "entry point," but because it has the potential to let product long-term value grow outside foundation models. Yet it may also be a "Big Hole"—the friction of real environments, technical engineering challenges, and current-stage uneconomical costs are all evident. The Big Thing and the Big Hole are two sides of the same coin; precisely because of its "non-consensus" nature and "slim chance," it holds true value for entrepreneurs.

However, the authors explicitly mark the boundaries of this argument. The article notes that vertical integration has not yet directly won orders from hyperscale customers, where the primary criteria for selecting vendors remain resources and track records. The data center market in China is highly competitive; rents have halved over five years to approximately $40 per kilowatt per month (excluding electricity), capital expenditures have dropped by about 25% to under $3 million per megawatt, and electricity prices in Inner Mongolia are approximately $0.055 per kilowatt-hour. In such a market, integration signifies greater control over costs and schedules rather than automatic order conversion. The article suggests that this advantage may evolve from marginal improvement to structural barrier only as power access continues to tighten and the internal power supply architecture of data centers is redesigned.

By April 2026, he conducted systematic tests. Six sites (Xiaohongshu, Bilibili, Taobao, Pinterest, Reddit, TikTok), totaling 21 runs, focused on collection throughput and coefficient of variation (CV). Results ranged from 1.42% to 8.34%: Pinterest at 78.90 Pins per minute with a CV of 1.42%; Bilibili at 50.9 content cards per minute with a CV of 2.70%; TikTok at 5.70 videos per minute with a CV of 3.10%; Xiaohongshu at 40.0 content cards per minute with a CV of 5.83%; Taobao at 28.03 product cards per minute with a CV of 7.85%; Reddit at 15.63 posts per minute with a CV of 8.34%.

Regarding resolution, he used the TikTok video switching path to conduct five sets of window and zoom condition tests, covering laptop baseline windows, 125% browser zoom, narrower windows, and native 4K and 2K modes. Across all five sets, 150 video sources were recorded, and all 145 switches succeeded without getting stuck. For someone tortured by model box jitter for three months, this result was indeed reassuring.

However, the author drew clear boundaries: this mainly validated only the video switching path, and did not prove that all operations on all sites could adapt to all resolutions. When Xiaohongshu switched layouts in narrow windows, configurations relying on fixed areas encountered issues early on. Each site had only three to six runs, representing small-sample observations; CV measures throughput fluctuation and cannot be treated as recognition accuracy or task success rate; since each site collects different objects, throughputs are not suitable for direct horizontal ranking.

These tests belong to early engine experiments from April 2026, still using site configurations. That the same framework could run on several sites was progress; stability after changing content or windows is the next step. Reducing site configurations and lowering maintenance burdens requires further advancement. The author said that to make the computer rely less on him, he first had to clarify his accustomed judgments bit by bit.