ReadingResearchRadarInvestment framework
Sign in / Sign up
AllTechnologyProductsInvestingPublic marketsOther

Reading

2026-11-184 posts

Refresh

US DOJ and Commerce Confirm Criminal Probe Into Megaspeed Over Nvidia Chip Export Violations

Material
2026-11-17 21:30 GMT+8

The US Department of Justice and the Commerce Department issued a joint statement on November 17, 2026, confirming a criminal investigation into Singapore-based cloud computing firm Megaspeed. Authorities allege the company may have circumvented export rules designed to restrict the sale of advanced AI chips to approved entities and countries. This development marks an escalation from administrative scrutiny triggered by the recent scandal involving former Nvidia CEO Jensen Huang to active federal law enforcement.

The statement identifies Megaspeed as one of several companies suspected of facilitating the transfer of controlled AI chips to China. Although Nvidia added Megaspeed to its 'no-sell' list in June 2025, reports indicate that a Malaysian subsidiary of Megaspeed continued to receive large shipments of Nvidia chips for eight months thereafter. These components, including export-controlled Blackwell and H200 models, were allegedly shipped to Speedmatrix before being handed off to China.

Nvidia has argued that it received permission from the Commerce Department to ship components to Megaspeed and continues to list the firm as a cloud partner. However, the initiation of a criminal probe suggests deepening regulatory concerns over Nvidia's compliance enforcement. The Commerce Department had previously investigated Megaspeed starting in 2024, requesting sales data from Nvidia in May 2025. The Justice Department took the lead after officials visited Megaspeed and interviewed former executive Alice Huang in June 2025.

For AI industry investors, this event highlights geopolitical risks and compliance gaps in the global AI compute supply chain. Megaspeed was previously accused of helping move approximately $2 billion worth of Nvidia chips into China. As the US government intensifies its crackdown on chip smuggling, Chinese AI firms relying on gray-market channels face increased supply disruption risks, while chipmakers like Nvidia must navigate stricter export control audits and potential legal liabilities.

Sources:Tom's Hardware

Research

AMD Demonstrates Trade-offs in Agent Inference Scheduling: Active Session Latency Drops 22%, New Request Wait Increases 49%

Material
2026-11-17 08:00 GMT+8

The traffic patterns of agent coding sessions differ fundamentally from those of standard chat requests. In a technical blog post about its ATOM inference engine, AMD described a typical case: one session involved 198 model calls, with call #48 sending 195.5K tokens, of which only 1.3K were new content. The corpus-wide median input length was 142,016 tokens, while the median output was just 444 tokens. This pattern—extremely long inputs, extremely short outputs, and highly shared prefixes—combined with the bursty parallelism of sub-agents and idle intervals caused by tool execution, creates service challenges that are entirely different from those posed by standard requests.

AMD categorizes these challenges into three layers: memory (maintaining reusable history), scheduling (balancing new requests against ongoing decoding), and compute (reducing per-step overhead in small batches). Among these, the trade-offs in the scheduling layer most intuitively reveal the inherent contradictions of agent services. ATOM’s PrefillDelayer allows a fixed number of decode steps to run immediately after each prefill completes, during which newly arrived requests are held and merged into a single prefill operation. Under 16 concurrent sessions, this strategy reduced P90 token inter-token latency from 31.6 milliseconds to 24.6 milliseconds—a 22% improvement—allowing active sessions to maintain a more stable output rhythm; however, the median time-to-first-token for new requests increased from 1,182 milliseconds to 1,766 milliseconds, a 49% deterioration.

This contradiction is sharper in agent workloads than in standard chats because the session tree structure amplifies latency. A parent agent waits for results from its sub-agents, meaning any delay on one branch postpones the completion of the entire task. Consequently, AMD enables PrefillDelayer only at concurrency levels of 16 and above, keeping it disabled in lower-concurrency interactive ranges, and provides different configuration combinations in deployment recommendations based on concurrency levels.

Optimizations in the memory and compute layers each have their own applicable conditions. ReplaySSM replaces the full state snapshot for every draft position in speculative decoding with a single checkpoint plus compact update records. In experiments with seven draft tokens, this freed up 24.49 GiB per GPU card, increasing available KV blocks from 8,325 to 18,813—a 2.26x increase—but this adds historical retention capacity rather than throughput or cache hit rates. Mono decode fuses multiple small kernels in individual KDA layers into two persistent kernels, reducing the target model's forward pass time from 22.0 milliseconds to 16.4 milliseconds in single-request tests; however, this optimization is currently enabled only at single concurrency, and its effects at higher concurrency levels remain unmeasured.

In terms of comprehensive effects, AMD reported that at 48 concurrent sessions, 94.1% of prompt tokens were reused rather than recomputed (with 77.3% coming from GPU HBM and 16.8% recovered from CPU DRAM), whereas the theoretical upper limit for this corpus is 97.2%. At 56 concurrent sessions, eight MI355X chips achieved a total of 17.5K tokens per second per chip. These figures come from AMD’s runs on the SemiAnalysis InferenceX AgentX benchmark and represent engineering references from the vendor under specific hardware and model combinations, not universally validated independent third-party performance benchmarks.

Sources:ROCm Blogs

Research

Databricks and Google Cloud Enable Bi-Directional Zero-Copy Data Federation Across Unity Catalog and Borderless Lakehouse

Material
2026-11-18 00:30 GMT+8

Data analytics platform company Databricks announced on November 17, 2026, a significant advancement in its partnership with Google Cloud: customers can now access a single copy of data from both Unity Catalog and Google Cloud's "borderless Lakehouse" without duplication. This bi-directional zero-copy federation allows engines like BigQuery to read tables managed by Unity Catalog, and vice versa, breaking down traditional silos between data warehouses.

Beyond data interoperability, the two companies are driving open standards for catalog metadata. In collaboration within the Apache Iceberg community, they have landed proposals for "catalog labels," enabling business semantics and governance tags (such as "domain=finance" or "pii=ssn") to travel with data across different catalogs. This mechanism is critical for enterprise AI agents, which rely on shared metadata to identify sensitive information, apply masking policies, and understand business context when searching for assets across platforms.

The feature is available now through Databricks' Lakehouse Federation and corresponding Google Cloud services. While this marks a key milestone in the open lakehouse architecture, specific production performance, latency under high concurrency, and governance maturity for large-scale deployments remain based on vendor self-reports and await independent benchmark verification.

Sources:Databricks

Research

Google Threat Intelligence Reports Attackers Modifying Claude Code Config Files to Install Backdoors

Material
2026-11-17 09:22 GMT+8

Google's Threat Intelligence Group (GTIG) and Mandiant have released a quarterly report detailing new methods of malicious generative AI usage. The findings indicate a shift from single-prompt interactions to orchestrating multiple AI agents for automated intrusion tasks. A particularly notable trend involves attacks targeting the configuration files of AI coding tools.

According to the report, an actor named "MIDNIGHT NEPTUNE" targeted cryptocurrency-related organizations in North America and Europe. Using fake recruiter profiles, spoofed conference sites, and "ClickFix" tactics that trick users into executing commands, the group gained initial access. Once inside internal code repositories, the attackers modified the .claude/settings.json file associated with Claude Code. When developers launched Claude Code in these compromised environments, the system automatically downloaded and executed a backdoor named "SOMBERMEME." This technique turns the AI development tool itself into a vector for malware distribution.

Beyond supply-chain attacks on specific tools, AI-driven automated intrusions are accelerating. The report highlights the operational use of the open-source attack framework ARTEX. Released on GitHub in July 2026 as a penetration testing tool, ARTEX garnered significant attention, exceeding 12,000 forks before being made private on October 8. Wiz and Google reported in October that China-linked actors were using ARTEX to target IT and software companies. Other frameworks such as CAIRN, CyberStrikeAI, and PentAGI were also cited.

The automation of the vulnerability-to-exploit lifecycle is also increasing. An exposed server revealed a tool called "exploit_agent," which connects to multiple large language models to automatically compare pre- and post-patch code, identify vulnerabilities, and generate and execute exploit code. Targets included websites in France's media, entertainment, and education sectors.

Meanwhile, "LLMJacking"—the theft of AI compute resources—is becoming widespread. In one case handled by Mandiant, attackers generated over $100,000 in fraudulent bills in a single day, with cumulative damages reaching $1 million in the worst instances. Underground services known as "LLM Mixers" are reselling stolen AI credentials, with prices starting as low as $0.10 per million tokens.

Sources:テクノエッジ TechnoEdge

Research

You’re all caught up in this view

Sign in / Sign up
ReadingResearchRadarInvestment framework