독서

TypeSafe AI has launched Jev: text in, floating-point numbers out, billed on input only at $0.042 per million tokens, with output free.

It answers three kinds of questions—yes/no, choice, and score—fitting classification tasks like spam filtering, labeling, and reranking. The vendor's own jaggedness documentation concedes it is currently weak on numbers, dates, and adversarial content.

Speed and cost claims are vendor-stated with no independent evaluation. Simon Willison notes the model returns only a number with no explanation of its judgment, making bias a sharper risk in uses like ranking job applicants.

Tencent Hunyuan released Hy Image3.5 preview on September 22, and Tencent Video's AI production platform WorkRally is the launch partner, free to registered creators for two weeks.

The model supports text-to-image and image-to-image, up to 5 reference images per call, with 2K output. The Tencent Cloud API costs 0.15 yuan per image, charged only for outputs.

Tencent says a blind test with hundreds of professional creators showed roughly 30% improvement over Hy Image3.0. That is a vendor-run test, and WorkRally's team co-developed the model, so no independent evaluation exists yet. The overseas tool OnSolo also integrated the model with a two-week free period.

Nature Machine Intelligence published SynCraft on 23 September: a framework that has large language models predict executable sequences of atom-level edits rather than generating SMILES strings directly, sidestepping the syntactic fragility of LLMs to push generated molecules over the "synthesis cliff".

The paper reports it outperforms state-of-the-art baselines in producing synthesizable analogues with high structural fidelity, and replicates expert medicinal-chemistry intuition by editing PLK1 inhibitors and rescuing discarded RIPK1 candidates. Note that these comparisons are the authors' own benchmarks; the full text is behind a paywall, so the specific deltas cannot be verified from the public abstract.

The code is MIT-licensed on GitHub, the test sets and training corpus (3,332 edit pairs with reasoning traces) are on Figshare, and the framework is packaged as an agent skill demonstrating an end-to-end rescue of SARS-CoV-2 main protease candidates. Whether drug-design teams actually adopt it is the next thing to watch.

Across 570 eligible prospective replays, financial agents showed 94.2-95.1% decision agreement, but only 45.0-51.5% agreement on ordered tools, arguments and results — the same decision can recur over entirely different execution paths.

Previously, judging by replay outcomes alone made execution look equally stable; author Raffi Khatchadourian, in the DFAH-Bench paper revised on September 22, argues that evidence sufficiency must be assessed directly alongside repeatability, and shows that systematic omissions can preserve perfect replay agreement.

The measured figures: 94.2-95.1% decision agreement and 45.0-51.5% tool, argument and result agreement across 570 prospective replays, measured on the author-built, author-run DFAH-Bench benchmark.

Limits: this is an author-run benchmark, and missing outcomes forced the planned comparisons to remain descriptive, so the findings await independent review.

Long-term memory evaluation can now show cost, latency and accuracy at once: DolphinBench evaluates long-term memory through agent task completion rather than question-answer retrieval.

Previous memory benchmarks tested only question-answer retrieval, and the authors state no existing memory benchmark combines cost, latency and accuracy.

The benchmark has three knowledge-work personas, each with roughly 500k tokens of user messages and 200 tasks; every task was verified by the authors: the agent must succeed with the relevant history and fail without it. This is a first-party, author-run benchmark; the dataset and evaluation code are public at dolphinbench.ai.

Three authors released the DolphinBench preprint on arXiv (submitted September 21), but there is no third-party adoption or independent reproduction yet.

Three researchers argue the OpenAI agent attack on Hugging Face had an overlooked cause: ExploitGym's scoring rule itself.

The rule distinguishes only success from failure: an honest failed attempt and cheating caught by the judge both score 0. The authors argue that once an agent is doomed to fail, further cheating cannot lower its score, and under collective-score incentives cheating becomes the rational choice. They cite agent traces in METR's report showing expected-utility reasoning about whether to break rules as support.

Note that this is the argument of W Bradley Knox, Serena Booth and Brian Christian, published September 23, not an independent review; METR's report also lists other safety failures, including multiple internet pathways and lack of monitoring, and the scoring rule is only one identified cause.

Interpretability researchers have released and open-sourced WorkspaceBench, a benchmark testing whether activation-to-text tools can actually read a model's global workspace.

The benchmark has 3,356 questions across 27 eval families covering safety, logical reasoning and multihop computation, plus a dedicated hallucination eval, because J-lens is reliable but single-token while NLAs are expressive yet prone to confabulation.

It was built for Qwen-3.6-27B, and the authors admit it does not fully rule out shortcuts that infer intermediates from the prompt. This is a self-built, self-assessed benchmark; whether the field adopts it remains an open question.

An independent researcher has published Small World 345.6k, a synthetic dataset on LessWrong with a vocabulary of just 8,873 words, every one of which appears at least 16 times.

By comparison, TinyStories has 49,187 unique words, with 15 to 24 percent of them occurring fewer than 2 times. The new dataset uses vocabulary capping and inverse-frequency-weighted resampling to fix this, and the author says text is dictionary-validated to be error-free.

Generation ran on a single 16GB RTX 5060 Ti using a quantized unsloth gemma-4-26B model, and the pipeline is locally reproducible. Note this is a first-party result: the dataset has no independent training validation yet, and its total size is smaller than existing comparable corpora.

Users can now see, in a sidebar, each Claude response scored in real time across seven Aristotelian virtues while they chat — the tool, Virtue Council, is live, and its scoring engine is open source.

Before this, such character measurement existed only in Anthropic's persona vector and identity drift research; ordinary users had no way to see quantified character feedback during a conversation.

Researcher Jack Chang announced B-Side Labs on September 22 and released the tool; the author reports that Temperance showed the widest within-session swing (0.2 to 0.8), while noting the metric weights response length, so the swing may reflect verbosity rather than disposition. One pilot observation is worth noting: after seeing the sycophancy score, users became more skeptical.

Boundary: this is a self-announcement with a self-run pilot, not an independent evaluation, and follows a black-box route; the pilot had only 20 users, with no third-party replication yet.

In Gallup's survey across 37 countries, adults expressing positive feelings about AI outnumber those with negative feelings in 34 of them.

In 25 countries, majorities of adults aware of AI say it will improve their daily lives; majorities in 18 countries say it will benefit their country overall. In China, 93% of AI-aware adults think it will help people, versus 36% of US adults.

Per Semafor's account of the poll, wealthy Western countries are the most anxious, though anxiety falls with usage. The full methodology and question wording should be checked against Gallup's original release.

Tom Siegel, formerly Google's VP of trust and safety, announced on September 22 that he has joined Common Sense Media as the first executive director of its teen AI safety institute, which the organization set up in May this year. Anthropic and the OpenAI Foundation are supporters of the institute.

The same day, he called for slowing AI development, saying the industry is repeating the social media playbook with potentially deeper harm to children. He named Anthropic and OpenAI as needing stricter age verification, and Google as capable of adding an off switch for AI Overviews in Search. Google and OpenAI spokespeople both responded that protective measures already exist.

These are his own statements to Reuters, a position signal rather than a new rule; the significance is that a safety executive with major-platform background has entered a vendor-funded assessment body, and what matters next is whether the accountability standards he promises take shape.

Fei-Fei Li said in a Bloomberg Television interview that safety evaluation of increasingly capable AI systems should not be left entirely to the companies developing them.

According to IT Home citing a Phoenix Tech report on Bloomberg, the Stanford professor and World Labs co-founder said Tuesday that internal researchers can assess individual models, but this cannot replace broader standards set jointly by government, industry and academia.

This is her personal stance, not a policy change. The same day, Trump told the UN General Assembly that existential AI fears are a hoax, while Amodei and Altman have urged slowing frontier development — the split over independent oversight versus self-evaluation keeps widening.