Astronomy alert field extraction hits 99.8% agreement with audit
Astro-COLIBRI combined a constrained schema, model extraction and deterministic rule checks on 1,775 alerts; 25,827 of 25,880 field judgments matched human audit.
Field extraction from astronomy alerts can now reach about 99.80% agreement with human audit: the Astro-COLIBRI team processed 1,775 astronomy alerts, and 25,827 of 25,880 explicit field judgments matched an internal human audit, with errors concentrated in observation times and facility attribution.
Previously this kind of alert field curation relied on manual work, which was costly and hard to scale. The method chains a constrained schema, model extraction and deterministic rule checks together.
The agreement rate is about 99.80%, measured by the team's own internal human audit (first-party self-test). Boundary: it covers only one scientific domain, has not been peer-reviewed or externally reproduced, and cannot be extrapolated to the reliability of general enterprise agents; the preprint was released on August 24 (arXiv:2608.23270).