NASA’s new dark energy space telescope can also detect killer asteroids
technologyreview.com·3h ago
TL;DR
Researchers identified a gap in LLM evaluation benchmarks. They built a synthetic dataset with 10k adversarial prompts targeting reasoning failures.
✦ Why It Matters
Use this benchmark to audit LLM robustness before deploying in production reasoning pipelines.
Key Takeaways
How It Works
ANoCo constructs a bipartite graph connecting query patches to normal patches based on cosine similarity. It explicitly removes edges that could dilute evidence, allowing for a clearer assessment of how much a query patch deviates from the normal feature manifold.
The anomaly score is calculated as the magnitude of the update needed to satisfy normality constraints, reframing the graph Laplacian as a non-conformity operator.
Related