Accelerating the search for antimicrobial peptides with Google Antigravity
deepmind.google·2h ago
AI Research
arXiv CS.AI·1d ago·5 min read
Does a Hosted Decision Model Respect Irrelevant Alternatives? A Pre-Registered Test of Option-Set Dependence in Jev
TL;DR
A pre-registered study of the jev-1.13.0 decision model reveals that adding irrelevant options significantly alters the probabilities of existing choices, violating the independence of irrelevant alternatives (IIA) principle. The findings indicate that even minor additions can distort decision-making outcomes.
✦ Why It Matters
Evaluate the impact of irrelevant options in your decision models to ensure accurate outcomes.
Key Takeaways
- Test decision models for IIA compliance before deployment.
- Monitor log-odds shifts when adding new options.
- Consider the similarity of options to existing choices.
- Limit the number of options to reduce distortion.
How It Works
The jev-1.13.0 model calculates probabilities for options based on input data. When irrelevant options are added, the model reallocates probability mass among existing choices, leading to shifts in log-odds that violate IIA.