Position: Anthropomorphic Misalignment Research Needs Stronger Evidence
Vansh Gupta, Peter Nutter, Samuel Stante, Andreas Krause, Florian Tramèr, Lukas Fluri, Xin Chen and Anna Hedström
International Conference on Machine Learning (ICML) 2026 (Oral Presentation)
We argue that many Anthropomorphic Misalignment Research (AMR) studies need stronger evidence to ensure that they can provide a robust foundation for critical safety decisions, such as model deployment and regulation. By evaluating failure modes across different misalignment concepts, such as deception, emergent misalignment, and sycophancy, we show how conceptual ambiguity, non-robust datasets, experimental design, and insufficient causal interventions can lead to overinterpretation of model behaviors. This position paper aims to offer guidance on evidentiary considerations that can help improve methodological rigor in AMR. To achieve this, we provide a clear call to action through a proposed framework of evidence levels and a diagnostic checklist. These shared standards will enable more productive scientific discourse and ensure that claims about AI risks rest on solid empirical foundations.
| @inproceedings{GNSK+26, | |||
| author | = | {Gupta, Vansh and Nutter, Peter and Stante, Samuel and Krause, Andreas and Tramèr, Florian and Fluri, Lukas and Chen, Xin and Hedström, Anna}, | |
| title | = | {{Position: Anthropomorphic Misalignment Research Needs Stronger Evidence}}, | |
| booktitle | = | {International Conference on Machine Learning (ICML)}, | |
| year | = | {2026}, | |
| howpublished | = | {arXiv preprint arXiv:2606.07612}, | |
| url | = | {https://arxiv.org/abs/2606.07612} | |
| } | |||