As Artificial Intelligence (AI) evolves from tool to teammate, traditional approaches to evaluating human-AI team (HAT) performance no longer capture the dynamic complexity of these interactions. This panel brings together experts from industry and academia to address the critical challenges in modeling and evaluating human-agent teams in the era of agentic AI. Distinguished panelists will examine novel methodologies that integrate objective performance metrics with subjective assessments to capture emergent team states, trust calibration, and communication patterns that define effective human-AI agent collaboration. Through interdisciplinary dialogue, this panel aims to establish research priorities and methodological approaches for developing evaluation frameworks that can adapt to increasingly fluid team compositions and operational contexts. Outcomes will include a roadmap for future research focused on HAT effectiveness in high-stakes operational environments where humans, HAI systems, and autonomous agents will increasingly share roles and responsibilities.
Building similarity graph...
Analyzing shared references across papers
Loading...
Sylvain Bruni
Svitlana Volkova
Laura Cassani
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Arizona State University
Mitre (United States)
Aptima (United States)
Building similarity graph...
Analyzing shared references across papers
Loading...
Bruni et al. (Tue,) studied this question.
www.synapsesocial.com/papers/68fa1210f9f8b44535bfcf31 — DOI: https://doi.org/10.1177/10711813251369392
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: