PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 18, 2026AI & Society0 citationsOpen Access

The AIR framework for research transparency: a critical analysis of stage-specific AI disclosure in the context of accessibility and research integrity

DRDavid Ruttenberg

Key Points

  • This analysis aims to address the transparency crisis in integrating AI tools into research workflows and assesses the AIR framework's impact.
  • Conducted a critical review of the AIR framework's theoretical foundations and empirical application.
  • Performed an inter-rater reliability pilot study with 15 raters across nine scenarios to gauge agreement in applying AIR.
  • Identified five major limitations and proposed evidence-informed refinements to enhance accessibility and integrity.
  • Inter-rater reliability study achieved substantial agreement (Cohen’s κ = 0.72) among evaluators applying AIR.
  • Identified critical limitations including false precision in ambiguities and inadequate treatment of accessibility-related AI use.
  • Proposed refinements aim to improve AIR's precision while addressing the needs of vulnerable researchers.

Abstract

Abstract As generative AI tools integrate rapidly into research workflows, the absence of shared disclosure vocabulary creates what I characterize as a transparency crisis: researchers wish to use AI responsibly but lack consistent language for describing how these tools contribute to their work. The AIR (AI in Research) framework addresses this gap through a two-dimensional matrix mapping AI involvement across seven research stages and five engagement bands, from no use to substantial use. This critical review examines AIR’s theoretical foundations, empirical viability, and ethical limitations, with particular attention to accessibility and neurodiversity. Drawing on virtue epistemology, I argue that transparency must be understood as a constitutive epistemic virtue rather than a procedural requirement, and assess how AIR operationalizes this commitment. An inter-rater reliability pilot study ( n = 15 raters, nine scenarios, Cohen’s κ = 0.72) demonstrates that trained evaluators can apply AIR with substantial agreement while revealing systematic boundary ambiguities. Critical analysis identifies five major limitations: false precision in ambiguous practices, inadequate treatment of accessibility-related AI use, stigmatization of legitimate high-band practices, vulnerability to adversarial compliance, and insufficient edge case guidance. I propose evidence-informed refinements including boundary case designations, a protected A1-Access sub-band for disability accommodations, separation of verification burden from appropriateness judgment, spot-check validation studies, and community-maintained edge case repositories. These refinements aim to preserve AIR’s descriptive precision while protecting vulnerable researchers and mitigating exclusion risks. The analysis finds that AIR, with the proposed refinements, shows promise as transparency infrastructure, but that implementation requires sustained dialogue among researchers, integrity officers, editors, accessibility advocates, and policymakers to ensure research integrity and inclusion remain interdependent rather than competing aspirations.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

David Ruttenberg (2026) studied this question.

synapsesocial.com/papers/6a0aacb35ba8ef6d83b7017ehttps://doi.org/10.1007/s00146-026-03082-x
Ask AI
Helpful
Bookmark
Share
View Full Paper