Large language models (LLMs) are increasingly capable of generating functional source code, raising concerns about authorship, accountability, and security. While detecting AI-generated code is critical, existing datasets and benchmarks are narrow, typically limited to binary human-machine classification under in-distribution settings. To bridge this gap, we introduce AICD Bench, the most comprehensive benchmark for AI-generated code detection. It spans 2M examples, 77 models across 11 families, and 9 programming languages, including recent reasoning models. Beyond scale, AICD Bench introduces three realistic detection tasks: (i) ~Robust Binary Classification under distribution shifts in language and domain, (ii) ~Model Family Attribution, grouping generators by architectural lineage, and (iii) ~Fine-Grained Human-Machine Classification across human, machine, hybrid, and adversarial code. Extensive evaluation on neural and classical detectors shows that performance remains far below practical usability, particularly under distribution shift and for hybrid or adversarial code. We release AICD Bench as a unified, challenging evaluation suite to drive the next generation of robust approaches for AI-generated code detection. The data and the code are available at https: //huggingface. co/AICD-bench}.
Building similarity graph...
Analyzing shared references across papers
Loading...
Daniil Orel
Mohamed bin Zayed University of Artificial Intelligence
Dilshod Azizov
Mohamed bin Zayed University of Artificial Intelligence
Indraneil Paul
Technical University of Darmstadt
Building similarity graph...
Analyzing shared references across papers
Loading...
Orel et al. (Mon,) studied this question.
synapsesocial.com/papers/69a760e1c6e9836116a2e0cc — DOI: https://doi.org/10.48550/arxiv.2602.02079