PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 21, 20260 citationsOpen Access

HIATUS-bench v0.3 — A Minimal Benchmark for Discriminant Experimental Design (Dataset + Paper)

View Full Paper
LVLuc de Veigy

Key Points

  • The research aims to establish a minimal benchmark that assesses the ability of models to select experiments that minimize uncertainty between hypotheses.
  • Developed a discriminant framework leveraging variational and geometric principles.
  • Included baseline policies: random, fixed, and greedy.
  • Constructed controlled micro-world environments (relaxation, oscillator) for evaluation.
  • Provided configuration files and reproducibility tools for consistent runs.
  • HIATUS-bench enables comprehensive assessment of discriminant power across different paradigms.
  • Highlights the superiority of adaptive evaluation methods over traditional benchmarks focused solely on predictive accuracy.

Abstract

This repository provides the full experimental bundle for HIATUS-bench v0.3, a discriminant framework designed to evaluate informational transitions across controlled micro-worlds. Unlike standard benchmarks focused on predictive accuracy, HIATUS-bench evaluates the ability of models to actively select experiments that reduce uncertainty between competing hypotheses. The benchmark is built on a variational and geometric perspective of transitions, where competing models are evaluated based on their ability to discriminate between structured dynamics. The bundle includes:- core implementation- baseline policies (random, fixed, greedy)- micro-worlds (relaxation, oscillator)- configuration files- reproducible runs (seed42)- results and evaluation scripts The goal is to provide an auditable and minimal experimental setup for testing discriminant power across paradigms. This work is part of a broader research program on informational transitions, variational geometry, and adaptive evaluation frameworks. Disclaimer:Personal work (concept, structure, arbitrations) with AI assistance for writing, formatting, and a minimal Python POC. All artifacts and tests are provided for reproducibility.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Luc de Veigy (2026) studied this question.

synapsesocial.com/papers/69be38ca6e48c4981c6797cfhttps://doi.org/10.5281/zenodo.19107019
Ask AI
Helpful
Bookmark
Share
View Full Paper