Skip to content
Published studies are shown for demonstration purposes, not because they are good or bad research. Demonstrator · items marked Example are invented · what exists today
Search

Proposals · sp-0003

Adopt a common format for evaluation records

draftExample proposal
Problem
Evaluation records written in different formats cannot be compared or aggregated.
Change
Store evaluation records in an established common format for AI evaluation results, including failed and aborted runs.
Consequences
Evaluators export records in that format; the site reads them directly.
Source
Standard Explorer §5, Evaluation protocol.

Discussion

Loading…