Replication of a published study
Computational reproduction of a published study from its Zenodo replication package: fetch and verify the package, plan, run it in a Docker sandbox, and compare every reported number with what the rerun produced.
Where it sits
left: what it builds on · right: what builds on it · pale: exampleBy e2er authors
How studies reach it
No published study reaches it yet.
Disciplines it reaches
No study reaches it yet.
Solid: published studies. Light: examples.
Computed from the records on this site: what each study, template and specialist names as used, which study extends which, and who authored what. 0 studies in total.
- Input
- A Zenodo record (its DOI) and, if you have it, the published paper as PDF
- Output
- A reproduction report and the dossier
- At the end
- When any run ends, e2er builds the PDF, writes the audit trail and the structured export, and pushes to GitHub if you set that up.
Steps
- 1 checkFetch and verify the packageDownloads the record keyless from Zenodo, verifies every file against Zenodo's checksum, hashes it (SHA-256) and unpacks it read-only into package/. Stages the paper the researcher supplies (paper.pdf), fingerprinted.
- 2 specialistsPlan the reproductionThe replication planner maps each table and figure to the script that produces it and records the published numbers to compare against (replication_plan.json).
- 3 your reviewPlan reviewThe researcher reads and may edit the plan.
- 4 checkRun the code in DockerThe entry points run inside Docker: a pinned official image, dependencies installed first with network, then each script without network, with CPU, memory and time limits, the package read-only and outputs in a separate folder.
- 5 specialistsCompare every numberThe reproduction comparer levels each result (reproduced, minor differences, not reproduced, could not be run) against the targets.
- 6 checkReproduction checkRe-reads every compared number from the output files and fails when the report claims one they do not hold.
- 7 your reviewReport reviewThe researcher reads the report.
Technical details
Template id replication · file pipelines/replication.toml, checked against pipeline.schema.json.
| Step | Id in the template file | Specialists |
|---|---|---|
| 1. Fetch and verify the package | fetch | |
| 2. Plan the reproduction | plan | replication_planner |
| 3. Plan review | review_plan | |
| 4. Run the code in Docker | sandbox_run | |
| 5. Compare every number | compare | reproduction_comparer |
| 6. Reproduction check | reproduction_gate | |
| 7. Report review | review_report |
At the end (finalize): audit_export, structured_export. Modes: single_pass, iterative.
More
Description
Data model- Discipline
- Economics
- Method family
- Empirical (quantitative)Replication
- Design
- not specified
- Research stage
- not specified
- Authors
- e2er authors (Software, Methodology)
- Usage
- not used in published research yet
- Source
- e2er repository · pipelines/replication.toml · @v0.11.0
- Record
- template:replication · JSON
Solid tags are declared by the source or mapped from its terms; dashed tags are inferred by a published rule. Hover a tag for its provenance.
Versions and evaluations
One version, unreleasedOne version so far: pipelines/replication.toml in e2er 0.11.0. No evaluation records exist yet.
Checks on this template
- ✓Output contracts · Every step produced the artifact it declared, in the declared form
Required of every template. - ✓Execution reliability · Analysis code ran and wrote a parseable, non-empty result
Required of every template. - ○Numbers · Every number in tables and text matches the output of executed code
Proposed. Proposed for the floor; runs log it but may not block on it. - ○Citations · Every reference resolves to an existing publication via OpenAlex, Semantic Scholar or Crossref
Proposed. Proposed for the floor; runs log it but may not block on it. - ○Verbatim passages · Every claim about a source points to a passage found word for word in that source
Proposed. Proposed for the floor; runs log it but may not block on it.
Runs of this template
No runs yet.
Use it
Install e2er as described on the Install page, then start a run:
e2er run "Computational reproduction of <title> (10.5281/zenodo.<id>)" --template replicationFrom e2er 0.11.0. Get started goes from install to publish.
On e2er.org
Loading…
Discussion
Loading…