Skip to content
Published studies are shown for demonstration purposes, not because they are good or bad research. Demonstrator · items marked Example are invented · what exists today
Search

Templates

Paper review

Six reviewer specialists each score a paper from one angle, in parallel, after a number check and a citation check; their weighted average is the internal quality review score.

PlannedRuns today as the review phase of the empirical template; running it on its own is plannedreview
No evaluations yet
Input
A paper with the result files and bibliography it was written from
Output
Six reviewer reports and one score of 0 to 10

Steps

  1. 1
    Number check
    Every number in the tables is compared with the result file it came from; failures block the review.
    check
  2. 2
    Citation check
    Every citation must resolve in the bibliography and in OpenAlex, Semantic Scholar or Crossref.
    check
  3. 3
    Review panel
    Each reviewer writes its own report: mechanism, technical, literature, writing, data and identification. The data reviewer is skipped for theoretical papers.
    specialists, parallel
  4. 4
    Score
    The combined score is the weighted average of the six scores (technical and identification weigh most); a mechanism score below 5 or any score below 4 is the combined score on its own. The score decides whether the draft is revised.
    check
Technical details

Template id paper-review.

StepId in the template fileSpecialists
1. Number checknumber check
2. Citation checkcitation check
3. Review panelreviewmechanism_reviewer, technical_reviewer, literature_reviewer, writing_reviewer, data_reviewer, identification_reviewer
4. Scorescore
More

Description

Data model
Discipline
General
Method family
Review
Design
not specified
Research stage
Review
Authors
e2er authors (Software, Methodology)
Usage
not used in published research yet
Source
e2er repository · src/core/strategist/runner.py · @d8fd8ab
Record
template:paper-review · JSON

Solid tags are declared by the source or mapped from its terms; dashed tags are inferred by a published rule. Hover a tag for its provenance.

Versions and evaluations

Planned

No versions yet.

Evaluate this template Report a failure
Cite this template
Persistent identifiers planned
@software{e2erauthors2026e2erpaperreviewtemplate,
  title   = {e2er paper review template},
  author  = {e2er authors},
  year    = {2026},
  note    = {e2er template. Persistent identifier planned},
  url     = {https://e2er.org/templates/paper-review}
}

Connectors this template can use

What a run of this template can reach outside your machine, and what each sends out.

Checks on this template

  • ✓Output contracts · Every step produced the artifact it declared, in the declared form
    Required of every template.
  • ✓Execution reliability · Analysis code ran and wrote a parseable, non-empty result
    Required of every template.
  • –Numbers · Every number in tables and text matches the output of executed code
    Not applicable. This method produces no computed numbers to match.
  • ○Citations · Every reference resolves to an existing publication via OpenAlex, Semantic Scholar or Crossref
    Proposed. Proposed for the floor; runs log it but may not block on it.
  • ○Verbatim passages · Every claim about a source points to a passage found word for word in that source
    Proposed. Proposed for the floor; runs log it but may not block on it.

Runs of this template

No runs yet.

On e2er.org

Loading…

Discussion

Loading…