nitro-ai-judge

A public reading-time prediction repository with a reproducible baseline pipeline, data contract, local evaluation, and experiment boundaries.

nitro-ai-judge

Why this article exists

This project is useful because it shows restraint under leaderboard pressure. The repository keeps the baseline, data contract, local estimates, failed experiments, and promotion rules visible so model progress is not confused with wishful scoring.

Problem

A competition pipeline can look successful while hiding whether a score came from local validation, official feedback, leakage, oracle ceilings, or a lucky upload.

What shipped

CSV data contract, `solution.py`, generated submission, cross-validation evaluator, acceptance criteria, baseline design docs, target audit, and documented Transformer/BERT/semantic experiments.

Evidence

The README distinguishes local estimates from hidden Nitro leaderboard scores, documents a rejected BERT score, and states when experiments are not promoted.

Inspect path

Inspect `solution.py`, `evaluate.py`, `docs/submission_pipeline_design.md`, `ACCEPTANCE_CRITERIA.md`, experiment reports, and target-audit commands.

Boundary

Local validation is not the hidden leaderboard, and experimental models are not promoted unless local or official evidence supports them.

What changed

The baseline discipline became clearer: a plain model is useful when it protects error analysis, promotion rules, and evidence quality from leaderboard noise.

Next question

Which failure class would justify a more complex model instead of cleaner data, features, or evaluation?

Open public repository

https://github.com/89325516/nitro-ai-judge