NoCap-Test evidence · think2earn docs
Source code ↗

Challenge terms — official rules vs this campaign

Audience: strangers auditing whether our numbers match the BottleCapAI benchmark.
Official source: BottleCapAI/NoCap-Test (master README).
Our measurement: FAIR_CLOCK.html · GLOSSARY.html


What BottleCapAI asks for

Open benchmark (Modded-NanoGPT fork) on one GPU (reference: RTX 4090).

Official ruleSummary
Optional goalval loss ≤ 3.3821 on FineWeb faster than stock baseline.
Non-4090Benchmark baseline on your setup; report speedup vs that baseline.
Fair comparisonSame treatment for baseline and candidate (e.g. don’t raise LR only on candidate).
DocumentationIDEA.md with motivation, method, results. Negative results welcome.
Submissiongit bundle create <first>-<last>.bundle --allhey@bottlecapai.com (speedup % in subject; negative OK). Beat baseline → add RESULTS.md.
StatusFirst competition finished Nov 2025; self-paced submissions still welcome.

They want algorithmic ideas, not LR-only tuning or copied Modded-NanoGPT tricks. Sub-baseline runs with a clear idea still matter.

Metric: cross-entropy on FineWeb val (we log val_disjoint). README allows other sequence lengths if the full val set remains a valid probability model.


How this campaign maps those rules

OfficialOur mapping
Quality ≤ 3.3821First logged val_disjoint ≤ 3.3821 (horizon 4768). GLOSSARY.
Speed vs baselineFirst-passage train time T from train_time_ms at first-cross (compile warmup in). FAIR_CLOCK.
Non-4090 ruleDenom = our sealed stock AdamW on pinned stack — not the 4090 leaderboard row.
Fair comparisonOne sealed denom; no matched speedup vs joint stock where stock missed quality.
IDEA.mdCampaign docs + FAILURE_LEDGER.html.
BundleCampaign packaging for organizers — not an official win by itself.

Public denominator

LabelWorkspacePinFirst-cross T
F1_sealClock-WStock AdamW · A100-SXM4-40GB · torch 2.13.0+cu1303.866 h @ 4736

ΔT% = 100 × (3.866 h - T_candidate) / 3.866 h

Current claim (honest)

Attribution for any submission: Muon (Keller Jordan); timing-cheap split-QKV from this campaign’s bank.


Non-claims

  1. Official NoCap win or 4090-table speed without re-benchmarking 4090 baseline.
  2. Cardinal % from 800-step proxies or historical notebook F1 (~229.1 min).
  3. “Beat joint stock” — stock missed on matched pairs.

Copy-safe wording: FAIR_CLOCK § non-claims.


DocUse
GLOSSARY.htmlTerms (val_disjoint, F1_seal, workspaces)
disjoint-val-explained.htmlPedagogy: held-out val · bar · first-passage
FAIR_CLOCK.htmlSpeed metric, noise floor, pin
CAMPAIGN_OVERVIEW.htmlNarrative
DOCS_INDEX.htmlFull catalog

Live: https://nocap.think2earn.com