Overview
Production Readiness
0.6
Novelty Score
0.6
Cost Impact Score
0.6
Citation Count
0
Why It Matters For Business
Training on many verifiable tasks yields broader reasoning, faster RL training, and better generalization—useful for robust assistants, automated QA, and data-synthesis pipelines.
Summary TLDR
INTERNBOOTCAMP is an open-source library of 1000+ verifiable reasoning tasks and a 9,232-sample benchmark (BOOTCAMP-EVAL). The authors show that training LLMs on many verifiable tasks (task scaling) improves reasoning performance and RL training efficiency. They release code and data and demonstrate large gains when combining supervised fine-tuning (SFT) and reinforcement learning (RL) on synthesized long chain-of-thought data.
Problem Statement
Current RL efforts for LLM reasoning focus on narrow domains (math/code). Real-world reasoning needs cross-domain, verifiable tasks and scalable task generation. Building large, verifiable task libraries by hand is impractical, and it's unclear how increasing the number of training tasks affects reasoning generalization and RL training efficiency.
Main Contribution
INTERNBOOTCAMP: open-source library with 1000+ verifiable reasoning task classes and unified interfaces to generate problems and verify solutions.
BOOTCAMP-EVAL: a cross-domain benchmark (9,232 samples across 118 human-curated tasks) for measuring reasoning generalization.
Automatic agent workflow (evolutionary generation + self-consistent unit tests) to scale bootcamp creation and retain a core set of 704 high-quality tasks for experiments.
Empirical finding: scaling the number of verifiable training tasks (8 → 512 → full set) improves reasoning performance and RL training efficiency, and enables emergent abilities.
Practical recipe: data synthesis + SFT followed by RL on bootcamp tasks yields the best gains on in-domain and OOD reasoning benchmarks.
Key Findings
INTERNBOOTCAMP supports 1000+ reasoning task classes and the authors used a core set of 704 tasks for experiments.
BOOTCAMP-EVAL is a verifiable evaluation suite of 9,232 examples spanning 118 tasks.
Scaling number of training tasks improves RL training efficiency and validation performance roughly linearly between 8 and 512 tasks.
Large performance gains from Bootcamp training: DeepSeek-R1-Distilled-Qwen-32B overall score improved 31.5 → 55.7 after Bootcamp-RL; Qwen2.5-32B-Instruct improved 24.4 → 61.1 after Bootcamp-SFT.
Automated generation quality improved with iterative (evolutionary) refinement: simplification keyword presence fell from 97.93% to 32.46% across 3 iterations, and problematic bootcamps decreased from 33/228 to 14/228.
Emergent learning: tasks that do not improve when trained in isolation can become solvable when trained in a diverse 512-task mix, with a critical improvement after ~300 RL steps.
Results
BOOTCAMP-EVAL size
Core tasks used in experiments
DeepSeek-R1-Distilled-Qwen-32B overall BOOTCAMP-EVAL score
Qwen2.5-32B-Instruct overall BOOTCAMP-EVAL score
Out-of-domain avg score (selected)
Self-consistent unittest filtering thresholds
Emergent improvement timing
Who Should Care
What To Try In 7 Days
Clone INTERNBOOTCAMP and run BOOTCAMP-EVAL on your model to get a cross-domain baseline.
Generate a small synthetic dataset (few thousand long-CoT samples) from 50–200 bootcamp tasks and fine-tune (SFT) one model.
Follow SFT with a short RL pass (DAPO/GRPO) using verify_score as reward; compare to SFT-only and RL-only baselines over 300 steps or fewer steps to spot efficiency gains.
Optimization Features
Training Optimization
- Task scaling: multi-task RL on many verifiable tasks
- SFT
- DAPO-like dynamic-sampling RL to maintain verification score diversity
- Oversampling rollout strategy (rollout batch 3x prompt batch)
Reproducibility
Code Available
Data Available
Open Source Status
- yes
Risks & Boundaries
Limitations
- Automatically generated bootcamps can be overly simplified or semantically wrong; the pipeline relies on heuristic thresholds and human review (Sec.3.3).
- Random task selection for scaling experiments can overlap conceptually with evaluation domains; authors control for data-level contamination but category overlap remains possible (Sec.4.1).
- Reported gains are tied to verifiable tasks and the provided verification mechanism; results may not transfer to tasks that lack rule-based verifiers.
When Not To Use
- Don't use a small number of narrow tasks (e.g., 8 tasks) for RLVR: entropy collapse and degenerate rollouts cause inefficient training (Sec.4.2, Fig.6).
- Avoid trusting automatically generated bootcamps without execution tests and manual inspection—generation alone can produce broken or trivial tasks.
Failure Modes
- Entropy collapse in RL rollouts when task diversity is low, producing all-correct or all-wrong responses and invalid preference data (Sec.4.2).
- Automated bootcamp simplification where generated tasks cover only a narrow instance set; needs iterative refinement (Sec.3.3).
- Self-consistent filtering may still pass subtle semantic errors; requires human spot-checking.
Core Entities
Models
- DeepSeek-R1
- DeepSeek-V3
- DS-R1-Distilled-Qwen-32B
- Qwen2.5-32B-Instruct
- Qwen2.5-7B-Instruct
- Qwen3-32B
- Qwen3-235B-A22B
Metrics
- verification score (0-1)
- overall bootcamp evaluation score
- Accuracy
- rollout batch generation count (training efficiency proxy)
Datasets
- BOOTCAMP-EVAL
- INTERNBOOTCAMP task pool (1000+ tasks; 704 core used)
- 55K synthesized long-CoT samples
- 11K math supplementary data
Benchmarks
- BOOTCAMP-EVAL
- BBEH
- KOR Bench
- MMLU
- AIME
- GPQA Diamond
- Super GPQA
- LCB v6