OpenEuroLLM 9B post-training
How the OpenEuroLLM 9B 256K base model is post-trained into a multilingual assistant on the Leonardo supercomputer: Stage 1 Instruct SFT → Stage 2 Reasoning SFT → Stage 3 Tool-use SFT → Stage 4 DPO → Stage 5 RL. The documents below are the working record of the run. They are updated as it progresses, and are written so the pipeline can be reproduced.
| Document | What it contains |
|---|---|
| Plan and decisions | goals, status dashboard, dated decisions with reasons, stage plans, evaluation protocol, budget, risks, next steps |
| Playbook | the reproducible record: data, configs, hashes, job IDs, costs, results, pitfalls, exact commands |
| RL run program | Stage 5 run by run: questions, run cards, results, stop rules, merging policy |
| Stage 5 data and rewards | RL data pools with licenses, rewards, difficulty windows, environment tiers |
Code: qwen35-posttrain (SFT/DPO data builders, trainers, Slurm
launchers, evaluation scripts) and oellm-rlvr (RL control plane).
Related benchmark: EUROPA Reasoning.
Paths in the documents use placeholders ($WORK, $SCRATCH, <account>); model checkpoints are private until
evaluation and license review.