Asap7772
/

Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.1-loss-sigmoid-rpo-1.0-ckpt-135

Model card Files Files and versions

Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.1-loss-sigmoid-rpo-1.0-ckpt-135 / zero_to_fp32.py

Commit History

Upload checkpoint from checkpoint-135

884089d
verified

Asap7772 commited on Sep 16