“The TULU-2 70B model was trained by applying the Zephyr recipe using a JAX implementation of DPO on TPUs, and the initial training run was successful without any parameter tuning or ablations.”