“At the time of its launch, Devin achieved a 13% success rate on the SWE-bench benchmark, surpassing the previous state-of-the-art performance of 3-4%.”