Dario Amodei says at the beginning of the year, models scored ~3% at a professional software engineering tasks benchmark. Ten months later, we’re at 50%. He thinks in another year we’ll probably be at 90%
Dario Amodei says at the beginning of the year, models scored ~3% at a professional software engineering tasks benchmark. Ten months later, we’re at 50%. He thinks in another year we’ll probably be at 90%