To fix the way we test and measure models ... more than 2,000 real-world programming problems pulled from the public GitHub repositories of 12 different Python-based projects.