Benchmarks compare open models against closed products, not closed models. We might be missing what were actually paying for
So this has been on my mind for a while and it kinda bugs me. Every time someone benchmarks glm-5.2 or deepseek against claude or gpt, the closed one wins on some tasks and people just assume the underlying model is smarter. but thats not really what w…