ModelClash: Dynamic LLM Evaluation Through AI Duels

Hi!

I've developed ModelClash, an open-source framework for LLM evaluation that could offer some potential advantages over static benchmarks:

• Automatic challenge generation, reducing manual effort
• Should scale with advancing model capabilities
• Evaluates both problem creation and solving skills

The project is in early stages, but initial tests with GPT and Claude models show promising results.

I'm eager to hear your thoughts about this!