| I built an AI World Cup commentator and tested it on the recent USA vs Belgium match, using a Donald Trump style commentator voice. The live pipeline uses: RTMP goes into Agora Media Gateway, Agora converts it into RTC, the browser plays the Agora RTC stream, and a Python backend joins the same channel to sample video frames. The AI generates short commentary, runs TTS, and publishes the voice back into the same Agora RTC session. The tricky part is sync. Football moves fast, so I let the AI watch the real time feed while viewers see a slightly delayed video feed. That makes the AI commentary line up better with the action on screen. It’s funny, sometimes surprisingly close, and still very rough. I don’t see this as replacing human commentators. I’m more interested in optional commentary layers for accessibility, alternate languages, tactical explanations, or personality based streams. I’ve open sourced the project too. If people are interested, I’m happy to share it [link] [comments] |