I built an LLM-powered simulator that models X’s leaked 2026 production ranking algorithm to score drafts locally
I built an LLM-powered simulator that models X’s leaked 2026 production ranking algorithm to score drafts locally

I built an LLM-powered simulator that models X’s leaked 2026 production ranking algorithm to score drafts locally

When X dropped their latest production ranking pipeline code and model checkpoints, a lot of the discussion online devolved into generic marketing advice. As a developer, I wanted to see if we could actually build a local, deterministic simulation environment to map out exactly how the platform grades text before it ever hits a server.

I’ve spent some time building an open-source tool called XViral that does exactly that. It's written in Python and uses LLM orchestration to recreate the exact multi-headed scoring environment described in the release.

Repo: https://github.com/ninjahawk/XViral

The coolest engineering hurdle was dealing with the withheld parts of the algorithm. X's release omitted the exact prompt parameters for their native Grok content judges, but they left the strict input/output schemas behind. I used a local LLM loop to emulate these black-box judges against those exact schemas—specifically tracking how the algorithm isolates systemic signals.

Here are a few fascinating algorithmic mechanics the simulation handles that completely contradict standard social media folklore:

The Hardcoded "Slop Score": The pipeline doesn't just look for keywords; it feeds text and media through vision-language judges that assign an integer slop_score (measuring repetitive structural templates) alongside a quality_score ("banger" threshold).

Extreme Down-Weighting Metrics: The negative feedback loops are brutally punishing compared to positive ones. In the legacy weight configurations, a single user report hits a post with a massive −369 penalty, completely erasing the value of +0.5 for a standard like.

The Nineteen Engagement Heads: The ranking algorithm doesn't treat engagement as a monolith. It runs nineteen distinct prediction heads simultaneously (predicting separate probabilities for replies, long-dwell times, mutes, etc.) before aggregating them into the final "For You" score.

I’ve open-sourced the entire simulation architecture on GitHub under a permissive license so people can inspect the scoring formulas, run their own text drafts through the local pipeline, or adapt the LLM judge-emulation logic for other algorithmic platforms.

I'd love to get this community's thoughts on using LLMs to simulate proprietary or withheld judge layers in open-source releases. Are there better ways to calibrate the model weights to match the actual production distribution?

submitted by /u/TheOnlyVibemaster
[link] [comments]