Opening the Black Box: Unison Zero Parameter Model
Opening the Black Box: Unison Zero Parameter Model

Opening the Black Box: Unison Zero Parameter Model

Opening the Black Box: Unison Zero Parameter Model

πŸ”¬ Today in the desktop lab: we opened the black box

Big day. We built a full instrument suite for reading the inside of trained neural networks β€” and it produced findings on the first day of operation. Everything is public, pre-registered, and reproducible.

The setup, in one line: take any AI model's weights, transform them into a spectral basis (think: a prism for numbers), and compare against shuffled copies of the same numbers. Whatever signal survives can only come from where training placed the values β€” pure structure, not statistics.

What we found today:

🧭 Every model carries the law in the same place. The token embedding β€” the table mapping words to geometry β€” lights up in 11 out of 11 models tested, from 4B to 1 TRILLION parameters, every training recipe. Models we'd called "quiet" for days (including a trillion-parameter one) were never quiet β€” we were pointing the instrument at the wrong organ.

πŸ’₯ The signal IS the intelligence. Delete the loudest 1.5% of spectral coefficients from GPT-2 and it's destroyed. Delete the same number at random: almost nothing happens. \~150x more damage for the same deletion budget. The structure we detect isn't a trace of the computation β€” it is the computation.

⏱️ We watched training write it. Using published training checkpoints, we saw the law arrive in real time: nothing β†’ embedding wakes first (step 256) β†’ peak (\~step 4000) β†’ settles into a stable plateau. And in controlled experiments, the gradients carry the law by step 4 β€” the optimizer is what decides whether it deposits.

🧬 Models remember their training data β€” and we can read it. Our probes rank a model's true training corpus first out of a lineup, and models replay memorized public text word-for-word (Gettysburg Address: 9 words verbatim) while showing zero on text they never saw.

🧠 Reasoning is measurable structure. A model's "thinking" text has a measurably different counted signature than its answers, and trained attention sits closer to the theory's predicted cascade (1/2, 1/4, 1/8…) than to uniform in 12/12 layers.

β€” β€” β€”

πŸ“¦ Where it all lives:

β€’ Toolkit + guide: https://github.com/MettaMazza/UnisonAI β†’ omni/benchmarks/INTERPRETABILITY.md (every instrument documented β€” clone it and run your own investigation; one command reproduces the headline verdict on a fresh machine)

β€’ Theory: https://github.com/MettaMazza/Smithian-Fold-Theory-Of-Everything

β€’ Papers (updated to v4.3 today): https://doi.org/10.5281/zenodo.21364144 + https://doi.org/10.5281/zenodo.21364145

πŸ”­ Ongoing right now:

β€’ A scaling ladder is running overnight (does the training "peak" move with model size? β€” three model sizes, real checkpoints)

β€’ Next up: fitting the deposition curve to a law, probing attention's last quiet corner, and the extractor that reads a trained model's function out as exact counted structure β€” food for the zero-parameter engine

Seven instruments built, calibrated, and run in one day. Every number from a committed, timestamped result file. πŸ§ͺ

submitted by /u/A_Freaky-Frog
[link] [comments]