Open-source tool that maps what concepts an LLM has learned into browsable tree structures using hyperbolic geometry
I built HyperSAE, an open-source interpretability tool that extracts what an LLM "knows" and organizes it into tree-shaped concept maps. The idea: LLMs learn concepts hierarchically. "Programming" contains "Python" contain…