Despite techniques to get LLMs to "unlearn" bad knowledge, it turns out that when you quantize them for deployment, much of that knowledge is recovered.
Despite techniques to get LLMs to "unlearn" bad knowledge, it turns out that when you quantize them for deployment, much of that knowledge is recovered.