p-e-w/heretic

Ah yes, those pesky Chinese backdoors that no single instance was ever found, even though Chinese open-weight model are a thing for many years now. Many people burn through millions of tokens on these models every day - surely someone would have triggered one of those backdoors, right? Or that pesky CCP censorship and propaganda baked into the model, which any random guy can remove from whichever model they want as a single weekend side project with an off-the-shelf tool[1]. (Try it. It's fun. I've done it myself.) [1]: https://github.com/p-e-w/heretic

…it, it does agent skills and mobile actions, all local to the phone? Whaaaat? (Have to check out later! Anyone have any tips yet?) I don't normally do the whole "abliterated" thing (dealignment) but after discovering https://github.com/p-e-w/heretic , I was too tempted to try it with this model a couple days ago (made a repo to make it easier, actually) https://github.com/pmarreck/gemma4-heretical and... Wow. It worked. And... Not having a built-in nanny is fun! It's also possible to make an MLX version of it, which runs a little faster on Macs, but won't work through Ollama unfortunately. (LM Studio maybe.) Runs great on my M4 Macbook Pro w/128GB and likely also runs fine under 64GB... s…

…l, then anthropic, openai, meta, google... all these companies should have deleted their LLMs long ago. This wording disgusts me. Heck, it would be amazing if we had more models without guardrails - some of the models that are produced via heretic[1] are actually quite nice to use - in particular, I've enjoyed investigating Chinese censorship by interacting with an abliterated model of Qwen3.8-27b. If security is really a concern, then secure your systems - don't attempt to dumb-down the tools we use. If someone breaks your window, then they are responsible, not the hammer they use to do so. [1]: https://github.com/p-e-w/heretic

Here's a widely used toolkit: https://github.com/p-e-w/heretic Distributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.

Personally the only 'enthusiast' modified qwen 3.6 27b or 3.6 35b-a3b I've found useful are the ones that have been run through heretic and adversarial data sets for innocent/dangerous prompts, to produce uncensored LLMs. They have some niche non-coding uses for things that a commercial LLM will never talk about. https://github.com/p-e-w/heretic

They are open weight, so you can abliterate: https://github.com/p-e-w/heretic You can finetune and mould it to whatever you want.

Sounds like something that heretic or similar might be useful for? https://github.com/p-e-w/heretic

For open-weights models, censorship removal is now a "solved" problem. If you wait a few days after a new model release, someone will have made a heretic ( https://github.com/p-e-w/heretic ) version with the censorship removed, so in a way the only use for censorship now is to avoid lawsuits, not reduce improper usage.

That doesn't stop/prevent abliteration. The creator of XTC/DRY is also a chad who makes sure that you really can access the full model capabilities. Censorship is the devil. https://github.com/p-e-w/heretic

You may be interested in heretic. People often post models to hf that have been un-censored https://github.com/p-e-w/heretic