AIAny
AI Model2026
Icon for item

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

An uncensored, "abliterated" fork of Qwen3.8-27B that removes refusal behavior by modifying targeted weights and provides multiple GGUF/BF16 quantized variants for local research and deployment, while carrying significantly reduced safety filtering.

Introduction

Altering a model's refusal behavior changes how it handles sensitive prompts and can dramatically widen possible outputs — intentionally or not. This release is a proof-of-concept "abliteration" of Qwen3.8-27B that modifies specific tensors to remove safety refusals and then offers several quantized builds for local use and experimentation.

What Sets It Apart
  • Abliteration approach: specific weight tensors (token_embd, output, ffn_down, ssm_out, attn_output) are targeted and converted/modified to remove refusal behavior rather than retraining or using activation-space edits. The first 15 transformer layers, MTP, and visual components are retained unmodified.
  • Multi-format distribution: provides BF16 base plus multiple GGUF quantized builds (Q2_K_L through Q8_0_L variants, with some weights converted to BF16 and filenames suffixed _L) to balance size, speed, and quality for different local runtimes.
  • Local-runtime compatibility: prepared for common local inference tools (llama.cpp, ollama) and includes guidance for llama-quantize conversion commands so users can run appropriate GGUF variants on CPU/GPU environments.
  • Research-first posture: explicitly described as experimental and uncensored; maintainers warn about reduced safety filtering and recommend monitoring outputs and restricted use cases.
Who it's for and tradeoffs

Great fit if you want a research-oriented, local copy of Qwen3.8 modified to bypass refusal behavior for experimentation, forensic analysis of safety mechanisms, or studying the effect of targeted weight changes across quantization formats. It saves time for users who need quantized GGUF builds ready for llama.cpp/ollama.

Look elsewhere if you need production-ready, safety-hardened models or are building public-facing services; the project reduces safety filtering and carries ethical, legal, and content-moderation risks. Expect unpredictable behaviors and the need for manual output review; not suitable for minors or uncontrolled public deployment.

Information

Categories

More Items

Hugging Face
AI Model2026

Provides per-tensor non-uniform GGUF quantizations of Qwen3.8-27B using GSQ and RCO, delivering high accuracy at 2.5–3.5 bits and including a BF16 vision projector for multimodal use. Optimized to run unmodified in llama.cpp, Ollama, and LM Studio.

Hugging Face
AI Model2026

Generates L2-normalized multimodal embeddings (default 4,096‑D) for text, images, videos and visual documents, supporting interleaved inputs and flexible dimension truncation (Matryoshka). Designed for cross-modal retrieval, ranking and downstream retrieval systems; audio is not supported.

Hugging Face
AI Model2026

Drop-in abliterated (refusal-removed) build of GLM-5.3-Flash that bakes refusal-direction removal into block-FP8 safetensors, yielding an uncensored 320B (18B active) multimodal MoE model with a 1M-token context. Intended for red-teaming, interpretability, and robustness research; MIT license; not for production without added guardrails.