FlagOS-Compressor converts and quantizes local Hugging Face safetensors checkpoints. It supports BF16 conversion, selected-layer quantization, calibrated quantization, and output validation.
Why use FlagOS-Compressor
Convert supported low-precision checkpoint weights to BF16.
Quantize selected model modules with MSE, GPTQ, AWQ, or native AutoRound workflows.
Inspect source checkpoints and validate generated artifacts from one CLI.
Install
Install the project from a source checkout in editable mode:
Run quantization with --dry-run before writing a large output directory. Structural validation does not replace runtime or performance testing. See the output validation guide for the complete verification workflow.
FlagOS-Compressor
FlagOS-Compressor converts and quantizes local Hugging Face
safetensorscheckpoints. It supports BF16 conversion, selected-layer quantization, calibrated quantization, and output validation.Why use FlagOS-Compressor
Install
Install the project from a source checkout in editable mode:
See the installation guide for prerequisites and optional extras.
Quick start
Inspect a checkpoint, quantize selected weights, and validate the output:
Run quantization with
--dry-runbefore writing a large output directory. Structural validation does not replace runtime or performance testing. See the output validation guide for the complete verification workflow.Documentation and help
Start with the documentation portal.