Can transformers load GGUF files?

Yes. Passing a GGUF file name as gguf_file to from_pretrained loads it. On Apple Silicon, the weights stay packed and run on ggml Metal kernels, according to Hugging Face.

Is transformers free to use?

Yes. It is open source under the Apache 2.0 licence and installed with pip.

TechAILatest.newsTrackers

Open-source machine learning library

Hugging Face Transformers

Transformers is Hugging Face's open-source Python library for defining, loading, training and running machine learning models, with implementations for most open-weight model architectures. It loads checkpoints from the Hugging Face Hub through from_pretrained, serves models over an OpenAI-compatible API with transformers serve, and since September 2026 runs llama.cpp GGUF quantized files.

Last reviewed 28 Oct 2026 · by Hugging Face

Facts at a glance

Developer	Hugging Face
Type	Python library for model definition, training and inference
License	Apache 2.0
GGUF packed inference	Apple Silicon (MPS) only, Qwen3.5 and compatible Qwen3.8 architectures at launch source
Serving	transformers serve, OpenAI-compatible API source

Questions people ask

Can transformers load GGUF files?: Yes. Passing a GGUF file name as gguf_file to from_pretrained loads it. On Apple Silicon, the weights stay packed and run on ggml Metal kernels, according to Hugging Face.
Is transformers free to use?: Yes. It is open source under the Apache 2.0 licence and installed with pip.