Installing BitsAndBtyes for Windows - So That You Can Do PEFT

• By Bruce Nielson
• ML & AI Specialist
• Posted March 26, 2024

Many tutorials within the Huggingface ecosystem, especially ones that make use of PEFT or LoRA for LLM training, will require the use of a library known as BitsAndBytes. Unfortunately, BitsAndBytes is not yet fully supported on Windows. However, you are not out of luck and in this tutorial, we will share the process we used to get it working properly on Windows.