LM Studio - The Easiest Way to get Started with Hugging Face LLMs
- By Bruce Nielson
- ML & AI Specialist
Want to get started with a local Hugging Face Large Language Model (LLM) but aren’t technical enough to just starting writing code?
No worries! There is a particularly easy way to get started with local Hugging Face LLMs without needing to write a line of code. Just download LM Studio!
Now download the correct version for your Operating System. If you are a Windows shop like us, then select this button:
Or whichever is appropriate for you.
The tool itself is quite easy to use:
Now select the little magnifying glass to find a model off of the Hugging Face hub:
For fun, search for ‘Story’ and press Go: (Or a good alternative is Mistral Instruct)
Now go to the ‘Chat’ (the little dialogue bubble) and select the model you just downloaded:
Once it is loaded, you can chat with your own private model.
There are hundreds of models to play with on the Hugging Face hub!
Why might you want to download a local LLM? One obvious reason is that Open AI’s ChatGPT and Google’s Gemini are both costly when used via an API. So, learning to play with a local LLM might make sense. Another reason might be that you want to circumvent the sometimes overly protective ‘safety rails’ they put on their LLMs. Or maybe you need a finetuned LLM for a specific purpose. Hugging Face has an amazing array of those.
But whatever your reason, welcome to the wide world of Hugging Face LLMs!
If you would like to learn more about Hugging Face, be sure to check out other other article on how to get started with Hugging Face and its' pipelines!
https://www.mindfiretechnology.com/blog/archive/an-introduction-to-hugging-face-and-their-pipelines/