In this video i show off this software "LM Studio" which lets you download any of the models on hugging face and run inference on your local machine.
Another awesome feature it has is that it can run it's own inference server in which you can easily swap out OpenAI API for it!