How to Run LLaMA Model on ANY PC (Any OS, NO GPU REQUIRED)
Alpaca.cpp Github Repository: https://github.com/antimatter15/alpac...
Join the Discord server: / discord
The $30 microphone I'm using: https://amzn.to/3VkMDKB
Custom prompt: ### Instruction: {YOUR QUESTION HERE}\n\n### Response:
Timestamps:
00:00:00 Intro
00:00:20 Custom prompt
00:01:05 Full 65B parameter model THEORETICAL requirements
00:01:58 Writing code with 7B model
00:02:51 Start of Tutorial
00:03:42 Download quantized model
00:04:28 How to run the 7B model after downloaded
00:04:38 How to run the 13B model
00:05:18 RAM requirements for 13B
00:05:50 Comparing 7B to 13B
00:06:20 Unexpected results with 13B model
00:06:49 Pros/Cons to ChatGPT
00:07:25 Conclusion to 7B vs 13B
00:07:45 Running models above 13B parameters
00:09:18 If you have problems