Llama 3.2 3b Review Self Hosted Ai Testing on Ollama - Open Source LLM Review
Llama 3.2 is the latest open source llm models out from Meta and the 1b and 3b are out on Ollama. I'm using Open WebUI and ollama to test the 3b in fp16. I hope the 90b and 11b vision are supported soon. These new multimodal 1b and 3b models are aimed at edge use cases and very small VRAM footprints. Will these take self hosted Ai to the next level for those with 8GB gpus? Check out how the llama 3.2 - 3b at fp16 and q4 handle our Ai Testing questions!
Chapters
0:00 Llama 3.2 3b fp16 Review
1:23 LLM Video Game Coder
2:42 Armageddon with a Twist
3:50 Sentence and Word Parsing
4:28 Arbitrary Pair Arrays
5:02 Which Number is Larger?
5:43 Recipe Creativity
7:19 Physical Fitness Coach
9:31 Peppermint
10:04 Calendaring Cat
10:42 100 decimals of Pi
11:04 Retesting at q4
15:17 Conclusion
Be sure to 👍✅Subscribe✅👍 for more content like this!
Join this channel / @digitalspaceport
Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!
Digital Spaceport Website
🌐 https://digitalspaceport.com
🛒Shop (Channel members get a 3% or 5% discount)
Check out https://Shop.DigitalSpaceport.com for great deals on hardware and merch.
*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****