Rockchip RK3576 NPU with Armbian on the Mekotronics R57
In this video I show you running a Large Language Model (LLM) on the NPU of the Rockchip RK3576.
Here is the link to the video of Anton Maltsev: • LLMs for RockChip. Guide for RKLLM. R...
And here is my video on how to compile the software: • Running LLMs on the NPU of the Rockch...
You can find the program to use the NPU here: https://github.com/Pelochus/ezrknn-llm
Converted model files: https://huggingface.co/Pelochus/ezrkl...
Allow more open files: ulimit -n 16384
Check NPU load: sudo cat /sys/kernel/debug/rknpu/load
00:00 Intro
01:15 System Info
02:40 WebGL Aquarium
04:50 ulimit
05:18 RKLLM qwen-chat 1.8B
If this video was helpful, please like, comment and subscribe!
Bluesky: https://bsky.app/profile/livinglinux....
#mekotronics #rockchip #RK3576 #armbian #ai