llama3 (8b, 70b) summary that you must know
Summarized Llama 3 8b, 70b released on April 2024.
Keywords: llama 3 8b, 70, SFT, PPO, DPO, GQA.
Here we get to know llama 3 benchmarks against llama 2 and similar size model and key differences among them.
Reference:
https://ai.meta.com/blog/meta-llama-3/
https://github.com/meta-llama/llama3/...
https://arxiv.org/pdf/2305.13245