GPT-NeoX-20B Model Announcement And Quick Comparison With GPTJ
EleutherAI has once again announced that it is releasing another large GPT3 like model, this time with 20 billion parameters! In this video, I go over the announcement and briefly compare this new model with GPTJ.
blog post: https://blog.eleuther.ai/announcing-20b/
model playground: https://goose.ai/
Timestamps:
00:00 - Intro
01:04 - Model Metrics On Datasets
02:00 - Model Performance On Factual Information
02:31 - Goose AI Model Host
03:11 - Comparing GPTJ With GPT Neo 20B
03:38 - GPTJ Results
04:21 - GPT Neo 20B Results
05:15 - Outro And Future Plans