"AGI" is here - and it's stupid?
Recently, there is a new wave of "AGI is here" commentary, and to the regular everyday person where doing a simple task is "AGI" - sure AGI is here then and has been since GPT-3.
AGI ≠ AGI anymore apparently. AGI means a model can generalize any problem and come up with a novel solution. ARC AGI is a series of tests by François Chollet that have been breaking "AGI" every cycle.
The newest test is a game, so lets play it and talk about AGI. Honestly this is exhausting.
Links
On the Measure of Intelligence: https://arxiv.org/abs/1911.01547
ARC Prize & tests: https://arcprize.org/
Stochastic Goose: https://github.com/DriesSmit/ARC3-sol...
Lex Podcast citation: • NVIDIA CEO says AGI is already here | Jens...
Chapters
0:00 Apparently, AGI is here?
0:25 Podcast citation
1:10 About AI benchmarking
2:50 Enter ARC AGI benchmarks
4:41 Arc AGI-1 Benchmark
5:47 Arc AGI-2 Benchmark
6:37 Arc AGI-3 - The one breaking all models
9:00 The current leader is a CNN, not an LLM
12:18 Replays and Agentic Harnesses
14:36 I honestly don't believe in AGI