Hidden Layers: Decoded (Meta's Llama 3.2, OpenAI, Microsoft, Nobel Prize Reactions, GraphRAG & more)
In this episode of Hidden Layers, Ron Green is joined by KUNGFU.AI's Michael Wharton and Dr. Steve Kramer to discuss the latest news in AI. They cover OpenAI’s leadership turnover, the rise of smaller, more efficient AI models, and the growing importance of AI governance. Plus, they explore Meta's Llama 3.2, a new multimodal model, and share insights from recent AI conferences. The conversation concludes with a discussion of AI experts winning Nobel Prizes for their groundbreaking work in physics and chemistry.
0:00 - Introduction and AI News Overview
1:05 - OpenAI Leadership and Challenges
3:17 - OpenAI's Future: Bullish or Bearish?
7:38 - Microsoft’s Relationship with OpenAI
13:06 - AI Conference Highlights: LLMs and Governance
16:59 - Meta's Llama 3.2 and Multimodal Models
21:57 - Intelligence at the Edge of Chaos
37:00 - Nobel Prize Winners in AI and Science
Resources:
-The EPDS speaker was Dr. William Gilpin, here's the paper in question: https://arxiv.org/abs/2110.05266
-Llama 3.2 release: https://ai.meta.com/blog/llama-3-2-co...
-Paper: "Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI" https://arxiv.org/pdf/2409.14160
Intelligence at the Edge of Chaos — https://arxiv.org/abs/2410.02536
-"The Shift from Models to Compound AI Systems" https://bair.berkeley.edu/blog/2024/0...
-"Enhancing AI Retrieval Systems with Structured Data" https://gradientflow.substack.com/i/1...
-"The EU AI Act: A Pathway to AI Governance with Fiddler" https://www.fiddler.ai/blog/the-eu-ai...
-Kramer, S., and M. Marder. "Evolution of river networks." Physical Review Letters 68, no. 2 (1992): 205.