Curious Ducks with the Free Energy Principle
BEHOLD! direct.mit.edu/neco/article/36/9/1854/123686/Intrinsic-Rewards-for-Exploration-Without-Harm
I'm trying to make that open-access, until then here's a free version: arxiv.org/pdf/2405.07473
github.com/oist-cnru/curious_maze
patreon.com/thinkstr
00:00 Introduction
00:36 Let's Explore a Biased T-Maze
02:09 Let's Make a Duck Do It
03:45 How This Duck Works
04:42 Go, Duck, Go!
06:09 Entropy
07:23 Go, Entropy Ducks, Go!
07:53 Curiosity (Prediction Error)
10:19 Go, Curious Duck, Go!
11:59 Curiosity (Hidden State, FEP)
15:56 Go, Curious Duck, Go!
17:02 Duck's Point-of-View
18:05 Expanding T-Maze
19:43 Who Reviewed This Paper?
22:52 Also I Have a Patreon