Timeline
00:00 Introduction
01:42 Project Setup
02:49 Resources Configuration
09:01 GitHub Assets
12:51 Custom I/O manager & Webscraping Assets
17:34 Prompting Asset
19:00 Prompting Example
23:00 Outro
In this video, Developer Advocate Alex Noonan uses Dagster to builds a Retrieval-Augmented Generation implementation using Dagster's GitHub and documentation to answer questions about Dagster.
In this guide, Alex covers the following topics:
Dagster Resources
Custom I/O managers
Webscraping
Embedding text in a vector Database
The Dagster OpenAI integration
Declarative Automation
The finished project can be found here: https://github.com/dagster-io/dagster...
Dagster Open Platform: https://github.com/dagster-io/dagster...
Join our community! https://dagster.io/slack