Lab 9: Web Deployment (Full Stack Deep Learning - Spring 2021)
New course announcement ✨
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
https://www.scale.bythebay.io/llm-wor...
Hope to see some of you there!
--------------------------------------------------------------------------------------------- - First, we speed up our ParagraphTextRecognizer model with TorchScript
Next, we wrap the model in a web app, and send it some requests
We package up the web app and model as a Docker container, and run it that way
Lastly, we prepare to deploy as a serverless function using AWS Lambda, getting it working locally.