Create and Monitor LLM Summarization Apps using OpenAI and WhyLabs
Free WhyLabs Signup: https://whylabs.ai/free
Notebook: https://bit.ly/sum-monitor
LangKit github (give us a star!) https://github.com/whylabs/langkit
Join The AI Slack group: https://bit.ly/r2ai-slack
Try Our Expert Plan FREE for 30 Days! https://bit.ly/coupon-wlcommunity
Join this hands-on workshop to build and monitor a summarization application using OpenAI, LangKit, WhyLabs, and Gradio!
The ability to effectively evaluate and monitor large language models (LLMs) like GPT from OpenAI has become essential in the rapidly advancing field of AI. WhyLabs, in response to the growing demand, has created a powerful new open source tool named LangKit, to ensure LLM applications can be better evaluated, monitored, and operated responsibly.
Join our workshop designed to equip you with the knowledge and skills to use LangKit with OpenAI models. Guided by our team of experienced AI practitioners, you'll learn how to evaluate, troubleshoot, and monitor large language models more effectively.
Once completed, you'll also receive a certificate!
This workshop will cover how to:
Make an API call to OpenAI for GPT models
Change the LLM behaviors by creating a system prompt for summarization
Evaluate LLM system prompts, responses, and user interactions
Configure acceptable limits to indicate things like malicious prompts, toxic responses, hallucinations, and jailbreak attempts.
Set up monitors and alerts to help catch undesirable behavior and LLM performance drift
Create a simple application user interface with Gradio
What you’ll need:
A free WhyLabs account (https://whylabs.ai/free)
OpenAI Account with API access
A Google account (for saving a Google Colab)
Who should attend:
Anyone interested in building applications with LLMs, AI Observability, Model monitoring, MLOps, and DataOps! This workshop is designed to be approachable for most skill levels. Familiarity with machine learning and Python will be useful, but it's not required to attend.
By the end of this workshop, you’ll be able to implement ML monitoring techniques to your large language models (LLMs) to catch deviations and biases.
Bring your curiosity and your questions. By the end of the workshop, you'll leave with a new level of comfort and familiarity with LangKit and be ready to take your language model development and monitoring to the next level.
About the instructor:
Sage Elliott enjoys breaking down the barrier to AI observability, talking to amazing people in the Robust & Responsible AI community, and teaching workshops on machine learning. Sage has worked in hardware and software engineering roles at various startups for over a decade.
Connect with Sage on LinkedIn: / sageelliott
About WhyLabs:
WhyLabs.ai is an AI observability platform that prevents data & model performance degradation by allowing you to monitor your data and machine learning models in production. https://whylabs.ai/
Check out our open-source data & ML monitoring projects
LangKit: https://github.com/whylabs/langkit
whylogs: https://github.com/whylabs/whylogs
Do you want to connect with the community, learn about WhyLabs, or get project support? Join the WhyLabs + Robust & Responsible AI community Slack: https://bit.ly/rsqrd-slack