Charting LLMOps Odyssey // Yinxi Zhang @ Databricks // AI in Production Talk
Brought to you by our Premium Brand Partner @Databricks
//Abstract
In this presentation, Yinxi Zhang navigates the iterative development of Large Language Model (LLM) applications and the intricacies of LLMOps design. They emphasize the importance of anchoring LLM development in practical business use cases and a deep understanding of one's own data. Continuous Integration and Continuous Deployment (CI/CD) should be a core component for LLM pipeline deployment, just as in Machine Learning Operations (MLOps). However, the unique challenges posed by LLMs include addressing data security, API governance, the imperative need for GPU infrastructure in inference, integration with external vector databases, and the absence of clear evaluation rubrics. The audience is invited to join as Yinxi illuminates strategies to overcome these challenges and make strategic adaptations. Yinxi's journey includes reference architectures for the seamless productionization of RAGs on the Databricks Lakehouse platform.
//Bio
Yinxi Zhang is a Staff Data Scientist at @Databricks, where she works with customers from various verticals to build end-to-end AI solutions. Prior to joining Databricks, Yinxi worked as an ML specialist in the energy industry for 7 years. She holds a Ph.D. in Electrical Engineering from the University of Houston. Yinxi is a former marathon runner and is now a happy yogi.
// Sign up for our Newsletter to never miss an event:
https://mlops.community/join/
// Watch all the conference videos here:
https://home.mlops.community/home/col...
// Check out the MLOps Community podcast: https://open.spotify.com/show/7wZygk3...
// Read our blog:
mlops.community/blog
// Join an in-person local meetup near you:
https://mlops.community/meetups/
// MLOps Swag/Merch:
https://mlops-community.myshopify.com/
// Follow us on Twitter:
/ mlopscommunity
//Follow us on Linkedin:
/ mlopscommunity