[Exclusive] Weights & Biases Round-table // Model Management in a Regulated Environment
MLOps Coffee Sessions Special episode with Weights & Biases, Model Management in a Regulated Environment, fueled by our Premium Brand Partner, @WeightsBiases.
// Abstract
Step into the fascinating world of Language Model Management (LLMs) in a Regulated Environment! Join us for an enlightening chat where we'll explore the intricacies of managing models within highly regulated settings, focusing on compliance and effective strategies.
This is your opportunity to be part of a dynamic conversation that delves into the challenges and best practices of Model Management in Regulated Environments. Secure your spot today and stay tuned for an enriching dialogue on navigating the complexities of navigating the regulated terrain. Don't miss out on the chance to broaden your understanding and connect with peers in the field!
// Bio
Darek Kłeczek
Darek Kłeczek is a Machine Learning Engineer at Weights & Biases, where he
leads the W&B education program. Previously, he applied machine learning
across supply chain, manufacturing, legal, and commercial use cases. He also
worked on operationalizing machine learning at P&G. Darek contributed the first Polish versions of BERT and GPT language models and is a Kaggle Competitions Grandmaster.
Mark Huang
Mark is a co-founder and Chief Architect at Gradient, a platform that helps companies build custom AI applications by making it extremely easy to fine-tune foundational models and deploy them into production. Previously, he was a tech lead in machine learning teams at Splunk and Box, developing and deploying production systems for streaming analytics, personalization, and forecasting. Prior to his career in software development, he was an algorithmic trader at quantitative hedge funds where he also harnessed large-scale data to generate trading signals for billion-dollar asset portfolios.
Oliver Chipperfield
Oliver Chipperfield is a Senior Data Scientist and Team Lead at M-KOPA, where he utilizes his expertise in machine learning and data-driven innovation. At M-KOPA since October 2021, Oliver leads a diverse tech team, making improvements in credit loss forecasting and fraud detection. His career spans multiple industries, where he has applied his extensive knowledge in Python, Spark, R, SQL, and Excel. He also specialized in the building and design of production ML systems, experimentation, and Bayesian statistics.
Michelle Marie Conway
As an Irish woman who relocated to London after completing her university studies in Dublin, Michelle spent the past 12 years carving out a career in the data and tech industry. With a keen eye for detail and a passion for innovation, She has consistently leveraged my expertise to drive growth and deliver results for the companies she worked for.
As a dynamic and driven professional, Michelle is always looking for new challenges and opportunities to learn and grow, and she's excited to see what the future holds in this exciting and ever-evolving industry.
// MLOps Jobs board
https://mlops.pallet.xyz/jobs
// MLOps Swag/Merch
https://mlops-community.myshopify.com/
// Related Links
Fine-Tuning LLMs: Best Practices and When to Go Small // Mark Kim-Huang // MLOps Meetup #124 - • Fine-Tuning LLMs: Best Practices and When ...
-------------- ✌️Connect With Us ✌️ ------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: / dpbrinkm
Connect with Darek on LinkedIn: / kleczek
Connect with Mark on LinkedIn: / markhng525
Connect with Oliver on LinkedIn: / oliver-chipperfield
Connect with Michelle on LinkedIn: / michelle-conway-40337432
Timestamps:
[00:00] Introduction of the panel
[02:23] 10-second snippets
[03:35] Model Management
[06:26] Regulated Environments
[12:09] Model Management vs Traditional ML in the context of LLMs
[16:36] Handling SL Reporting Feedback
[21:34] Model Management Data Quality
[24:02] Security and Compliance in ML
[28:33] Model Pickling vs Live Building
[31:05] Secure Open Source LMS
[32:20] Mistral model
[34:00] Explainability Techniques and Tools
[41:53] Business Stakeholders in Debugging
[44:21] Communicating Model Insights
[48:27] Custom evaluations
[49:40] Effective Collaboration Across Teams
[52:25] Decentralization drive
[55:06] Wrap up