Inference - new application | AI Reliability Engineering | LLM Tracing with OpenInference | @fwdays
In this episode, I will be presenting my talk at Fwdays: AI Reliability Engineering: Should We Adopt a New Approach or Continue Using the Traditional Approach? AI products and solutions have become increasingly important in ensuring business competitiveness. However, deploying and operating AI products within the organization’s perimeter creates new challenges in terms of data security and reliability.
To mitigate risks such as data leakage, budgets, compliance with ethical standards and reliability processes, it is crucial to adopt new approaches. In this context, we will look at new challenges and SRE practices specifically adapted for AI using an OpenAI case study and an AutoGPT demo.
00:00 Intro
03:57 Inspiration
06:58 Numbers
08:00 AI Current State
11:55 AIRe Challenges
14:53 AI Observability
26:44 Q&A