Anonymizing Sensitive Data in LLM Prompts
➡️ ADVANCED-inference Repo (incl. notebooks in this vid.): https://trelis.com/enterprise-server-...
VIDEO RESOURCES:
Slides: https://docs.google.com/presentation/...
Phi-3 Mini: https://huggingface.co/microsoft/Phi-...
Presidio: https://microsoft.github.io/presidio/...
spaCy model: https://huggingface.co/spacy/en_core_...
OTHER TRELIS LINKS:
➡️ Trelis Newsletter: https://blog.Trelis.com
➡️ Trelis Resources and Support: https://Trelis.com/About
TIMESTAMPS:
0:00 Data Anonymization for LLMs
0:52 Anonymisation Performance
2:20 Video Overview
3:21 Anonymisation Techniques
11:05 Libraries - Presidio, Outlines
13:38 Notebook Demo: Using Presidio for Anonymisation
27:31 Notebook Demo: Using Phi-3 Mini + Outlines
31:35 Notes on vLLM, TGI and GGUF on Mac
35:14 Resources