Getting Started with Databricks Connect and Serverless Compute
When setting up Databricks Connect, it's essential to pin a specific version to ensure seamless compatibility with your Databricks Runtime version. This proactive approach guarantees that your code remains stable and functional, even when new versions of Databricks Connect are released. By pinning a version, you can avoid potential disruptions and ensure a smooth experience. Today the version to be used with serverless is 15.1
Chapters
• 0:00 - Introduction to Youssef & Databricks Connect V2 Overview
• 1:50 - Installing and Upgrading Databricks Connect
• 2:40 - Initial Configuration: Logging In and Cluster Setup
• 3:50 - Verifying Configuration and Running on Classic Architecture
• 4:50 - Switching to Serverless Compute: Method 1 (Temporary Profile Change)
• 5:50 - Switching to Serverless Compute: Method 2 (Persistent Config Modification)
• 6:40 - Conclusion
Resources & Documentation:
Setup Databricks Connect: https://docs.databricks.com/en/dev-to...
Configure a connection to Serverless Compute: https://docs.databricks.com/en/dev-to...
Connect with the community:
🚀 LinkedIn Youssef Mrini: / youssefmrini
🚀 Subscribe to the NextGenLakehouse Newsletter: https://www.nextgenlakehouse.com/
👥 Join Databricks subreddit Community: / databricks
🐦 Follow us on X: https://x.com/YoussefMrini
📸 Follow us on Instagram: / nextgenlakehouse
🎥 Follow us on TikTok: / nextgenlakehouse
💻 Explore the Databricks Developer Hub: https://developers.databricks.com/