Claude Sonnet vs Gemini Pro | AI API Design Showdown
Welcome to the AI API Design Showdown!
In this episode we put @anthropic-ai Claude Sonnet 3.5 up against @googledeepmind Gemini Pro 1.5 to see which of them can create the best OpenAPI document using the exact same prompt, then use RateMyOpenAPI to score their original and use the feedback to create an improved attempt.
One of them ABSOLULTELY CRUSHED IT.
#ai #anthropic #geminipro #llm #openapi
00:00 Intro
00:12 Anthropic Claude Sonnet 3.5 (First Attempt)
01:18 Claude's RateMyOpenAPI Score
01:55 Getting feedback from RateMyOpenAPI
02:22 Anthropic Claude Sonnet 3.5 (Revised Attempt)
03:02 Rating the revised OpenAPI doc!
04:22 Google Gemini Pro 1.5 (First Attempt)
05:11 Gemini feedback from RateMyOpenAPI
05:50 Revising Gemini's OpenAPI document with feedback
06:24 Rescoring Gemini Pro's revised OpenAPI doc
Tools used in this video:
Anthropic API Workbench: https://console.anthropic.com/workbench
Google Vertex AI Studio: https://cloud.google.com/vertex-ai
Rate My OpenAPI: https://zuplo.link/rmoa