Multimodality with Gemini
Compared to text-only LLMs, Gemini Pro Vision's multimodality can be used for many new use cases:
Example use cases with text and image(s) as input:
Detecting objects in photos
Understanding screens and interfaces
Understanding of drawing and abstraction
Understanding charts and diagrams
Recommendation of images based on user preferences
Comparing images for similarities, anomalies, or differences
Example use cases with text and video as input:
Generating a video description
Extracting tags of objects throughout a video
Extracting highlights/messaging of a video
Objectives
Use the Vertex AI Gemini API to generate text from text, image(s), and video prompts.