Google AI Mode: Image Analysis Powers Deeper Search
Google is enhancing its **AI Mode**, a Google Search experiment, by introducing **multimodal search capabilities**. This update allows users to ask questions about **uploaded photos** or images captured with their cameras, enabling a more **interactive and in-depth search experience**.
Powered by **Google Lens' multimodal capabilities**, AI Mode can now understand the **entire scene within an image**. This includes recognizing the relationships between objects, their materials, colors, shapes, and arrangement.
How it Works
Using a technique called **"query fan-out,"** AI Mode formulates multiple questions about the image and its contents. This allows it to provide more **detailed information** compared to a traditional Google search.
Imagine taking a photo of your bookshelf and asking: “If I enjoyed these, what are some similar books that are highly rated?” AI Mode can identify each book and provide a list of recommended titles with links for further exploration and purchase.
Furthermore, users can ask **follow-up questions** to refine their search. For example: “I’m looking for a quick read. Which one of these recommendations is the shortest?”
Availability Expansion
Google is expanding access to AI Mode to **millions more users** enrolled in Google Labs. Previously, this feature was exclusive to Google One AI Premium subscribers.
Launched last month, AI Mode is designed to compete with services like **Perplexity** and **OpenAI’s ChatGPT Search**. Google plans to continue refining the user experience and expanding the functionality of this feature.
1 Image of AI Search:
Source: TechCrunch