EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Hacker News·Aug 2·5 min read
Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers
TL;DR
A study reveals that 94.8% of small and mid-sized business websites are not mentioned in AI-generated answers to buying questions, despite only 8.9% blocking AI crawlers. This highlights a significant visibility gap for these businesses in AI-assisted search results.
✦ Why It Matters
Businesses should optimize their websites for AI visibility to increase chances of being cited in AI responses.
Key Takeaways
- Ensure your site allows AI crawlers in robots.txt.
- Implement structured data to improve machine readability.
- Regularly audit your website for AI visibility.
- Consider using Gemini for better AI mention rates.
Full Summary
The AI Visibility Study measures how often small and mid-sized businesses are cited in AI assistant responses to buying-intent questions. It found that 94.8% of the 193 audited sites were never named in AI answers, with only 1.9% being mentioned at all.
The study also assessed machine readability, revealing that 8.9% of sites block AI crawlers via their robots.txt file. Notably, Gemini had the highest mention rate at 2.9%.
The methodology involved querying multiple AI assistants and analyzing the sites' structured data and crawl signals. These findings indicate that many businesses are missing opportunities for visibility in AI-driven search results.