EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Hacker News·Sep 6·5 min read
It took a year to ship WebAssembly in Anubis
TL;DR
Anubis, a new web protection tool, employs a Proof-of-Work scheme to deter aggressive web scraping by AI companies. This solution aims to balance server accessibility while developing more sophisticated methods for identifying non-human traffic.
✦ Why It Matters
Consider disabling privacy plugins like JShelter to ensure proper functionality of Anubis on your site.
Key Takeaways
- Implement Anubis to reduce scraping on your website.
- Understand the implications of Proof-of-Work for user experience.
- Monitor the effectiveness of fingerprinting techniques over time.
- Disable conflicting browser plugins to ensure proper functionality.
How It Works
Anubis employs a Proof-of-Work mechanism that requires users to perform a small amount of computational work before accessing the site. This additional load is manageable for individual users but becomes prohibitively expensive for automated scrapers, thereby deterring mass scraping attempts.