EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago

TL;DR
Apple has introduced its third generation of Foundation Models (AFM), designed to enhance user experiences while prioritizing privacy. These models, developed in collaboration with Google, include both on-device and server-based options.
✦ Why It Matters
Explore how to integrate Apple’s Foundation Models into your applications for enhanced user experiences.
Key Takeaways
How It Works
AFM 3 Core Advanced employs a sparsely activated architecture, activating only a portion of its parameters based on the task, which optimizes memory usage and processing speed. This allows the model to handle complex requests efficiently by loading weights incrementally, rather than requiring all parameters to be active simultaneously.
Related