EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Lobsters·6d ago·5 min read
Janet on x32: 32-bit Pointers, 64-bit Speed, 25% Less RAM
TL;DR
Using the Linux x32 ABI allows programs to utilize 32-bit pointers on 64-bit systems, significantly reducing memory usage and improving speed. For example, deploying Mastodon on x32 cut memory usage from 650MB to 350MB.
✦ Why It Matters
Consider enabling x32 on your Linux system to optimize memory usage for pointer-heavy applications.
Key Takeaways
- Enable x32 ABI on your Linux system for memory savings.
- Compile software for x32 to reduce memory usage significantly.
- Explore using Janet libraries like Spork for custom build flags.
- Consider the performance benefits of fitting more data in cache.
Full Summary
The Linux x32 Application Binary Interface (ABI) enables the use of 32-bit pointers in 64-bit environments, which can lead to substantial memory savings—up to 50% for applications with heavy pointer usage. This approach also enhances performance by allowing more data to fit in the CPU cache.
Despite its potential, x32 is often overlooked and disabled by default in popular distributions like Debian and Arch Linux, requiring users to enable it manually or compile software themselves. In practical tests, deploying the Mastodon application on x32 reduced its memory footprint from 650MB to 350MB, showcasing the benefits of this configuration.
However, the effort to promote and package x32 applications is largely unrecognized and requires significant coordination.