EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Lobsters·Aug 31·5 min read
Could Cargo's scheduler be better?
TL;DR
The author explores the scheduling mechanism of Cargo, the Rust package manager, questioning its efficiency based on external observations. By benchmarking 15 Rust projects, insights into potential improvements are suggested.
✦ Why It Matters
Consider evaluating your project's build times to identify potential optimizations in Cargo's scheduling.
Key Takeaways
- Adopt b-level scheduling to improve build efficiency.
- Utilize historical build data for better task duration estimates.
- Consider a local database for tracking crate build times.
- Experiment with scheduling strategies to find optimal configurations.
How It Works
The b-level scheduler calculates the 'b-level' for each task, which is the length of the longest chain of dependent tasks that need to run after it. When a worker becomes available, the scheduler selects the task with the highest b-level, effectively prioritizing tasks that are critical to the build process.