Attention Maps Know When to Think: Training-Free Difficulty-Aware Chain-of-Thought for Reasoning Segmentation
arxiv.org·2d ago
AI Research
arXiv CS.AI·Jul 22·5 min read
Now We Know? A Systematic Comparison of TerraMind and THOR
TL;DR
A systematic comparison of two Geospatial Foundation Models (GFMs), THOR and TerraMind, reveals that architectural choices significantly impact performance variance. Key findings suggest that patch size and decoder type are more influential than model identity itself.
✦ Why It Matters
Evaluate your GFM architecture choices to optimize performance for specific use cases today.
Key Takeaways
- Consider patch size and decoder type when designing GFMs.
- Utilize dataset-level characterization for accurate model evaluation.
- Explore complementary strategies in model training and inference.
- Apply findings to improve performance in specific applications.
How It Works
THOR employs a compute-adaptive architecture that allows for variable patch sizes, optimizing data processing based on input characteristics. In contrast, TerraMind uses a dual-scale token/pixel objective for cross-modal generation, enabling it to infer missing sensor data during inference.