NASA’s new dark energy space telescope can also detect killer asteroids
technologyreview.com·1h ago
Data Science
Simon Willison's Blog·24d ago·5 min read
shot-scraper 1.11
TL;DR
Shot-scraper 1.11 introduces minor improvements focused on command option consistency. It enhances the server mechanism for both shot-scraper video and multi, ensuring functionality even if the server takes over a second to start.
✦ Why It Matters
Update to shot-scraper 1.11 today to improve your video scraping reliability during server delays.
Key Takeaways
- Utilize the new --js-file option for JavaScript loading.
- Adjust server settings to accommodate longer connection times.
- Standardize timeout settings across all commands.
- Explore the updated command options for improved functionality.
Full Summary
Shot-scraper, a tool for capturing web content, has released version 1.11 with several minor improvements aimed at enhancing user experience. Notably, the server processes for both shot-scraper video and multi now wait up to 30 seconds for a target URL to accept connections, replacing the previous one-second delay.
This change allows for better handling of slower server responses. Additionally, the commands for shot-scraper html, accessibility, and har now include a --js-file option, enabling users to load JavaScript from various sources, which offers more flexibility compared to the previous --javascript option.
Furthermore, a --timeout option has been standardized across commands to ensure consistency. These updates aim to streamline workflows and improve the overall functionality of the tool.