Screaming - Frog Seo Spider 19.8
Screaming Frog SEO Spider 19.8: A Deep Dive into the Latest Features, Performance Upgrades, and Why You Should Update Now
- Chrome Headless Update: The embedded Chromium engine has been updated to version 120+ (matching current stable Chrome). This improves rendering of modern JavaScript frameworks (React 18, Vue 3, Angular 15+).
--no-sandbox Stability: Enhanced command-line argument handling for Linux servers, reducing crashes when crawling SPAs (Single Page Applications) in headless environments.
- Interaction Improvements: Better detection of
click events that dynamically load content without URL changes (e.g., infinite scroll pagination via "Load More" buttons).
- XPath 3.0 Support: Faster parsing of complex XML documents (sitemaps, RSS feeds) using updated Saxon-HE library.
- CSS Selector Caching: Repeated selectors (e.g., extracting all
h1 across 100k pages) are now cached in memory, reducing crawl time by up to 15% on large sites.
- Country/Language Parameters: The tool updated how it handles
gl (Geolocation) and hl (Language) parameters when scraping Google search results.
- Data Accuracy: This ensures that when an SEO is checking rankings or scraping SERP features, they are seeing the results relevant to the specific country and language they are targeting, rather than default US/English results.
2. JavaScript Rendering Engine Improvements
- Memory Management: The 19.x series has seen a push toward better memory management for