Google Search’s new /goto links replace direct organic-result URLs with opaque redirect tokens. Human clicks still work, but SERP scrapers now need an extra resolution step. This guide explains the Location-header pattern and safer Python handling without loading destination pages.
Most sites are crawlable by AI, yet almost none are ever named. An AI Visibility Index study found 94.8% of audited businesses weren’t cited in AI answers, while only 8.9% blocked AI crawlers in robots.txt.
A company attempted to remove a technical article, and the process reportedly involved search indexing changes. The incident illustrates how origin edits, takedown workflows, and search deindexing interact and why content may remain discoverable for some time.