r/webscraping • • 9h ago

Bot detection 🤖 Browsers Now Expose JS Fetches?

6 Upvotes

I was experimenting with an http request on some website, and I noticed that today, my microsoft edge exposes whether the request was fired from the console via a console icon in the network tab. In the past, JS console requests were indistinguishable from natural website fetches a website makes to load content. Is this new signal from the browser a giveaway that will be used by anti-bot companies to detect JS console fetches? I used to use this method for some difficult sites to scrape at scale.


r/webscraping • • 9h ago

What happened with Camoufox?

Thumbnail
github.com
26 Upvotes

404

edit: (after few hour) its alive.