You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Nov 6, 2023. It is now read-only.
Repository navigation
This repository was archived by the owner on Nov 6, 2023. It is now read-only.
Fetcher should send headers of an actual browser #10873
This can help us to avoid issues like #9877 where the fetching test failed because the site used header sniffing to determine bots. In addition, We should send excally the same headers, as some sites are sniffing headers other than User-Agent. e.g. sniffing of upgrade-insecure-requests
@gloomy-ghost this is always the goal, but I don't think we need to open an issue for this. Especially because there are strange idiosyncrasies with pyCurl, we're never going to get 100% alignment with the browsers, see #10944. Plus the browsers are a moving target.
I suggest a more specific issue, like "Update user-agent string to Firefox 52" or something like that.
Activity
J0WI commentedon Jul 7, 2017
See also #10833
Hainish commentedon Jul 8, 2017
@gloomy-ghost this is always the goal, but I don't think we need to open an issue for this. Especially because there are strange idiosyncrasies with pyCurl, we're never going to get 100% alignment with the browsers, see #10944. Plus the browsers are a moving target.
I suggest a more specific issue, like "Update user-agent string to Firefox 52" or something like that.