Browse Source
The dict of headers of request objects in urllib has its keys always capitalized. This causes the lookup to fail and overwrite the header. If for example a Extractor tries to add a "User-Agent" header the internal representation in the request object is "User-agent". The header is therefore clobbered by the "User-Agent" in std_headers, because the strings are not equal.master
Johannes Knoedtel
10 years ago
1 changed files with 3 additions and 1 deletions
Loading…