55b2f099c0
[utils] Decode HTML5 entities
Used in test_Vporn_1. Also related to #9270
8 years ago
6c33d24b46
[utils] Add audio/mpeg to mimetype2ext()
Used in WDR live radios (#6147 )
8 years ago
c88270271e
Added sanitization support for Hungarian letters Ő and Ű
8 years ago
9a4aec8b7e
[utils] Use bytes-like objects as header values on Python 2
8 years ago
0ea590076f
[utils] Always decode Location header
escape_url is broken for bytes-like objects
8 years ago
293c255688
[utils] Remove debugging codes
8 years ago
5950cb1d6d
[utils] Support a new form of date
Found in dw.com (#9475 )
8 years ago
c6b9cf05e1
[utils] Do not fail on unknown date formats in unified_strdate
8 years ago
46bc9b7d7c
[utils] Allow None in remove_{start,end}
8 years ago
cdd94c2eae
[utils] Check for None values in SOCKS proxy
Originally reported at
https://github.com/rg3/youtube-dl/pull/9287#issuecomment-219617864
8 years ago
79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049 , related to #9440
8 years ago
cda6d47aad
[utils] Simplify integer conversion in js_to_json
8 years ago
89ac4a19e6
[utils] Process non-base 10 integers in js_to_json
8 years ago
bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
8 years ago
7581bfc958
[utils] Unquote crendentials passed to SOCKS proxies
Fixes #9450
8 years ago
778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
Fixes #9463
8 years ago
702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output
8 years ago
edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack
8 years ago
d5ae6bb501
[utils] Add rationale for register_socks_protocols
8 years ago
51fb4995a5
[utils] Register SOCKS protocols in urllib and support SOCKS4A
8 years ago
71aff18809
[socks] Support SOCKS proxies
8 years ago
dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py
8 years ago
abc97b5eda
[utils] Allow empty attribute values in get_element_by_attribute ( Closes #9415 )
8 years ago
c587cbb793
improved performance by extracting accented chars to top level
8 years ago
79a2e94e79
Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347
8 years ago
eb9ee19422
[utils] Allow None mimetypes in mimetype2ext
8 years ago
acaff49575
[utils] imporove parse_duration to handle more formats
8 years ago
cacd996662
[utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
8 years ago
5bf28d7864
[utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081 ).
8 years ago
15d260ebaa
[utils] Use update_Request in http_request
8 years ago
ed0291d153
[utils] Add update_Request
8 years ago
17bcc626bf
[utils] Extract sanitize_url routine
8 years ago
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
8 years ago
622d19160b
[utils] Clarify Python versions affected by buggy struct module
8 years ago
efbed08dc2
[utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
8 years ago
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
8 years ago
09fc33198a
utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
8 years ago
810c10baa1
[utils] Use compat_xpath
8 years ago
c5229f3926
[utils] PEP 8
8 years ago
2f7ae819ac
[utils] PEP 8
8 years ago
fb47597b09
[bbc] Generalize unit table lookup and add parse_count
8 years ago
25cb05bda9
[utils] Remove codec2ext
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
8 years ago
6d210f2090
[utils] Add more codecs to codec2ext
BBC uses avc3. Here's an example (thanks to @remitamine for this example)
http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd
See also https://trac.ffmpeg.org/ticket/5217
8 years ago
19a17d4623
[utils] Add codec2ext
8 years ago
3233a68fbb
[utils] update_url_query: Encode the strings in the query dict
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
8 years ago
38f9ef31dc
[utils] add update_url_query function
8 years ago
8ee239e921
[utils] Jython support - handle filenames correctly
Now test:youtube downloads
8 years ago
8bb56eeeea
[utils] Add extract_attributes for extracting html tag attributes
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
9 years ago
e07237f640
[utils] remove check for val from find_xpath_attr
8 years ago
5eb6bdced4
[utils] Multiple changes to base_n()
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
8 years ago
Yen Chi Hsuan
bzc6p
Sergey M․
felix
Adam Thalhammer
remitamine
Jaime Marquínez Ferrándiz
Brian Foley