844 Commits

Author SHA1 Message Date
Philipp Hagemeister
ccfde9c81f [bambuser] Do not test for MD5, seems to be flaky 2013-11-23 17:48:46 -02:00
Philipp Hagemeister
60e44d7811 [dailymotion] Fix playlists 2013-11-23 17:48:46 -02:00
Philipp Hagemeister
3feb769814 [spiegel] Implement format selection 2013-11-23 17:48:46 -02:00
Philipp Hagemeister
2e41399194 Add automatic generation of format note based on bitrate and codecs 2013-11-23 17:48:46 -02:00
Philipp Hagemeister
198dd977eb [ted] Fix playlists (Fixes #1770) 2013-11-23 17:48:46 -02:00
Philipp Hagemeister
12207326ae [ted] simplify 2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
106fe8a1eb [rtlnow] Remove the test for nitro
The videos expire.
2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
6ce077671b Don't accept '>' inside the content attribute in OpenGraph regexes 2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
1bede9f6c6 Improve the OpenGraph regex
* Do not accept '>' between the property and content attributes.
* Recognize the properties if the content attribute is before the property attribute using two regexes (fixes the extraction of the description for SlideshareIE).
2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
baf4b73157 [tvp] Update the title and the description of the test video 2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
19f2d7b4bc [youtube:channel] Fix the extraction of autogenerated channels
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-23 17:48:46 -02:00
Philipp Hagemeister
9855e620c5 [youtube] Fix protocol-independent URLs (Fixes #1768) 2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
f898fbea50 [soundlcoud] Set the correct extension for the tracks (fixes #1766)
Some tracks are not in mp3 format, they can be wav files.
2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
72044f3f26 [livestream] Add an extractor for the original version of livestream (closes #1764)
The two versions use different systems.
2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
1057e3591a Don't assume the 'subtitlesformat' is set in the params dict (fixes #1750) 2013-11-23 17:48:46 -02:00
Jaime Marquínez Ferrándiz
ba9ade5b44 [gamekings] Fix the test video checksum 2013-11-23 17:48:45 -02:00
Jaime Marquínez Ferrándiz
705ff439f5 [youtube:playlist] Login into youtube if requested (fixes #1757)
Allows to download private playlists
2013-11-23 17:48:45 -02:00
Jaime Marquínez Ferrándiz
b4ed26e2ab [youtube:playlist] Don't use the gdata api (closes #1508)
Parse the playlist pages instead
2013-11-23 17:48:45 -02:00
Philipp Hagemeister
ce3725b1d3 [tvp] Minor improvements (#1730) 2013-11-23 17:48:45 -02:00
Philipp Hagemeister
2c35b14de2 [gamekings] Minor fixes (#1759) 2013-11-23 17:48:45 -02:00
Jelle van der Waa
d68a0deb4b Add extractor for gamekings.tv 2013-11-23 17:48:45 -02:00
migbac
6cfb8eb316 Add support for d8.tv 2013-11-23 17:48:45 -02:00
Jaime Marquínez Ferrándiz
f63ccd8b5d [vine] Fix uploader extraction 2013-11-23 17:48:45 -02:00
Philipp Hagemeister
2aa2b12e4f [common] Simplify og_search_property 2013-11-23 17:48:45 -02:00
Marcin Cieślak
6f4ff04bf1 [tvp] Telewizja Polska: new extractor for tvp.pl, fixes #1719
Thanks-To: mplonski

https://github.com/mplonski/linux/blob/master/tvp-dl.py
2013-11-23 17:48:45 -02:00
Jaime Marquínez Ferrándiz
0ed05a1d2d Use the 'rtmp_live' field for the live parameter of rtmpdump 2013-11-10 12:45:17 +01:00
Jaime Marquínez Ferrándiz
1008bebade Merge remote-tracking branch 'rzhxeo/rtmpdump_live' 2013-11-10 12:38:40 +01:00
Jaime Marquínez Ferrándiz
be6dfd1b49 [ted] Return a single info_dict for talks urls
It failed with the --list-subs option
2013-11-10 12:09:12 +01:00
Jaime Marquínez Ferrándiz
231516b6c9 Merge pull request #1705 from iemejia/master
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
Jaime Marquínez Ferrándiz
fb53d58dcf Merge pull request #1726 from saper/escaped
Fix AssertionError when og property not found
2013-11-10 02:51:52 -08:00
Jaime Marquínez Ferrándiz
f470c6c812 [arte] Improve the format sorting
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
2013-11-09 19:05:19 +01:00
Jaime Marquínez Ferrándiz
566d4e0425 [arte] Make sure the format_id is unique (closes #1739)
Include the bitrate and use the height instead of the quality field.
2013-11-09 19:01:23 +01:00
Jaime Marquínez Ferrándiz
81be02d2f9 [cnn] Accept www.cnn.com urls (fixes #1740) 2013-11-09 18:16:32 +01:00
Jaime Marquínez Ferrándiz
c2b6a482d5 [brightcove] the format function requires to specify the index in python2.6 2013-11-09 18:10:11 +01:00
Jaime Marquínez Ferrándiz
12c167c881 [soundcloud] Allow to download tracks marked as not 'streamable'
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
2013-11-09 18:08:03 +01:00
Jaime Marquínez Ferrándiz
20aafee7fa [kankan] Fix the video url
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
2013-11-09 16:51:11 +01:00
Jaime Marquínez Ferrándiz
dd5bcdc4c9 [brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter (fixes #1553) 2013-11-07 21:06:48 +01:00
Jaime Marquínez Ferrándiz
b1a80ec1a9 [xnxx] Accept urls that start with 'www' (fixes #1734) 2013-11-06 23:45:01 +01:00
Jaime Marquínez Ferrándiz
51040b72ed [brightcove] Support redirected urls from bcove.me (fixes #1732)
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
2013-11-06 22:03:00 +01:00
Jaime Marquínez Ferrándiz
4f045eef8f [youtube:channel] Fix the extraction
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
Jaime Marquínez Ferrándiz
5d7b253ea0 Add an extractor for eitb.tv (fixes #1608)
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
2013-11-06 20:06:14 +01:00
Jaime Marquínez Ferrándiz
b0759f0c19 [brightcove] Extract all the available formats 2013-11-06 19:05:41 +01:00
Jaime Marquínez Ferrándiz
065472936a Add an extractor for space.com (fixes #1718)
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
2013-11-06 17:37:39 +01:00
Jaime Marquínez Ferrándiz
fc4a0c2aec [brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' (fixes #1697)
It seems to be needed when using the htmlFederated page
2013-11-06 17:31:47 +01:00
Jaime Marquínez Ferrándiz
eeb165e674 [brightcove] Add the extraction of the url from generic 2013-11-06 16:58:03 +01:00
Jaime Marquínez Ferrándiz
9ee2b5f6f2 tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working 2013-11-06 16:43:26 +01:00
Marcin Cieślak
a8eeb0597b Fix AssertionError when og property not found
On tvp.pl some webpages contain OpenGraph
metadata and some don't.

If og property is not found, _og_search_description
fails with

WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
  File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
    youtube_dl.main()
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
    _real_main(argv)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
    retcode = ydl.download(all_urls)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
    videos = self.extract_info(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
    ie_result = ie.extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
    return self._real_extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
    info['description'] = self._og_search_description(webpage)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
    return self._og_search_property('description', html, fatal=False, **kargs)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
    return unescapeHTML(escaped)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
    assert type(s) == type(u'')
AssertionError

The patch allows me to use:

  try:
    info['description'] = self._og_search_description(webpage)
    info['thumbnail'] = self._og_search_thumbnail(webpage)
  except RegexNotFoundError:
    pass
2013-11-05 23:19:29 +01:00
Ismaël Mejía
4ed3e51080 [ted] fixed error in case of no subtitles present
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
2013-11-05 12:00:13 +01:00
rzhxeo
2dcf7d8f99 [GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of " 2013-11-05 02:08:02 +01:00
Jaime Marquínez Ferrándiz
19b0668251 [canal2c] Accept more urls (fixes #1723)
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
2013-11-04 22:26:19 +01:00