23145 Commits

Author SHA1 Message Date
Yen Chi Hsuan
b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 2016-10-09 18:42:15 +08:00
Yen Chi Hsuan
8204c73352
[Makefile] Fix for GNU make < 4 (closes #9387)
Shell assignment operator in BSD make != is ported to GNU make in
version 4.0, so 3.x doesn't work. I choose to drop BSD make support as
installing GNU make on *BSD systems is easier than installing newer GNU
make.
2016-10-09 18:24:45 +08:00
John Hawkinson
8b0c5de724 Recommend case-insentitive _VALID_URL matching 2016-10-09 01:31:25 -04:00
John Hawkinson
b9ede2fe9e Revert "Case-insensitive URL match via suitable()"
This reverts commit cd381738a616d0de907c52de7c1f510c73a74f50.

dstftw commented in #10854 that he thinks this is the wrong way to go.
2016-10-09 01:26:02 -04:00
John Hawkinson
cd381738a6 Case-insensitive URL match via suitable()
Cherry-picked from bca0b731c41adeb689dbb119f8ee60fded5fa251 on my iqm2 branch
2016-10-09 01:25:32 -04:00
John Hawkinson
f46aea8404 remove blank line 2016-10-08 23:12:37 -04:00
John Hawkinson
2cc84715bc Set to_generic -> True to suppress fallback msg 2016-10-08 23:11:07 -04:00
John Hawkinson
9a2ed02b65 debugging print -> self.to_screen() 2016-10-08 22:46:09 -04:00
John Hawkinson
f8eeb2b25a Some instances don't have downloadable video
E.g. somervillecityma.iqm2.com only has the JWPlayer video.
Makes a better test case, so add it as the first.
2016-10-08 21:01:43 -04:00
John Hawkinson
0bdb0c707b Condense comments, distribute 2016-10-08 19:38:28 -04:00
John Hawkinson
077bf26371 Use url_result instead of instance of GenericIE() 2016-10-08 19:31:50 -04:00
John Hawkinson
e6a1522743 Tighten up regex comment 2016-10-08 19:23:59 -04:00
John Hawkinson
71fbddb78a Use (?i) for case-insensitivity in URLs 2016-10-08 19:21:33 -04:00
John Hawkinson
e468f91968 Move test cases from comment to _TESTS 2016-10-08 19:17:32 -04:00
Simon Morgan
7e44689bd0 Update README.md 2016-10-08 23:01:04 +01:00
Pierre Mdawar
ae5b06b6be [FFmpegExtractAudioPP] fix info dict return audio filepath and ext instead of the video filepath if file already exists
If the converted audio file already exists, the `FFmpegExtractAudioPP.run` method returns the video filepath instead of the audio filepath and ext.
2016-10-08 23:09:38 +03:00
Déstin Reed
2b51dac1f9
[slutload] Fix test and simplify 2016-10-09 01:17:38 +07:00
Sergey M․
f68901e50a
[reverbnation] Eliminate code duplication in thumbnails extraction 2016-10-09 01:02:35 +07:00
Déstin Reed
3adb9d119e
[reverbnation] Modernize 2016-10-09 01:00:38 +07:00
John Hawkinson
99315aa252 ExternalFD:real_download(): Skip getsize/rename when writing to stdout
In the real_download() method of the ExternalFD class:

Special-case output to stdout, when filename=='-', because otherwise
the call to os.path.getsize() raises
  OSError: [Errno 2] No such file or directory: '-'
which in turn gets masked by a try block and re-raised as
UnavailableVideoError().

And even if getsize had succeeded, we would fail on renaming, and then
we would also fail on reporting progress as report_progress() expects
to have file size information.

So report download completion with self.to_screen() just as
report_progress() would in the noprogress==True case.

You might ask whether it's an abstraction violation for external.py to
have to know and think about '-' as a filename, but unfortunately
we're there already. _call_downloader() thinks about it, and also
real_download() calls common.py's temp_name() which special-cases the
'-' filename to preserve it instead of returnign a temp file. So we
already worry about this case at this abstraction level, as well as
both below and above. Perhaps that should change, but that's for
another day.
2016-10-08 09:51:00 -04:00
John Hawkinson
ca14b60aca Print traceback when raising UnavailableVideoError
An OSError or IOError generally indicates something a little more
wrong than a "simple" UnavailableVideoError, so print the actual
traceback that leads to the exception. Otherwise meaningful postmortem
debugging a bug report is essentially infeasible.
2016-10-08 09:27:24 -04:00
Remita Amine
1dd58e14d8 [lego] improve info extraction and bypass geo restriction(closes #10872) 2016-10-08 08:33:18 +01:00
Simon Morgan
77da0152fe [yuvutu] Move regular expressions to place of usage. 2016-10-07 17:19:00 +01:00
Sergey M․
a054e619cc
release 2016.10.07 2016-10-07 22:27:15 +07:00
Sergey M․
dd4291f729
release 2016.10.07 2016.10.07 2016-10-07 22:25:30 +07:00
Simon Morgan
5d4d88151f [yuvutu] Export thumbnail URL 2016-10-07 16:23:16 +01:00
Sergey M․
888f8d6ba4
[ChangeLog] Actualize 2016-10-07 22:23:16 +07:00
Simon Morgan
f6199a619d [yuvutu] Add new extractor 2016-10-07 16:17:57 +01:00
Sergey M․
f475e88121
[vimeo] PEP 8
[ci skip]
2016-10-07 22:15:26 +07:00
Remita Amine
3c6b3bf221 [iprima] detect geo restriction 2016-10-07 15:53:16 +01:00
Yen Chi Hsuan
38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
2016-10-07 20:04:49 +08:00
Yen Chi Hsuan
85bcdd081c
[extractors] Add MmsIE 2016-10-07 19:31:26 +08:00
Yen Chi Hsuan
9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
2016-10-07 19:24:22 +08:00
Yen Chi Hsuan
98763ee354
[extractor/common] Add id and title helpers for generic IEs 2016-10-07 19:20:53 +08:00
Yen Chi Hsuan
3d83a1ae92
[generic] Support direct MMS links (closes #10838) 2016-10-07 17:50:45 +08:00
Yen Chi Hsuan
c0a7b9b348
Revert "[Makefilea] Fix for GNU make < 4"
This reverts commit 831a34caa2112a9b2d867e05f8a4debf965e8389.

The reverted commit breaks lazy extractors.
2016-10-07 16:03:34 +08:00
Yen Chi Hsuan
831a34caa2
[Makefilea] Fix for GNU make < 4
Closes #9387

The shell assignment operator != was introduced in GNU make 4.0, or
specifically the commit in [1]. This fix removes such usages and
fallback to a more portable syntax. Tested with:

* GNU make 3.82 on CentOS 7.2
* bmake 20150910 on CentOS 7.2, source RPM from Fedora 24 [2]
* GNU make 4.2.1 on Arch Linux (Arch official package)
* bmake 20160926 on Arch Linux (Arch official package)
* GNU make 3.82 on Arch Linux (Compiled from source)
* Apple bsdmake-24 on macOS Sierra, binary package from Homebrew

Thanks @bdeyal for the feedback of the first tests

[1] http://git.savannah.gnu.org/cgit/make.git/commit/?id=b34438bee83ee906a23b881f257e684a0993b9b1
[2] http://koji.fedoraproject.org/koji/buildinfo?buildID=716769
2016-10-07 03:28:41 +08:00
Sergey M․
09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 2016-10-06 23:22:52 +07:00
Simon Morgan
ddf0343527 Various grammar corrections.
This should hopefully aid readability a little bit.
2016-10-06 12:50:42 +01:00
Remita Amine
33898fb19c [nzz] Add new extractor(#4407) 2016-10-06 10:45:57 +01:00
John Hawkinson
78210b31fa copyedit comments 2016-10-06 01:51:06 -04:00
John Hawkinson
021c07f81a Comment verbatim example of <div id=VideoPanelInner/> 2016-10-06 01:42:30 -04:00
John Hawkinson
e2135e8791 Handle relative URLs with urlparse.urljoin() 2016-10-06 01:38:25 -04:00
John Hawkinson
9adff20bb5 strip unused title= code 2016-10-06 01:33:34 -04:00
John Hawkinson
841b2af158 strip unnecessary comments from template 2016-10-06 01:30:44 -04:00
John Hawkinson
bca0b731c4 Case-insensitive URL match 2016-10-06 01:29:58 -04:00
John Hawkinson
70d117053d [IQM2] Add new extractor
first cut
2016-10-06 01:09:53 -04:00
Remita Amine
017eb82934 [npo] detect geo restriction 2016-10-05 18:27:02 +01:00
Sergey M․
b1d798887e
[npo] Add support for 2doc.nl (Closes #10842) 2016-10-05 23:43:08 +07:00
arza
66ba843052 [ruutu] Add support for Supla URLs 2016-10-05 11:32:37 +03:00