31047 Commits

Author SHA1 Message Date
JChris246
4a48287075 Updated regex to accommodate new video_id with letters 2020-06-26 20:27:34 -04:00
Tarasovych
83d318bbb3
Update YoutubeDL.py 2020-06-25 09:20:49 +03:00
Glenn Slayden
bd1340d294
Prevent HTTP 301 for YouTube playlist continuations
When a YouTube playlist or channel listing has more than one page of videos, the continuation URLs specify `youtube.com` instead of `www.youtube.com`. This causes an unnecessary HTTP round-trip for each continuation page the extractor accesses.

**Example**

<code>
youtube-dl  -s --print-traffic  https://www.youtube.com/channel/UCBR8-60-B28hp2BmDPdntcQ
</code>

**Before**

<code>
GET /playlist?list=UUBR8-60-B28hp2BmDPdntcQ&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIsEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoOZWdaUVZEcERSMUUlM0Q%253D&disable_polymer=true
Host: youtube.com
HTTP/1.1 301 Moved Permanently
Location: https://www.youtube.com/browse_ajax?action_continuation=1&continuation=4qmFsgIsEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoOZWdaUVZEcERSMUUlM0Q%253D&disable_polymer=true

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIsEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoOZWdaUVZEcERSMUUlM0Q%253D&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERUV2RD&disable_polymer=true
Host: youtube.com
HTTP/1.1 301 Moved Permanently
Location: https://www.youtube.com/browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERUV2RD&disable_polymer=true

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERUV2RD&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERTM2RE&disable_polymer=true
Host: youtube.com
HTTP/1.1 301 Moved Permanently
Location: https://www.youtube.com/browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERTM2RE&disable_polymer=true

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERTM2RE&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK
</code>

**After**

<code>
GET /playlist?list=UUBR8-60-B28hp2BmDPdntcQ&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIsEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoOZWdaUVZEcERSMUUlM0Q%253D&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK

GET /browse_ajax?action_continuation=1&continuation=4qmFsgIqEhpWTFVVQlI4LTYwLUIyOGhwMkJtRFBkbnRjURoMZWdkUVZEcERUV2RD&disable_polymer=true
Host: www.youtube.com
HTTP/1.1 200 OK
</code>
2020-06-24 23:02:06 -07:00
martin54
e6e5d98cdb [ard.py] add playlist support 2020-06-25 01:33:19 +02:00
Mickey Rose
6ec9586e02 [FragmentFD] only write fragment to disk if --keep-fragments is given 2020-06-24 18:30:51 +02:00
Mickey Rose
2915ae8eb6 [HttpFD] extract method create_context 2020-06-24 18:30:51 +02:00
Roxedus
10664e43be
[nrk:base] Redo playback extractor
It does not need to be in the loop, introduces some duplicated parts of code
2020-06-24 14:28:34 +02:00
Remita Amine
9a7e5cb88a [bellmedia] add support for cp24.com clip URLs(closes #25764) 2020-06-23 15:09:13 +01:00
xarantolus
5cbe7563be [youtube] Return to old feed extraction code as it *seems* like that change was reverted
The old code now works again, but it downloads without limit. This is why a limit of 1000 videos is added, it can be overwritten with the `--max-downloads` option - that way, only so many ids will be extracted as videos downloaded
2020-06-23 11:27:02 +02:00
Alex Merkel
f6513e1a93
[postprocessor/embedthumbnail] Replace % with _ in ffmpeg image output path 2020-06-23 10:25:04 +02:00
J. Randall Owens
26d98ae442 Merge branch 'master' of https://github.com/rg3/youtube-dl 2020-06-23 09:04:27 +01:00
xarantolus
6a3cc89394 [youtube] Make search extraction less dependent on json schema.
If an object looks like a video (it has a `videoId` key), assume that it is.
2020-06-23 08:56:21 +02:00
Roxedus
64ea58e49c
[nrk:base] Add tests for alt_title, flake8 and convension 2020-06-21 22:15:12 +02:00
Roxedus
5063afc5df
[nrk:base] Fall back to another endpoint for season and episode number
Prevents some long-running series from returning `NA`
2020-06-21 21:42:56 +02:00
Alex Merkel
6011dd9539
[postprocessor/embedthumbnail] Fix comments to make flake8 happy 2020-06-21 12:16:45 +02:00
Alex Merkel
ac0ad4f91d
[postprocessor/embedthumbnail] Close file before possible renaming 2020-06-21 12:06:01 +02:00
David Roizenman
c9c1c46d47
[pinterest] Add new extractor 2020-06-21 03:00:17 -07:00
Alex Merkel
e987deb504
[postprocessor/embedthumbnail] Add detection for mislabeled WebP files 2020-06-21 11:53:22 +02:00
xarantolus
b3fd4b155e run flake8 2020-06-21 09:41:42 +02:00
xarantolus
57f72370c5 [youtube] Fix feed extraction
This moves feed extraction from using html content to json metadata. However, loading additional pages no longer works.

The _extract_video_info function also returns a continuation object that contains some metadata that - together with an API key that is in the page source - might be used to request the next page.
2020-06-21 09:31:04 +02:00
hatienl0i261299
e9958b8d7a [zing_mp3] Add new extractor 2020-06-20 16:20:18 +07:00
Roxedus
2be9bcaae6
[nrk:base] Add alt_title
This is what I consider the actual title
2020-06-20 05:09:11 +02:00
Roxedus
cbd871084c
[nrk:base] Secondary method to fetch streams
Can't see why the original method don't work for some streams.
Bonus: provides 1080p quality
Closes #24221
2020-06-20 03:40:02 +02:00
Roxedus
d71bc476a8
[nrk:episode] Fixes KeyError
Get content of meta tag
Inspired by, and closes #25594
2020-06-20 03:36:28 +02:00
bmensah
acb0f56569 [idf1_extractor] Add new extractor (fulfilling support request #25671) 2020-06-19 17:08:13 -04:00
xarantolus
6dad89289c [youtube] Move search URL extraction to appropriate extractor 2020-06-19 21:29:47 +02:00
xarantolus
7a74feda78 [youtube] Fix extraction of search urls (closes ytdl-org/youtube-dl#25696) 2020-06-19 14:57:57 +02:00
Alex Merkel
777d5a45be
[postprocessor/embedthumbnail] Add conversion for non JPG/PNG images 2020-06-18 22:36:44 +02:00
andysalvadorss
8f47f4450f
Create main.yml 2020-06-16 18:28:57 +03:00
Sergey M․
2391941f28
[brightcove] Improve embed detection (closes #25674) 2020-06-16 17:38:25 +07:00
J. Randall Owens
0fc20620fc Merge branch 'master' of https://github.com/rg3/youtube-dl 2020-06-16 10:07:22 +01:00
oleksis
a8b5bc2e2f Merge branch 'master' of https://github.com/ytdl-org/youtube-dl into PictaExtractor 2020-06-16 04:00:18 -04:00
Sergey M․
9ff6165a81
release 2020.06.16.1 2020.06.16.1 2020-06-16 06:22:01 +07:00
Sergey M․
1c748722f9
[ChangeLog] Actualize
[ci skip]
2020-06-16 06:19:23 +07:00
Sergey M․
ee0b726cd7
[youtube] Force old layout (closes #25682, closes #25683, closes #25680, closes #25686) 2020-06-16 06:17:53 +07:00
jeredav
ae9013f47f Prefer video_details.get('shortDescription') to self._html_search_meta('description', video_webpage) when retrieving video_description. 2020-06-15 18:33:35 -04:00
Sergey M․
dbeafce5d5
[youtube] Fix categories and improve tags extraction 2020-06-16 03:13:39 +07:00
J. Randall Owens
cb1a427c98 Merge branch 'master' of https://github.com/rg3/youtube-dl 2020-06-15 21:10:41 +01:00
Sergey M․
ed604ce7bc
release 2020.06.16 2020.06.16 2020-06-16 02:53:33 +07:00
Sergey M․
7adc7ca547
[ChangeLog] Actualize
[ci skip]
2020-06-16 02:52:09 +07:00
KiberInfinity
1dda2c9eda [youtube] Fix category extraction 2020-06-15 21:51:49 +02:00
Sergey M․
a6211d237b
[youtube] Fix uploader id and uploader URL extraction 2020-06-16 02:43:09 +07:00
Sergey M․
7b16239a49
[youtube] Improve view count extraction 2020-06-16 02:38:45 +07:00
Sergey M․
37357d21a9
[youtube] Fix upload date extraction 2020-06-16 02:37:19 +07:00
Sergey M․
b477fc1314
[youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676) 2020-06-16 02:29:04 +07:00
Sergey M․
ec9e8b79bd [youtube] Fix playlist and feed extraction (closes #25675) 2020-06-15 21:11:13 +02:00
Philipp Hagemeister
46d2733f92 [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
2020-06-15 21:11:13 +02:00
Sergey M․
06dc6af04c [youtube] Extract chapters from JSON (closes #24819) 2020-06-15 21:11:13 +02:00
Sergey M․
000522151f [kaltura] Add support for multiple embeds on a webpage (closes #25523) 2020-06-15 21:11:13 +02:00
Sergey M․
134453d1b2 release 2020.06.06 2020-06-15 21:11:13 +02:00