Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zoom #32094

Open
5 tasks done
gklimm opened this issue Apr 23, 2023 · 9 comments · May be fixed by #32828
Open
5 tasks done

Zoom #32094

gklimm opened this issue Apr 23, 2023 · 9 comments · May be fixed by #32828
Labels
broken-IE problem with existing site extraction yt-dlp working or fix available in yt-dlp

Comments

@gklimm
Copy link

gklimm commented Apr 23, 2023

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2021.12.17
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.2 (CPython) - Linux-5.10.0-21-amd64-x86_64-with-glibc2.31
[debug] exe versions: ffmpeg 4.4.4, ffprobe 4.4.4, rtmpdump 2.4
[debug] Proxy map: {}
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading webpage
ERROR: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 547, in extract
    raise ExtractorError('An extractor error has occurred.', cause=e)
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

WRITE DESCRIPTION HERE

@dirkf
Copy link
Contributor

dirkf commented Apr 23, 2023

Does this play for you? I get "Untersuchungskurs Gruppe V- Shared screen with speaker view" and a player widget with an unresponsive play button and the text "No compatible source was found for this media."

However, I can reproduce the above.

yt-dlp also fails but with:
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: No video formats found!

@dirkf dirkf added broken-IE problem with existing site extraction clarification-needed and removed broken-IE problem with existing site extraction labels Apr 23, 2023
@october262
Copy link

video plays ok for me, you can also just right click on the video and click "save as"
to download the video in mp4 format. yt-dlp & youtube-dl doesn't work for me either,
however ytdl-patched does download this video.

@gklimm
Copy link
Author

gklimm commented Apr 24, 2023

Yes, ytdl-patched works fine!
Hope that @shiningw takes this in future for the ncdownloader

@dirkf
Copy link
Contributor

dirkf commented Apr 24, 2023

The yt-dlp from ytdl-patched or from a nightly build in the yt-dlp repo includes yt-dlp/yt-dlp#6789 which fixes Zoom extraction. Quite a painless backport gives this yt-dl result:

$ python -m youtube_dl -F -v 'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-F', u'-v', u'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: 64d6dd64c
[debug] Python version 2.7.18 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[zoom] Extracting URL: https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading share webpage
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading share info JSON
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading play webpage
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading play info JSON
[info] Available formats for 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3:
format code                           extension  resolution note
9579c7e5-0fc8-4d1d-b0db-32077cfa3316  mp4        1920x1080  Camera stream , ~658.04MiB
$

It's a rewrite rather than a small patch so it'll have to wait for a PR.

@dirkf dirkf added broken-IE problem with existing site extraction yt-dlp working or fix available in yt-dlp and removed clarification-needed labels Apr 24, 2023
@gklimm
Copy link
Author

gklimm commented Apr 24, 2023

This reads as if metadata would then come again and perhaps a meaningful file name would be generated. That would be awesome

@dirkf
Copy link
Contributor

dirkf commented Apr 24, 2023

The problem page will generate this filename:
Untersuchungskurs Gruppe V-9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3.mp4

Awesomeness may be in the eye of the beholder.

@catleeball
Copy link

Just commenting that I also encountered this issue. Unfortunately, when I try the right-click + save as workaround, it produces a small file that isn't a valid .mp4 file.

The ytdl-patched workaround did work for me though! Logs for both below.


youtube-dl error:

[16:31:13]
> youtube-dl --verbose --add-header 'cookie: ...redacted...' 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C' | tee youtube-dl.log
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--add-header', 'cookie: ...redacted...', 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C']
[debug] Adding header from command line option cookie: ...redacted...
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.13 (CPython) - macOS-10.16-x86_64-i386-64bit
[debug] exe versions: ffmpeg 6.0, ffprobe 6.0, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading webpage
ERROR: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 547, in extract
    raise ExtractorError('An extractor error has occurred.', cause=e)
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

[ 4s085 | Jun 03 04:32PM ]
>

ytdl-patched success:

[16:34:06]
> ytdl-patched --verbose --add-header 'cookie: ...redacted...' 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C'
[debug] Command-line config: ['--verbose', '--add-header', 'cookie: ...redacted...', 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8 (No ANSI), error utf-8, screen utf-8 (No ANSI)
[debug] ytdl-patched version [email protected] [b9ed90fbe] (zip)
[debug]      from commit b9ed90fbe
[debug]      based on 2fb35f600
[debug] ** The command you are running is not yt-dlp.
[debug] ** Please make bug reports at https://github.com/ytdl-patched/ytdl-patched/issues/new/choose instead.
[debug] Lazy loading extractors is disabled
[debug] Python 3.9.13 (CPython x86_64 64bit) - macOS-10.16-x86_64-i386-64bit (OpenSSL 1.1.1q  5 Jul 2022)
[debug] exe versions: ffmpeg 6.0 (setts), ffprobe 6.0, phantomjs 2.1.1, rtmpdump 2.4
[debug] Optional libraries: WebSocketClientWrapper-None, brotli-None, certifi-2022.09.24, sqlite3-2.6.0
[debug] Proxy map: {}
[debug] Loaded 1874 extractors
[zoom] Extracting URL: https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading play webpage
[zoom] [debug] Fetching webpage from https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading play info JSON
[zoom] [debug] Fetching webpage from https://washington.zoom.us/nws/recording/1.0/play/info/CouDd0Bb75NV-fxSOk96HlKlFeoV_Z2yQO8mGcciSTiOeoTFdxwW3PjYD7ty9Vc7aNJZfu6JPPWRFYPl.uBww1Hy1fk8XwT52
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading 1 format(s): 0807a70a-92fc-4d3f-aeb6-30a1851f52f1
[debug] Invoking http downloader on "https://ssrweb.zoom.us/replay02/2023/05/31/D8D0B8AB-C288-492B-83EE-9DC5A2309AE1/GMT20230530-223029_Recording_2560x1440.mp4?response-content-type=video%2Fmp4&response-cache-control=max-age%3D0%2Cs-maxage%3D86400&data=dca60b94a2370c6571ce27392a82716217250f27b314d0cd3086095124229a81&s001=yes&cid=aw1&fid=BQF5e8QzKZDaXDts0UGVpb-kde2q8R9M01dE332IAWhxev_bTIW8rc3e__R-fJux97ZquH2xOJFI9Xwq.9bmRE3sYSEWyNBN8&s002=cBqebhz_MnFcXiKiwyKDDIyCY6uAKkOM8Guu4Ai7s8Vd3N0CAJhohVRAVA.NfznprD9pVLGU9ag&tid=v=2.0;clid=aw1;rid=WEB_1cebfa12d336c123253b23a937a2f77b&Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6Imh0dHBzOi8vc3Nyd2ViLnpvb20udXMvcmVwbGF5MDIvMjAyMy8wNS8zMS9EOEQwQjhBQi1DMjg4LTQ5MkItODNFRS05REM1QTIzMDlBRTEvR01UMjAyMzA1MzAtMjIzMDI5X1JlY29yZGluZ18yNTYweDE0NDAubXA0P3Jlc3BvbnNlLWNvbnRlbnQtdHlwZT12aWRlbyUyRm1wNCZyZXNwb25zZS1jYWNoZS1jb250cm9sPW1heC1hZ2UlM0QwJTJDcy1tYXhhZ2UlM0Q4NjQwMCZkYXRhPWRjYTYwYjk0YTIzNzBjNjU3MWNlMjczOTJhODI3MTYyMTcyNTBmMjdiMzE0ZDBjZDMwODYwOTUxMjQyMjlhODEmczAwMT15ZXMmY2lkPWF3MSZmaWQ9QlFGNWU4UXpLWkRhWER0czBVR1ZwYi1rZGUycThSOU0wMWRFMzMySUFXaHhldl9iVElXOHJjM2VfX1ItZkp1eDk3WnF1SDJ4T0pGSTlYd3EuOWJtUkUzc1lTRVd5TkJOOCZzMDAyPWNCcWViaHpfTW5GY1hpS2l3eUtEREl5Q1k2dUFLa09NOEd1dTRBaTdzOFZkM04wQ0FKaG9oVlJBVkEuTmZ6bnByRDlwVkxHVTlhZyZ0aWQ9dj0yLjA7Y2xpZD1hdzE7cmlkPVdFQl8xY2ViZmExMmQzMzZjMTIzMjUzYjIzYTkzN2EyZjc3YiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY4NTg0NzcwNH19fV19&Signature=WNwvaVAe6-E5jPokdP8FaoUBoQNLIe5Kfr1s77W6o9JZcI7T6mSpG1yooSu~pr9Y6hVshcmNkzLQ-bmvJh5huKuPIPpWtYPquQsRmWIu-bUYMWE47Y4L7lximG0W3fmI0eyL3haRpQootVgsJuPSqMY1ETK1uFYhO2o963Z2uA3EB58MIh0SbxVJiBDal5hCi9GrDknPxBd1IggytRY12yEhfdiWDA7zHQ6uhdiz9aT7szfnOm7ulX7H0pho8m1lRqDXMWb-g0yfAlckrY0yvu4SjaG3Z82L42i7wRMCLy8A1MezjSmGMOGJE23g0sLMYzxBSkuS833XPqqoyoDpSQ__&Key-Pair-Id=APKAJFHNSLHYCGFYQGIA"
[download] Destination: LING 575 D Sp 23: Topics In Computational Linguistics [UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C].mp4
[download] 100% of 581.10MiB in 00:15 at 38.72MiB/s  
[debug] Cleaning up 1 streams
                                                                                                                                                                [ 30s482 | Jun 03 04:35PM ]
[16:35:23]
>

@thiswillbeyourgithub
Copy link

Still present today in the latest git version. That's too bad

rafiw added a commit to rafiw/youtube-dl that referenced this issue Jun 30, 2024
rafiw added a commit to rafiw/youtube-dl that referenced this issue Jul 1, 2024
@rafiw rafiw linked a pull request Jul 1, 2024 that will close this issue
11 tasks
@dirkf dirkf linked a pull request Jul 6, 2024 that will close this issue
11 tasks
@dirkf
Copy link
Contributor

dirkf commented Jul 9, 2024

If anyone cares to test the linked PR, please report there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
broken-IE problem with existing site extraction yt-dlp working or fix available in yt-dlp
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants