Skip to content

Can't download videos due to too many requests error. #51

Open

Description

@hollowgalaxy

CSVs are downloaded from the https://deepmind.com/research/open-source/open-source-datasets/kinetics/
Followed the instructions of ActivityNet/Crawler/Kinetics/README.md to create the environement.
Created video/ in the same directory as the the download script.
Made 1 modification to the script to print whenever an error occurs in downloading a file.
Ran the following command
python download.py data/kinetics_600_test.csv videos/

After downloading about 60 videos in, I get the following error for all videos.
ERROR: Unable to download webpage: HTTP Error 429: Too Many Requests (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

I tried both the download.py used in this repo as well as this one.

Using Aws ec2 instance

Activity

  1. Pankaj01998 commented on Aug 16, 2019

    @Pankaj01998

    Yes I am also getting the same error for all videos after downloading some videos

  2. escorciav commented on Aug 30, 2019

    @escorciav
    Collaborator

    Thanks for reporting this.

    The issue is on the Youtube platform and the youtube-dl package. Thus, we don't know how to fix it. Feel free to reference the issue where youtube-dl is tracking the problem.


    Regarding the datasets that concern to this repo

    ActivityNet dataset. You can sign up to download it from here. You must read the terms and conditions.

    For Kinetics dataset, please vote this petition.

  3. Thoudancer commented on Sep 11, 2019

    @Thoudancer

    @escorciav hello, i filled the form to request the data 3 days ago from here,but have not received the link mail. How long does it spend to check the mails usually?

  4. frostinassiky commented on Sep 11, 2019

    @frostinassiky

    @Thoudancer Thanks for your feedback. The server was down for some technique issue. It is running now!

  5. jae0choi commented on Oct 10, 2019

    @jae0choi

    Hi there, I'm wondering if you have had chance to check my request to download the dataset. I submitted the form last Friday.

  6. frostinassiky commented on Oct 10, 2019

    @frostinassiky

    Hi there, I'm wondering if you have had chance to check my request to download the dataset. I submitted the form last Friday.

    We met some sharing problem because of the google drive settings. I restart the server and your request will be approved soon!

  7. Abrahamon commented on Aug 26, 2020

    @Abrahamon

    For everyone else, consider installing a newer version of youtube-dl through pip, not with apt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions