Skip to content

Crawler outputs damaged videos with parallel ffmpeg calls #90

New issue
New issue
Open
Open
Crawler outputs damaged videos with parallel ffmpeg calls#90

Description

@josedvq
josedvq
opened on May 20, 2022

The Crawler/Kinetics/download.py script fails when using num_jobs > 1. The videos are downloaded correctly but the clipping with ffmpeg produces a damaged video that doesn't play fully. My solution was to set prefer='threads' in the call to Parallel. The job is still calling subprocess_check_output for downloads and ffmpeg calls so will likely be ran in parallel. I'm posting in case anybody else encounters this frustrating issue. To devs, please reply if you want me to make a pull request with this fix.

Activity

  1. javierselva commented on Mar 2, 2023

    @javierselva
    javierselva
    on Mar 2, 2023

    Hi! I am having a similar issue. The videos download but in most cases I cannot open them nor can OpenCV.

    Thanks for the proposed solution! I have a question, though. To be clear, you mean making a change in

    ActivityNet/Crawler/Kinetics/download.py

    Line 191 in 82304fa

    status_lst = Parallel(n_jobs=num_jobs)(delayed(download_clip_wrapper)(
    resulting in

        status_lst = Parallel(n_jobs=num_jobs, prefer='threads')(delayed(download_clip_wrapper)(

    Is that correct? Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions