Skip to content

One shard on the daily test workflow is taking 20 minutes to complete #13444

Closed

Description

@AlexWaygood

One of these things is not like the others:

Screenshot

Image

None of the other shards take more than 6 minutes.

Link to workflow run: https://github.com/python/typeshed/actions/runs/13021949798

Activity

  1. AlexWaygood commented on Jan 29, 2025

    @AlexWaygood
    MemberAuthor

    Four days ago the workflow was still completing in <9 minutes: https://github.com/python/typeshed/actions/runs/12969611420

  2. AlexWaygood commented on Jan 29, 2025

    @AlexWaygood
    MemberAuthor

    It looks like it's taking a very long time to run stubtest on google-cloud-ndb

  3. AlexWaygood commented on Jan 29, 2025

    @AlexWaygood
    MemberAuthor

    It's unclear what's changed. The last release of google-cloud-ndb was in September.

  4. srittau commented on Feb 27, 2025

    @srittau
    Collaborator

    For reference, here we can see that the google-cloud-ndb tests run for 903.70 s aka 15 min: https://github.com/python/typeshed/actions/runs/13555948200/job/37890157810. I can reproduce this locally.

    Another check from the same shard that takes surprisingly long is the ldap3 check, which takes about a minute, with most checks lasting well below 10s. I suspect some stubtest shenanigans, which warrants a closer inspection.

  5. srittau commented on Mar 16, 2025

    @srittau
    Collaborator

    I wrongly blamed stubtest. At least for google-cloud-ndb and dateparser installing the dependencies is what takes so long. Locally, for google-cloud-ndb pip installing google-cloud-ndb[]==2.3.* mypy==1.15.0 protobuf==3.20.2 six took 433 seconds (> 7 minutes), while running stubtest only took a good second. Installing the dependencies for dateparser took ~20s, probably because numpy is among the indirect dependencies.

  6. added a commit that references this issue on Mar 16, 2025
    a3847aa
  7. srittau commented on Mar 16, 2025

    @srittau
    Collaborator

    In the case of google-cloud-ndb, the ancient stubtest requirements (that are unnecessary by now) cause pip to download many different versions of the various indirect dependencies, trying to find a solution. It eventually succeeds, but needed to download all of PyPI for it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions