Skip to content

Shard mypy_primer more - #9443

Closed
AlexWaygood wants to merge 1 commit into
python:mainfrom
AlexWaygood:primer-shards
Closed

AlexWaygood wants to merge 1 commit into
python:mainfrom
AlexWaygood:primer-shards

Conversation

@AlexWaygood

Copy link
Copy Markdown
Member

Might help reduce the performance impact of #9433 on mypy_primer CI runs.

@AlexWaygood

Copy link
Copy Markdown
Member Author

Yeah, doesn't look like this helps

@AlexWaygood AlexWaygood closed this Jan 2, 2023
@AlexWaygood
AlexWaygood deleted the primer-shards branch January 2, 2023 17:47
@github-actions

github-actions Bot commented Jan 2, 2023

Copy link
Copy Markdown
Contributor

According to mypy_primer, this change has no effect on the checked open source code. 🤖🎉

@AlexWaygood

AlexWaygood commented Jan 2, 2023 •

Copy link
Copy Markdown
Member Author

It looks like we had:

  1. A 6:01 shard
  2. An 8:18 shard
  3. A 5:45 shard
  4. A 6:23 shard
  5. A 17:02 shard(!!)
  6. A 5:35 shard

For shard 4, it took 8 minutes for each run of mypy checking manticore, far exceeding any of the other projects in that shard. No other project in shard 4 took >1 minute to be checked once by mypy.

Whether or not we decide to revert #9433, that's quite interesting! Cc. @hauntsaninja.

@hauntsaninja

Copy link
Copy Markdown
Collaborator

That is interesting. I took a closer look, should be a simple fix to improve perf on manticore.

hauntsaninja added a commit to hauntsaninja/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s.

I looked into this because of python/typeshed#9443 (comment)
hauntsaninja added a commit to python/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s (uncompiled).

I looked into this because of
python/typeshed#9443 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants