Repository navigation

GH-116380: Speed up `glob.glob()` by removing some system calls - #116392

Merged

barneygale merged 101 commits into

python:mainfrom

barneygale:gh-116380

Feb 28, 2025

Commits on Mar 5, 2024
- GH-116380: Make `glob.glob()` twice as fast
  barneygale
  committed
  db3c620
- Use `os.listdir()` if we don't need to check entry type.
  barneygale
  committed
  9e1f059
Commits on Mar 6, 2024
- A few small speedups.
  barneygale
  committed
  10432df
- Simplify prefix removal
  barneygale
  committed
  7e389e2
- Re-implement `glob0()`, `glob1()`, and `has_magic()`.
  barneygale
  committed
  8680a0a
- Fix errant `StopIteration`.
  barneygale
  committed
  3bf3124
- Skip compiling pattern for consecutive `**` segments.
  barneygale
  committed
  f8fb992
- Clarify regex/path building in literal and recursive selectors.
  barneygale
  committed
  50ef080
- Simplify code to ignore root_dir.
  barneygale
  committed
  ccefacd
- Fix possible Windows separator issue.
  barneygale
  committed
  fa951f6
- Address some review feedback.
  barneygale
  committed
  0aec12c
- Use assignment expressions in a couple of places
  barneygale
  committed
  72691ba
- Replace lambda with `operator.not_`.
  barneygale
  committed
  c58dd21
- Merge branch 'main' into gh-116380
  barneygale
  committed
  c361ec9
- Speed up `_add_trailing_slash()`
  barneygale
  committed
  22b30db
Commits on Mar 7, 2024
- Speed up `select_literal()`
  barneygale
  committed
  83b70bd
- Speed up `select_recursive()`
  barneygale
  committed
  1d32d14
Commits on Mar 17, 2024
- Merge branch 'main' into gh-116380
  barneygale
  authored
  1e5aacc
Commits on Mar 18, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  a038bb8
- Cache compiled patterns rather than selectors.
  barneygale
  committed
  f1440a9
- Remove a bit of code duplication.
  barneygale
  committed
  9c64643
Commits on Mar 19, 2024
- Fix stray newline
  barneygale
  committed
  b0e8ba6
Commits on Mar 22, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  1b1233e
Commits on Mar 28, 2024
- Remove tests for glob0 and glob1
  barneygale
  committed
  0e02ec5
Commits on Mar 29, 2024
- Add a bunch of comments explaining the more subtle parts.
  barneygale
  committed
  be4865e
Commits on Apr 1, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  203e8ef
Commits on Apr 3, 2024
- Clarify variable naming in iglob()
  barneygale
  committed
  13355a0
Commits on Apr 4, 2024
- Use keyword arguments to pass True/False/None literals, for clarity.
  barneygale
  committed
  2e5cebd
- Speed up recursive globbing very slightly
  barneygale
  committed
  5eba2eb
Commits on Apr 5, 2024
- Merge branch 'main' into gh-116380
  barneygale
  authored
  b0a99b7
- Implement recursive wildcards with a stack
  barneygale
  committed
  ad0ece8
- Add argument defaults, simplify code slightly.
  barneygale
  committed
  cafe9be
- Also make rel_path optional
  barneygale
  committed
  301d922
- Optimise _add_trailing_slash
  barneygale
  committed
  beb2507
Commits on Apr 6, 2024
- Remove use of os.listdir() -- doesn't generalise
  barneygale
  committed
  312c73a
- Add `_Globber` class; prepare for merger with pathlib globbing.
  barneygale
  committed
  ae820e2
- Unify with pathlib implementation \o/
  barneygale
  committed
  dcfe11d
- Use literal selector only if no case sensitivity preference is given.
  barneygale
  committed
  123a0f6
- Fix a few tests
  barneygale
  committed
  0ed7b9c
- Fix a few more tests.
  barneygale
  committed
  aceb85f
Commits on Apr 10, 2024
- Merge commit '689ada79150f28b0053fa6c1fb646b75ab2cc200' into gh-116380
  barneygale
  committed
  b04de9d
- Merge branch 'main' into gh-116380
  barneygale
  committed
  3eb2d19
- Fix select() argument order.
  barneygale
  committed
  8a15db0
Commits on Apr 12, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  7eb3e61
Commits on May 3, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  316ea56
- Support `include_hidden` and `dir_fd` in `pathlib._glob`.
  barneygale
  committed
  2018027
- Fix stray newline
  barneygale
  committed
  2f21626
Commits on May 4, 2024
- Update Lib/pathlib/_glob.py
  
  barneygale
  and
  eendebakpt
  authored
  339df68
- Fix docs
  barneygale
  committed
  28aa95f
- Test for unique results
  barneygale
  committed
  abcb1f8
- Spacing
  barneygale
  committed
  71387a6
Commits on May 5, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  de22de6
Commits on May 7, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  8b08374
Commits on May 8, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  54efa7c
- Update whatsnew
  barneygale
  committed
  cf11922
Commits on May 14, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  6710924
Commits on May 31, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  a547cd2
- Close file descriptors when `recursive_selector` is finalized.
  barneygale
  committed
  14ae438
- Make `iglob()` a generator.
  barneygale
  committed
  69d7a86
- Make `_iglob()` a generator.
  barneygale
  committed
  3b84a1d
- Make `_relative_glob()` a generator.
  barneygale
  committed
  f9f9a8d
- Simplify skipping empty string
  barneygale
  committed
  24a9ee4
Commits on Jun 4, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  d05d58d
Commits on Jun 7, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  27c463e
- Make `_GlobberBase` fully abstract.
  barneygale
  committed
  a94f2a7
Commits on Jun 9, 2024
- Address review feedback
  barneygale
  committed
  d19bb89
- Typo fix
  barneygale
  committed
  1677588
- Speed up pattern parsing.
  barneygale
  committed
  539f044
Commits on Jun 12, 2024
- Add test for globbing above recursion limit.
  barneygale
  committed
  70a1b42
Commits on Aug 26, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  1560712
Commits on Sep 1, 2024
- Apply suggestions from code review
  
  barneygale
  and
  picnixz
  authored
  099e86e
- Test that `iglob().close()` closes file descriptors.
  barneygale
  committed
  ee76faf
- Address some review feedback
  barneygale
  committed
  4cf8a4d
Commits on Oct 27, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  8a118a7
- Address more review comments
  barneygale
  committed
  3ad9367
- Drop parse_entry
  barneygale
  committed
  66af33d
Commits on Oct 28, 2024
- Address review feedback
  barneygale
  committed
  ce74ef1
- Add comment.
  barneygale
  committed
  a69a060
Commits on Nov 1, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  a10a1e0
Commits on Nov 8, 2024
- Merge branch 'main' into gh-116380
  barneygale
  committed
  e2e0a2e
Commits on Nov 27, 2024
- Merge branch 'main' into gh-116380
  barneygale
  authored
  be260c1
Commits on Jan 13, 2025
- Merge branch 'main' into gh-116380
  barneygale
  committed
  0d1dc7e
Commits on Jan 16, 2025
- Merge branch 'main' into gh-116380
  barneygale
  committed
  f1c5326
Commits on Feb 4, 2025
- Merge branch 'main' into gh-116380
  barneygale
  committed
  e113457
Commits on Feb 8, 2025
- Merge branch 'main' into gh-116380
  barneygale
  committed
  d8ec2d4
- Merge branch 'main' into gh-116380
  barneygale
  committed
  203b78b
- Windows test fixes
  barneygale
  committed
  ffeb81a
- Speed up suppression of initial empty path.
  barneygale
  committed
  ec157a1
- Anticipate the removal of glob0() and glob1()
  barneygale
  committed
  7a620db
- Merge branch 'main' into gh-116380
  barneygale
  committed
  e9fa3ac
- Handle _initial_path_exists more explicitly in select_special()
  barneygale
  committed
  46429ad
- Add comment, remove redundant check
  barneygale
  committed
  f160e8c
Commits on Feb 9, 2025
- Avoid slicing prefix when root_dir is None
  barneygale
  committed
  47846ca
Commits on Feb 12, 2025
- Replace `_initial_path_exists` sentinel with `empty` boolean arg
  barneygale
  committed
  e55d946
- Slightly simplify recursive globbing
  barneygale
  committed
  47499c7
- Revert "Slightly simplify recursive globbing"
  barneygale
  committed
  849de87
- Split out method for scanning cwd
  barneygale
  committed
  10a6cf4
Commits on Feb 14, 2025
- Merge branch 'main' into gh-116380
  barneygale
  authored
  413b12e
Commits on Feb 18, 2025
- Merge branch 'main' into gh-116380
  barneygale
  committed
  acf0f9b
Commits on Feb 21, 2025
- Merge branch 'main' into gh-116380
  barneygale
  authored
  a89211f
Commits on Feb 28, 2025
- Merge branch 'main' into gh-116380
  barneygale
  authored
  e4c519c

Commits

Commits on Mar 5, 2024

Commits on Mar 6, 2024

Commits on Mar 7, 2024

Commits on Mar 17, 2024

Commits on Mar 18, 2024

Commits on Mar 19, 2024

Commits on Mar 22, 2024

Commits on Mar 28, 2024

Commits on Mar 29, 2024

Commits on Apr 1, 2024

Commits on Apr 3, 2024

Commits on Apr 4, 2024

Commits on Apr 5, 2024

Commits on Apr 6, 2024

Commits on Apr 10, 2024

Commits on Apr 12, 2024

Commits on May 3, 2024

Commits on May 4, 2024

Commits on May 5, 2024

Commits on May 7, 2024

Commits on May 8, 2024

Commits on May 14, 2024

Commits on May 31, 2024

Commits on Jun 4, 2024

Commits on Jun 7, 2024

Commits on Jun 9, 2024

Commits on Jun 12, 2024

Commits on Aug 26, 2024

Commits on Sep 1, 2024

Commits on Oct 27, 2024

Commits on Oct 28, 2024

Commits on Nov 1, 2024

Commits on Nov 8, 2024

Commits on Nov 27, 2024

Commits on Jan 13, 2025

Commits on Jan 16, 2025

Commits on Feb 4, 2025

Commits on Feb 8, 2025

Commits on Feb 9, 2025

Commits on Feb 12, 2025

Commits on Feb 14, 2025

Commits on Feb 18, 2025

Commits on Feb 21, 2025

Commits on Feb 28, 2025