Repository navigation

PARQUET-2417: Add statistics support to geometry logical type - #2971

Merged

wgtmac merged 101 commits into

apache:masterfrom

zhangfengcdt:feature-apache-parquet-2417-geospatial

May 18, 2025

Merged

PARQUET-2417: Add statistics support to geometry logical type#2971
wgtmac merged 101 commits into
apache:masterfrom
zhangfengcdt:feature-apache-parquet-2417-geospatial

Commits on Jul 23, 2024
- PARQUET-2471: Add support for geometry logical type
  zhangfengcdt
  committed
  6a2e051
- fix types
  zhangfengcdt
  committed
  d354012
- Refactor BoundingBox and GeometryTypes
  zhangfengcdt
  committed
  969b696
Commits on Jul 24, 2024
- revert naming changes
  zhangfengcdt
  committed
  87ee8ea
- revert TestDecimalUtils
  zhangfengcdt
  committed
  d67e03b
- revert more
  zhangfengcdt
  committed
  ccf1c4a
- refactor statistics
  zhangfengcdt
  committed
  35342c2
- modify EnvelopeCovering
  zhangfengcdt
  committed
  bcfefb7
Commits on Jul 25, 2024
- add more unit tests
  zhangfengcdt
  committed
  cf615f6
- update comments
  zhangfengcdt
  committed
  c6ae733
Commits on Jul 26, 2024
- add comment for envelope converging expand calculation
  zhangfengcdt
  committed
  80a629e
Commits on Jul 29, 2024
- Fix the boundingbox initial values in constructor
  zhangfengcdt
  committed
  e0ec9ef
Commits on Aug 7, 2024
- Update the poc implementation for the changes to the spec
  zhangfengcdt
  committed
  7c728b1
- remove print
  zhangfengcdt
  committed
  fa36d06
Commits on Aug 8, 2024
- implement evelop covering for spherical coordinates
  zhangfengcdt
  committed
  2a1c62a
Commits on Aug 12, 2024
Commits on Aug 19, 2024
- address some review comments
  zhangfengcdt
  committed
  0c4b8b4
Commits on Aug 20, 2024
- revert changes that are not desired
  zhangfengcdt
  committed
  a56e9ad
- refactor toString and remove test scope of jts-core in parquet-hadoop module
  zhangfengcdt
  committed
  1ae3d99
Commits on Aug 23, 2024
- refactor the converings to be map to avoid ordering issues in stats merge
  zhangfengcdt
  committed
  198642d
Commits on Sep 13, 2024
- address review comments
  zhangfengcdt
  committed
  0cf2de9
- fix formating
  zhangfengcdt
  committed
  4f0f7ed
Commits on Sep 23, 2024
- address comments to remove string parsing (to be consistent with spec)
  zhangfengcdt
  committed
  a378a9a
Commits on Oct 17, 2024
- update according to the changes to the upstream pqrquet-format pr
  zhangfengcdt
  committed
  698325a
- remove coverings
  zhangfengcdt
  committed
  d65ba8e
- add GeometryStatistics to ColumnMetaData
  zhangfengcdt
  committed
  1b0f5b9
- more code cleanup for covering
  zhangfengcdt
  committed
  342e400
Commits on Oct 18, 2024
- add toParquetGeometryStatistics
  zhangfengcdt
  committed
  3cc9b68
- fix check errors
  zhangfengcdt
  committed
  dc05cfd
Commits on Nov 13, 2024
- Merge branch 'master' of github.com:apache/parquet-java into feature-apache-parquet-2417-geospatial
  zhangfengcdt
  committed
  6f1d586
Commits on Feb 7, 2025
Commits on Feb 8, 2025
- handle the wraparound case for X values
  zhangfengcdt
  committed
  93e28b7
- support GEOGRAPHY type
  zhangfengcdt
  committed
  e688d05
- revert import changes
  zhangfengcdt
  committed
  01ac560
Commits on Feb 19, 2025
- address pr review comments
  zhangfengcdt
  committed
  f9585cd
- fix formatting issue
  zhangfengcdt
  committed
  b805cf4
- refactor geography logic type
  zhangfengcdt
  committed
  6aa7028
- revert the edge algorithm to use string to avoid loop dependency
  zhangfengcdt
  committed
  4536e5f
Commits on Feb 21, 2025
- add enum EdgeInterpolationAlgorithm for the geography edge algorithm
  zhangfengcdt
  committed
  f188341
- address pr comments: rename, hash, and equal
  zhangfengcdt
  committed
  214fd39
- remove column index changes
  zhangfengcdt
  committed
  907acce
- revert unnecessary changes
  zhangfengcdt
  committed
  ef83a2e
Commits on Feb 24, 2025
- refactor GeospatialStatistics
  zhangfengcdt
  committed
  c5d542b
- refactor writers
  zhangfengcdt
  committed
  c1fb37b
- refactor to use colomn value collector instead of binary statistics
  zhangfengcdt
  committed
  dac9ad0
- revert getLogicalTypeAnnotation
  zhangfengcdt
  committed
  e0a319e
- fix TestColumnChunkPageWriteStore
  zhangfengcdt
  committed
  4fd177d
- remove DummyBoundingBox
  zhangfengcdt
  committed
  9f0482e
Commits on Feb 25, 2025
- handle noop builder and null values
  zhangfengcdt
  committed
  ebd45a9
- refactor normalizeLongitude
  zhangfengcdt
  committed
  0114701
- add ShowGeospatialStatisticsCommand and tests
  zhangfengcdt
  committed
  4cd8dfd
Commits on Feb 28, 2025
- add shouldNormalizeLongitude
  zhangfengcdt
  committed
  5ec6546
Commits on Mar 3, 2025
- add allowWraparound
  zhangfengcdt
  committed
  23af52f
Commits on Mar 18, 2025
- Merge remote-tracking branch 'apache/master' into feature-apache-parquet-2417-geospatial
  zhangfengcdt
  committed
  d0081be
- add allowWraparound in bbox to ParquetProperties
  zhangfengcdt
  committed
  375de55
Commits on Mar 24, 2025
- update to use the latest parquet-format release
  zhangfengcdt
  committed
  92f45c2
- improve handling null, empty, and nan cases in boundingbox
  zhangfengcdt
  committed
  1ecb5b6
Commits on Mar 28, 2025
- remove wrap around logic
  zhangfengcdt
  committed
  4c10575
Commits on Mar 29, 2025
- set initial state of bbox to NaN
  zhangfengcdt
  committed
  8937907
- add more unit tests to boundingbox
  zhangfengcdt
  committed
  928109d
- fix comments
  zhangfengcdt
  committed
  9d08f92
Commits on Apr 1, 2025
- make sure no NaN is saved to parquet meta
  zhangfengcdt
  committed
  f751eb3
- upgrade jts version
  zhangfengcdt
  committed
  9916908
Commits on Apr 9, 2025
- address pr review comments
  zhangfengcdt
  committed
  df461cc
Commits on Apr 11, 2025
- address pr review comments
  zhangfengcdt
  committed
  f3c4979
- refactor BoundingBox
  zhangfengcdt
  committed
  7b98a10
- revamp check valid in the geo statistics
  zhangfengcdt
  committed
  79c80c8
Commits on Apr 14, 2025
- update handling of invalid and empty bbox
  zhangfengcdt
  committed
  f6610e7
- Merge remote-tracking branch 'apache/master' into feature-apache-parquet-2417-geospatial
  zhangfengcdt
  committed
  3fdef44
- fix unit tests
  zhangfengcdt
  committed
  91e9d26
- add update + merge test cases with NaN inputs
  zhangfengcdt
  committed
  af23c11
Commits on Apr 24, 2025
- Merge remote-tracking branch 'apache/master' into feature-apache-parquet-2417-geospatial
  zhangfengcdt
  committed
  819b3e3
- address some pr comments
  zhangfengcdt
  committed
  d8ffe0e
- add test to TestTypeBuilders
  zhangfengcdt
  committed
  e88268d
- add more tests and fix some comments
  zhangfengcdt
  committed
  398dd0b
- fix fmt
  zhangfengcdt
  committed
  efe8875
- fix the test dependency issue
  zhangfengcdt
  committed
  455d15b
- fix dependency issue
  zhangfengcdt
  committed
  5e6579f
Commits on Apr 25, 2025
- clean up the code and add more unit tests
  zhangfengcdt
  committed
  eecd915
Commits on Apr 29, 2025
- Merge remote-tracking branch 'apache/master' into feature-apache-parquet-2417-geospatial
  zhangfengcdt
  committed
  5c63b4e
Commits on May 5, 2025
- address pr comments
  zhangfengcdt
  committed
  ccd0715
Commits on May 12, 2025
- address pr comment to only check the first coordinate for types update
  zhangfengcdt
  committed
  ef8e343
- change the behavior of merge null or invalid statistics
  zhangfengcdt
  committed
  81eb57d
- change null or invalid only
  zhangfengcdt
  committed
  e904e3e
Commits on May 14, 2025
- address review comments - part 1
  zhangfengcdt
  committed
  882ef38
- address review comments - part 2
  zhangfengcdt
  committed
  e9d2426
- address review comments
  zhangfengcdt
  committed
  7955496
- fix tests
  zhangfengcdt
  committed
  74e94ab
- update the test to reflect the changes of "Failed to parse WKB geometry, omit it from stats"
  zhangfengcdt
  committed
  9f3d31a
- fix testInvalidGeometryPresented
  zhangfengcdt
  committed
  136bbf4
- fix spotless errors
  zhangfengcdt
  committed
  945ecdf
Commits on May 16, 2025
- address review comments - part 1
  zhangfengcdt
  committed
  f5dd1d0
- add validity check before checkking any bbox values
  zhangfengcdt
  committed
  dbc8798
- split xy into x and y for valid and empty check
  zhangfengcdt
  committed
  33d3b77
- fix scala fmt issue
  zhangfengcdt
  committed
  1957dca
- rename geometry package to geospatial package
  zhangfengcdt
  committed
  aec732e
- clean up code
  zhangfengcdt
  committed
  476dfff

Commits

Commits on Jul 23, 2024

Commits on Jul 24, 2024

Commits on Jul 25, 2024

Commits on Jul 26, 2024

Commits on Jul 29, 2024

Commits on Aug 7, 2024

Commits on Aug 8, 2024

Commits on Aug 12, 2024

Commits on Aug 19, 2024

Commits on Aug 20, 2024

Commits on Aug 23, 2024

Commits on Sep 13, 2024

Commits on Sep 23, 2024

Commits on Oct 17, 2024

Commits on Oct 18, 2024

Commits on Nov 13, 2024

Commits on Feb 7, 2025

Commits on Feb 8, 2025

Commits on Feb 19, 2025

Commits on Feb 21, 2025

Commits on Feb 24, 2025

Commits on Feb 25, 2025

Commits on Feb 28, 2025

Commits on Mar 3, 2025

Commits on Mar 18, 2025

Commits on Mar 24, 2025

Commits on Mar 28, 2025

Commits on Mar 29, 2025

Commits on Apr 1, 2025

Commits on Apr 9, 2025

Commits on Apr 11, 2025

Commits on Apr 14, 2025

Commits on Apr 24, 2025

Commits on Apr 25, 2025

Commits on Apr 29, 2025

Commits on May 5, 2025

Commits on May 12, 2025

Commits on May 14, 2025

Commits on May 16, 2025