Skip to content

[Python] Create Python examples of HTTP GET Arrow client and server using HTTP compression #40601

Closed
apache/arrow-experiments
#35

Description

@ianmcook

Describe the enhancement requested

Create simple Python-based HTTP client and server examples like the ones in arrow-experiments/http/get_simple or arrow-experiments/http/get_range but using HTTP compression.

For example, the client sends a request with header Accept-Encoding: gzip, deflate, br, zstd and the server sends a response with header Content-Encoding: gzip and with the response body gzip-compressed which the HTTP client library automatically decompresses.

Component(s)

Python

Activity

  1. felipecrv commented on Mar 17, 2024

    @felipecrv
    Contributor

    watching

  2. ianmcook commented on Jun 29, 2024

    @ianmcook
    MemberAuthor

    @felipecrv I suggested using Python here for simplicity, but it could be in some other language if needed

  3. ianmcook commented on Sep 4, 2024

    @ianmcook
    MemberAuthor

    @felipecrv let's please make sure we test HTTP compression using the zstd codec. That way we will have a same-codec comparison between HTTP compression and Arrow IPC buffer compression.

    We should also test other HTTP compression codecs, since zstd is not as common for HTTP.

    (Besides zstd, the only other codec that IPC buffer compression supports is lz4. But lz4 is rarely or never supported for HTTP compression. So zstd is our only choice for same-codec comparisons.)

  4. felipecrv commented on Sep 5, 2024

    @felipecrv
    Contributor

    I'm doing all of them actually. Server can acts according to the Accept-Encoding header and negotiate the chosen compression. But I will put a recommendation for zstd for sure.

  5. felipecrv commented on Sep 6, 2024

    @felipecrv
    Contributor
  6. pinned this issue on Sep 7, 2024
  7. unpinned this issue on Sep 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions