Skip to content

[C++] Improve Dataset Write Option Defaults #32672

Closed

Description

@asfimport

Currently, for writing a table to disk directly, the defaults are suitable when going to a CSV, IPC, Parquet, etc. However, writing a dataset requires multiple options to be configured, even when defaults could be obvious, e.g., the name for the fragments requires user input, when often they'll be named something like "part{i}.parquet." Ideally, the defaults should be adequate to write a Dataset, without further user configuration.

Reporter: Kae Suarez / @ksuarez1423

Related issues:

Note: This issue was originally created as ARROW-17402. Please see the migration documentation for further details.

Activity

  1. asfimport commented on Aug 12, 2022

    @asfimport
    Author

    David Li / @lidavidm:
    Possibly falls under ARROW-15409?

  2. asfimport commented on Aug 16, 2022

    @asfimport
    Author

    Kae Suarez / @ksuarez1423:
    Yes, this is part of ARROW-15409, in reality. 

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions