Skip to content

[CI][Crossbow] Nightly dask integration job fails #22805

Closed

Description

@asfimport

See https://circleci.com/gh/ursa-labs/crossbow/2326. Either fix, skip job and create followup Jira to unskip, or delete job.

Reporter: Neal Richardson / @nealrichardson
Assignee: Wes McKinney / @wesm

PRs and other links:

Note: This issue was originally created as ARROW-6435. Please see the migration documentation for further details.

Activity

  1. asfimport commented on Sep 5, 2019

    @asfimport
    Author

    Wes McKinney / @wesm:
    Ben shared the reproducer with me. Neither of these failure modes here is great

    In [1]: s = pd.Series([np.nan, np.nan]) 
    
    In [10]: pa.array(s, type=pa.list_(pa.int64()), from_pandas=True, safe=True)
    ---------------------------------------------------------------------------
    ArrowNotImplementedError                  Traceback (most recent call last)
    <ipython-input-10-1e7ed1b785ed> in <module>
    ----> 1 pa.array(s, type=pa.list_(pa.int64()), from_pandas=True, safe=True)
    
    ~/code/arrow/python/pyarrow/array.pxi in pyarrow.lib.array()
        205                 values, type = pandas_api.compat.get_datetimetz_type(
        206                     values, obj.dtype, type)
    --> 207             return _ndarray_to_array(values, mask, type, c_from_pandas, safe,
        208                                      pool)
        209     else:
    
    ~/code/arrow/python/pyarrow/array.pxi in pyarrow.lib._ndarray_to_array()
         76
         77     with nogil:
    ---> 78         check_status(NdarrayToArrow(pool, values, mask, from_pandas,
         79                                     c_type, cast_options, &chunked_out))
         80
    
    ~/code/arrow/python/pyarrow/error.pxi in pyarrow.lib.check_status()
         84             raise ArrowKeyError(message)
         85         elif status.IsNotImplemented():
    ---> 86             raise ArrowNotImplementedError(message)
         87         elif status.IsTypeError():
         88             raise ArrowTypeError(message)
    
    ArrowNotImplementedError: NumPyConverter doesn't implement <list<item: int64>> conversion.
    In ../src/arrow/python/numpy_to_arrow.cc, line 821, code: converter.Convert()
    
    In [11]: s = pd.Series([np.nan, np.nan], dtype=object)
    
    In [12]: s
    Out[12]:
    0    NaN
    1    NaN
    dtype: object
    
    In [13]: pa.array(s, type=pa.list_(pa.int64()), from_pandas=True, safe=True)
    ---------------------------------------------------------------------------
    TypeError                                 Traceback (most recent call last)
    <ipython-input-13-1e7ed1b785ed> in <module>
    ----> 1 pa.array(s, type=pa.list_(pa.int64()), from_pandas=True, safe=True)
    
    ~/code/arrow/python/pyarrow/array.pxi in pyarrow.lib.array()
        205                 values, type = pandas_api.compat.get_datetimetz_type(
        206                     values, obj.dtype, type)
    --> 207             return _ndarray_to_array(values, mask, type, c_from_pandas, safe,
        208                                      pool)
        209     else:
    
    ~/code/arrow/python/pyarrow/array.pxi in pyarrow.lib._ndarray_to_array()
         76
         77     with nogil:
    ---> 78         check_status(NdarrayToArrow(pool, values, mask, from_pandas,
         79                                     c_type, cast_options, &chunked_out))
         80
    
    TypeError: object of type 'float' has no len()

    I'm going to take a look

  2. asfimport commented on Sep 6, 2019

    @asfimport
    Author

    Wes McKinney / @wesm:
    Issue resolved by pull request 5302
    #5302

  3. asfimport commented on Sep 15, 2019

    @asfimport
    Author

    Wes McKinney / @wesm:
    This is broken again.

  4. asfimport commented on Sep 16, 2019

    @asfimport
    Author

    Wes McKinney / @wesm:
    These are working again, I guess the failure I saw hadn't gotten the fix in dask master yet

  5. added this to the 0.15.0 milestone on Jan 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions