Repository navigation
Add missing scalar functions #463
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I would like access to the full set of scalar functions defined in the Rust library.
Describe the solution you'd like
I would like to have Python bindings for the following functions:
Math Functions
- acosh
- asinh
- atanh
- cbrt
- cosh
- degrees
- factorial
- gcd
- isnan: Add
isnanandiszero#495 - iszero: Add
isnanandiszero#495 - lcm
- nanvl
- pi
- radians
- sinh
- tanh
Binary String Functions
- encode: add Binary String Functions;encode,decode #494
- decode: add Binary String Functions;encode,decode #494
Array Functions
- array_append
- array_cat
- array_concat
- array_dims
- array_element
- array_empty
- array_extract
- [ ] array_fillremoved Implementarray_repeat, removearray_filldatafusion#7199 - array_has
- array_has_all
- array_has_any
- array_indexof
- array_join
- array_length
- array_ndims
- array_pop_back
- array_position
- array_positions
- array_prepend
- array_push_back
- array_push_front
- array_remove
- array_remove_all
- array_remove_n
- array_repeat
- array_replace
- array_replace_all
- array_replace_n
- array_slice
- array_to_string
- cardinality
- empty
- flatten
- list_append
- list_cat
- list_concat
- list_dims
- list_element
- list_extract
- list_indexof
- list_join
- list_length
- list_ndims
- list_position
- list_positions
- list_prepend
- list_push_back
- list_push_front
- list_remove
- list_remove_all
- list_remove_n
- list_repeat
- list_replace
- list_replace_all
- list_replace_n
- list_slice
- list_to_string
- make_list
[ ] trim_arraydeprecated
Time and Date Functions
- extract
Other Functions
- arrow_cast
Describe alternatives you've considered
None
Reacted by Andy Grove
Activity
jiangzhx commentedon Sep 11, 2023
Some scalar functions are available in Datafusion version 30.0.0. Maybe we should first update our datafusion version.
block by #464
viirya commentedon Sep 11, 2023
Please add your PR on the particular functions it works on, in order to avoid conflict.
mobley-trent commentedon Jan 15, 2024
Hello @ongchi I'd like to contribute on some of the functions on the list
ongchi commentedon Jan 15, 2024
@mobley-trent
Great! Most of the array functions have been done but not completely. I'm not going to add more functions to my PR, so feel free to contribute to any functions that are not implemented.
judahrand commentedon Mar 4, 2024
I think most of the remaining ones are covered in #605
kosiew commentedon Oct 29, 2024
datafusion has removed array_fill - apache/datafusion#7199
kosiew commentedon Nov 14, 2024
trim_array has been deprecated - https://github.com/apache/datafusion/blob/main/docs/source/user-guide/expressions.md, apache/datafusion#6936
exkson commentedon Mar 4, 2025
Hello, i would like to work on this issue but I'm currently unable to assign it to myself with
takecommand.viirya commentedon Mar 4, 2025
You can claim what function you are going to work and submit the PR directly without assigning.
Like previous comments and contributors did.
deanm0000 commentedon Mar 14, 2025
I see cardinality, empty, list_cat, list_concat, list_repeat, make_list, extract, and arrow_cast in functions.py. Only thing missing is trim_array if whoever has control of the checkboxes wants to check those.
rawwar commentedon Mar 17, 2025
trim_array is now deprecated. So, this issue can be marked as complete? @viirya