You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Joris Van den Bossche / @jorisvandenbossche: @pitrou I was looking into this what removing it would involve. But so we still have one place internally where we use the (de)serialization machinery ourselves, i.e. in plasma.
In the Python plasma code, we use it for the PlasmaClient.put/PlasmaClient.get to put/get generic Python objects in the plasma store (
). It is relatively easy to only keep those two functions in (de)serialize.cc and remove the rest we no longer need. But are you aware of other internal utilities that might cover that as well?
Joris Van den Bossche / @jorisvandenbossche:
No, I don't think we ever officially / explicitly decided to deprecate Plasma (although there are regularly mailing list threads asking about plasma status confirming it is basically unmaintained)
Activity
asfimport commentedon Sep 24, 2021
Joris Van den Bossche / @jorisvandenbossche:
@pitrou I was looking into this what removing it would involve. But so we still have one place internally where we use the (de)serialization machinery ourselves, i.e. in plasma.
In the Python plasma code, we use it for the
PlasmaClient.put/PlasmaClient.getto put/get generic Python objects in the plasma store (arrow/python/pyarrow/_plasma.pyx
Lines 543 to 547 in 83e1698
In addition, we also use part of the
arrow::pyserialize functionality in the plasma C++ code:WriteNdarrayHeader(arrow/python/pyarrow/tensorflow/plasma_op.cc
Line 141 in 83e1698
NdarrayFromBuffer(arrow/python/pyarrow/tensorflow/plasma_op.cc
Line 286 in 83e1698
asfimport commentedon Sep 27, 2021
Antoine Pitrou / @pitrou:
Isn't Plasma explicitly deprecated or did we forget to raise any warnings?
asfimport commentedon Sep 28, 2021
Joris Van den Bossche / @jorisvandenbossche:
No, I don't think we ever officially / explicitly decided to deprecate Plasma (although there are regularly mailing list threads asking about plasma status confirming it is basically unmaintained)
GH-29705: [Python] Remove deprecated pyarrow.serialization functional…
apacheGH-29705: [Python] Remove deprecated pyarrow.serialization func…
apacheGH-29705: [Python] Remove deprecated pyarrow.serialization func…
apacheGH-29705: [Python] Clean-up no-longer-used pandas dataframe ser…
GH-29705: [Python] Clean-up no-longer-used pandas dataframe serializa…