Repository navigation
Bring in a faster Transform stream #147
Description
https://github.com/mcollina/syncthrough offers 3x the throughput of Transform. https://www.npmjs.com/package/minipass offer similar characteristics.
I think bringing in a faster set of Streams that enforce backpressure would speed up an area of Node.js that is showing its time.
Activity
rluvaton commentedon Feb 9, 2024
I don't think we should have another stream implementation, this will be confusing and need to maintain multiple implementations for complex topic
ronag commentedon Feb 9, 2024
There is room to further optimize
stream.Transformto be close to synchthrough. To begin with we should avoid the double buffering and implementstream.Transformas astream.Readablewithstream.Writablecompatible api.ronag commentedon Feb 9, 2024
Also rather than adding another stream api, I think we should add support for sync functions in pipeline, i.e.
mcollina commentedon Feb 9, 2024
I would love this, whoever the world depends on
_readableStateand_writableState. If you have ideas, I'm all ears.@ronag that would have almost the same effect. Maybe we could internalize SyncThrough or analog and use ti to support pipeline
rluvaton commentedon Feb 11, 2024
@ronag I remember u had some pr to remove the double buffering but stopped, do you remember what blocked you?
ronag commentedon Feb 11, 2024
Time was a blocker.