You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Python][R] GcsFilesystem can appear to hang for non permanent errors #32332
GcsFileSystem will attempt to retry if it gets a non-permanent error (such as couldn't connect to server). That's fine, except: (1) the sleep call used by the retry doesn't seem to check for interrupts and (2) the default retry timeout is 15 minutes!
The following snippets will hang for 15 minutes if you run them and wait about 5 seconds before trying to do a keyboard interrupt (CTRL+C):
Ian Cook / @ianmcook:
As of the 9.0.0 release, R package docs contain a reference to this 15-minute default and an example showing how to override it (added in ARROW-16887) and the PyArrow docs contain an example showing how to override it (added in ARROW-16818). If we choose to implement a different default retry timeout to solve this issue, these docs should be modified accordingly.
Activity
asfimport commentedon Jul 8, 2022
Will Jones / @wjones127:
FYI @coryan
asfimport commentedon Jul 22, 2022
Ian Cook / @ianmcook:
As of the 9.0.0 release, R package docs contain a reference to this 15-minute default and an example showing how to override it (added in ARROW-16887) and the PyArrow docs contain an example showing how to override it (added in ARROW-16818). If we choose to implement a different default retry timeout to solve this issue, these docs should be modified accordingly.