You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Python][Packaging] Stop uploading nightly wheels to gemfury #43904
I filed an issue to document the new index URL, #45288, and just put up a patch for it, #45289. So the new text can land in Arrow 20.0.0.
Do we have any sense of whether Gemfury is being used at all? I'm not totally sure we'd have to wait until the release after 20.0.0 to remove Gemfury from CI considering how we present it to users. Either way, I'm happy to follow-up with a PR removing Gemfury after #45288 is resolved.
Good call on doing that search. If we just stop uploading to gemfury and those projects don't migrate, I guess they'll think they're testing against a recent PyArrow nightly when they're actually just getting the last version we published to gemfury which could be very out of date. Maybe we can do the following:
Stop uploading nightly wheels to gemfury
Post to the dev list (using careful language to make it clear the nightlies aren't an official release, etc, etc)
Filter through that GitHub search and identify repos to file issues against to notify of the change and give them a cutoff date
Disable/delete or otherwise remove the arrow-nightlies index so installs against it fail. This would be done
Is that too much? If it sounds good, I can take on 1, 2, and 3 if someone with credentials can do 4 when the time comes.
@amoeba should we follow this up? I've submitted a couple of PRs to the biggest repositories (dask and python-bigquery). I think we should get rid of gemfury wheels upload, possibly after 21.0.0? Reasons:
Nightly wheels are not official released artifacts and we always add the warning to the documentation.
We have been uploading them on the scientific nightlies channel since 4th September 2024
We updated the documentation officially for 20.0.0
Hey @raulcd thanks for the reminder and thanks for doing those PRs. Moving ahead with this for the 22.0.0 release sounds good. I can start in on this once the 21.0.0 release is out.
Reacted by Raúl Cumplido and Joris Van den Bossche
Activity
jorisvandenbossche commentedon Sep 3, 2024
I think we should probably keep it for some time on both, and at least start with documenting the new index url as soon as possible.
(for example at least keep until 18.0 is released, when the stable docs will have the updated url)
raulcd commentedon Jan 15, 2025
We don't seem to have updated the documentation on the new index URL, we should try update it for the next release.
amoeba commentedon Jan 16, 2025
I filed an issue to document the new index URL, #45288, and just put up a patch for it, #45289. So the new text can land in Arrow 20.0.0.
Do we have any sense of whether Gemfury is being used at all? I'm not totally sure we'd have to wait until the release after 20.0.0 to remove Gemfury from CI considering how we present it to users. Either way, I'm happy to follow-up with a PR removing Gemfury after #45288 is resolved.
jorisvandenbossche commentedon Jan 17, 2025
It is certainly being used by a bunch of projects to test the dev version of pyarrow. For example https://github.com/search?q=https%3A%2F%2Fpypi.fury.io%2Farrow-nightlies%2F&type=code
amoeba commentedon Jan 17, 2025
Good call on doing that search. If we just stop uploading to gemfury and those projects don't migrate, I guess they'll think they're testing against a recent PyArrow nightly when they're actually just getting the last version we published to gemfury which could be very out of date. Maybe we can do the following:
Is that too much? If it sounds good, I can take on 1, 2, and 3 if someone with credentials can do 4 when the time comes.
raulcd commentedon Jun 23, 2025
@amoeba should we follow this up? I've submitted a couple of PRs to the biggest repositories (dask and python-bigquery). I think we should get rid of gemfury wheels upload, possibly after 21.0.0? Reasons:
amoeba commentedon Jun 25, 2025
Hey @raulcd thanks for the reminder and thanks for doing those PRs. Moving ahead with this for the 22.0.0 release sounds good. I can start in on this once the 21.0.0 release is out.
apacheGH-43904: [CI][Python] Stop uploading nightly wheels to gemfury
GH-43904: [CI][Python] Stop uploading nightly wheels to gemfury (#47470)
raulcd commentedon Sep 3, 2025
Issue resolved by pull request 47470
#47470
apacheGH-43904: [CI][Python] Stop uploading nightly wheels to gemfury (…