Repository navigation
Error in .util_download #66
Copy link
Copy link
Open
Description
library(BiocFileCache)
path <- tempfile()
bfc <- BiocFileCache(path, ask = FALSE)
remoteresource <- "https://bioconductorhubs.blob.core.windows.net/annotationhub/goldenpath/hg19/database/stsMap_0.0.1.RData"
proxy <- "http://prox1:3128/"
bfcadd(bfc, rname = "uniquename", fpath = remoteresource, proxy = proxy)
Error in .util_download(x, rid[i], proxy, progress, config, "bfcadd()", :
bfcadd() failed; see warnings()
In addition: Warning messages:
1: download failed
web resource path: ‘https://bioconductorhubs.blob.core.windows.net/annotationhub/goldenpath/hg19/database/stsMap_0.0.1.RData’
local file path: ‘/tmp/RtmpUyiOdh/fileff3f2260f4cc2/ff3f27e6e41cc_stsMap_0.0.1.RData’
reason: Failed to perform HTTP request.
Caused by error in `curl::curl_fetch_disk()`:
! Couldn't resolve proxy name [bioconductorhubs.blob.core.windows.net]:
Could not resolve proxy: prox1
2: bfcadd() failed; resource removed
rid: BFC1
fpath: ‘https://bioconductorhubs.blob.core.windows.net/annotationhub/goldenpath/hg19/database/stsMap_0.0.1.RData’
reason: download failed
packageDescription("BiocFileCache")
Package: BiocFileCache
Title: Manage Files Across Sessions
Version: 2.99.5
Authors@R: c(person("Lori", "Shepherd", email =
"lori.shepherd@roswellpark.org", role = c("aut", "cre")),
person("Martin", "Morgan", email =
"martin.morgan@roswellpark.org", role = "aut"))
Description: This package creates a persistent on-disk cache of
files that the user can add, update, and retrieve. It is
useful for managing resources (such as custom Txdb
objects) that are costly or difficult to create, web
resources, and data files used across sessions.
Depends: R (>= 3.4.0), dbplyr (>= 1.0.0)
Imports: methods, stats, utils, dplyr, RSQLite, DBI, filelock,
curl, httr2
BugReports: https://github.com/Bioconductor/BiocFileCache/issues
DevelopmentURL: https://github.com/Bioconductor/BiocFileCache
License: Artistic-2.0
Encoding: UTF-8
RoxygenNote: 7.3.2
biocViews: DataImport
VignetteBuilder: knitr
Suggests: testthat, knitr, BiocStyle, rmarkdown, rtracklayer
git_url: https://git.bioconductor.org/packages/BiocFileCache
git_branch: devel
git_last_commit: e88fb8e
git_last_commit_date: 2025-05-15
Repository: Bioconductor 3.22
Date/Publication: 2025-05-18
NeedsCompilation: no
Packaged: 2025-05-18 20:18:32 UTC; biocbuild
Author: Lori Shepherd [aut, cre], Martin Morgan [aut]
Maintainer: Lori Shepherd <lori.shepherd@roswellpark.org>
Built: R 4.5.0; ; 2025-07-15 14:00:26 UTC; unix
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Activity
lshep commentedon Jul 16, 2025
can you please share the full
sessionInfo()mavino commentedon Jul 16, 2025
mavino commentedon Jul 16, 2025
my original problem came from doing this
lshep commentedon Jul 16, 2025
We switched from using httr to httr2 and have been trying to accurate test the proxy setting. Can you try setting the https_proxy environment variable instead to see if that help? See #54
If not can you also provide the
traceback()after the error occursmavino commentedon Jul 16, 2025
I am not sure if I am doing this right...not an expert
following the beginning of #54 but not running the command remotes::install_github("#57")
when ask = F, I get the error I am showing you above (nzchar(proxy) is not TRUE)
so when I set up ask=T it asks me to create a directory, I say yes and that's not error.
Now I am not really sure if I am doing this test right.
When I re-run the first command here on top with traceback
lshep commentedon Jul 16, 2025
How did you determine the remoteresource url? I think it might be an outdated path?
Note sure if that will entirely fix the proxy error but it is also worth noting.
mavino commentedon Jul 16, 2025
I am sorry I do not understand your question,
I copied your remoteresource url from your #54.
Yesterday I had bioconductor 3.21 and everything was working...the I updated to 3.22, re-updating all the packages and BiocFileCache is not working anymore.
I tried to re-download earlier version 2.16.0 which came with bioconductor 3.21 and still got the problem.
No I returned back to 2.99.5 and I am stuck...
lshep commentedon Jul 16, 2025
3.21 still uses httr instead of htt2.
3.22 reflects the updates to httr2.
httr2 handles proxy and global variables very differently unfortunately so it is considered a major update. We were working with members of the community to test being behind a proxy.
We appreciate your patience as we help debug.
So to understand more fully too -- You want to ideally run the following without ERROR:
Are you actually behind a proxy where you are running this command to have to set it? I assumed you were based on the code provided but if you just copied and pasted the previous issues code that might not be the case (since the proxy provided is the same used in the other issue) -- if you are behind a proxy you need to provide your proxy information
Can you repeat the above with a traceback and sessionInfo?
mavino commentedon Jul 16, 2025
I am not behind a proxy
thank you
lshep commentedon Jul 16, 2025
Thank you and thank you for baring with the debugging process.
Do you get the same error calling ExperimentHub directly
mavino commentedon Jul 16, 2025
lshep commentedon Jul 16, 2025
Thank you. I'll continue to investigate. It looks like there were recent updates to httr2 which may be the root cause
lshep commentedon Jul 17, 2025
I'm still having trouble reproducing this. Would you mind seeing if the file will download manually so I can try and narrow down the issue.
and also the results of
mavino commentedon Jul 17, 2025
lshep commentedon Jul 18, 2025
Can you see if the following two work:
vs
and for good measure can you do a
BiocManager::valid()/BiocManager::install()and update any outdated packages.Again I appreciate your help in debugging as I am not able to reproduce this locally but would like to make sure it gets working for you
mavino commentedon Jul 18, 2025