Repository navigation
Support for loading files wrapped in .gz and .bz2 (also file metadata) #14
Description
Also raised in #8 : it's pretty normal for people to keep big .txt, .csv or .fq files hanging around as .csv.bz2 or .csv.gz etc. It'd be good to have support for this and even better to have support for this baked in to a file reader superclass so that every individual file reader plugin doesn't have to implement this itself.
Activity
nickzoic commentedon May 4, 2023
While I'm talking about a file loader superclass, it seems like file metadata is going to be pretty common for when loading many files. You could do this by having a "filename" column and then joining on filename with a metadata DataTable but that's kind of clunky and it'd be nicer to have a common mechanism across file loaders.
[-]Support for loading files wrapped in .gz and .bz2[/-][+]Support for loading files wrapped in .gz and .bz2 (also file metadata)[/+]Allow reading gzipped fastq files (but see #14 for a more general con…
nickzoic commentedon Mar 13, 2026
this may or may not prove to be useful, one problem is that lots of file loading libraries have their own handling for bzip2 etc so it's hard to know where to slice this.