Skip to content

There should be a caching wrapfs #223

Description

@hmeine

For networking-based filesystems, one is often interested in some kind of local cache. As far as I can see, that would be another good use case for fs.wrapfs, right?

Activity

  1. travcunn commented on Dec 9, 2015

    @travcunn

    Yes fs.wrapfs would be perfect. The implementation really depends on what type of filesystem you're trying to wrap and your use case though.

  2. arekbulski commented on Dec 10, 2015

    @arekbulski

    There are classes for caching single files and filesystem metadata, but not complete filesystem:
    https://github.com/PyFilesystem/pyfilesystem/blob/master/fs/remote.py

  3. hmeine commented on Jan 6, 2016

    @hmeine
    ContributorAuthor

    Yes, I think CacheFS comes close, but I would like to have an additional cache of files that were read. So, one would configure a local cache directory and maximum cache size (after which the oldest files are purged), and all files would first be copied there and reused instead of re-downloaded. The metadata would obviously be solved by CacheFS[Mixin] already.

  4. mguillau commented on Feb 29, 2016

    @mguillau

    Hi,

    I'm working on a WrapFS subclass implementing the LRU caching scheme (wikipedia entry). On top of the wrapped FS, one provides another FS used for caching and the max size of the cache. The consistency is checked based on md5, so it's compatible with s3's etag. Would you consider a pull request when I'm done?

    M.

  5. arekbulski commented on Aug 1, 2016

    @arekbulski

    I think you could close this issue, unless you have some code to submit. You made a point.

  6. lurch commented on Aug 1, 2016

    @lurch
    Contributor

    IMHO this is a perfectly valid suggestion / request, so there's no point closing it.

  7. arekbulski commented on Aug 1, 2016

    @arekbulski

    I agree. Some maintainers close less prospective issues when there is no active work to discuss.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions