Skip to content

WLS regression workflow #51

Closed
Closed

Description

@afrubin

We want to support the types of analyses that were possible in Enrich2, especially the weighted least squares regression and replicate combination using the random effects model.

This is likely to require some new plugins (like a random effects model plugin), but that's something we can use down the line to (for example) combine scores from individual barcodes into a single variant-level score.

The example workflow can target the existing Enrich2 example dataset, which already is downsampled to include a limited number of variants.

Activity

  1. added this to the Preprint milestone on Mar 12, 2026
  2. added
    workflowRelated to a specific workflow or analysis
    on Mar 12, 2026
  3. nickzoic commented on Apr 21, 2026

    @nickzoic
    Collaborator

    Random Effects Model code is in Enrich2 at https://github.com/FowlerLab/Enrich2/blob/main/enrich2/random_effects.py and documentation of the algorithm is in "Mixed Models: Theory and Applications with R", Eugene Demidenko, 2 ed, pp 233 - 239.

    The Enrich2 code implements this as an operation on an entire dataframe but for CountESS we'll implement this as a python function operating on a single row and use DuckdbParallelTransformPlugin.transform to run it over all rows.

  4. nickzoic commented on Apr 29, 2026

    @nickzoic
    Collaborator

    Support for this is working now in v0.0.19 and getting the correct answers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    workflowRelated to a specific workflow or analysis

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions