Repository navigation
Refresh datasets page from the republished 2.4 build - #511
Merged
Merged
Conversation
Regenerate every number on the Datasets page from the build now served as
version 2 of Figshare article 33990850.
gen_dataset_stats.py now also writes dataset_summary_statistics.csv and
dataset_curve_metrics_wide.csv, which were previously produced by
notebooks/dataset_documentation.ipynb against hardcoded local paths and had
not been recomputed for 2.4. It also fixes two counting bugs:
- Lines with quoted fields (e.g. samples other_names "b1_4, b1_5, b1_6")
were split on raw delimiters, shifting columns. This undercounted MPNST
samples (47 vs 133) and Novartis (348 vs 386), overcounted the cell-line
datasets by one, and garbled model_type values.
- Sample ids written as floats ("3524.0", novartis experiments) are
normalized so they match the integer ids in the omics files.
Also add a delta_auc entry to the dose-response metric glossary and update
the refresh instructions in docs/README.md.
jjacobson95
force-pushed
the
docs-2.4-v2-counts
branch
from
October 13, 2026 20:48
0741290 to
efefbe7
Compare
jjacobson95
temporarily deployed
to
github-pages
October 14, 2026 16:30 — with
GitHub Actions
Inactive
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refreshes the Datasets Included page so its numbers reflect the republished 2.4 data (Figshare article 33990850, v2), and generates every table on the page from
scripts/gen_dataset_stats.py.Changes:
scripts/gen_dataset_stats.py: also writesdataset_summary_statistics.csvanddataset_curve_metrics_wide.csv. Fixes column parsing on rows with quoted fields, which miscounted samples for MPNST, Novartis and the cell-line datasets. Normalizes float sample IDs (3524.0) so Novartis experiments match its omics files.docs/source/_static/: regenerated all three CSVs from the v2 build.docs/source/datasets_included.rst: updated sample and drug counts in the Datasets and Modalities table and addeddelta_aucto the metric glossary.docs/README.md: refresh instructions now cover all three CSVs.NCI60 drugs increase from 23,267 to 55,143, reflecting the rebuilt drug files. MPNST samples change from 47 to 133 and Novartis from 348 to 386 due to the parsing fix.
Verified the docs build renders the updated tables.
Refs #337