Repository navigation
Leave documents of uncertain authorship out of the published private-writing results - #12
Merged
Merged
Conversation
…writing results The private-writing report and README now cover only the groups that are certainly or very probably human-written. private_eval report gains --omit-group for this.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The private-writing results included a group of recent documents whose authorship is uncertain, with commentary about that group. Those numbers are not a measure of false accusations, and they do not belong in the published results.
Change
private_eval reportaccepts--omit-groupand leaves the named groups out of the report entirely.results/private_writing.mdand.jsonare regenerated without that group.Validation
Lint clean, 52 tests pass. The regenerated report and README were searched for the removed group and contain no mention of it.
Note
Earlier revisions of these files remain in the Git history.