Skip to content

feat: v0.7.0 OSINT subcommands, full-history walks, parked rate limits, --csv export - #64

Merged
extiop merged 5 commits into
mainfrom
feat/v0.7.0
Oct 26, 2026
Merged

extiop merged 5 commits into
mainfrom
feat/v0.7.0

Conversation

@extiop

@extiop extiop commented Oct 25, 2026 •

Copy link
Copy Markdown
Owner

PR summary

What does this PR do?
Add the OSINT investigation subcommands for v0.7.0: full profile investigation (user), reverse email lookup (email/emails) and organization investigation (org): 100% GitHub API, no clone, no scraping, no git binary, no new dependency. Details in the CHANGELOG [0.7.0] entry.

Related issues:
Closes the 0.7.0 milestone (user/email/org investigation, as announced in the README roadmap).

Type of change

  • Bug fix
  • Feature
  • Breaking change
  • Documentation

@extiop extiop added the enhancement New feature or request label Oct 25, 2026
@extiop
extiop force-pushed the feat/v0.7.0 branch 2 times, most recently from f9c18a6 to 60e3d56 Compare October 25, 2026 23:29
extiop and others added 5 commits October 26, 2026 00:53
- user: usernames/name history, external contributions, email variants,
  secondary accounts, SSH keys
- email/emails: reverse email -> GitHub account over the token pool
- org: members and repositories of an organization, parallel scan
- honest caps everywhere (commits, events, search ceiling, variants)
Security and robustness: bounded reads (response body, token file, bulk
file), fork skipping in the user investigation, resolved-login search
queries, public-only org listings, dot-segment and foreign-host URL
rejection, deterministic report ordering, length caps on hostile commit
fields and variant patterns, partial-results preservation on bulk aborts.

Readability: function extractions (scan_repository_commits,
fetch_external_hits, fold_emails, build_variants, classify_rate_limit,
read_token_json, WorkerAccum, run_report_command), shared helpers where
logic was duplicated, honest doc comments, sober terminal copy.

Docs: CHANGELOG hardening entries, README accuracy (SSH keys, forks,
result paths), doc/src alignment with the actual behavior.

399 tests (370 lib + 29 CLI), fmt/clippy/doc clean.
…orks, skipped inventory

Deferred-item sweep for 0.7.0: every JSON report stamps its provenance
(generated_at, tool_version, hand-rolled RFC 3339 formatter); search
reports record the request (query, language, qualifiers); search reports
break findings down per repository; bulk reports list skipped_addresses;
user and org take --include-forks. Internal: shared token-pool runner,
scan result structs instead of 7/8-tuples, parse_user_repos_page /
parse_profile_repos_page rename, pinned arm64 macOS runner.

Zero local caps: every commit walk covers its full default-branch
history and ends where GitHub's listing ends — the API limits, we do
not. The only remaining bounds are GitHub's own documented windows
(profile events, search results) and the variant combinatorics guards
against hostile commit metadata, each warning honestly when it bites. A
spent hourly quota now PARKS the token until x-ratelimit-reset instead
of retiring it (a secondary-limit drain fails with the dedicated
RateLimitPaused error), and every degrading event logs at warn. New
deliverables: --csv export of the per-author correlation (RFC 4180,
atomic publish), results/user/<username>, exit code 3 for an empty
scan/search, last_commit_date freshness on correlation authors, and a
startup proxy check that mirrors the pinned stack's env acceptance
rules exactly (scheme case sensitivity, ALL_PROXY fallback, set-but-
empty shadowing, authority validation) so a silently ignored proxy is
never announced. Structure: user/{mod,parsing,report,variants} split,
the parallel worker pool in sources/parallel.rs, parse_github_url
unified, atomic staging under one sweepable .git2mail-stage namespace.
Release: cargo-auditable SBOM embedded in every binary. Docs: README,
mdBook and CHANGELOG verified line-by-line against the code by a
118-reviewer campaign (security, adversarial, doc-code, 29 UX personas,
test audit, proxy-mirror equivalence proofs against the locked
hyper-util/http sources) across 9 waves.
@extiop
extiop merged commit 650bffb into main Oct 26, 2026
8 checks passed
@extiop
extiop deleted the feat/v0.7.0 branch October 26, 2026 00:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant