Repository navigation

Token-level CodeSearchNet preprocessing option - #13

Open

bzz wants to merge 7 commits into

codesearchnet-helper-update

Open

Token-level CodeSearchNet preprocessing option#13
bzz wants to merge 7 commits into
masterfrom
codesearchnet-helper-update

Commits on Jan 31, 2020
- CLI: drop PT dependecny, add stdout output flag
  bzz
  committed
  dcd7b22
- CLI: add --token-level-sources option
  bzz
  committed
  16063f1
Commits on Feb 3, 2020
- cli: address code review
  bzz
  committed
  aa65cc4
- cli: add --token-level-targets \w dpu_utils.codeutils.identifiersplitting
  bzz
  committed
  6cfc883
- cli: switch output to .txt
  bzz
  committed
  a1da1f5
- cli: fix a typo
  bzz
  committed
  96ceb0d
- cli: error handling for tokens
  bzz
  committed
  b20d69b