Vocabulary of code2vec in dataset

[anon721702]

Dear Sir,

• I would like to what exists in the java14m.dict.c2v file in dataset folder. As I am trying to see the content but its encoding is different. Please share file which has normal readable format.

• Also, how you have created vocabulary for the same, please elaborate a little.

[urialon]

Hi @anon721702 ,
Thank you for your interest in code2vec, and sorry for the delayed response.

You can reproduce the way that our code opens this file:
https://github.com/tech-srl/code2vec/blob/master/vocabularies.py#L75 to see its content.

You can see how this file was created here:
https://github.com/tech-srl/code2vec/blob/master/preprocess.py#L16

Best,
Uri

[urialon]

By the way,
See our newer code2seq model's demo and code.