Repository navigation
How to create code embeddings from Java codebase and store it in a vector database? #180
Description
Hi there team code2vec,
I am working on a personal project. My aim is to store a Java codebase in a vector database to run similarity searches and retrieve code files from the db relevant to my query. Queries can be of the type:
- Method creating database pool connection.
- Entity class linked to 'Subjects' table
Basically a query will be an activity performed by the codebase and I should return the package, classname, (and method if required).
My plan is to vectorize these search queries using a vectorizer present in your codebase, perform similarity search and return results.
My questions are:
- How can I generate vectors for Java code using a your pretrained model?
- Will it be a good idea to vectorize an English query for similarity search?
Activity
urialon commentedon Jun 26, 2023
Hi @shankernamami ,
Thank you for your interest in our work!
See this part of the README: https://github.com/tech-srl/code2vec#exporting-the-code-vectors-for-the-given-code-examples
See also these newer models/papers:
Best,
Uri
shankernamami commentedon Jun 27, 2023
@urialon Thank you! this answers my questions : )
asyed79gatech commentedon Feb 22, 2024
Hi I have used the same command indicated on the ReadMe link which is "-export_code_vectors". However doing so gives me the following error:
My command was
where "new-data/test/AdministeredCommentsDto.cs" is the path to the code snippet whose embeddings I am trying to create. I guess I am unable to determine the correct input file type. Guidance in this will be highly appreciated.
Thanks
urialon commentedon Feb 22, 2024
Hi @asyed79gatech ,
Thank you for your interest in our work.
I believe that you haven't run the
preprocess.shscript on the data.However in general, I recommend using the newer https://github.com/neulab/code-bert-score project. It is based on Huggingface, which is actively maintained.
Best,
Uri