Microsoft Internship

Started an internship at Microsoft, working on generative retrieval and exploring how language models can be trained to perform retrieval over large-scale indexes. The work investigates jointly learning representation and retrieval in a single model, effectively compressing the retrieval index into the model weights and reducing storage costs.