how can we store data in RAM ? as the author has mentioned to store in RAM for faster retrieval , can anyone elaborate more on this , on how to store it in RAM , using which modules in python etc
Hi Rohan_Devaki.
When we talk about storing in RAM, for example, it means using any data structure, such as lists or arrays. You create the lists or arrays. In the latter case, you can use NumPy. From the moment you create the list or array, you’re already using RAM.
In the case of vector databases (Word2Vec, GloVe), you have to have your database as part of your project, and then you have to read that database. When you read it, you’re already loading it into RAM. Since you already have it in memory, you can access it.
Then, if you want to use that database, which is already in RAM, you can create an HNSW index for it, as the author indicates. With that, you can operate on the index to perform searches.
A Python library that can help you work with vector databases is “faiss.”
Regards
Ronweld