I am using python 3, and have heavy variables in memory, I would like to seamlessly allowing myself to write them to disk, and load them when I actually need them, without the need for pickling and reading from disk explicitly any time I need them. Is that at all possible and how?
I tried RDFlip but this does not seem to work It's a store that you need to explicitly approach, and I am trying to make it seamless.
You might want to look into something like an Object Relational Mapping (ORM) library that lets you store the objects to a database, and retrieve them by using Python method/function calls (rather than SQL statements). SQLAlchemy is one of the most popular ORMs for python, and has tons of documentation and community support available online. You would have to do the "explicit" work you are talking about only once, when defining your database tables and configuring DB connectivity, etc for SQLAlchemy, But then after that, you could just use a single method call to write your variables to disk (in the DB), and another for retrieving them. And unlike pickle, you can store any binary object in your database, so you aren't limited as far as what kind of data you can serialize/store.
