Comment by jorams
2 years ago
> To read/write blobs, you have to serialize/deserialize your objects to bytes. This process is not only tedious, but also varies for different objects and it's not a first-class citizen in other tools, so things kept breaking as my dependencies upgraded.
I'm confused what you mean by this. Files also only contain bytes, so that serialization/deserialization has to happen anyway?
The tools associated with every file type you support have to support reading/writing a buffer/bytestream or whatever it is called.
For example, `pd.read_parquet` accepts "file-like objects" as its first argument: https://pandas.pydata.org/docs/reference/api/pandas.read_par...
However, this is not the case for fringe tools
Maybe you need to encode bytes as text for sql?
Writing and reading bytes in sqlite is very easy: https://www.sqlite.org/c3ref/blob_open.html