Comment by raverbashing

2 years ago

> As my app matured, I found that I often wanted hierarchical folder-like functionality. Rather than recreating this mess in db relationships, it was easier to store the path in sqlite and work with it in Python. E.g. `os.listdir(my_folder)`

This makes total sense and it is also "frowned upon" by people who take a too purist view of databases

(Until it comes a time to backup, or extract files, or grow a hard drive etc and then you figure out how you shot yourself in the foot)

To make it more queryable, you can have different classes for dataset types with metadata like: file_format, num_files, sizes