Comment by ncruces
1 day ago
A read-only VFS doing this can be really simple, with the right API…
This is my VFS: https://github.com/ncruces/go-sqlite3/blob/main/vfs/readervf...
And using it with range requests: https://pkg.go.dev/github.com/ncruces/go-sqlite3/vfs/readerv...
And having it work with a Zstandard compressed SQLite database, is one library away: https://pkg.go.dev/github.com/SaveTheRbtz/zstd-seekable-form...
Your page is served over sqlitevfs with Range queries? Let's try this here.
I did a similar VFS in Go. It doesn't run client-side in a browser.
But you can use it (e.g.) in a small VPS to access a multi-TB database directly from S3.
this does not caches the data right? it would always fetch from network? by any chance do you know of solution/extension that caches the data it would make it so much more efficient.
The package I'm using in the HTTP example can be configured to cache data: https://github.com/psanford/httpreadat?tab=readme-ov-file#ca...
But, also, SQLite caches data; you can simply increase the page cache.