Comment by ComputerGuru
13 hours ago
Maybe? I wasn’t under the impression these could be reliably lost or out of sync without risking data loss?
13 hours ago
Maybe? I wasn’t under the impression these could be reliably lost or out of sync without risking data loss?
Wasn't aware you could put a WAL on a unreliable storage system either without risking data loss?
Would be interesting for indexes say put them on ram drive and rebuild them on restart if they aren't there just fallback to table scans.
MSSQL has memory optimized tables that do this sort of thing: https://learn.microsoft.com/en-us/sql/relational-databases/i...
If you lose the WAL you lose the data since the last merge but there’s no risk of corruption. The WAL handles missed syncs fine, too, missing losing just that window of data.
I don’t know if or how Postgres records the transaction number in the index to be able to notice if it’s out of date. If it does, I don’t know of any solution to “catch up” the index besides recreating it, which would be ok if that’s the only issue but from my experience with out-of-date indexes (libc or icu updates, where Postgres doesn’t know if anything IS broken and just reports that it could be), there’s no guarantee you’d even notice and your app could be running completely broken until you rebuild.
>If you lose the WAL you lose the data since the last merge but there’s no risk of corruption.
That is not my understanding:
https://www.postgresql.org/docs/current/app-pgresetwal.html
>After running this command on a data directory with corrupted WAL or a corrupted control file, it should be possible to start the server, but bear in mind that the database might contain inconsistent data due to partially-committed transactions. You should immediately dump your data, run initdb, and restore. After restore, check for inconsistencies and repair as needed.
1 reply →