Comment by inglor
3 months ago
This is really nice though looking at the code - a lot of the postgres types are missing as well a lot of the newer parquet logical types - but this is a great start and a nice use of FDW.
3 months ago
This is really nice though looking at the code - a lot of the postgres types are missing as well a lot of the newer parquet logical types - but this is a great start and a nice use of FDW.
Hi, what types are you expecting to see that aren't supported? I believe we had support for most/all builtin postgres types.
Postgres has like 300+ types but mostly stuff like decimals should work the same way it does with Postgres (with the edge cases like NaN existing in Postgres but not parquets accordingly)
In principle, Postgres has an infinite number of possible types :).
pg_lake maps types into their Parquet equivalent and otherwise stores as text representation, there are a few limitations like very large numerics.
https://github.com/Snowflake-Labs/pg_lake/blob/main/docs/ice...
Also, any planned support for more catalogs?
I think we have recently merged (or are getting ready to merge) REST catalog support, so that will open some things up in this department.