Comment by Hugsun 10 months ago How do you infer your Parquet schemas? 1 comment Hugsun Reply threeseed 10 months ago You infer the types of the source data.For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.
threeseed 10 months ago You infer the types of the source data.For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.
You infer the types of the source data.
For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.