Comment by Hugsun 3 days ago How do you infer your Parquet schemas? 1 comment Hugsun Reply threeseed 3 days ago You infer the types of the source data.For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.
threeseed 3 days ago You infer the types of the source data.For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.
You infer the types of the source data.
For example you can go through say 1% of your data and for each column see if you can coerce all of the values to a float, int, date, string etc. And then from there you can set the Parquet schema with proper types.