Comment by janlaureys
9 hours ago
Been working on a dashboard that takes in a bunch of different public data sources in different formats and pandas has truly been a godsend for this.
I've got csv, txt, xlsx in all different shapes and sizes and with just a few settings I can go through them quite easily and very fast as well.
Depending on the size and the transformations you are doing, polars is worth checking out. Syntax is a bit different from pandas but the performance is really nice.
My biggest bottleneck right now is upload speed but I'll keep it in mind thanks.
[dead]