← Back to context

Comment by gwerbin

2 hours ago

What's different between Narwhals and Ibis? Why does the former exist when the latter has already (struggled along) existing for a while? Narrower scope / benefit of hindsight? No support for "cloud" data frames like Ray and Spark?

Also Pandas is very much still a great tool and it's only getting better. It has some fundamental limitations that are relevant for processing bigger datasets or running things with higher performance. But it's still my preferred data frame for interactive day-to-day work. I only switch to Polars (or DuckDB) when I want to maximize performance.