I apologise for the title. Not intended to mislead, just to be a bit of fun :)
> t's really cool to learn about how fsspec [...]
I'm glad you took something from it. At the last place I worked I spent a lot of time building a library to persist dataframes (intended audience: data analysts) and in retrospect I wish we'd thought of the approach of just having a `csvbase://` url scheme via fsspec.
Currently it doesn't support Parquet which they would have needed though. Still some work to do for csvbase to accept Parquet uploads.
I apologise for the title. Not intended to mislead, just to be a bit of fun :)
> t's really cool to learn about how fsspec [...]
I'm glad you took something from it. At the last place I worked I spent a lot of time building a library to persist dataframes (intended audience: data analysts) and in retrospect I wish we'd thought of the approach of just having a `csvbase://` url scheme via fsspec.
Currently it doesn't support Parquet which they would have needed though. Still some work to do for csvbase to accept Parquet uploads.