Spark SQL is actually ANSI SQL. Plus you can mix and match R, Scala and SQL all ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

threeseed on May 23, 2017 | parent | context | favorite | on: Don't use Hadoop when your data isn't that big (20...

Spark SQL is actually ANSI SQL.

Plus you can mix and match R, Scala and SQL all together.

dswalter on May 23, 2017 [–]

I used to use Spark SQL for this purpose, but I've switched. I now use Spark for when I want to transform data. But when I'm writing ad-hoc data exploration/investigation queries, PrestoDB is my jam; it's what it's designed for. Parquet as the data storage method makes both of these quite workable.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact