In a thread, Simon Willison asked: how do you start exploring and analyzing a CSV with 100k rows?
My own answer before reading that thread was to load the CSV in Snowflake, import into a table and run queries on it.
Now I am curious about https://datasette.io/ and the other options.
I've collected some of the responses:
1) open the CSV in Datasette Desktop (mac app, someone said it may not handle more than 30 columns though)
2) sqlite-utils insert /tmp/data.db rows big.csv --csv
datasette /tmp/data.db
(SQLite max columns is 2000)
3) grep cut sed xargs sort uniq wc
(xargs strips quotes though)
4) Excel
5) pandas (I've used it before and it is very handy)
df = pd.read_csv( "csv file path" )
6) ydataai/pandas-profiling (GitHub repo with tool to create HTML reports from pandas dataframes)
7) antlr.org (parser for large files)
8) R and packages: tidyverse, dtplyr, arrow, vroom, data.table
9) TadViewer.com (fast/free tabular data file viewer for CSV/DB files)
10) zed.brimdata.io (command line tool for search/analytics)
11) BurntSushi/xsv (GitHub repo with fast CSV command line tool)