Practical Shell Commands for Data Scientists and Analysts - Command Line Tutorial

Learn essential shell commands for data scientists and analysts in this comprehensive command line tutorial. Explore practical techniques for data preparation, cleansing, and analysis using bash commands. Discover how to manipulate files, process data, and perform basic arithmetic operations in the shell. Master key commands such as date, cd, mkdir, rm, mv, pwd, unzip, ls, cp, wc, head, tail, cut, sort, and uniq. Gain hands-on experience with shell variables, environment variables, wildcards, pipes, and redirection. Apply these skills to real-world data science scenarios using a Kaggle dataset. Enhance your data manipulation toolkit and streamline your workflow with powerful command line tools.

Intro
Dataset from kaggle
Introduction to shell
date command in bash zsh
Shell variables
Environment variables vs Shell variables
cd change directory command
mkdir make directory command
rm -r remove recursively command
mv move command
pwd print working directory command
&& in bash
unzip unzip a file command
ls list command
cp copy command
-v verbose option
wc wordcount command
* for wildcard
head / tail -n first / last n lines of file
| pipe character in shell
cut command in bash
shell redirection
attach to append to file
cat concatenate to print contents
cut -d, -f colnum for csv
sort command
uniq command
arithmetic add, minus etc in shell
$ for arithmetic expansion
expr to evaluate an expression in Unix
data cleansing / preparation / exploratory scenarios in shell bash
paste command
bc in shell basic calculator