Bash resources
(updated 3/25/25)
Raindrop.io bookmarks, 3/25/25
In this tutorial, we’ll cover 10 essential Bash shell commands every data scientist should know—commands that save time, simplify tasks, and keep you focused on insights rather than busywork.
Here are 10 powerful one-liners that can help you quickly accomplish essential data tasks.
Introduction For beginners venturing into the world of Linux, understanding shell expansion is a crucial step towards mastering the command line. Shell expansion is a powerful feature that allows users to generate complex commands and manipulat...
It’s more than rails!
Bash scripting, a cornerstone of Unix and Linux system administration, offers powerful tools to automate repetitive tasks, streamline workflows, and handle complex operations. For those already comfortable with basic scripting, diving into advanced techniques can unlock new levels of efficiency and capability. This post will explore advanced shell scripting techniques in Bash, focusing on script optimization, robust error handling, and automating complex system administration tasks. Script Optimization Optimization is crucial for ensuring that your scripts run efficiently, especially when dealing with large datasets or intensive tasks. Here are some key techniques to optimize your Bash scripts.
$BASH_REMATCH is a special array variable in the Bash shell that stores the results of matching a regular expression using the =~ operator…
📖 A collection of pure bash alternatives to external processes. - dylanaraps/pure-bash-bible
As a developer, you most likely spend a significant amount of time working with the command-line...
Explains three methods to get and extract filename extension in Bash for Linux and Unix shell scripting needs.
In Linux, there are shell built-in commands which you are already using but never paid attention to. Learn more about them in this tutorial.
While for maybe the most popular bash loop, wait until you discover until. Pun intended :)
Here are a couple of ways for reading file line by line in the Bash shell.
In this quick Bash tip, you'll learn about appending to an existing array in bash.
The exec command in shell scripts is super useful for logging, reading from files and running commands by replacing the current process.
The bash shell has some special variables that have specific usages and purposes. Learn more about them here.
This is an open-source introduction to Bash scripting ebook that will help you learn the basics of Bash scripting and start writing awesome Bash scripts that will help you automate your daily SysOps, DevOps, and Dev tasks...
In this article, we are going to take a look at five different data science-related scripting-friendly tasks, where we should see how flexible and useful Bash can be.
Brace expansion in the bash shell is a lesser known but an awesome feature. Learn about using them like a Pro Linux user with practical examples.
This article is about a few quick thumb rules I use when writing shell scripts that I’ve come to appreciate over the years. Very opinionated....
Have you ever wondered how a Web server works under the hood? Moreover, would you be willing to...
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance. - onceupon/Bash-Oneliner
Learn how to find PID using a process name in Linux. Also learn to get the parent process ID (PPID) of the given process.
A complete guide for newcomers and advanced users to correct usage and deepen understanding of the bash shell language.
📖 A collection of pure bash alternatives to external processes. - dylanaraps/pure-bash-bible
Variables · Functions · Interpolation · Brace expansions · Loops · Conditional execution · Command substitution · One-page guide to Bash scripting
Intro Recently I wanted to deepen my understanding of bash by researching as much of it as possible. Because I felt bash is an often-used (and under-understood) technology, I ended up writing …
Get more efficient by using condensed versions of long Bash commands.
I write a letter to my past self about the Shell's importance I wish I'd focused on earlier in my career.
Update 25 Sep 2019: This article is now available in Japanese, thanks to the hard work of ラナ・クアール....
Images take up to 50% of the total size of an average web page. And if images are not optimized, users end up downloading extra bytes. And if they’re
5 bash tricks I find myself using often that I wish I'd discovered sooner.
The seemingly insignificant #! characters at the beginning of a shell script has a major significance on how your script will be executed.
You might have used variables in Bash before, but probably not like this.
Learn to process thousands of items reliably and repeatably in this installment.
The .bash_logout file is the individual login shell cleanup file. It is executed when a login shell exits. This file exists in the user's home directory. For example, $HOME/.bash_logout. This file is useful if you want to run task or another script or command automatically at logout. For example, clear the mysql command line history stored in ~/.mysql_history or to make a backup of files you can use this file.
In this post, I try to explore various ways to repeat a character and string in Bash 'n' times that must run on macOS/FreeBSD and Linux.
Commandline one liners that makes your workflow more productive
What exactly happens when we run a file starting with #! (aka shebang), and why some people use #!/us...
Free Introduction to Bash Scripting eBook.
Bash aliases are essentially shortcuts that can save you from having to remember long commands and eliminate a great deal of typing when you are working on the command line.
Ruby is one of the most popular languages today. It has an elegant syntax and it is the language behind the powerful Ruby on Rails framework. In this tutorial we will show you three different ways to install Ruby on Ubuntu 18.04 system.
Dead simple testing framework for Bash with coverage reporting - Checksum/critic.sh
Bash-my-AWS is a simple but powerful set of CLI commands for managing resources on Amazon Web Services.
A short description and screenshot of some useful command line tools I use that aren't part of typical POSIX environment.
You can do more data science than you think from the terminal.
I've long been impressed by shell one-liners. They seem like magical incantations. Pipe a few terse commands together, et voilà! Out pops the solution to a problem that would seem to require pages of code. Are these one-liners real or mythology? To some extent, they're both. Below I'll give a famous real example. Then I'll argue
Why unix pipes are awesome.
Five lesser-known command line utilities you'll want to install right away.
A collection of small bash scripts for heavy terminal users - alexanderepstein/Bash-Snippets
other, mainly PDFs (7/6/22)
globs vs regexes
exit codes
if, [, [[
set
<()
quoting
top shortcuts
startup order
getopts
2. help
3. view/edit files
4. create/delete files & directories
5. move/copy files, making links, command history
6. directory trees, disk usage, processes
7. misc
8. disk, memory, cpu usage
9. REPLs & versions
10. environment vars
11. basic scripting
12. config files
13. find
14. download
15. redirect
16. superuser
17. file permissions
18. users & groups
19. text ops
20. pattern matches
21. copy files over SSH
22. long-running processes
23. more
2. Download something - be able to resume if something goes wrong
3. Generate a random, 20-character password for a new online account
4. Downloaded a file - test the checksum
5. Limit ping to five attempts
6. Start a web server in any folder
7. See how fast your network is with Speedtest-cli
8. See your external IP address
9. See your local IP address?
10. Clear the screen.
2. std output (22)
3. std input (8)
4. executing commands (10)
5. shell variables
6. logic & math ops
7. tools
8. more tools
9. finding files
10. more scripting features
11. dates & times
12. example user tasks as scripts
13. parsing, etc
14. secure scripts
15. advanced topics
16. config / customization
17. admin tasks
18. shortcuts
19. tips & traps
A. options (multiple)
B. examples
C. command line processing
D. revisino control
E. build from source
2. shebang
3. directory navigation
4. listing files
5. cat
6. grep
7. aliasing
8. jobs & processes
9. redirects
10. control structures
quoting variables
global, local, environment variables
for loops
if statements
functions
always quote your vars
return quotes
background processes,br> set -e, set -x, set -u
linting
2. param expansions
3. loops
4. functions
5. conditionals
6. arrays
7. dicts
8. options 9. command history
10. miscellaneous*
2. actions
3. package managers
4. dot files
5. VIM
6. aliases
7. scripts