Slashdot Mirror


(Useful) Stupid Unix Tricks?

So the other day I messaged another admin from the console using the regular old 'write' command (as I've been doing for over 10 years). To my surprise he didn't know how to respond back to me (he had to call me on the phone) and had never even known you could do that. That got me thinking that there's probably lots of things like that, and likely things I've never heard of. What sorts of things do you take for granted as a natural part of Unix that other people are surprised at?

123 of 2,362 comments (clear)

  1. Find / Grep by BigJClark · · Score: 2, Informative


    I find a combination of find/grep to be pretty useful. Not sure about how unknown it is, but I do know that several UI-based linux admins around our office don't know about "stacking" commands. (I know, I know, one would think they would be mutually-exclusive ;) )

    find . | grep [string]

    --

    Hi, I Boris. Hear fix bear, yes?
    1. Re:Find / Grep by Anonymous Coward · · Score: 1, Informative

      find . -exec grep -l {} \;

    2. Re:Find / Grep by imp7 · · Score: 2, Informative

      How about the using find for what it is...

      find . -name [String]

      You have a bit more control when you are looking for a file and you are not grep'ing through more thee just file names. Plus you need to remember to put in any wildcards if you don't know the whole file name.

  2. Tab by computersnstuff · · Score: 5, Informative

    I'm sure everyone at some point is surprised of tabbed completion.

    1. Re:Tab by Craig+Davison · · Score: 5, Informative

      With bash, you can even get tab completion for hostnames. Try this:

      ssh user@l[tab]

      Everything after the @ is filled in from /etc/hosts.

    2. Re:Tab by Bandman · · Score: 3, Informative

      funny! I just chanced on this blog entry about ZSH. It sounds really intriguing and apparently has great tab completion.

    3. Re:Tab by goodwid · · Score: 3, Informative

      One of my favorites (in tcsh, at least) is to use ^[p which completes into the history..

      Also, !$ for the previous command's parameter, or !! for the previous command, or !3 for re-doing the third entry in history. Fun stuff.

      --

      The net interprets censorship as damage and routes around it. -- John Gilmore
    4. Re:Tab by ArTourter · · Score: 2, Informative

      Actually, it is filed in from the known_hosts files, both global and user specific. you also don't need to specify the user:

      ssh [tab][tab]

      will list all the hosts and IPs you have used in the past.

      I wish it would complete the -o flag, but it doesn't on my system.

    5. Re:Tab by Anonymous Coward · · Score: 1, Informative

      My ZSH is configured to use ~/.ssh/known_hosts for this too. And usernames get completed for things like su or chown... and arguments...

    6. Re:Tab by RichiH · · Score: 3, Informative

      Long story short, I know no single person who really used zsh for more than a week and went back to their old shells. By "really" I mean "steal a zshrc from somewhere" or "read the docs". The feature list is too long to even begin, but suffice it to say that once you are used to zsh, you can not imagine why you ever used anything else. Yes, it's that amazing.

      Get "From Bash to Z Shell" if you like dead trees. Subscribe to the mailing list & join the IRC channel if not.

      Find me under my username on freenode or send a PM via /. if you want a quite extensive zshrc which does loads of neat stuff.

  3. Listing directory contents without the ls command by thepacketmaster · · Score: 4, Informative
    echo *

    I discovered if you give the echo shell command an asterisk as a parameter, it dumps out the file names of the current directory. (The sad thing is I had a practical use for this when a less-than-clueful-collegue deleted the /bin directory, leaving the system without an ls program).

    --

    --

    Luck is just skill you didn't know you had.

  4. A simple search by AKAImBatman · · Score: 2, Informative

    find . -exec grep -l keyword {} \;

    Works like a charm for finding a file containing a keyword. Another one I often use is:

    Human readable disk space:

    df -h

    Track down where your space is going:

    du -h

    1. Re:A simple search by UnderScan · · Score: 2, Informative
      Your

      find . -exec grep -l keyword {} \;

      is fine for non-GNU UNIX grep.

      If you have GNU grep, then

      grep -lR keyword .

    2. Re:A simple search by AKAImBatman · · Score: 4, Informative

      Xargs is much more fun with complex data processing. e.g.

      Convert all PSDs to PNGs:

      ls *.psd | cut -d . -f 1 | xargs -L1 -i convert {}.psd {}.png

      Parse out and sort column 2 from a semicolon delimited file:

      cat myfile.txt | cut -d \; -f 2 | sort > output.txt

      Oh, I almost forgot about one of my favorite tricks. Count the number of items:

      wc -l
      (paste the list into the window and then type CTRL-D)

      It even works when the list of items has oddities. e.g. I had a list where every other line was blank. So I needed to count n/2 the value. Except that one of the blank lines wouldn't copy, so I actually needed (n+1)/2.

      echo $(($((`wc -l`+1))/2))

      Want to make sure your sig is under 120 characters? Type "wc -c" in, paste it into your terminal, then press CTRL-D. Instant character count.

      Ah, all the fun stuff you can do with Unix tools.

    3. Re:A simple search by Chris+Pimlott · · Score: 3, Informative

      Your

      find . -exec grep -l keyword {} \;

      is fine for non-GNU UNIX grep.

      If you have GNU grep, then

      grep -lR keyword .

      Most systems will GNU grep will also have an rgrep command which is the same as 'grep -r'.

      But the find approach allows much more sophisticated searches. Such as:

      find . -name \*.xml -not -user root -exec grep -l keyword {} \;

      (search all .xml files that aren't owned by root)

  5. X-forwarding by mikeb · · Score: 5, Informative

    I've seen Windows people go slack-jawed in astonishment as I ssh to the other side of the world and run X programs over forwarding.

    Some refuse to believe it, others shake their heads and walk away.

    1. Re:X-forwarding by Shikaku · · Score: 3, Informative

      http://www.math.umn.edu/systems_guide/putty_xwin32.html

      First result of X-Forwarding on Google.

    2. Re:X-forwarding by Chris+Pimlott · · Score: 5, Informative

      You could easily have an entire Ask Slashdot just on ssh, perhaps the greatest unix command ever invented.

      One of it's many great uses is creating secure tunnels:

      ssh user@remotehost -L123:example.com:456

      Open a tunnel on your local machine, port 123, to example.com, port 456, via the remote host

      ssh -R lets you go in the opposite direction (tunnel from remote end to local end), but if your application supports SOCKS, it's even easier:

      ssh user@remotehost -D8080

      Creates a secure tunnel supporting the SOCKS protocol.

    3. Re:X-forwarding by Hatta · · Score: 3, Informative

      That means that hypothetically I could be looking at porn via my home computer

      If you're going to do that, make sure you run firefox with the -no-remote flag. Otherwise it will detect that you're in an SSH session, and just open a new window on your local machine.

      --
      Give me Classic Slashdot or give me death!
    4. Re:X-forwarding by Noctris · · Score: 2, Informative

      It's not "windows".. it's the "users".. they obviously didn't hear about the latest in computer technology: Remote Desktop

  6. Re:rm -rf / by Anonymous Coward · · Score: 2, Informative

    more like
    sudo rm -rf /

  7. Talk / DD / Mount by p14-lda · · Score: 5, Informative
    People seem to be losing the ability to use all the older manual ways of doing things.

    On the older systems, talk was a great utility.

    dd, device duplicator / disk destroyer

    mount, what I can't have a desktop icon?

    also managing disk volumes and the old conventions of /opt, /u, /usr, /usr/local

    This new fangled Linux craze with all of the UI tools is feeding it. Redhat is training admins that are dependent on a given release of their enterprise software (which I am a huge fan of) but not teaching them how it works under the hood.

    How about slirp? scp?

    The one ray of hope seems to be a new generation hacking their bsd and linux based (iPhone/Android) phones and having fun in a somewhat embedded (but full blown) *nix environment.

  8. cd - by JustinOpinion · · Score: 5, Informative

    In terms of navigation directories efficiently, I find that "cd -" is often forgotten (changes directory to your previous directory). I personally find it very useful, and couldn't live without it!

  9. talk by Anonymous Coward · · Score: 2, Informative

    Before IRC and IM there were finger and talk. They don't work as often as they used to because admins generally don't open them up to the public. But, you used to be able to see if someone was online using finger and then chat with them using talk.

    finger user@example.com
    talk user@example.com

    You can usually still use these with another user on the same host as the author did with write.

  10. Job control. by Craig+Davison · · Score: 5, Informative

    fg, bg, kill, Ctrl-Z, &. Learn it. Know it. Live it.

    Even if they do know about job control, I've seen people look for a background job with ps, and then kill it using the PID. In most shells you can just do kill %, e.g. kill %1

    1. Re:Job control. by XXeR · · Score: 2, Informative

      that's a lot of work to do what 'disown' does

    2. Re:Job control. by SatanicPuppy · · Score: 2, Informative

      My personal soapbox is always nice. In the old days, when cpu cycles were crazy valuable, people were very careful to set up their jobs to not hog too many cycles.

      These days, that's not so much the case, and when resources are plentiful, it doesn't NEED to be the case. But if you have a lot of things going you need to be able to prevent everything from trying to run at 100%...Don't need some reporting job crapping on a critical process.

      So yea, job priority: nice, renice, getpriority, and setpriority

      --
      ad logicam Claiming a proposition is false because it was presented as the conclusion of a fallacious argument.
  11. Re:How about a new GUI apt get trick? by Blublu · · Score: 2, Informative

    Synaptic Package Manager is a GUI thing that comes with Ubuntu and has a search function. You just put a checkbox next to the packages you would like to install and press "apply".

    --
    meh
  12. Re:Listing directory contents without the ls comma by marcansoft · · Score: 4, Informative

    You're not giving echo an asterisk as a paratemer. You're giving the shell an asterisk, which it dutifully expands. echo (which in this case is a shell builtin, but it doesn't have to be then just echoes them back.

    This isn't some echo peculiarity. It works for anything, even commands that don't normally take files, or even with files that look like switches (conversely, if you want to treat all subsequent arguments as files, not switches, most programs have a '--' switch):


    $ ls
    a -l b c
    $ ls *
    -rw-r--r-- 1 marcansoft users 0 2008-11-05 21:58 a
    -rw-r--r-- 1 marcansoft users 0 2008-11-05 21:58 b
    -rw-r--r-- 1 marcansoft users 0 2008-11-05 21:58 c
    $ ls -- *
    a -l b c

    In the second example, ls sees "ls a -l b c" and takes -l as a switch instead of a filename.

  13. Re:This one always surprises people for some reaso by interiot · · Score: 4, Informative
    • Optimized version of that: find / | grep -i $SOMETHING
    • Even more optimized: find / -iname $SOMETHING
    • However, most systems support locate/updatedb already, and that's much faster.
  14. multitasking in a terminal by shvytejimas · · Score: 2, Informative

    Quite a handy way to switch between several applications on a single terminal: Ctrl+Z stops the current program, then bg to resume it and send to background, fg to resume in foreground. You can have several stopped programs and pick one with fg 3, for example. See all stopped jobs with jobs.

    Few things to note, wget still prints to STDOUT, even when backgrounded, so I run it in screen. Also, pico may require a -z switch to allow suspension.

  15. -exec as a test by Chris+Pimlott · · Score: 4, Informative

    One great feature of find that many people are unaware of is that you can use -exec as a test, not just as an action. For example, this is equivalent to your command above:

    find . -exec grep -q {} \; -print

    The "-print" action is only executed if the -exec command returns success.

    You can do a lot of handy things with this. Here's a real-world example from earlier today. I wanted to change the mime-type of all the xml files in my svn repository from "application/xml" to "text/xml":

    find . -name \*.xml -exec sh -c "svn propget svn:mime-type {} | grep -q application/xml" \; -exec svn propset svn:mime-type text/xml {} \;

  16. Re:Show attached block devices by duguk · · Score: 5, Informative

    Some more common ones I've thought of:

    screen - too useful, run apps in a virtual console which you can attach, deattach and share

    cd `pwd -P` - Jump into the real directory (from a linked directory).

    history - use it with grep if you forgot what you did

    strings - just show the printable strings from a file

    tail and head - tail -f is a lifesaver

    sftp - i really shouldn't need to explain this.

    file - do magic stuff

    Hope that's some help.

  17. Re:Listing directory contents without the ls comma by Chris+Pimlott · · Score: 2, Informative

    This is an important difference between unix shells and dos/windows shell. In Unix, the wildcards like "*" are handled by the shell and expanded before the program ever sees the arguments. In DOS/Windows, the expansion must be done by the program itself. This is why every program in unix understand wildcards, while only some do in the MS world.

  18. Re:search and replace in files by element-o.p. · · Score: 2, Informative

    Why not just use sed if you are on the command line?

    sed "s/searchme/replaceme/g" *

    ...etc.

    --
    MCSE? No, sir...I don't do Windows. Yes, I am an idealist. What's your point?
  19. short list of shell tips by James+Youngman · · Score: 4, Informative

    Assuming you already know the simple stuff like how to use shell quotes correctly, what you can do with ps and top, ...

    1. Using awk '$3 ~ /foo/ { bar }' to grep just one column of a file
    2. reset
    3. find . -blah -exec quux \+
    4. Adding : to the front of complex commands you just typed but realise you don't want to execute yet so that they get into your shell history
    5. Meta-T in Bash for swapping arguments
    6. find . -printf X | wc -c for counting files (since find |wc -l would miscount files with newlines in the name)
    7. set, shift and implicit shell loops (for without in)
    8. "${foo:-bar}" and similar
    9. "${x%%.ext}.newext"
    10. comm -3 <(sort long) <(sort short)
    11. unalias rm
  20. dmidecode by jvillain · · Score: 3, Informative

    Need to know the serial number of a server or bios version or many other things dmidecode is your friend.

  21. Share mouse and keyboard by pieleric · · Score: 5, Informative

    When I pop up with my laptop to discuss with a colleague, after a while I might do on their computer:
    xhost +mylaptopname

    and on my laptop I do:
    x2x thecomputername:0 -west

    Then suddenly my mouse can go over the two computers, my keyboard works on both as well, and I can even copy-paste between the two computers. It looks like the two computers got united. In a flash, newbies get a new idea of what means unix and X ;-)

    1. Re:Share mouse and keyboard by drago · · Score: 2, Informative

      Or even more wonderful if you need a more permanent setup of this: synergy. It gives you basically the same functionality x2x does, but it also works on Windows and Mac (and also mixed environments of Linux, Windows and Mac of course). Couldn't live without it.

  22. directory stack by Komi · · Score: 3, Informative
    Directory stack commands, pushd and popd, are quite handy. I alias them to pd and po. Then pd works just like cd, except it remembers where you've been.

    The advantage of the directory stack over "cd -" is that the directory stack always remembers where you last were. "cd -" only remembers until you change directories again.

    In tcsh (I don't know other shells), you can do directory stack substitution. =0 is current directory, =1 is one up, =2 is two up, and so on.

    I also use bindkeys to bind Control-G to 'dirs -v' so I can look at the directory stack with ease, even in the middle of a command.

    Personally, I think directory stack commands are the least-known, but most useful feature in tcsh.

    --
    The ultimate goal of science is to unify all forces of nature to a single law that can be silk-screened onto a T-shirt.
    1. Re:directory stack by Chris+Pimlott · · Score: 4, Informative

      In tcsh (I don't know other shells), you can do directory stack substitution. =0 is current directory, =1 is one up, =2 is two up, and so on.

      In bash, it's ~0, ~1, ~2, etc.

  23. sudo !! by n.e.watson · · Score: 3, Informative

    !! in bash uses the last command you entered. $ make_me_a_sandwich What? No. $ sudo !! okay. $

  24. Re:grep -R by amorsen · · Score: 2, Informative

    To find a string in a file I used to do "find . | xargs grep foo"

    It's generally wise to use -print0 and -0...

    --
    Finally! A year of moderation! Ready for 2019?
  25. Re:If he liked write by sjaskow · · Score: 2, Informative

    Actually, you don't need fingerd running if you looking at the local machine. IIRC it reads the local wtmp or wtmpx file to get the information.

  26. Finding where your disk space went. by thisissilly · · Score: 3, Informative

    ls -l | sort -n +4 -- sorts files in size order, good for finding big files in a directory
    du -s * | sort -n -- similar to above, find the biggest files & subdirectories of the current dir
    du | xdu -- only when you're in X, obviously. Better grain than above, with the ability to drill down into subdirectories

  27. My favourite on-liner so far: by Anonymous Coward · · Score: 1, Informative

    Reverse a bash-Array:
    j=0; for i in ${array[*]}; do newind="$(( ${#array[*]} - ($j+1)))"; echo j=$j newind=$newind; newarr[$newind]=$i; let j++; done

  28. Re:Show attached block devices by HTH+NE1 · · Score: 4, Informative

    This shows all attached block devices (it also errors like crazy, hence the | more)

    blockdev --report /dev/* | more

    Redirect stderr much?

    blockdev --report /dev/* 2> /dev/null

    --
    Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
  29. Re:Imbedding output with ' by mjcecil · · Score: 2, Informative

    Embedding output... use the backtick, not the doubletick. '`' not '"'

    echo There are `ls | wc -l` entries in this directory.

    In ksh, you can also use the syntax $(command string)

    echo There are $(ls | wc -l) entries in this directory.

    --
    Mark J. Cecil -- Senior UNIX Engineer
    New Orleans, Louisiana
    http://notrealswift.blogspot.com
  30. Re:Surprised that it does it correctly. by Pixie_From_Hell · · Score: 2, Informative

    Well, to be fair it's a relatively new feature in bash, so perhaps ubuntu is just the first place you've tried that makes bash completion the default. Here's a blog posting on changing completion to make it smarter, so perhaps you can follow some links and learn how to make the shell do what you want. That's sort of the point...

  31. Re:grep -R by digitalhermit · · Score: 2, Informative

    Instead of using find and xargs it's sometimes easier to use the -exec parameter to find:

          find . -type f -exec ls -l {} \;

    xargs is very useful in other circumstances. One thing that I get asked about a lot is how to pass variables. Main thing to remember is to call the shell via xargs to process variables and other parameters.

    BTW: How does one ork a cow?

  32. Re:A real time saver! by Mish · · Score: 4, Informative

    DISCLAIMER: Don't run this!
    I didn't think I needed to say this, but I just showed someone this and they thought it was a legitemately helpful command...

  33. Re:Surprised that it does it correctly. by Waffle+Iron · · Score: 2, Informative

    Add this to your .inpurc file:

    Control-Space: menu-complete

    Then you can do it either way. <Ctl-Space> works like Windows, tab works like bash. Also add these if you want a little additional sanity:

    set completion-ignore-case on
    set show-all-if-ambiguous on

  34. Re:Show attached block devices by MrMunkey · · Score: 4, Informative

    cd -

    Change to your previous directory. It's great for going from dev to test environments from time to time.

  35. Re:Imbedding output with ' by atomic-penguin · · Score: 2, Informative

    ls -l 'locate gcc' // Output would give you a long listing of wherever gcc is located

    Maybe it is just my font, but I think those should be backticks. Variables and commands cannot interpolate strings with single quotes ''.

    Backticks, however, will allow command output redirection.

    ls -l `locate gcc`

    You could write it this way, but you threw in double-quotes and do not really need them here.

    find ~/tvshows -name doctor\*who\* -exec mplayer -fs "{}" ";"

    You could type the following, with the same effect. The find command with the -exec switch, is forking off a sub-shell for every argument passed by the find command, the \; or ";" is a command terminator for the sub-shell which is forked off. Depending on the task this could run very, very, very slow. For heavy-duty tasks there is a pretty neat utility shipped with every distribution of Perl, check out find2perl sometime.

    find ~/tvshows -name "doctor*who*" -exec mplayer -fs {} \;

    To generate pure Perl code to do the same loop, run the following. If you tack on a '| perl', after the find2perl command, it will pipe the generated code straight to the language interpreter and execute.

    find2perl ~/tvshows -name "doctor*who*" -exec mplayer -fs {} \;

    --
    /^([Ss]ame [Bb]at (time, |channel.)){2}$/
  36. A nice tip from the OSX world by Chris+Pimlott · · Score: 3, Informative

    My previous place of employment was a Mac shop, where I discovered the wonderful pbcopy and pbpaste commands. Why they aren't a standard part of every X windows distribution, I'll never know, but they are damned handy.

    What they do is allow you to read and write from the cut-and-paste buffer from the command line. "pbpaste" will print the currently copied text to stdout, while "pbcopy" will replace the buffer with stdin.

    Fortunately, there are some third-party X equivalents for this, such as xsel or xclip, which can be adapted to work in the same way.

    Rougly equivalent:

    pbcopy
    xsel -i --clipboard
    xclip -in -selection clipboard

    pbpaste
    xsel -o --clipboard
    xclip -o -selection clipboard

  37. grep --color by krappie · · Score: 5, Informative

    grep --color

    For some reason, many people are greatly surprised when they figure out that grep will highlight matches for them.

    1. Re:grep --color by starfishsystems · · Score: 3, Informative

      diff -y Compares files side by side.

      --
      Parity: What to do when the weekend comes.
  38. find, dc, sed, dd pipes by dschuetz · · Score: 2, Informative

    The find command is definitely a good tool to be familiar with. Also, I've done a lot of really wacky stuff with sed in the past. (and sed experience can help you to work with ed and even ex, for those times the system has crashed so hard that's all you've got) (though I don't think I've had that happen since I left Ultrix).

    dc and bc are good things at times. Really, I do a whole lot of really complicated manipulation of data with the various utilities, sometimes all in one long pipeline and sometimes in multiple complicated stages. An example of that is where I'll often take a du output, use sed to convert G, K, and M to the proper amount of zeroes (or maybe there's a du option to do that automatically, I forget), awk out the 1st column and print each as "$1 +" with no returns, echo a "0" at the end, and pipe the whole thing through bc, to get a "grand total." (maybe that's a bad example, but the ([do something]; echo 0) | bc is definitely something I've done a lot over the years.

    I used to have aliases to call dc to do radix conversion (like echo "2 o 1337 p" | dc to get "10100111001"). (there's also a great .sig line out there that does some kind of crazy dc stack program to print out an ascii message, that I wasted a good chunk of time figuring out on paper to understand how it worked).

    Another great trick I've been using for 20 years is dd piped through ssh, to copy a local hard drive image over the net to another machine, or vice-versa (well, okay, 20 years ago it was rsh). (like boot off a live CD, "(ssh remote cat /my/image.dd) | dd of=/my/dev" to rebuild a local drive from a remote backup.

    There are lots of other things, way too many to write here. I'm sure there's a website out there somewhere.

    Oh, and another great one from the days when I'd get files with untypable characters in the filename -- "ls -i" to get a files inode, then "find . -inum [inode] -exec rm {} \;" to delete that (or mv {} newname to rename it). Not sure I need that much any longer, but at the time it was VERY useful.

  39. lsof by pak9rabid · · Score: 5, Informative

    lsof is a LIFE SAVER for trying to find what's still using something in a mounted resource when trying to unmount something. For example:

    lsof /mnt/myMount

    That will list which processes have anything under /mnt/myMount open

    It's also useful to find who's accessing what device. For example, say you're trying to listen to an mp3 and Amarok bitches about the sound device not being available. In that case, you could do something like this (assuming you're using ALSA):

    lsof /dev/snd

    That will list what processes are accessing any of your ALSA sound devices.

    1. Re:lsof by DRobson · · Score: 3, Informative

      Performed an upgrade (particularly applicable for Gentoo users)?

      lsof | grep DEL | grep lib

      Lists all libraries which have been deleted and who is using them. Handy for restarting selected applications after updates.

  40. Secure remote copy by Ewasx · · Score: 2, Informative

    When I want to copy entire directory trees to a remote system while preserving all file attributes:
    tar -czf - some_dir | ssh user@remote.host 'tar -C target_location -xzf -'

    This also works when you want to copy something to a system that doesn't support scp (embedded devices)

  41. Re:Show attached block devices by aniefer · · Score: 5, Informative

    ctrl+r (in bash?): reverse incremental search through history.
    pushd/popd , change directory saving the old one on a stack.

  42. Re:Show attached block devices by jonaskoelker · · Score: 4, Informative

    sftp - i really shouldn't need to explain this.

    I much prefer sshfs. Diff doesn't work so well over ftp ;)

  43. Re:Show attached block devices by cain · · Score: 5, Informative

    tail and head - tail -f is a lifesaver

    I use tail -F, which is the same as tail -f, but works on non-existent files. Useful when tailing log files from programs that start a new log file every time it runs. Using tail -F in this case, you can just leave tail running while you start and restart the program overwriting the log file.

  44. Re:rm -rf / by EthanV2 · · Score: 2, Informative

    I believe you mean NO CARRIER

  45. Shell history tricks by steveha · · Score: 5, Informative

    There are a whole bunch of "history" tricks, to recall old commands without using the mouse.

    When I started college, I studied the shell's man page until I knew them all. Some are so obscure I have forgotten them.

    Generally, these involve an '!' character in some way.

    Here are a few I use:

    !! # run again the last command that was run
    !9 # run again the command with history number 9
    !v # run again the last command that started with a 'v'
    !vi # run the last command that started with "vi"
    !?foo? # run the last command that had the string "foo" anywhere in it

    diff oldfile newfile
    mv !$ !^ # same as "mv newfile oldfile"
    # !$ is last arg of previous command, !^ is first arg

    ls foo bar baz
    rm -f !!* # same as "rm -f foo bar baz"
    # !!* repeats all arguments from previous command

    There are actually some baroque tricks that recall a previous command and perform a search-and-replace on it, but for anything that complicated I just recall the line and edit it. The baroque tricks would have been pretty darn cool back in the paper teletype days, though.

    By the way, the Bash shell can be configured to edit command lines using vi or Emacs commands. I described how to do it in an article I wrote for Linux Journal magazine. It's the last section, "vi or Emacs Mode in the Shell".

    http://www.linuxjournal.com/article/8361

    Oh, not exactly a history trick, but here's something I use all the time:
    ls -1 > /tmp/files
    vi /tmp/files # edit list to include just the files I want
    rm `cat /tmp/files`
    # `cmd` inserts the standard output from cmd into the command line as if you typed it

    ls -1 > /tmp/files
    vi /tmp/files
    # edit list to include just the files I want
    # now run this command: :%s+.*+mv & /some/directory/path/&+
    # save file and quit vi
    source /tmp/files

    This moves the chosen files to "/some/directory/path". The breakdown of the vi command is as so:
    : # invoke "ex mode" for search and replace command
    % # run the following command on every line of the file
    s # do a search and replace
    + # use a '+' for the command delimiter, so I won't have to backslash escape '/' chars in the path

    .* # all characters on the line
    + # end the match pattern, begin replace pattern
    # & refers to the match pattern, thus all chars on the line
    mv & /some/directory/path/& # replace "foo" with "mv foo /some/directory/path/foo"

    Takes less time to do it than to explain it!

    The above is perhaps overkill if all the files are going to the same place. It's great if you want to send some files one place, some to another, because you can just edit the destinations until it looks right.

    steveha

    --
    lf(1): it's like ls(1) but sorts filenames by extension, tersely
    1. Re:Shell history tricks by bobstreo · · Score: 2, Informative

      How about setting FCEDIT to your favorite editor, and running fc on the command line, very very VERY handy when messing with long paths. (stupid java)

      the script command is also your friend when creating pointless documentation people will never read.

      another thing people never think of is the
      nohup command.

      sshfs is kinda spiffy if you want to mount things over an ssh connection.

      I do HATE with a passion when the same commands on different OS versions (I'm looking at you here SUN) ouput different results.

      Oh and don't forget stupid little things like aliases in your shell startup file. I just like typing l to do an ls -aF.

      You can also write some nice functions for your startup files. and don't forget the logout files, you can have some fun there.

      Also if you're old school command line and really bored:

      http://nadvsh.sourceforge.net/nadvsh.6.html

  46. Re:Screen by Randle_Revar · · Score: 2, Informative

    you don't have to use Ctrl-a. You can bind screen's escape to any key.

  47. Re:Show attached block devices by duguk · · Score: 2, Informative

    Try:
    blockdev --report /dev/* 2> /dev/null

    as HTH NE1 (675604) said above.

    blktool is probably good, but blockdev is on most Linux recovery CD's as default.

  48. and disown it! by Domini · · Score: 2, Informative

    (otherwise it will get killed the moment you log out)

    1. Re:and disown it! by Gazzonyx · · Score: 2, Informative

      nohup, FTW!

      --

      If I mod you up, it doesn't necessarily mean I agree with what you've said, sorry.

  49. Re:rm -rf / by fr4nk · · Score: 2, Informative

    dd if=/dev/zero of=/dev/sdx bs=512 count=1

    should clear out the MBR.

  50. Re:Show attached block devices by c0p0n · · Score: 2, Informative

    cd

    takes you to your home directory.

    --

    Your head a splode
  51. Re:Well by Hatta · · Score: 4, Informative

    You only need a tiny bit of entropy to seed the pseudorandom number generator in /dev/urandom. Once it's seeded you get all the pseudorandom numbers you want. /dev/random gives you truly random numbers, and is highly dependent on the amount of entropy the system has. It will block if you run out of entropy, urandom will not.

    --
    Give me Classic Slashdot or give me death!
  52. Re:Show attached block devices by EvanED · · Score: 5, Informative

    Along that line are pushd and popd. pushd <dir> changes to the specified directory and pushes it onto a stack of directories; popd changes to the directory at the top of the stack and removes it. There are commands for manipulating the directory stack but I don't know or use them.

    With zsh, and I think with Bash as well, you can setopt AUTO_PUSHD and setopt PUSHD_SILENT and then cd behaves like pushd.

    (Both of these commands, along with cd -, work in the Windows command interpreter too.)

  53. SSH by evilviper · · Score: 3, Informative

    I'd say most people don't know how to use SSH very well...

    Stop typing passwords for every system: ssh-keygen, ssh-auth and ssh-add.

    Transferring files both with scp/sftp and ssh user@host "cat file" > file, and the like.

    Changing encryption algo for significantly improved speed, eg. -c arcfour

    Enabling/disabling compression for internet/intranet. -C

    An $HOME/.ssh/config file to map names to IP addresses, specify the default user names for each host, toggle compression per host, enable/disable port forwarding, keepalive, etc.:

    host webserver
        ForwardX11 no
        ForwardAgent yes
        Compression yes
        hostname slashdot.org
        port 2100
        user cmdrtaco

    And parenthesis and backticks seem to be going out of fashion in short order... Too bad, since they're quite time-saving: mkdir `date +%Y`

    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  54. Re:Show attached block devices by EvanED · · Score: 3, Informative

    sshfs is truly pimp, but both deserve mention; AFAIK sshfs can't be used on a system where you don't have root that doesn't have FUSE installed.

  55. One Upped by Chagatai · · Score: 3, Informative
    While the 'write' command is full of possible hijinks, the better option is to redirect output directly to the port on which someone is sitting. Unless that user has turned messages off with an 'mesg n' command, you can flush whatever you want to their screen with nothing to show the source of the transmission aside from shell history files.

    For example, I did these to some of my favorite people:

    banner "PORN HERE" > /dev/pts/4

    echo "All files deleted." > /dev/pts/3

    cat dictionary.list > /dev/pts2

    --
    --Chag
  56. Useful tricks. by ElizabethGreene · · Score: 5, Informative

    I can't live without svn. Svn is a revision control repository, usually used for source code. What makes it really powerful is that you can _easily_ have a history of everything that has changed in a file and when. On my systems, I keep /etc in svn, plus bind's zone files, plus all the non-image web content, and the "Network Documentation" folder.

    Second trick, rsync. I use it to backup my home directory to another box. Very nice when you go through a hard drive/year.

    Screen -x was my next pick, but somebody already mentioned it.

    "echo ProtocolKeepAlives 120 >> /.ssh/config" No more dropped ssh sessions because of stupid nat boxes.

    su -u Username -s .. become Username, but keep the current shell. Good for diagnosing permissions problems when the user has a /bin/false shell. (named/www-user/backup/etc).

    A little awk goes a long way. Not the big-bad-I-am-a-programming-language-awk, but the smaller-friendlier extract one or two columns of text from something awk. ex. awk '{print $2}' prints the thing in the second column. Add -F the field separator tool and it gets really useful.
    Better example. Here is a postfix log line.
          Nov 5 16:27:19 pdc postfix/smtpd[13601]: 92B3F499C25F: client=exprod5mx254.postini.com[64.18.0.49]
    Here is the awk to extract just the message id. awk -F': ' '{print $2}'

    And here is the "I didn't get this message your mailserver must have eaten it" disprover. It searches the maillog for every message from or to a given address and extracts the full email transaction for that message id.

    grep -i user@domain.com /var/log/maillog | grep smtpd | awk -F': ' '{print $2}' | sort -un > temp.fil && grep maillog -f temp.fil

    Next trick, back ticks. `` Back ticks substitute the output of a command within a command.
    Ex. Name a file after the date. echo "hi" > `date +%Y%M%d`.txt

    On the subject of dates. date -d'yesterday' or 'last week' or '-4 hours' can be handy.

    Last one. Loopback nat with Iptables, so you can access local hosts by their external ip. (Instead of setting up split dns.)
    iptables -I POSTROUTING -s $local_network -d $local_network -j SNAT --to $lan_interface

    My local network is 192.168.0.0/24 and the netfilter lan ip is 192.168.0.1, so that becomes...
    iptables -t nat -A POSTROUTING -d 192.168.0.0/24 -s 192.168.0.0/24 -j SNAT --to 192.168.0.1

    -ellie

  57. Re:Show attached block devices by ip_fired · · Score: 5, Informative

    I actually like less better than tail -f. If you less a file, and then hit SHIFT-F it will tail the file, but you can break out of it and scroll around and search for terms. Very handy while looking at log files.

    --
    Don't count your messages before they ACK.
  58. Re:rm -rf / by orclevegam · · Score: 1, Informative

    LOL, that's awesome.

    --
    Curiosity was framed, Ignorance killed the cat.
  59. Re:Show attached block devices by kitgerrits · · Score: 2, Informative

    The fd0 comes from the BIOS and not the O/S
    If you tell the BIOS there is a fd0, it will simply report its existence to the O/S.
    The O/S will simply assume there is no disk in there.

    --
    "I was in love with a beautiful blonde once, dear. She drove me to drink. It's the one thing I am indebted to her for."
  60. Use NX to make X forwarding actually usable by mangobrain · · Score: 2, Informative

    Even better: use NX (http://www.nomachine.com/ - includes a "free edition"). Basically heavily compressed X forwarding, but also includes niceties such as being able to disconnect and reconnect sessions without killing the X clients. I use it over a VPN on the rare occasions I work from home, on a standard ADSL connection. Typing on an NX forwarded xterm is almost as quick as when SSH-ing in directly (which may seem a somewhat pointless use-case, but is the closest I know how to get to the behaviour of "standard" SSH with X forwarding). I also find I get *much* better responsiveness if I run VMWare Server Client on my work box, forwarded over NX, instead of running the client at home and connecting to the work VMWare server from there.*

    Also available as FreeNX (http://freenx.berlios.de), but harder to set up IME.

    * Which may just be another way of saying "VMWare's protocol sucks", but regardless, turns it from near unusable to very useful.

  61. Re:rm -rf / by buchner.johannes · · Score: 2, Informative

    I do the same, luckily a lot of music players support something like
    # audacious --play
    # rhythmbox-client --play
    for controlling the running app from the shell. The second actually goes over DBUS.
    more often I use the opposite, --pause, or
    # sleep 15m && sudo poweroff
    for listening to some music in bed before falling asleep.

    --
    NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
  62. Re:I never knew that command by Anonymous Coward · · Score: 1, Informative

    And the VMS HELP pages were (and probably still are) inestimably better than Unix style man pages. Even 20 years later I still miss them.

  63. Re:Show attached block devices by mooingyak · · Score: 3, Informative

    or if you're a vi freak like me:

    set -o vi
    escape (enters command mode)
    k to scroll up
    / to search

    --
    William of Ockham had no beard. The most likely explanation is that it was chewed off by squirrels every morning.
  64. Time warp by SchmellsAngel · · Score: 5, Informative

    cal 9 1752

    --
    We must repeat.
  65. Re:Show attached block devices by geminidomino · · Score: 4, Informative

    Organizing them all is left as an exercise for the reader.

    Cakewalk. Put the following in ~/.bash_profile or ~/.profile

    For ubuntu:
    SHELLID=(echo `tty` | sed 's!/!.!g')
    HISTFILE=$HISTFILE$SHELLID

    Logout. Log back in. Bada-bing.

  66. Re:Show attached block devices by bodan · · Score: 2, Informative

    If you're using bash, try adding

    # don't overwrite history from several sessions
    shopt -s histappend

    and

    # save history after each command instead of logout
    PROMPT_COMMAND='history -a;'${PROMPT_COMMAND}

    in your ~/.bashrc

    You might also want to add this, too:

    # don't put duplicate lines in the history. See bash(1) for more options
    export HISTCONTROL=ignoredups
    # ... and ignore same sucessive entries.
    export HISTCONTROL=ignoreboth

    --
    "I think I am a fallen star. I should wish on myself."
  67. Re:Show attached block devices by BorgCopyeditor · · Score: 4, Informative

    Your data is corrupt: only the current sig is ever shown.

    --
    Shop as usual. And avoid panic buying.
  68. Re:Show attached block devices by Isomer · · Score: 4, Informative

    More awesomely, if you have found something in your history with ^R or up arrow or whatever, then you can press ^O to "execute this line and put the next line in the history onto the command line". Thus:
    vi foo.c
    make
    ./foo
    ^Rvi^O^O^O^O^O^O^O^O^O^O^O^O^O^O
    and so on.

  69. Re:rm -rf / by Teilo · · Score: 2, Informative

    For recent versions:

    sudo -i

    shorter

    --
    Mir tut es leid, Menschen daß Einfältigfehlersuchenbaumfolgendenaffen sind.
  70. esc-. by Anonymous Coward · · Score: 1, Informative

    in bash, esc-. is a fantastic shortcut

  71. Re:Show attached block devices by FrangoAssado · · Score: 4, Informative

    I think you missed a '$' before the open parenthesis, it should be:

    SHELLID=$(echo `tty` | sed 's!/!.!g')

    Also, you could replace "echo `tty`" with simply "tty":

    SHELLID=$(tty | sed 's!/!.!g')

  72. Re:Show attached block devices by g0dsp33d · · Score: 2, Informative

    Yeah. tail -f is amazing. Other big time savers:
    -watch (reruns last comand at set interval)
    -ctrl+z and then %(bg # goes here) & (stops current process and resumes it in background
    -using tab instead of typing out file paths
    - pipe redirects such as > and | (lets you put stuff in new places)

    --
    lol: You see no door there!
  73. Shells... by BrokenHalo · · Score: 2, Informative

    One of the most timesaving things I ever did was to replace the default sh or bash with zsh.

    zsh has so many features, it would be impossible to list them all here. In fact, I can't claim to know them all, but everybody takes what works for them.

    Suffice to say that the completion, iteration, history and redirection tools are second to none if you're as lazy a typist as I am.

    1. Re:Shells... by goodwid · · Score: 2, Informative

      Yeah, zsh is definitely awesome, but by the time I found it, I had already many years of tcsh usage, and not the inclination to re-learn a new shell. But I agree, zsh is amazing.

      More tcsh goodness: the ability to add tabcomplete for whatever you want. For example, this:

      complete kill 'n/*/`ps axu|grep $USER| awk \{print\ \$2\}`/'

      lets you do tabcomplete on your processes' pids. Handy.

      --

      The net interprets censorship as damage and routes around it. -- John Gilmore
  74. Re:Show attached block devices by eosp · · Score: 2, Informative

    It uses different, non-Python syntax, but I find Fish useful.

  75. Ported to Ubuntu by El_Oscuro · · Score: 2, Informative

    (posted with pbcopy)
    503 sudo apt-get install xclip
    504 echo xclip -in -selection clipboard > bin/pbcopy
    505 chmod ug+x bin/pbcopy
    506 echo xclip -o -selection clipboard > bin/pbpaste
    507 chmod ug+x bin/pbpaste
    508 history | pbcopy

    --
    "Be grateful for what you have. You may never know when you may lose it."
  76. Re:rm -rf / by tdknox · · Score: 2, Informative

    Well, unless you're already root, your command will fail with a permission denied error since the > redirect will run with your user permissions, not with sudo permissions.

    So, in that case yes, sudo will prevent an "Oh sh*t!" moment.

    --
    Did you know that gullible is not in the dictionary?
  77. Re:rm -rf / by Curtman · · Score: 4, Informative

    when I told a guy over the phone to 'rm -rf /bin' but unknowingly he was at "/". Oooops

    I don't get it. You told him to give rm an absolute path, it doesn't matter where he was.

  78. Re:rm -rf / by PuercoPop · · Score: 2, Informative

    Shell built-in? news to me as I have it instaled on /usr/bin/

    My post obviously isn't an actual output but my attempt at a koan. As koan's are supposed to disruput your cognitive process so one can percieve reality as such. Of course you may think it is a sucky koan, but an attemp at least it is.

    You can Mod if Funny now :'(

  79. Re:Show attached block devices by Abattoir · · Score: 3, Informative

    Diff works fine with ssh.

    ssh $remote_system cat remotefile | diff - localfile

    cat localfile | ssh $remote_system diff - remotefile

  80. Re:rm -rf / by Anonymous Coward · · Score: 1, Informative

    That's what sudo -i is for.

  81. tricks by Anonymous Coward · · Score: 1, Informative

    bash#set -o vi

    also

    $ls -tgo |less

    shows modified files first, useful for webmasters

  82. Re:Show attached block devices by darkvizier · · Score: 2, Informative

    Harah for vi mode!

    'diff' - compare two files, list differences
    'tr' - text replace... replaces all instances of a character in the input stream with a different one in the output.
    'touch' - update timestamps on a file, or create it if it's not there

    At my last job I dealt with a lot of HIPAA compliant medical files... All tilde delimited with no endlines. I ended up writing a bunch of perl scripts that piped the files through tr to replace tildes with endlines, then do something useful such as grep, or parse the files with regexes. Perl also has special variables for the field record seperators, which you can set to change the endline character that it reads ( $/ ) and writes ( $\ ). If you're ever working with delimited files with no endlines, this can be a lifesaver... just set both variables to your delimiter, and it handles all the conversion for you.

  83. Re:rev by Anonymous Coward · · Score: 1, Informative

    This might be horrendously ugly, but I use it all the time, normally in pairs. One example is to grab file extensions in a bourne-shell (not bash) compatible way

    as in:

    EXT=`echo $FILE | rev | cut -f 1 -d '.' | rev`

    I know I know there are shell builtins for stuff like this for all recent shells. But why would you want to fuss with those.

  84. Re:rm -rf / by Antique+Geekmeister · · Score: 2, Informative

    Not by me! Sharing root passwords was _nasty_, and sudo provided much better logging of who was going in as root and forcing them to use their own passwords, not a root password.

  85. Re:Show attached block devices by Lodewijk · · Score: 2, Informative

    Another 'du' variant:

    du -mb | sort -rsg | less

    Gets the size of all subdirectories relative to `pwd`, writes the size in blocks and sorts them from big to small. Very useful to find deeply nested directories stuffed with old and forgotten .iso's of Debian Potato.

  86. Re:Bah, subtlety: by Anonymous Coward · · Score: 1, Informative

    Damn you Google ! Damn you and your lousy "exact search" ! Exact search my a** !

  87. Re:Show attached block devices by gullevek · · Score: 2, Informative

    actually ignoreboth ignores duplicates and lines which begin with a space.

    --
    "Freiheit ist immer auch die Freiheit des Andersdenkenden" - Rosa Luxemburg, 1871 - 1919
  88. Re:rm -rf / by pato101 · · Score: 2, Informative

    Well, perhaps it depends on your distro. Some shells could have it built-in.

  89. Re:Show attached block devices by wylderide · · Score: 2, Informative

    tail --follow=name --retry --max-unchanged-stats=5 Is good for log files that periodically restart and rename the old ones.

    --
    This is the best restaurant I ever eat in
  90. (Useful) Stupid Unix Tricks? by foldoc · · Score: 2, Informative

    A NeXT consultant showed me this:

        mv /some/long/path/{old,new}file.blah

    The {,} notation expands the containing word to a space-separated list obtained by substituting in each thing in the {}, giving for the above:

        mv /some/long/path/oldfile.blah /some/long/path/newfile.blah

    Great for mv, cp, ln, diff, cmp.

    --
    Free On-Line Dictionary of Computing http://foldoc.org/
  91. Re:rm -rf / by VShael · · Score: 4, Informative

    Pshaw! All 1337 sysadmins just live as root!

    Yes, but all the really stupid ones do as well.

  92. Re:Last argument by iggya · · Score: 2, Informative

    Suppose you did this: ls -la filename, then you can do this: man !:0 which converts the !:0 into the zeroth word on the previous command, namely ls. So man !:0 would be man ls. Similarly, !:1 changes to -la, and !:2 is filename. You may also like !:1* or !:2*. !:1* would be the first word and all after it, !:2* is the second word and all after it. So !:1* changes to -la filename in this case. There is also !:0-2 for a range of words. Here is an example:

    sl -la file1 file2 file3 file4
    # oops i put sl instead of ls
    ls !:1*
    # same as ls -la file1 file2 file3 file4
    less !:3 # same as less file2
    ls -la file1 file2 file3 file4
    echo !:1-2 # echo -la file1

    More information can be found in the HISTORY EXPANSION section of the bash manpage. Specifically, the Word Designators subsection. Enjoy!

  93. Re:Screen by Anonymous Coward · · Score: 1, Informative

    in ~/.screenrc you can remap pretty much all the keys, including the control key. I've set mine to '`', and it works like a charm.

  94. Re:session-sharing with screen -x by quarterbuck · · Score: 5, Informative

    eject is a useful tool, If you have a rack of servers all alike and you need to identify one of them . Some servers have blinking lights etc. but mine had no audio nor lights. But it had a CD tray.
    I simply put eject and "eject -t" in a loop and go look in the server room -- the hyperactive server is the one I was looking for.

    --
    http://slashdot.org/submission/1062723/Cheap-mobile-data-plan?art_pos=2
  95. Re:rev by Anonymous Coward · · Score: 1, Informative

    The rev command has got to be one of the most useless Unix commands I've ever come across.

    That's crazy talk. I use rev all the time in shell scripts. Especially if I need the last bit of information in a line of unpredictable length. I''m so grateful for the core-utils.

  96. a pseudo-random sampling by oik · · Score: 2, Informative

    (Some of these might have been mentioned)

    Bash foo:

    # Make my prompt "pretty" colours and set the xterm title bar to useful things at every command. Also make the continuation prompt blue rather than '> ' so I can cut and paste
    PS1='\[\033[00;31m\]$USER\[\033[00;33m\]@\[\033[00;32m\]\h\[\033[00;00;00m\]:\[\033[00;34m\]\w\[\033[00;00;00m\]\$ '
    PS2='\[\033[00;34m\]'

    # Tell me if something worked
    random_command && echo yes || echo no

    # Completions:
    #  commands which should complete to a command
    complete -A command which
    #  commands which should complete to a shell variable
    complete -A file -A variable unset
    complete -A file -A variable export
    #  commands which should complete to a word list and files
    complete -A file -W "commit diff remove update status annotate log" cvs
    complete -A file -W "all install depend clean" make
    complete -A file -W "all install depend clean" pmake

    # C-d twice to log out
    IGNOREEOF=1

    # Avoid tmp files
    join <(sort file1) <(sort file2)

    # Other things
    shift-insert to paste from the clipboard in terminals
    history > ~/docs/stuff_i_just_did_so_i_dont_forget
    less -S  for wide files
    strace / ptrace / truss
    pushd/popd

    --oik

  97. Re:rm -rf / by FictionPimp · · Score: 2, Informative

    Here we have 5 people with root access on our web server. Who do you blame if root deletes /var/www?

    With sudo I know exactly who to blame.

  98. Re:rm -rf / by Kymermosst · · Score: 2, Informative

    The reason pkill uses -v to negate the match is because it is a variation on the pgrep command, which is used to grep for processes. So, its options are much more like grep.

    So, what option does grep use to negate the match?

    --
    "Alcohol, Tobacco, Firearms, and Explosives" should be a convenience store, not a government agency.
  99. Re:rm -rf / by JCholewa · · Score: 2, Informative

    I'm guessing IHBT, but here's an explanation for those who don't quite get it:

    He typed: at midnight `shutdown -r now`
    He meant to type: at midnight "shutdown -r now"
    The "at" command schedules the command in quotes to run at midnight. Putting backquotes around the command, as he actually typed, causes the command to be run immediately.