The Hidden Treasures of Sysinternals
Barence writes "PC Pro contributing editor Jon Honeyball has written a nice feature on the latest treasures to be found on the Windows Sysinternals website. Among them are a tool for creating virtual hard disks from physical drives, a hard disk read-write monitoring tool, and a utility for putting ISO images onto flash drives. They're free, but they're effective."
psexec has saved my ass SO many times it's not even funny. psexec \\almostcrashedserver cmd.exe
There's a reason MS bought the company and hired Mark, he consistently puts out the most useful tools for in the trenches Windows diagnostics. Heck MS's PSS would routinely have you use his tools even before the purchase because nothing they put out internally was nearly as useful.
There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
Comment removed based on user account deletion
You know, sysinternals was amazing piece of reverse engineering work and some of the utilities that came out of it were pretty interesting as examples of that reverse engineering work.
But...
All that stuff is junk compared to what Linux does for utilities!
I mean, my ubuntu has had burning ISOs and copying them any which way now for at leas 5 years. I can type sensors and get the motherboard temperature, fan speeds, everything. I mean, if you are into doing hardware and low level OS hardware interfacing stuff, there's enough gobblygook in /proc to keep anyone happy from Linux, and then there's all the log files and then the source.
I mean, yeah, Windows has its advantages, but sysinternals isn't one of them. sysinternals is just proof that for a lot of applications you have to be a hero to get it to do anything simply because the source is closed.
This is my sig.
Process Explorer is what Windows should ship with instead of task manager.
Process Monitor is so kick ass... I can't even put it in words.
Not to be confused with the Sisinternals porn website.
> They're free, but they're effective.
What an unusual combination of attributes!
This is very useful- I was one of the people who stuck the Windows 7 MSDNAA downloaded iso onto a flash drive in order to install it to my desktop and laptop.
The more difficult part for normal users is not extracting the iso to the drive but making the drive bootable- which unless you have a utility (Like the one in the article)- requires some command line work. This would make the process way quicker.
I am just pissed Newsid doesn't work on Vista and 64-bit OSes anymore. I know it(SID) shouldn't matter but it can an sometimes does in some instances.
I have been using SysInternals stuff starting from TCPView, which was pretty useful for me back then. But how exactly is DiskMon a latest treasure? It's been around for ages, unless now it monitors on kernel level.
Among them are a tool for creating virtual hard disks from physical drives...
subst? That's old stuff... but nice for the other tools!!
I can't call that English
Tried using it on my box as a backup tool for a clean install of Win7. AVOID IF YOU ARE GOING TO USE THE SAME PHYSICAL DRIVE. Windows 7 couldn't mount or boot it. Known issue, and extremely aggravating.
"Sometimes a woman is a kind of religion, she can save your soul & set you free from all your sins" - Bad Examples
So it's usefulness is kind of limited. If you want to create bootable usb-sticks for other operating systems, check http://unetbootin.sourceforge.net/
I used SelfImage recently to dd a windows 2003 box to an LVM-based virtual machine on Proxmox, a Debian-based Virtual Machine Server. Worked a treat. While I see the benefit of created a Microsoft VHD if you're an MS shop, we're a mix so being able to pump a live physical disk into a remote logical volume was great.
"PC Pro contributing editor Jon Honeyball
Was that his porn star name?
One of the reasons I can't use Windows for real work is because of the lack of multidesktop. For me is very important the ability to switch from one desktop to other, never having the screen of the taskbar cluttered, having my "graphic things" open in a desktop, and my "programming things" in other. I can't understand how people can work withouth it. Is like browsing withouth tabs, only worse :-)
I know that there are a few free and now free tools that try to provide MD to windows, but all falls flat. The guy behind sysinternals tried to, and was almost a success, but nope. It seems theres some architecture limit that stop this thing to work smoothly on windows, but that is just natural on the X system.
This and the horrible console that Windows have, makes working with windows infuriating.
-Woof woof woof!
Now if someone could point out how I boot up my Vista partition from Virtualbox then that would be truly useful. I don't see how any of this proprietary Microsoft stuff helps matters.
This was a god send to me, after VMWare Converter could not/would not convert a machine of mine, even after registry and driver cleaning, it just failed near the end without a meaningful error message in the log.
I used disk2vhd, booted up the image in VirtualBox, and bingo - working image.
/\/\icro/\/\uncher
There, fixed that for you. Saying "free but effective" suggests that free implies ineffective.
They're excellent for a wide range of things. Filemon (now superceded but still available) is an excellent tool for working out what files a piece of software is opening (eg. if you're trying to find config files). Regmon does something similar for the registry. Process explorer is stellar for getting more detail on a process than task manager will ever give (like where the image is running from and what DLLs it's using). Sysinternals filled a gap in diagnostic software. In a Windows environment they're as basic to me as netstat or ping. (speaking of which check out sysinternals tcpview). Especially good for tracing a user mode process right through. There are a lot of other utils to unlock the power of your Windows environment too.
Two sysinternals that weren't mentioned worth knowing about:
streams - view or remove hidden file streams attached to a file not normally seen in explorer. Especially good for removing that pesky "downloaded files are bad" warning when something is marked as being from the Internet zone.
junction - One of a handful of tools that allows you to create junctions (simliar to but not the same as hard directory links) in Windows XP.
The other non-sys-internals thing that every power user should know about is windbg and the debugging symbols. Indespesible for tracking down the culprit if you get blue screens due to device drivers (though obviously non-developers are not going to be able to do much about fixing the fault apart from downloading a different version or removing the device driver)
These posts express my own personal views, not those of my employer
Don't forget live.sysinternals.com for instant access to any of the tools.
ironically... mark sued geeksquad for using these and his other tools!
Barely related to the topic (except that the Sysinternals monitors did a lot of this first), but I've had limited success googling...
The Windows 7 Performance Monitor is very very nice... what utilities under Linux would give it similar abilities to show per-process cpu/mem/disk/network/file/I/O usage?
So far I've managed to scrape together a variety of disparate tools to report on most of those things, but it would be nice if it could all be builtin to e.g. gkrellm or gnome-system-monitor or something.
* (the venerable) top: for sorting by CPU / mem virtual/reserved/shared, but not much else.
* iftop, ntop : to show realtime network activity per host:port (not just an aggregate for the interface). It would be nice to also be able to see net activity per process, though.
* dstat, sar : can print out some disk I/O related numbers at intervals, suitable for plotting. But "dstat --top-bio" only lists the process using the most disk I/O. And other than running "lsof" and trying to manually correlate PIDs, is there a way to actually figure out what file is being written / read?
* ltrace, strace, and dtrace : can tap into a running program and show library and sys.os function calls, (such as files being opened, etc.) but they put in some execution overhead.
* pmap : for digging into memory mapped to processes; would be neat to be able to visualize this... e.g. to see what apps have how much memory swapped to disk, or if something is still mapped to an older version of a shared library after an upgrade, etc.
Well, yes, of course Windows sucks, but the SysInternals package really does mitigate the suckage to a surprising degree. Arguably, it's stuff that should have been part of Windows all along. I've been using it for a couple of years and it has made it much, much easier to beat Windows into submission. It's also extremely useful for finding and removing the crap that virus and malware scanners are apparently incapable of dealing with, as well as finding the mounds of not-actually-temporary temporary files that both Windows and a lot of applications like to consume unreasonable amounts of drive space with.
Proud member of the Weirdo-American community.
These have been available for a long time, used to just be from a site called Sysinternals run by Russonivich before Microsoft hired him. This guy is, literally, the person who wrote the book on Windows. Windows Internals is the current name, used to be called Inside Windows 2000. A wonderful technical document of the internal workings of Windows.
At any rate, Russonivich produces extremely useful tools. Not the sort of thing you want in the hands of inexperienced users, as many of them can break your system, but extremely powerful. I use them all the time in the course of my job, especially when there's manual malware removal that needs to be done. So far, malware is unaware of the ability to suspend a process, which Process Explorer will do. So you suspend the malware, its watcher process doesn't know to restart it. You then use autoruns to remove the startup entries. At that point you can reboot, it won't start, and you can clean up the residuals.
There is nothing like these tools for any other platform on the market. Mark Russinovich is THE MAN!
You mean other than UNIX and Linux systems? I don't see any comparable functionality that is not already available on those systems. It's great that the MS environment gets some useful diagnostic funtionality too; sad they haven't always had it.
"I believe in Karma. That means I can do bad things to people all day long and I assume they deserve it." : Dogbert
Now that I read more carefully author of referenced article must mean Filemon not Diskmon. Diskmon doesn't tell you what files are open (at least not the version I have). Filemon does.
These posts express my own personal views, not those of my employer
are condemned to reinvent it. Poorly.
Article is referring to this tool: disk2vhd
He knows that. His post isn't funny without that fact.
for botnets.
Slashdot, should, for liability purposes, post a disclaimer with every story about WinBLOWs software.
Thanks for NOTHING.
Yours In Minsk,
K. T.
I think I would be able to use all 3 of the tools they mentioned in the summary - I also enjoy the idea of an ISO boot from a flash drive - as that means I only ever have to store all my ISO's on a hard drive, and then put them on the flash drive when I need to use them, no more need for blank CD's.
I also think creating virtual hard drives from physical ones is a good idea. I have been trying to go more virtual lately, just to keep up with the trends and add some security, but its difficult to get into full swing when all your apps are already installed on the root Machine.
As for the read-write monitoring, I have seen more and more failed hard drives lately, maybe its just my experience, but I have this looming feeling that it'll happen to me soon, and I'll want a record of whats going on.
"free" is indeed means not necessary effective to me. I always suspect it might become "not free" tomorrow or I won't be able to add functionality for my specific task if I need to.
SUBST is not the same thing. It just lets you assign a drive letter to a path. SUBST was great years ago when you had only one floppy drive and needed to copy a disk. Using SUBST to create an virtual drive, you could copy a floppy to the virtual driver and DOS would pause in between, letting you swap disks.
Whatever MS shill modded the above "flamebait" should have his moderation priveleges revoked. How is a politely worded, informative and truthful comment "flamebait"?
WTF???
Free Martian Whores!
It's not from sysinternals, but for tiny little utils, Spacemonger - the older version - not the new "installable" one - is absolutely fantastic for finding out where disk-space went..... can't live without it in any windows shop.
last time they had to shutdown the website and re-licence the tool (http://store.microsoft.com/Help/ISO-Tool) because of GPL violations. I wounder if they use http://unetbootin.sourceforge.net/ source code this time ;-)
While his tools are by far extremely useful when using Windows, I've always found it hilarious that we've had similar commands bundled with UNIX and UNIX-like systems for decades now.
I mean, the dd command takes care of "creating virtual hard disks from physical drives" and "putting ISO images onto flash drives". Commands like iostat and iotop take care of "hard disk read-write monitoring". And they're present even in the most basic of installations.
I understand the joke... but lets be serious here, I would be surprised if even 5% of their staff understands how to use these tools correctly.
When they first started GeekSquad in my area, I was there for a total of 3 months (~15/hr was a good chunk of cash for a college student).
I saw:
- people returning towers that ended up having the actual folder we used to document our steps INSIDE the case (surprised the thing didnt overheat)
- employees trying to remove a power supply without properly unscrewing and detaching the cables from the mobo.
- managers press their staff to push the ~$70 backup "deal" onto customers (4.7GB of backup no less)
- a virus on a PC that looked like it filled up the entire hard drive with empty avi files that had a random porn like name given to em.
- much more I cant recall right now (I've tried to delete it from my memory)
I stopped showing up shortly after.
Is this wonderful screensaver. >:)
After years of not using a signature, I am going to make one to say the following: Fuck Beta
Speaking of booting from an ISO on a flash drive... does anyone know a way to store multiple ISOs files on a flash drive so that you can choose which to boot from? Would make installing the various OSs I use a lot easier than searching for the correct CD/DVD each time I install.
"not necessarily effective" doesn't mean "ineffective". By saying "free but x", you're saying that free implies "not x", not just "not necessarily x". If it were the latter, you wouldn't describe it as being apparently contradictory to it being free.
wtf is the command line? I'm on Slashdot, so you can understand how this is new territory for me. It sounds complicated and scary.
== Jez ==
Do you miss Firefox? Try Pale Moon.
Process Explorer kicks the crap out of Task Manager simply for the fact that it doesn't give access denied error messages to admins trying to end protected system processes. Try ending the same processes with Process Explorer and it "just works" -- which goes to show that the Task Manager error message has nothing to do with actual account privileges. The first time I found this I realized it's no wonder Windows has such a problem with malware, the applications I run have more access to my system processes than I do!
I went to eat some animal crackers and the box said, "Do not eat if seal is broken." I opened the box and sure enough..
Spoken by someone who apparently hasn't used any other platform on the market.
I went to eat some animal crackers and the box said, "Do not eat if seal is broken." I opened the box and sure enough..
There was a time when this kind of thing was neato, but nowdays don't you pretty much take it for granted that your OS comes with this kind of stuff (or is one apt-get command away) and that the actual internals can be discovered by reading the source instead of REing? Seriously, the very idea that people are impressed by this, is so 20 years ago.
It's not great though (it likes to stop in the middle and you have no way of knowing if it is just going slow or has crashed)...I'll have to give this a try.
Bottles.
Obligatory comment mentioning that (copylefted) Free software is the only kind of software where your suspicions do not apply.
He knows that. His post isn't funny without that fact.
It wasn't all that funny WITH that fact. ;)
Whoosh.
Slightly off-topic, but I just wanted to say that sysinternals' Process Explorer and Autoruns are the two most valuable anti-virus tools on the planet. No Windows-savvy geek should be caught without them. Also, I've yet to see a nicer interface on any linux tool that does the same.
Apparently you haven't used these tools. Again, I'll say there is nothing like them for any other platform. Idiotic Linux tools like "ps" and "free" do not compare in any way to the brilliant stuff Mark has written.
there are 3 points of view here:
- English grammar (and you are right about it)
- lack of respect to a free tools by author
- my own interpretation from open source point of view
You mean other than UNIX and Linux systems? I don't see any comparable functionality that is not already available on those systems.
If you're so confidant, perhaps you can answer this guy's questions.
Process Explorer would like to have a word with you.
I've had mixed luck using unetbootin with non-Linux isos. freedos works fine, but I don't think I've ever made it work with any Windows product, including Win7 and Office2007OPK.
I am literally 3000 tokens away from the chaotic crossbow --Stephen
Odd, I am pretty sure that that is how I installed my current win7 system but I have had it work poorly with something in the past.
Bottles.
You mean like "fdisk E: /mbr" Much more trouble than installing a program.
I have to add my voice to the chorus praising Mark and Sysinternals. His stuff is great and I have enjoyed his books on windows internals as well as having used his tools for years. As an old time VMS kernel programmer, I can see the kinship with VMS -- still my long term favorite OS for rock-solid commercial performance. His tools gave me a way of peering into the sphagetti of windows and understanding what was messing with what. The disk IO trace and procexp have helped me many times. This should not be a hidden gem, but then, there are places where mortals were not meant to look -- I doubt that anyone with the skills and testicular veracity to reach into an OSs' guts doesn't know this stuff exists.
The ISO tool isn't by Sysinternals, and Filemon (he said that instead of Diskmon) has been discontinued in favor of the more versatile Process Monitor.
MOD PARENT UP!
Mod parent up!!
This isn't about Mark. It's promotion for an author at a website. Nothing new here - move on. And stop publishing spam links.
does it run on Linux
Why is it we have so many articles that are just pass-through sites (if we're lucky) to the actual thing they're talking about? Is that what "journalism" has become -- regurgitating single-source information from other places?
This one bit me in the ass because I forgot that I enabled it. I was pissed when I returned from an extended break...
What's the Linux equivalent of Process Explorer...? There isn't anything close.
-They're free, but they're effective.
I wonder what on earth the original writer meant by that? Apparently this world believes free software is bad. Ugh :(
Tools such as these and many more have existed inherently in Unix and especially GNU/Linux based systems for at least twenty years now. And, not that I have tried the software released by MS, but I'm willing to bet the open source software is more malleable, capable, and provides much more functionality.
pagedefrag + win = doitnow
(as many have stated, should be distributed by default)
image: capacity
I have been frustrated by the inability to safe-remove / unmount a removable drive in Windows Vista. The Safe-Remove tool comes with the system works poorly. A lot of times, even if my drive has been idled for over two days, it cannot stop the system daemon svchost, which is the only program accessing the drive as shown in the resource monitor. It forces me to shut down the system. Is there a tool to force the programs and the system daemon to give up accessing the drive? Something this generic is not searchable.
1) Process Explorer - gives you overview of all processes etc etc
2) TCPView - shows real-time network connections
With Grub4dos you can put a bunch of bootable isos and floppies on a flash drive, or on one dvd http://grub4dos.sourceforge.net/
Admittedly there are some subtleties to doing it that way, but I've done it for a long time.
She's still answering. Lily was on The Bonnie Hunt Show last week and Ernestine came with her.
Hey, I was home sick and just channel-surfing, honest.
Process Explorer is what Windows should ship with instead of task manager.
I vote for psdoom ;-)
they have been around for a long long time.
Do you really think the average office worker cares about examining mount points or finding out how many USER handles a process is using? That's why Microsoft doesn't ship any of that with Windows, and they probably never will.
That argument only holds water with Windows 7 Home. Windows 7 Professional and Windows 7 Ultimate is the mainstream developer platform.
Linux with all of the tools and Windows with, well, whatever it comes with, occupy about the same size of a DVD. I would think that Windows 7 Professional or Ultimate should come with all of these sorts of tools, and indeed, but instead, I can burn an ISO with Linux, but not Win7, out of the box.
This is my sig.
Well, I'm not a "confidant" but I will try to answer your post. That post you refer to is someone looking for a laundry list of tools to be delivered in a SINGLE app / interface (and I'd shudder at having all of that together in a blob). Basically they're wanting an iStat-type GUI tool... which would have to fill the entire screen (or screens) just to display all that info. On larger systems the concept would be even less useful.
KSysGuard does most of what they want in a single interface. SystemTap will give the rest.
It is easy to replace the task manager by putting a single check in the menu.
And the only thing missing in my opinion is the 'Network' tab, I only use the task manager for this otherwise I would always use ProceXP (and I was told by Mark Russinovich this will be added sometime in the near future).
P.S. In my personal opinion Mark Russinovich is the *only* person at Microsoft who has any idea of what makes Windows actually tick... To any sysadmin he should be the hero that makes life a little easier.
Before sysinternals was acquired by Microsoft the site provided the source code for these tools and useful documentation on Windows internals.
The remaining tools in themselves have almost no value.
Same here. unetbootin is great for blowing a Linux ISO onto a USB stick, but I've yet to see it work with any ISO that's not Linux-based and it doesn't seem to deal with multiple images on the same stick very well. What I really want is a USB bootloader that you can just point at a list of ISO files and boot straight from them, as 95% of the CD's I burn are fiddly 1-5MB firmware/BIOS updaters which'll only be used once or twice. Similarly, it'd be great to have an 8GB USB stick with a truckload of ISOs on it to allow you to carry your entire wallet of diagnostic/recovery discs on your keyring.
GRUB2 is meant to have this functionality but I've never managed to get it to work. Shall give GRUB4DOS a whirl perhaps, it seems alot more clear cut.
Moderation Total: -1 Troll, +3 Goat