Slashdot Mirror


Learning Reverse Engineering

TheBoostedBrain writes "Mike Perry and Nasko Oskov have written a very complete article about reverse engineering. It provides an introduction to reverse engineering software under both Linux and Windows."

53 of 211 comments (clear)

  1. Mirror by seanadams.com · · Score: 2, Informative


    Mirror here, just in case.

    What would we do without wget --recursive?
    1. Re:Mirror by SweetAndSourJesus · · Score: 5, Funny

      What would we do without wget --recursive?

      We would use wget -r.

      GNU-style flags are annoying to us lazy folk :P

      --

      --
      the strongest word is still the word "free"
    2. Re:Mirror by Anonymous Coward · · Score: 2, Informative

      Here's another one. Please use it - I want to see the Slashdot effect in action.

    3. Re:Mirror by corran__horn · · Score: 3, Informative

      actually the admin has been nice enough to copy a page detailing the amount of traffic that the box has put out here, so enjoy the show folks.

      --

      If people can connect to one another even the smallest of voices will grow loud.
      --Serial Experiments Lain
  2. Betting pool anyone? by Surak · · Score: 3, Insightful

    How long before this site is taken down for DMCA violations?

    1. Re:Betting pool anyone? by phalse+phace · · Score: 5, Funny
      ... taken down for DMCA violations?

      No need to. We'll take care of it just fine.

    2. Re:Betting pool anyone? by __past__ · · Score: 2, Funny

      DMCA? They have weapons of mass decompilation, dammit!

  3. whatabout truss/strace/ktrace? by multipartmixed · · Score: 5, Informative

    I can't believe they left out truss/strace/ktrace. Even without debugging symbols, these utilities can tell you what system calls are being called, when they are called, and what arguments are being passed.

    truss under Solaris is even more useful than strace under Linux or ktrace under the BSDs; you can also trace function entry points into user-level ELF solibs.

    --

    Do daemons dream of electric sleep()?
    1. Re:whatabout truss/strace/ktrace? by Burnon · · Score: 2, Informative

      It's there:

      http://www.acm.uiuc.edu/sigmil/RevEng/x288.htm#b eh avior_system_calls

    2. Re:whatabout truss/strace/ktrace? by MrDelSarto · · Score: 5, Informative

      ltrace will allow you to peek into what libraries are being called on Linux.

    3. Re:whatabout truss/strace/ktrace? by miu · · Score: 2, Informative
      truss under Solaris is even more useful than strace under Linux or ktrace under the BSDs; you can also trace function entry points into user-level ELF solibs.

      Unfortunately, not under 2.6. It does work on 2.8+ and can occasionaly be a lifesaver. 'ltrace' under Linux does pretty much the same thing.

      --

      [Set Cain on fire and steal his lute.]
  4. really dumb question... by Anonymous Coward · · Score: 2, Interesting

    do the authors of the book linked have the text available as a single PS or PDF file?

    1. Re:really dumb question... by Benley · · Score: 2, Informative
  5. Good info by melete · · Score: 2, Insightful

    I'm not sure that their claim that anyone who's read a "How to Learn [C|C++|Java|*] in nn Days" should be able to follow the article is correct, but it's a good intro nonetheless. The section on binary formats (ELF, etc.) is particularly useful.

  6. Oh come on, it's easy by BabyDave · · Score: 5, Funny

    mimosa: ~ $ echo 'engineering' | rev
    gnireenigne

    What more do you need to know?

    1. Re:Oh come on, it's easy by kurosawdust · · Score: 5, Funny
      What more do you need to know?

      How to make it stop, that's what!

      bash-2.05a$ rev
      moo
      oom
      exit
      tixe
      quit
      tiuq
      Ctrl-D
      D-lrtC

      OK now it's just being a smartass.

  7. DMCA i.r.t. Reverse Engineering by heli0 · · Score: 5, Informative

    `(f) REVERSE ENGINEERING- (1) Notwithstanding the provisions of subsection (a)(1)(A), a person who has lawfully obtained the right to use a copy of a computer program may circumvent a technological measure that effectively controls access to a particular portion of that program for the sole purpose of identifying and analyzing those elements of the program that are necessary to achieve interoperability of an independently created computer program with other programs, and that have not previously been readily available to the person engaging in the circumvention, to the extent any such acts of identification and analysis do not constitute infringement under this title.

    `(2) Notwithstanding the provisions of subsections (a)(2) and (b), a person may develop and employ technological means to circumvent a technological measure, or to circumvent protection afforded by a technological measure, in order to enable the identification and analysis under paragraph (1), or for the purpose of enabling interoperability of an independently created computer program with other programs, if such means are necessary to achieve such interoperability, to the extent that doing so does not constitute infringement under this title.

    `(3) The information acquired through the acts permitted under paragraph (1), and the means permitted under paragraph (2), may be made available to others if the person referred to in paragraph (1) or (2), as the case may be, provides such information or means solely for the purpose of enabling interoperability of an independently created computer program with other programs, and to the extent that doing so does not constitute infringement under this title or violate applicable law other than this section.

    `(4) For purposes of this subsection, the term `interoperability' means the ability of computer programs to exchange information, and of such programs mutually to use the information which has been exchanged.


    DMCA

    --
    Whenever the offence inspires less horror than the punishment, the rigour of penal law is obliged to give way...
    1. Re:DMCA i.r.t. Reverse Engineering by Surak · · Score: 2, Insightful

      The letter of the law means nothing when Microsoft/SCO/**AA/All that is evil in the world/etc. sicks a team of lawyers on the poor unsuspected guy who posted it. It's not what the law is, it's how much money you can spend on lawyers. Haven't you figured that out yet?

    2. Re:DMCA i.r.t. Reverse Engineering by cyril3 · · Score: 2, Interesting
      First I thought black box testing was testing specifically without knowledge of the internals of the system ie. you provide input after independently calculating the answer and then see if the output is the same as your expected answer. If you do it enough times and the answers are the same as your calcs then you can rely on the black box.

      Second, you may have missed the bit in the standard warranty and EULA that says the vendor accepts no responsibility if the software doesn't do what they say it will do let alone what you expect. Whether they stand up in court or not the vendor probably sees more l;oss in pirates than in claims for faulty software.

    3. Re:DMCA i.r.t. Reverse Engineering by yaphadam097 · · Score: 2, Insightful
      First I thought black box testing was testing specifically without knowledge of the internals of the system ie. you provide input after independently calculating the answer and then see if the output is the same as your expected answer. If you do it enough times and the answers are the same as your calcs then you can rely on the black box.

      You are correct for the most part. What I was talking about was the circumvention of copy protection for the purpose of performing testing. I suppose it would have been more correct to refer to grey box testing because you are more likely to have to do this then. However, there are times where some circumvention of copy protection which would violate the DMCA is necessary even for black box testing. (In order to do white box testing you have to actually have the source code, which means you would have to completely reverse engineer the whole app. At that point it is usually easier to write your own.)

      Second, you may have missed the bit in the standard warranty and EULA that says the vendor accepts no responsibility if the software doesn't do what they say it will do let alone what you expect. Whether they stand up in court or not the vendor probably sees more l;oss in pirates than in claims for faulty software.

      No, I didn't miss that. One of the reasons that EULAs don't always hold up in court is that this type of clause (e.g. "It doesn't actually have to do what you paid for it to do.") doesn't fool judges very often. The more likely reason that software companies aren't afraid of litigation is that they are so rich from peddling their vaporware that they can afford to hold such litigation up with motion after motion while simultaneously lobbying for crap like the DMCA, but that is just my opinion.

  8. README: From the Authors by mikepery · · Score: 5, Informative

    Well this was most unexpected. We still have a lot of work to do on this book, and are still in the process of looking for a publisher. In fact, both Nasko and I were working on the book as this was posted (quite a shock!). We're still putting together screenshots, describing debugging utilities, etc..

    In fact, the book looks more complete than it actualy is. Most of the chapters are basically just an outline that we've been filling in as we go along.

    Keep checking the book periodically for more updates, as again, this is a work in progress. If you notice any ommissions, or have any contributions, we would be glad to take them.

    Thanks,

    Nasko Oskov & Mike Perry

    1. Re:README: From the Authors by Dunkalis · · Score: 3, Insightful

      Nobody should use RAR. WinZip opens tarballs properly. Every OS on earth has the ability to open tarballs, and they are better. gzip has better compression, you never get the weird problems you get with unzip, etc. So be intelligent and think before you call something like RAR a standard. Zip works fine, but if you're aiming for 100% cross-platform, tarballs are king. PS: Tarballs are used on every Unix and Unix clone OS in existence, not just Linux.

      --
      Slashdot is a waste of time. I enjoy wasting time.
    2. Re:README: From the Authors by yerricde · · Score: 2, Informative

      Zip works fine, but if you're aiming for 100% cross-platform, tarballs are king.

      Info-ZIP UnZip is claimed to be the third most portable C program.

      Tarballs are used on every Unix and Unix clone OS in existence, not just Linux.

      Microsoft Windows ME and Microsoft Windows XP operating systems ship with Microsoft Compressed Folders, a feature that can read and write .zip files in a manner similar to that of WinZip and WinRAR but cannot make head nor tail of .tar.gz files.

      --
      Will I retire or break 10K?
  9. What happens when the original 404s? by kilogram · · Score: 5, Funny

    This. One of the funnier 404 messages I've seen. Take a look at the source for the page so you won't have to wait for the slow version of the text. :)

    1. Re:What happens when the original 404s? by RestiffBard · · Score: 2, Funny

      hilarious. now we're trying to slashdot 404s?

      --
      - /* dead coders leave no comments */
    2. Re:What happens when the original 404s? by mkb137 · · Score: 2, Funny

      Here's another good one: http://www.valhallalegends.com/notfound

  10. Wow, that is a long article...any ideas for POS? by skogs · · Score: 5, Interesting
    Kudos go out to the guy that found this and submited it. Hopefully you knew the guys involved, and didn't just accidently find this information while searching the internet for self worth.

    Very Good article, and I admit that I did not understand all of it, nor did I read all of it. However I did forward it along to a couple of friends who do not regularly /.

    Here is a reverse engineering feat for you all...POS(Point of Sale) terminal equipment. Specifically to replace NSC(National Systems Corporation) and similar diamond touch gear. If you can reverse engineer a system for taking customer's orders(think pizza/food), showing it on multiple screens around the store, and keeping track of inventory, sales numbers and statistics, customer tracking and history...wow you would be great. Nobody wants to spend $15-30,000 for a new POS system. Nobody.

    Biggest problem is that these small operators spend that much money on the system, that they are obligated and forced into using it for 10+ years, well after the hardware(monitors/keyboards) wear out. Then get stuck purchasing proprietary stuff at the same cost it was at the original purchase price...several hundred dollars for a custom keyboard...get real.

    Somebody please show me where there is a project to reverse engineer this with an X window under RedHat/Slack. Even terminal would be fine. The current system runs text only...over 1 pair of copper in a phone plug(rj11).

    --
    Who is this that even the wind and the waves obey Him? Surely this computer must submit also!
  11. That'll come in handy by SHEENmaster · · Score: 2, Funny

    When the Thought Police arrest you so that the MPAA can sue you for intent to possibly defraud, larsony of imaginary profits, and programming without a liquor license.

    --
    You can't judge a book by the way it wears its hair.
  12. Also has a nice 404 :) by arcanumas · · Score: 3, Interesting

    The part i had time to read before the *you know what* was really good. But there is something else. This server probably has the best 404 page i have seen. Some people spend some time to make a really nice 404 page?
    Ooo.. now i see. it's ".edu"
    :)

    --
    Slashdot Sig. version 0.1alpha. Use at your own risk.
  13. Learn from the masters. by JohnwheeleR · · Score: 5, Interesting

    For an excellent source of reverse engineering material, you really should check out the old Fravia pages. This is the original stuff right here.

    Along with reversing tutorials and materials, there is a rich history behind this stuff. A man named +ORC published a tutorial on how to reverse engineer a Windows program called pooldemo.exe. From this text, an era was born. The Fravia website was created and was home to the +HCU. Many people sought after the true identity of +ORC, and he left a strainer (riddle) behind that would take you to a URL where he would be unmasked supposedly. Just look up "ORC riddle" on google for details. Neat stuff!

  14. No it's not -- that's just a TOC entry by multipartmixed · · Score: 4, Interesting

    But now I know why, due to the authors' comments. Thanks for the pointer to the TOC entry though, don't how I missed that.

    For the readership out there, I'm sure those will be covered in the future; in the meantime, read your strace/ktrace/truss man pages. Run them on the application you're trying to RE before doing *anything* else. Sometimes, those dumps can provide *amazing* insight into the behaviour and structure of the program (particularly if you're good with 'grep'), especially if you're trussing and using the program interactively.

    --

    Do daemons dream of electric sleep()?
  15. Very useful... by Realistic_Dragon · · Score: 2, Interesting

    Given some of the code I get to deal with (19(7/8)0s vintage C, much of which is older than I am) it's probably easier to reverse engineer the binary and look at it there...

    --
    Beep beep.
  16. Play "Black Box" for a while. by Speare · · Score: 3, Interesting

    There was a slick plastic game called Black Box back when thinking games like Mastermind were raking in the dough. There are Java and PalmOS varieties of the game. It's a nice three-minute game to while away a bus stop wait, and it helps you get in the mindset of what reverse engineering really means.

    The inside of the Black Box is an 8x8 square. There are 8 ports on each side of the square. One player sets some marbles inside the covered square, and the other player tries to deduce their locations by the behavior of "rays" entering and exiting the box ports. Some rays go all the way through, some reflect off the balls inside, and some glance off the balls and go out some other side of the box.

    --
    [ .sig file not found ]
    1. Re:Play "Black Box" for a while. by BoneMarrow · · Score: 4, Informative

      http://www.eagle-i.com/JAVA/bb.html

      --
      Unfortunately, no one can be told what my sig is...
  17. Complete? My ass! by christoofar · · Score: 2, Funny

    Only two sections are complete.

    When will I be able to get this in paperback so I can read it while I'm sittin' on the can?

  18. This book falls short by JohnwheeleR · · Score: 4, Informative

    This book is pretty weak. I skimmed through it and no where did I see win32dasm dead listings or hands on reversing. It seems like it just tries to explain different windows and unix tools people might use for reversing. Comments like this certainly should have been left out: If you don't know assembly language, at the end of this book you will literally know it inside-out I mean gimme a break. In less than a hundred pages of text, no one is going to learn x86 asm "inside-out." Chapter 9, which many people would be interested in, is incomplete. I wouldn't waste my time. Go search for "fravia pages reverse engineering" on google. That material took years to put together.

    1. Re:This book falls short by stephanruby · · Score: 2, Interesting
      "TO SLASHDOT READERS: Yes, this book is incomplete. Yes it has mistakes. Yes, we are working as hard as we can to fix them. Please email the authors directly rather than simply ranting/flaming on slashdot. We will take your comments into consideration, and will list you in the credits. We've already built up a large queue of fixes thanks to helpful emails."

      Looks like they're trying to have Slashdot readers write their book for them. It's not a bad idea, but it would be easier if they added editing/commenting capablities directly onto their site. Otherwise, it's just too much of a hassle.

      It also would be better if they promised the contributors to keep the book online and free of charge even after it gets picked up by a publisher.

  19. Immature by mslinux · · Score: 5, Insightful

    Quote from the introduction of the book:

    "We don't know about you, but to us, software that we don't have source code to just pisses us off. So we figure: screw it, lets do some damage. :)"

    Cheap comments like this really degrade this book.

    1. Re:Immature by peachpuff · · Score: 2, Insightful

      I believe those are known as "jokes."

      --
      -- . . ramblin' . . .
  20. Ollydbg by httptech · · Score: 4, Informative
    Hadn't seen this mentioned in the book or in any comments so far: If you are wanting to get started reverse-engineering on Windows, you don't need to shell out big bucks (or pirate) softice unless you plan to do hard-core driver/kernel debugging. Seriously, check out Ollydbg It's freeware AND it kicks ass. I'm using it to do almost all my reverse engineering now.

    Here are a couple of beginner-level articles I've written on reverse-engineering malicious code:

    Reverse Engineering Hostile Code

    Alien Autopsy: Reverse Engineering Win32 Trojans on Linux

    1. Re:Ollydbg by IamTheRealMike · · Score: 4, Interesting

      Other useful tools are logger from the Windows Debugging Toolkit, which records every API call made, with details of the structures used and so on. Another good technique is to run the app in Wine, which gives you a very high level of debug output which is a rich source of data.

  21. Code Reading - The Open Source Perspective by MavEtJu · · Score: 4, Informative

    Recently I came by this book: Code Reading - The Open Source Perspective, which has the same idea except for when you have the source of a program and not only a binary.

    --
    bash$ :(){ :|:&};:
  22. can't have a book on reversing without by Anonymous Coward · · Score: 2, Informative

    a mention of IDA pro, W32Dasm, softice. These are the tools of the trade.

  23. 3 cheers for Nasko and Perry (and SIGMil) by cfoster611 · · Score: 2, Insightful

    These are cool guys, I've gone to a few of their SIGMil meetings. Its cool to think i've partied with some guys who've been slashdoted (also perry TA'd a class i took in the fall). Nasko likes to hit on my girlfriend (tho he's only seen her twice).

    Good job guys! Keep it up!

    They also run the most excellent ACM Special Interest Group at U of Illinois- Urbana Champaign. Anybody who's interested in this kind of research should check it out when they host meetings in the fall.

    --
    --- Kicking the Cheat since late 2002
  24. Program in Pascal by Latent+Heat · · Score: 2, Funny

    Or your could release the source code -- in Pascal. Anyone without enough programming skill to understand your system will rather go blind than read Pascal code.

  25. A note from the sysadmin of www.acm.uiuc.edu by Benley · · Score: 2, Informative

    Thanks, but no need - we've got boatloads of bandwidth at uiuc, and the web server is hardly noticing:



    [staffin@winston staffin]$ uptime
    21:20:19 up 79 days, 18:17, 3 users, load average: 0.24, 0.27, 0.32

    Not bad. It's an ultra5/360 running Debian with 256mb of ram, btw. I think this pretty much demonstrates that the slashdot effect is all about bandwidth, not the speed of the server.

  26. Banned from bibliographies by yerricde · · Score: 3, Insightful

    Is it supposed to cause certain groups of people to turn their noses up at this? What group would that be?

    How about the "I'm not going to cite this book in a bibliography because I cite only works that I would recommend to fellow professionals, who by the way do not appreciate obscene humor in the context of their jobs" group?

    I can't think of any group or person with that reaction who would be of the inclination to reverse engineer things.

    You mean like Compaq? Lots of Big Corporations(tm) reverse-engineer their competitors' products in order to learn how to interoperate. Such reverse engineering is exempt to an extent from the DMCA's circumvention ban (17 USC 1201) when under the supervision of an entity that can fund a legal defense.

    --
    Will I retire or break 10K?
  27. "Official" PDF version here by Benley · · Score: 3, Informative

    http://www.acm.uiuc.edu/~staffin/reveng.pdf - Here is the same pdf mentioned above, only on a site that isn't about to get slashdotted (on the same server as the original site, in fact). Have at it!

  28. RE/Cracking tutorials and games by sICE · · Score: 5, Informative

    you might want to have a look at AntiCrack which is a huge collection of tutorials cracking , reverse engineering, and programming. They also have a copy of the Old Fravia'Site, the new one being about searching).

    There's a few games/challenges out there about reverse engineering, cracking, logic and programming. Give them a try if you wish (Arcanum is really nice):
    AngularVision, Apotheosis, Arcanum, Aspect, Aspect2, C&CDisIncorporated, CyberArmy, Disavowed, Electrica, Escape, HackME, HackersGames, HackersLab, HackQuest, Hybrid, ICEFortress, Lamebulun, Mod-X, NetSplit, NGSEC'sSecurityGame, ProblemSetArchive, ReverserCourse, SlyFX, TheGame, and Try2hack.

    have fun ;-)

  29. Using Sniffer to Reverse Engineer by Radical+Rad · · Score: 2, Interesting

    Are there any lawyers here that can say whether packet sniffing is indeed a form of Reverse Engineering and could then be prohibited by an EULA? Common sense would tell me that it can not because it would be analogous to having a reasonable expectation of privacy when talking with someone inside your home but not when shouting to your neighbor through an open window.

  30. complete? by codegen · · Score: 2, Informative

    Not exactly complete. My research
    area is reverse engineering. The book only
    talks about low level reverse engineering
    (i.e. executable code). Most of the research
    in the area is at the source level.

    This is not a criticism targeted at theauthors,
    but at the submitter.

    --
    Atlas stands on the earth and carries the celestial sphere on his shoulders.
  31. device drivers? by Quickening · · Score: 2, Interesting

    What we need most are methods to reverse engineer device drivers.

    Let's say for example, a certain manufacturer of popular media cards actually has linux drivers for their hardware, running on an ARM in a setup box, but refuses to release these drivers, open or closed, to pc users. If I had said drivers in hand, could I port them to i386?

    --
    tcboo
  32. Wow. Good luck. by skogs · · Score: 3, Interesting
    Seldom is somebody actually willing to begin and create a project.

    As far as specifications go with hardware...the simpler it is the better. Honestly, do you want to code to something that is unfamiliar? No. You want to run x11 on a Plain old P4 or something with 5 pci video cards in it. vga monitors. Not monochrome monitors running off two wires that make ugly text displays. Something simple to program, and even simpler to replace.

    Seriously, you could sell this commercially if you found a backer. Give them the software for free, and sell them the system. One computer, 6 keyboards and 6 monitors. Thats all you need to supply, and you can charge them US$5000 for it. Sell upwards of fifty of these darn things to little mom and pop pizza places and they would be happy, and you would clear $1500 a piece...then start selling to Pizza Hut, Domino's, Papa John's...and make a shitload as they begin replacing their equipment and buying yours.

    Be sure to offer them support with certain little things for a specified ammount of time, and charge them like $2000 for a one year service contract.

    Modify your code with a couple different modules, and begin handling burgers and fries instead of just pizza sizes, toppings, and cokes...and then you open your market up to smaller chains like A&W, White Castle, and eventually anybody.

    there is a need for this type of software and hardware solution, and all businesses feel it roughly every 8 years or so. Thats a pretty good market. Get your hands on some old equipment and see how the inventories worked, the numbers added up, and displayed. Wow. Make yourself a living in 30 long and difficult steps.

    --
    Who is this that even the wind and the waves obey Him? Surely this computer must submit also!