What Was the First Piece of Man-Made Space Junk?

Splynn asks: "I was wondering about what the very first man made object to leave Earth's atmosphere was. We all know that Sputnik was the first man made satellite, but there must have been something that actually made it out there befor Sputnik." For those who are curious, Sputnik was launched on October 4, 1957. Sputnik may have been the first satellite to orbit the earth, but was it really the first successful launch into space?