Slashdot Mirror
Washington Finds Computer Simulation Unreliable
Toadpipe writes "Washington State Court of Appeals reverses a conviction in which a computer simulation had been the main evidence. Quoting 'At issue was PC-Crash, a computer program distributed by Vancouver, B.C.-based MacInnis Engineering Associates. The program recreates traffic collisions using simulations and reconstructions.
"PC-Crash had not been validated for the purpose for which the evidence was offered, simulation and prediction of multiple-occupant movement within a vehicle during a multiple-collision accident," the Court of Appeals said in ordering a new trial. "There is no general acceptance in the relevant scientific community of the use of the PC-Crash program for the purposes to which it was put."' Here is
the Court's opinion."
The Senate already informed us of that long ago.
yeah, the work done by LSTC's Dyna-3d, Altair's HyperMesh, and MSC'S Patran can give basically everything that you could *ever* want to know about explicit dynamic phenomena.
I did about 4 years working for the Vehicle Crashworthiness Division for the US DOT using the above programs, and they are quite complex and used for mostly research, not accident reconstruction.
Because, dumbass, the photo-radar manufacturers get a cut of the revenues from the cameras. Their implementation guidelines include shortening the duration of yellow lights in order to entrap more drivers and yield more revenue.
Tell me what that has to do with safety?
If the law does not respect the people, the people will not respect the law.
That's a totally different issue, that is almost completely unrelated to automatic cameras. And it does have quite a bit to do with safety. When yellow lights are 10 seconds long, people get the impression that yellow means "floor it". There are minimum lengths set by the federal government that ensure safety; anything beyond it encourages people to run the yellow light. In my town (which has no red light cameras) people routinely run red lights. Usually, you have to wait at least 2 seconds after the light turns green for the cross traffic to clear.
I think red light and speeding cameras serve a useful purpose. They guarantee near-100% enforcement, which is always a good thing. If the speed limit is too set too low in some place, call your DOT and complain instead of violating it. If enough people do that, we won't have artificially low speed limits that nobody respects.
I read the court transcript because it was quite interesting.
... well, you get the point.
Turned out the simulation that was generated that kinda matched what happened had the data entered at random until it matched "Heusser manipulated data by entering arbitrary 'inputs' such as separation speeds as high as 1,114.8 mph, placing the mailbox pole away from where it was actually located, and having the computer occupant models remain in a default resting position after the collision with the mailbox".
Indeed, the software was described at the end of the trial as "During closing argument to the jury, the prosecutor described PC-CRASH as a
computer program that essentially takes the laws of physics and reduces them to mathematical calculations that can be done over and over again to generate an accurate picture of what happened during a collision based on the tire marks at the scene, based on the physical evidence in the case such as the damage to the car, as well as the conditions that can be observed at the scene.
13 Report of Proceedings at 13. The prosecutor then showed the PC-CRASH
video to the jury, again.
Sipin was convicted as charged."
Whilst the expert opinion from someone who used his brain to see what happened described something completely different. The jury was mislead to how good the software was quite clearly, they were lead to believe that the software was infallible. It is only as good as the person entering the data, and when they choose to ignore data because it is inconvenient
So whilst the guy was stupid for buying a manual car when he had gout and couldn't drive it half the time, he does deserve a retrial.
Well, perhaps you think so. But it would be just as wrong. An electron isn't made of leptons anymore than a swede is made up by europeans.
There seems to be much less to this story than the slashdot submission seems to insinuate.
The court didn't find that software simulation was categorically disallowed as evidence. It didn't even find that the PC-CRASH application was inadmissible in general. It just found that this particular software in modeling this particular event had not been shown to satisfy expert consensus.
Maybe PC-CRASH will in the future be shown reliable for this type of modeling. Maybe it will be shown to be inaccurate. Maybe the makers will enhance the software to demonstrably cover this type of event. None of these are anything terribly profound, and none have any great moral for the intersection of law and software.
Buy Text Processing in Python
I remember ten years ago, gradebook software calculated grades incorrectly. It was used in thousands of schools.
I was a high school student at the time, doing a little part-time work for a company writing a competitor. We actually discovered this after hand testing our calculations by hand. Our calculations were right. But what other tests could we do? We figured we'd try their numbers and see if we got the same results. We didn't. Surely it was our problem, since we weren't on the market yet? No, it was their problem.
I had a 18% grade swing as a result of pointing this out to my chemistry teacher. She apologized over and over again. We also reporterd it anonymously to the company, which fixed it in their next version. But I discovered last year that as of two years ago my high school was still using the same version of the same flawed program, and it was still generating incorrect grades.
A younger friend of mine pointed this out to the teachers. The response was the same as ten years ago: "Of course it's right, the computer did it."
This is absolutely astonishing. It means that final grades produced by thousands of schools are not according to the criteria specified by the teachers and/or school and/or school district. If they are right, it is only the happiest of coincidences.
The problem is that there was reasonable evidence to show that the dead person was the driver who was flung to the side upon the second impact, having not being flung from the car initially because of the steering wheel. The evidence being fibers on the airbag, etc, showing both Sipin being ejected, and lateral movement from the dead person. There wasn't any flashy video for this testimony though ...
Either flight sim time is accepted by the FAA or not. There are no time fractions or anything. Also, it is no where near as realistic as a real plane without the cost, the full motion, and all the other forces. When in a plane, and you have to decide to get yourself to safety or save the plane, it is much different in a flight simulator. MS FS is very unrealistic compared to when I fly the same planes except from a real airport.
Make your computer faster: rm -rf
uncertified.
and is therefore unreliable. i.e. You can't rely on it in a court of law. If you RTFA
attaching an assessment of Heusser's PC-CRASH simulation from Boyd Allin of MacInnis Engineering Associates, Inc., which is the distributor of PC-CRASH for North America. Similar to McHenry, Allin opined that Heusser's arbitrary 'inputs' made the results of the occupant modeling highly suspect. Allin also stated that the PC-CRASH program could not calculate the speed change of a vehicle when it strikes a pole and pulls it out of the ground, and that Heusser should have considered this problem in his calculations. Finally, Allin emphasized that the multi-body model PC-CRASH program had not been validated for use in modeling the interaction of occupants within the vehicle interior, and that Heusser's use represented 'an overextension of the capabilities of the model.'
Waking Up - There must be a better way to start the day.
This may be shocking, but I am actually familiar with both this software and the process of giving expert testimony. PC-Crash is one of several *Crash* programs provided by different vendors that share a common lineage. It and its sister programs are used extensively in accident reconstruction and the results are presented to juries every day. The core of these *Crash* programs are a series of well-established (although certainly not perfect) algorithms and physical properties related to vehicle dynamics. The problem here was the extension to occupant dynamics, not the use of simulation programs in general.
You may now return to your regular uniformed ranting.
You cannot, even in theory, predict how a human with arms and legs banging around will move in a complex crash. It's chaotic, in the formal mathematical sense of the world. That is, an arbitrarily small change in the initial conditions can create a large change in the outcome. In Falling Bodies, if you change the low order digit of a double precision number in the initial conditions for a fall down a staircase, the simulations will start to diverge after about a second, and the fall may end quite differently.
I had this discussion a few years ago with an Army officer who was trying to reduce accidents in parachute landings, and was considering using Falling Bodies. I talked him out of it.
Auto collisions can be simulated well because there's one big mass that dominates the simulation. So you get a deterministic result within some error limits. Multibody systems with joints and links are quite different.
Realistically, you can probably do a sound simulation which predicts how a passenger will bounce around from the beginning of the collision to the first passenger interior collision with the vehicle. Beyond that point, forget it.
Uh, dude? You do know that global warming isn't contested, right?
Really? See http://www.sepp.org/books/hotcold.html and http://www.spiked-online.com/Printable/00000002D37 1.htm among others.
Not so long ago, we were facing imminent threat of an ice age caused by -- you guessed it -- our polluting ways. The proponents then were as convinced of their inerrancy as you are now.
When your computer model can accurately predict whether it will rain ten years from next Friday, then your inanity will warrant a rethink.