Slashdot Mirror


Digital Baseball Umpires

Dekaner writes "Wired is running an article on an electronic umpire that tracks each baseball pitch and judges whether it is within the "strike zone" has been installed at 10 major league ballparks in the U.S. The QuesTec system uses several cameras that track each pitch and compare the machine's judgment with that of the umpire standing behind the catcher. At the end of each game it provides a summary of its ratings and compares them with the umpire's calls. In general there is reasonably good agreement. In a recent test the QuesTec system judged that 32.1 percent of pitches were within the "strike zone", while the umpire called 31.4 percent as strikes. However, the umpires association has filed a complaint about the system's unreliability and incapability to replace the human 3-D, real-time view. "

35 of 403 comments (clear)

  1. Right... by Prince_Ali · · Score: 4, Interesting

    Does anyone read:

    "However, the umpires association has filed a complaint about the system's unreliability and incapability to replace the human 3-D, real-time view."
    as, "It points out our mistakes!"

    1. Re:Right... by dauvis · · Score: 5, Insightful

      Actually, I read it as "We don't want it to replace our jobs"

    2. Re:Right... by TopShelf · · Score: 4, Insightful

      It's being used as a tool to evaluate umpires, particularly to judge which ones should be involved in playoff games. Baseball would gain nothing by replacing umps with these tools, and would only incur the wrath of traditional fans (of course, given MLB, they may do that anyway).

      By and large, this is a GREAT tool in that it will help get rid of the absurd variance in strike zones as called by different umps. One factor in the Home Run Derby that MLB has become is the incredibly shrinking strike zone...

      --
      Stop by my site where I write about ERP systems & more
    3. Re:Right... by $$$$$exyKrout · · Score: 3, Interesting

      Not necessarily. Baseball has a long history of being a subjective game. Umpire mistakes are part of the game, and players learn how to take advantage of them.

      --
      I'm ekrout. I'm a girl. Read my journal
    4. Re:Right... by NetCurl · · Score: 5, Insightful

      I would strongly disagree that there is an absurd invariance in strike zones across different home plate umpires. If anything, the fact that there is a little over 1% difference in the machine and the actual human strike zone recognition proves this point. In general, umpires working in MLB have worked very hard through A, AA, AAA leagues to get where they are, and they are there for a reason.

      From a baseball purist standpoint, MLB has become a Home Run Derby of sorts, but that has VERY little to do with strike zone, and much more to do with performance enhancing drugs, different composition used in the actual ball, expansion thinning out pitching talent, and the general change in the makeup of ballparks (read: home run alleys as found in PacBell Park, and the new Great American Ballpark in Cinncinati).

      Personally, and I believe many die-hard baseball fans feel similarly, this new machine ruins the game. Pitching and hitting are arts, and the ability of a good pitcher to locate pitches just on the corners is something that is special to the game, and makes a great pitcher amazing. This machine has served it's purpose: it has proven that the Umpires are doing a very good job dealing with a highly subjective condition. Leave the subjectivity to the humans, and the web serving to the machines.

      --

      It's only when we've lost everything, that we are free to do anything...

    5. Re:Right... by notque · · Score: 3, Interesting

      By and large, this is a GREAT tool in that it will help get rid of the absurd variance in strike zones as called by different umps.

      Unless it doesn't work very well.

      Last year, I was invited to the umpire's room before a "Sunday Night Baseball" telecast. Umpiring officials showed me the QuesTec system and explained why they felt it wasn't accurate. And after seeing their demonstration, I could see what they were talking about (from ballpark to ballpark, similar pitches to the same batter were called differently by the computer). I even mentioned it on air that night. - Joe Morgan

      --
      http://use.perl.org
    6. Re:Right... by Yunzil · · Score: 4, Interesting

      By and large, this is a GREAT tool in that it will help get rid of the absurd variance in strike zones as called by different umps.

      Shrug. That's part of the game. Some umps have a wide strike zone. Some really squeeze it. Some allow a higher strike than others. As long as they are consistent, no one cares much.

      Ron Luciano had a story in one of his books about a game he called early in his career. The pitcher threw a pitch right around the top of the "official" strike zone. Ron called it a ball. The next pitch was right around the batter's knees. Ron called that a ball too. The catcher turned to him and said, "I'm not complaining, but you have to give me either the high pitch or the low pitch or we're going to be here all night." At that moment, Mr. Luciano was enlightened.

  2. Cool but... by Anonymous Coward · · Score: 5, Funny

    How do you kick dirt on a digital umpire?

    1. Re:Cool but... by nicedream · · Score: 4, Funny
  3. And the reason... by Obiwan+Kenobi · · Score: 4, Insightful

    The reason umpires don't want these machines on the field is that they make a KILLING doing their job.

    Seriously, the average pay for an ump is well over $100k. I'm not talking about your little league ump, I'm talking about the "Big Boys", the major league umpires.

    It's hilarious reading the article with this in mind, with the machine doing the same job better and the umps jumping up and down crying foul. Of COURSE they don't want these machines. They'd lose their Lexus.

    Just something to think about.

    1. Re:And the reason... by kawika · · Score: 3, Insightful

      Absolutely, these guys are not used to having their authority challenged. Unlike most other workers, I should add. It's fine for tech support staff to have their calls recorded, for employees to have all their emails monitored, and for factory workers to be judged by quantitative productivity standards. But if you start to question the ump, well then that's foul play!

    2. Re:And the reason... by Anonymous Coward · · Score: 5, Informative

      Jesus Christ. I thought you were lying about the salary issue, so I looked it up:

      "NEW YORK (9/5/00) _ Umpires will get raises of 10.2 percent to 14.9 percent this year under their new five-year contract, boosting the minimum salary this season to $104,704 and the maximum to $324,545. In 2004, the contract's final season, the minimum will be $108,716, up 14.4 percent from the $95,000 minimum in 1999, the final year of the old contract."

      (from: http://www.umpire.org/frames/fmlb.html)

      Well, I'm in full support of robots replacing them.

    3. Re:And the reason... by EggMan2000 · · Score: 5, Insightful

      I think it proves the Umps are pretty damn accurate at their jobs. To be that accurate takes quite a bit of skill.

      I respect the ups more than some athletes. They work hard, get hit with balls, and are highly trained professionals.

      Don't go off on umps for making decent money $100K a year is still middle class, they have to travel all over the damn country, and work pretty damn hard too.

      The computer may be able to see strikes more accuratly, but they could never replace the umps for the interp of rules, calling out players at base, etc...

      --
      what? what I thought we were in the trust tree in the nest, were we not?
    4. Re:And the reason... by EggMan2000 · · Score: 4, Insightful

      Dude, it's not like it's taxpayer money. The athletes themselves make millions. It easy to forget the work involved in being an ump beyond calling strikes.

      --
      what? what I thought we were in the trust tree in the nest, were we not?
    5. Re:And the reason... by drinkypoo · · Score: 5, Funny
      I respect the ups more than some athletes. They work hard, get hit with balls, and are highly trained professionals.

      I said the same things in defense of pornstarlets once, but I don't think anyone took me seriously.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    6. Re:And the reason... by AssFace · · Score: 5, Funny

      I like your logic - thumbs up!

      $100K pretax dollars is more than I make in pretax dollars.
      Anyone that makes more than me obviously does not deserve it.
      Therefore, they should be replaced with robots.
      QED

      By far the best proof I've ever seen.
      *golf clap*

      --

      There are some odd things afoot now, in the Villa Straylight.
    7. Re:And the reason... by JordoCrouse · · Score: 3, Insightful

      It's hilarious reading the article with this in mind, with the machine doing the same job better and the umps jumping up and down crying foul. Of COURSE they don't want these machines. They'd lose their Lexus.

      That is the stupidest thing I think I have ever heard. Nobody is asking for any umpires to be removed. Baseball by its nature is a very subjective game, and I don't think that anyone is stupid enough to think that a few machines will do a decent job of evaluating a game played at about 100 miles per hour on a gigantic chunk of real estate.

      You know that beep you hear when a tennis player faults at a major event? Thats a computer system that can determine when the player faults. But did you notice that it doesn't replace the small army of human observers and judges? Of course not, and it won't do the same thing in baseball either. These things are in position for evaluating the umpires, not replacing them.

      But here's my rant. Throughout history, umpires have been traditionally consistant from game to game. That doesn't mean they all are consistant with each other, but generally the same umpire will call the same way each game. And this has always been a great advantage to those who were students of the game. Pichers like Tom Glavine have made hall of fame careers by studying the umpires and knowing exactly where to throw the ball.

      But you have to understand that these devices, which may be responsible for the hiring and firing of umpires, are only installed at a handful of ballparks. So in order to keep their jobs, the umpires much change their calling style when at those ballparks, which destroys their consistancy, and makes them more prone to error.

      And the interesting thing is, this is a direct result of them being only installed in a handful of parks. If they were in every single major league ballpark, then you would see many of the objections disappear. Thats whats so interesting to me about this whole thing - not that they want to evaluate the umpires, but rather,that they don't want to evaluate them uniformly. Whats up with that?

      --
      Do you have Linux and a DotPal? Click here now!
    8. Re:And the reason... by phageman · · Score: 5, Insightful
      I've worked as an umpire at everything upto the Div I college level for over a decade, and I can say without a doubt that you have no fucking clue what you're talking about.

      First, the "fat men" standing behind the plate are a dwindling minority in MLB. It takes a lot of hustle to be in the correct position to make a call, especially at third base or in the outfield.

      Second, his job is physically dangerous. Why do you think the plate man wears so much protective equipment? Let's see how well you recover from a 90+ mph fastball between the eyes, off the inside of your knee, or (God forbid) a tipped ball that gets by the catcher and goes right off your nuts. Broken bones are a fact of life for any umpire with a full schedule of high-level ball.

      Third, his job is mentally and techincally demanding. He must make an immediate ruling on action that occurs in a fraction of a second, and is expected to get it right every time by the fans sitting in the stands or in the their air-conditioned homes, who, btw, also have the benefit of slo-mo instant replay from multiple camera angles. They also must have a complete mastery of probably the most convoluted and counter-intuitive set rules for any major sport.

      And just for fun, he gets to be the target of the wrath of the fans for every call that doesn't go their way.

      The average MLB umpire does between 130-160 games a year, not counting spring training or postseason assignments. All those games require travel, which puts a huge burden on their families. Most of them spend the offseason training for the regular season, just like all the other athletes. And all of this is after they've spent several years working their way up through the minors, making $1700/month, traveling by bus, and staying in cheap motels nine months out of the year.

      Hmmm, I guess paying $300k to someone who has over 15 years experience at their physically, mentally and emotionally challenging job just wouldn't be fair to everyone else.

      Now, as far as QuesTec goes, I think it is a usefull tool for evaluating umpire performance, but nothing beyond that.

  4. Sorry, but by Kaz+Riprock · · Score: 4, Insightful

    There's nothing like having a batter stare down an ump or kick dirt or get thrown out of a game.

    Of course, you'd still need an ump for the home plate tag calls...so it's not like the umpires are going to disappear.

    I think the machine is fun for the home-viewing audience, but the ump is necessary for the game. Until you can put in a Johnny-5 to call the game, I'll take my umpires and their strike calls and punch-out flourishes.

    --
    Mordor...a magical, mythical land where women are more rare than dragons--but where every man would rather find a dragon
  5. I agree with the umps... Maybe by RustyTire · · Score: 5, Interesting

    I have been playing sports my entire life and I must say that it is the human factor that makes it interesting. To take all the errors out of sport is to take away something -- and as I have recieved many a bad call I can't believe I am saying this -- special from it.

    Then again, with all the money that is in sports these days maybe it is a good idea -- from the point of view of owners, players, and sponcers. I think it takes something away from the fans.

    --
    I do not control the Sig, the Sig controls me.
  6. I mean seriously! by WndrBr3d · · Score: 5, Insightful

    The fact that people are COMPLAINING that there is a 0.7%(!!) margin between the accuracy of machines to humans is insane! I'd be congratulating my umpires for being so accurate!

    If anything, I think it'd be an argument on why to KEEP umpires.

  7. Why remove the human element? by zptdooda · · Score: 4, Interesting

    "These are proud professionals who don't want to be evaluated by a faulty apparatus"

    Or even by a working apparatus.

    This can go wrong in so many ways, false positives and false negatives along every border of the strike zone. But aside from the mathematical reasons, why take away the human element even more from baseball?

    You know one of the most fun parts of playing sports in my neighbourhood as a kid was watching my big brother argue whether something was a goal or not, who was safe or out. It was subjective and it was fun!

    Now we have photo radar and cars that will apply the brakes themselves too. Sheesh.

    --
    Esteem isn't a zero sum game
  8. A similar technique has been used for cricket by swimgeek · · Score: 4, Informative

    The ICC adopted a similar scheme some time ago, but it was to assist the umpires rather than replace them.

    --
    I would like to change the world,
    but they won't tell me the source code.
  9. Heck... by Craig+Maloney · · Score: 5, Funny

    Replace the batter and the pitcher with robots, and I still won't give a damn about baseball. :)

  10. "incapable?" by noda132 · · Score: 4, Funny

    However, the umpires association has filed a complaint about the system's unreliability and incapability to replace the human 3-D, real-time view.

    ... instead only giving an accurate 3-D, real-time view.

  11. Umpire 2003: A Baseball Odyssee by Anonymous Coward · · Score: 5, Funny

    "Dave.... Dave.... 3 strikes and you're out, Dave".

  12. Re:Pitchers are unhappy too by generic-man · · Score: 5, Funny

    Some pitchers are really mad about it. Curt Schilling was fined earlier in the season for destroying a QuesTec camera in Bank One Ballpark, his home park in Arizona.

    This, of course, is the same Curt Schilling who gave up two homers to a fellow player he abandoned in "Everquest," allowing said player's character to die.

    --
    For more information, click here.
  13. One problem... by siskbc · · Score: 4, Informative
    ...is that it's not uniform, being installed in 13 (as opposed to the 10 that Taco quotes) of the 31 MLB stadiums (counting Hiram Bithorn in Puerto Rico). Umpires have admitted calling games different (ie, correctly) when they're in a stadium that has Questec.

    I recall that one catcher was supposedly told by an umpire that he wanted to call a lot of those pitches strikes, but he couldn't. Catcher seemed to think this was a bad thing. So, in other words, the umpire admits that he doesn't typically enforce the rules as written unless outright forced to? Sounds like he's completely justifying the existence of the machines to me. Maybe now Atlanta pitchers won't get their customary strike zone that stretches between the home and visiting dugouts?

    --

    -Looking for a job as a materials chemist or multivariat

    1. Re:One problem... by ojplg · · Score: 3, Interesting

      This isn't what the article says though. What it says is that in games where the system is on 32.1% of pitches are called strikes by the umpires. In games where the system is off, the number of pitches
      called strikes by the umpires is 31.4%. It doesn't say what percentage of the pitches are called strikes by the machine. (Note: The summary of the article is also wrong.)

  14. Bad idea in general by Dr.+Bent · · Score: 4, Insightful

    I'm sure you could build a system that will measure strikes and balls better than any human. That's not the point. There's plenty of sports where automated systems could be used to replace human judges, but the question you have to ask is "does it make the game better?"

    I argue that most of the time, the answer is no. Sports are not meant to be an exersize in perfection, and there is an element to every sport that involves playing 'outside' the rules. In the specific case of Baseball, for example, a human umpire knows when to call a ball as a strike because the batter is being a dick. Competition can be more about manipulating the human and social factors than about following the rules, and we shouldn't take that aspect out of the game just because we can.

  15. I'm not sure you understand the complaint by belloc · · Score: 5, Informative

    The main problem that the umps have is not that it might replace them, but that it might not really be more accurate than them. This quote is from the article (which is the little clicky linky thing that you often find in the story text...we should all try clicking it sometime!):

    "Even if (the computer operators) were experienced umpires, this system would not work because it's based on a single frontal photograph in comparison with the 3-D, real-time view of the umpire," Gibson said.

    In addition, many batters move during the course of the pitch, which an umpire sees and weighs in determining the strike zone, he said.


    See, each time a batter steps to the plate, the system has to be calibrated for that batter's particular size, crouch, stance angle, etc. But that calibration is only done once (at the beginning of the at bat), and it's done by...a human being, just like the umpires. And often, this operator, while he may know the system, doesn't understand the game of baseball.

    So the umpires' beef is not that they don't want to be evaluated, it's just a question of whether the measuring stick is really doing a better job than they can do standing right behind the plate.

    Belloc

    --
    I got more rhymes than Jamaica got Mangoes.
  16. A few words about officiating by sjbe · · Score: 4, Insightful

    The reason umpires don't want these machines on the field is that they make a KILLING doing their job.

    And they deserve it too. Being a good official is really, really, really hard. I know first hand because I've been an official (different sport but same deal) for a number of years. Major league officials show as much skill as the athletes do. I know because I've been a division 1 college athlete (yes a few of us read slashdot believe it or not) and an official too.

    It is damn hard to know all the rules of a game, have them on instant recall, apply them to the situation at hand, and do so correctly and without pissing anyone off. If you do your job right, no one notices you and if you do get noticed you get screamed at, usually by some halfwit who has never picked up a rule book in their life.

    It annoys the hell out of me when I see some twit complaining about officials "trying to determine the outcome". Let me get out the cluebat. NO official I have ever met (and that is a LOT of officials) would ever try to determine the outcome of a game. We really don't care who wins. We just want to have a fair contest and really prefer it when one team kicks the crap out the other. Less chance of anyone getting their panties in a bunch over a *game*. If you don't take my word for it, read anything by Ron Luciano and you might get the idea. The only thing any official wants is for the game to get over with as quickly and fairly as possible. That's it.

    As for the measuring equipment being used. As an official I don't really have a problem with it being used as an evaluation tool. Most officials would welcome a tool to make them better at their job. I would however have a problem with it being used in a game I was officiating. No official wants to be second guessed because it undermines our ability to keep control of a game. People start becoming unnecessarily rough, unsportsmanlike, and generally begin to behave like cretins when they think they have a right to question the judgement of the officials. (This isn't a supposition of mine, I've seen it happen countless times)

    Now there are problems when the officials in some sports (basketball is notorious for this) start calling the game differently depending on the situation instead of how the rulebook specifies. That's a problem. But most officials at a high level do a very good job at what is a very difficult job. If they get paid well to do it, believe me, they've earned it.

  17. Re: strike zone size by dpille · · Score: 3, Insightful

    From a baseball purist standpoint, MLB has become a Home Run Derby of sorts, but that has VERY little to do with strike zone

    I think this section is an excellent analysis of the parent post. If the strike zone were the cause of "Home Run Derby" baseball, you'd expect to see an overall increase in league batting average. The theory would say that by improving the quality of the pitches the batter faces as strikes, they'd be hitting more of everything, not just home runs.

    Anyway, some guy's chart bears this out- keep in mind what looks like a big difference on that chart (.006, say) represents about 30 hits per team per season. Given that the NL appears to be hitting a collective .262 right now, I think I'd be hard pressed to convince anyone that umpires' collective decisions about strike zones can move overall batting averages so minimally yet be the cause of an increase in home runs.

  18. little league by interstellar_donkey · · Score: 3, Interesting

    I remember having a conversation about this some 20 years ago, when I was playing little league. After seeing so many bad calls, I brought up to my coach that someday we would have computers and robots making all of the decisions. He balked, saying it would ruin the game.

    Now that Iâ(TM)m older, I tend to agree with him; at least for the major leagues. But I still think this technology could be well used in little league, where itâ(TM)s hard to find someone to be an umpire, even harder to find one thatâ(TM)s any good. Some would show up drunk, would have some bone to pick against a team who had a player with a parent he didnâ(TM)t like, or simply be idiots.

    Whatâ(TM)s worse is the way parents react to calls (even good ones) they donâ(TM)t agree with. I can only imagine how it would change the dynamic of the game for kids if these officiating robots could be made cheaply and be available to kidsâ(TM) leagues.

    It wouldnâ(TM)t be without precedent: We already allow little leaguers to use aluminum bats, while the big leagues still have wood. Keep the majors pure and traditional, but it would be nice to see a little technology around to help keep the games fair for kids.

    --
    The Internet is generally stupid
  19. Re:You guys are WAY ahead of this one! by puck71 · · Score: 3, Informative

    I sense sarcasm, but I feel I should give the facts anyway. For a regular season major league baseball game there are four umpires (one for each base), compared to the nine defensive players that are always on the field, plus the batter and as many as three runners on base. So there are four umpires for as many as 13 players on the field. This is about the same ratio as the NBA (3 refs for 10 players) and the NFL (7 officials for 22 players).

    For the playoffs, major league baseball adds 2 umpires, one down each foul line so the outfield is covered better. In the minor leagues, there are usually only 3 umpires per game during the regular season.