Slashdot Mirror


Fitness Trackers Out of Step When Measuring Calories, Research Shows (theguardian.com)

Fitness devices can help monitor heart rate but are unreliable at keeping tabs on calories burned, research has revealed. From a report on The Guardian: Scientists put seven consumer devices through their paces, comparing their data with gold-standard laboratory measurements. "We were pleasantly surprised at how well the heart rate did -- under many circumstances for most of the devices, they actually did really quite well," said Euan Ashley, professor of cardiovascular medicine at Stanford University and co-author of the research. "At the same time we were unpleasantly surprised at how poor the calorie estimates were for the devices -- they were really all over the map." The team tested seven wrist-worn wearable devices -- the Apple Watch, Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2 -- with 31 women and 29 men each wearing multiple devices at a time while using treadmills to walk or run, cycling on exercise bikes or simply sitting.

26 of 81 comments (clear)

  1. Not a particularly unique problem. by jedidiah · · Score: 2

    This is probably true of any fitness device that claims to track calories. The new shiny shiny is no exception.

    --
    A Pirate and a Puritan look the same on a balance sheet.
    1. Re:Not a particularly unique problem. by MightyMartian · · Score: 2

      The best you can do outside a lab where you can monitor blood sugar levels and the like, is compare activity to various tables of average calories burned. I have no faith in any wearable device getting very close to calories burned.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    2. Re:Not a particularly unique problem. by CastrTroy · · Score: 3, Informative

      Apart from a power meter on a bicycle, you are probably right. It really hard to get a good estimate of calories burned without actually being able to measure how much work the person is doing. The heart rate is only very loosely correlated with how much work somebody is doing. Heart rate can be changed by a number of factors, many of which have little to do with how many calories you are burning. Power meters on bikes are a whole other story, because they can actually measure how much physical work you are doing, and will be able to measure calories burned within some reasonable level of accuracy. Even, then, you probably need to develop a base line, as each person will expend a varying amount of energy to produce the same output.

      --

      Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
    3. Re: Not a particularly unique problem. by Anonymous Coward · · Score: 2, Informative

      There are wearable gas analyzes but you will look like wearing a gas mask. But those are medical and accurate

    4. Re:Not a particularly unique problem. by toonces33 · · Score: 2

      Yeah, funny how they always seem to overestimate. About the only thing they are good for is relative comparisons from one day to the next. But they ought to remove the word calories and put some other word there - how about "donuts".

    5. Re:Not a particularly unique problem. by nine-times · · Score: 3, Interesting

      I also feel like it should be fairly obvious, if you take the time to think about it. What can these devices measure? Heart rate and motion, generally. Some will ask you what kind of exercise you're engaged in, but it rarely gets more specific than "running" or "cycling". There might be a GPS, in which case, the device can know roughly how much distance you cover.

      So take each individually:

      * Heart rate: Different things can effect your heart rate to different degrees, and there's not a direct/exact correlation between hear rate and calories burned.
      * Motion: One of these things just knows how much your wrist is moving, which often won't tell you much. Sit still and shake your arm a little, and then run around for an equal amount of time. The watch can't tell the difference.
      * Kind of exercise: You can't know how many calories you've burned simply from the information, "You were riding a bike for 10 minutes." Were you going up-hill or down-hill? How heavy is your bike? How well maintained is your bike? What gear were you in? How bumpy is the road?
      * GPS: It knows you went from point "A" to point "B", which gives a distance and theoretically an altitude and speed. Were you in a car or on a bike? Were you carrying anything? Were you doing jumping jacks while your travelled? When you went up 10 meters in altitude, did you climb the stairs or ride and escalator?

      So on their own, none of these things would get you to an accurate reading. Admittedly, you could try to combine these measurements to make the reading more accurate. For example, if the device knows you're riding a bike, it can use the GPS to determine how fast you're going, whether you're going up-hill or down. It can measure your wrist movements and heart rate to guess about how hard you might be pedaling. However, doing this kind of calculation would probably take some machine learning to figure out how to combine these things for each different kind of exercise, and even then it would probably change for different people in different circumstances, requiring some kind of calibration. And even then, it might be fooled or confused somehow.

      So I think, reasonably, all we can expect with the current technology is a vague estimate. However, that's not useless. If I use my fitbit every day, and yesterday it says I burned 200 calories, and then today it says I burned 2,000 calories, that is likely a good indication that I was far more active today than yesterday. Did I actually burn precisely 2,000 calories today? Probably not. Did I actually burn 10 times the number of calories as yesterday? That might be a decent estimate (I think that'd be worth studying). Did I do a significant amount of additional exercise today, probably improving my health? I think that's a safe bet, and mostly that's what people really need to know. After all, the numbers of calories listed on food packaging is also an estimate. If you're trying to line up your calories burned to calories eaten, you're fooling yourself.

    6. Re:Not a particularly unique problem. by dbIII · · Score: 2

      Indeed, it's kind of obvious but quantifying the difference was a different story.

    7. Re:Not a particularly unique problem. by Carnildo · · Score: 2

      Averaged over significant periods of time, heart rate is proportional to breath rate, breath rate is proportional to oxygen consumption, and oxygen consumption is proportional to calories burned. So in theory, starting from heart rate alone, you can measure calorie burn.

      The problem is that the constants of proportionality vary from person to person. Further, since the number you're measuring (heart rate) is three steps away from the number you want (calorie burn), errors tend to magnify each other. In practice, any device that calculates calorie burn from heart rate is just making a wild guess.

      --
      "They redundantly repeated themselves over and over again incessantly without end ad infinitum" -- ibid.
    8. Re: Not a particularly unique problem. by Hognoxious · · Score: 2

      If it releases carbon dioxide (I think it does) then yes.

      This was 30 years ago, but IIRC by comparing 02 consumption to C02 output you can determine which type of respiration is occurring.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    9. Re:Not a particularly unique problem. by necro81 · · Score: 3, Informative

      Power meters for bicycles aren't cheap either - maybe 1000$ or so.

      For some models, yes, but by and large your information is dated. There are plenty of "consumer" models that are less than $500, and provide data that is quite good.

      For more information than you can shake a bicycle crank at, I suggest taking a look at DC Rainmaker. He owns every device he reviews* and does lots of hands-on testing. For reviews of power meters, he typically tricks out his bike with 2-4 power meters (in different locations: crank arm, spider, rear hub, etc.), each with their own head unit.

      * As he explains on his website, he often is doing his hands-on reviewing with pre-production models from the company, but always returns is and purchases his own - to confirm that is wasn't a special snowflake - before posting.

  2. Big boned by 110010001000 · · Score: 4, Funny

    Big boned people like me burn calories differently. So that explains it.

    1. Re:Big boned by AmiMoJo · · Score: 2

      Well, yeah, actually... Once you start trying to diet seriously, your body goes into starvation mode. It conserves as much energy as possible, makes you feel tired so you do less etc. You go from needing 2500 calories a day to maintain to 1500, so your huge effort of will to drastically cut down your intake has no effect.

      You can overcome it by forcing your body to burn calories with exercise, but your body will fight you all the way and you will feel like absolute shit for a long time. And even then, if you don't maintain that activity level, more often than not your body won't reset the starvation mode flag so the rest of your life is going to suck.

      Arguably this is one of the most important medical issues facing humanity as we transition from subsistence living to having plentiful, high calorie food everywhere.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  3. Not all listed/detailed but... by RJFerret · · Score: 3, Informative

    From the blurb, "...errors on energy expenditure... ...ranging from the lowest at 27.4% for the FitBit Surge to the highest error of 92.6% for the PulseOn device."

  4. 'Tracking calories' is basically impossible by Rick+Schumann · · Score: 5, Interesting

    There are too many variables involved in determining calories burned by any biological entity, and these 'fitness bands' are not the only device that has this problem, either. The closest you can come are devices that measure power generated by your muscles (PowerTap hubs, SRM or Quarq cranksets and other bicycle-mounted direct measuring instrumentation like them, rowing machines with an ergometer, etc), and even then there is a variable 'biological efficiency' term in the equation that means you can only call it an estimate. Some of the worst accuracy devices are things like the treadmills and stationary bikes in a public gym, which just use statistical averages of a range for calories burned given a level of exertion, and even then they tend towards the high end of the range to keep people motivated to continue using the treadmill or stationary bike. Something like these fitness bands work in a similar way, and I'd fully expect that they too tend to estimate on the high end of the range of 'calories burned' to keep you motivated. The fact that they track heart rate means it's a little more accurate, given one more term in the equation, and if they have a way to enter your bodyfat percentage, that would improve the estimation also. There are other factors you can plug into such an equation to make it more accurate, but in the end it's still just an estimate because of the efficiency factor. Therefore: none of what is being claimed here about it's lack of accuracy in 'calories burned' is terribly surprising. Of course for the average person, moving their body for significant amounts of time (not just getting off the couch, going to the 'fridge for another soda/beer, then back to the couch) is good regardless of trying to track 'calories burned', and to be quite honest, your dietary intake is more important when trying to lose excess bodyfat than exercise is. Of course you don't need any 'fitness bands' for that, just a decent pair of running shoes, so that doesn't make the company any money now does it?

    1. Re:'Tracking calories' is basically impossible by jedidiah · · Score: 2

      Exercise is certainly important in counteracting the body's inclination to lower your metabolic rate to account for a sudden decrease in intake.

      Although extra energy burned during exercise is a relatively small amount compared to what kind of calorie deficit you need in order to lose weight.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    2. Re: 'Tracking calories' is basically impossible by Rick+Schumann · · Score: 2

      I've had performance testing in a lab using that sort of technology. You have to have a mask covering your entire nose and mouth, so no air leaks in or out. It's bad enough when you're an athlete putting up with that for 10 or 20 minutes, the average overweight person who has to force themselves to exercise at all is not going to put up with that for even ONE minute, let alone spend $4000 for the privilege of doing so every time they go to the gym or go out to run. Also that's still just an estimate albeit a more accurate one, and in the end dietary intake is still more significant for weight loss than exercise is. Bottom line: Nobody is going to spend $4000 for something they have to strap to their face every time they exercise -- therefore such things weren't relevent to even mention for purposes of this subject.

    3. Re:'Tracking calories' is basically impossible by Rick+Schumann · · Score: 2

      Exercise is certainly important in counteracting the body's inclination to lower your metabolic rate to account for a sudden decrease in intake.

      Sure, we're in agreement there, but we're discussing the accuracy (or lack thereof) of 'fitness bands' for calories burned. Everyone should exercise in some significant way on a regular basis for best overall health. Of course you don't need any sort of technology beyond a decent pair of walking/running shoes to do that, either. ;-)

    4. Re:'Tracking calories' is basically impossible by Rick+Schumann · · Score: 2

      See, now, applying what I said above to what you just said: "Most people" == 'statistical average' to one extent or another. Are you talking about other avid runners? Or are you talking about average people who just jog occasionally? The degree to which their bodies use calories efficiently is going to vary depending on how well conditioned they are.

      That being said, the tables that you find everywhere online that let you figure out about how many calories you're burning for running at 'X' pace for 'Y' time is good enough for most people, assuming they've got past the point where they're trying to account for it down to the single-digits.

    5. Re: 'Tracking calories' is basically impossible by sexconker · · Score: 2

      Chart your weight, exercises, diet (exactly) every day.
      Add in weights of your pees and poos, along with their calorie measurements (you'll need a bomb calorimeter).

      Now that's science.

  5. Garmin? by cmeans · · Score: 2

    How on earth could they not include any one of the Garmin devices? I guess they had costs involved but still seems like they'd include one of the (I assume) most popular fitness trackers available.

    1. Re:Garmin? by erice · · Score: 2

      How on earth could they not include any one of the Garmin devices? I guess they had costs involved but still seems like they'd include one of the (I assume) most popular fitness trackers available.

      It doesn't really matter, other than less exposure for Garmin. None of the consumer devices, Garmin included, have the instrumentation to get reliable calorie estimates. GPS tracks and heart rate are not the rate data.

      Rather surprisingly, Garmin units will give you a calorie estimate even when there is no heart rate data. It is just guess work based on knowing what activity you are doing and how long, along with user entered data like height, sex, and weight. Garbage, really. It gets even worse if you are doing an activity that is not running or cycling. I found that my Garmin 310xt would report much higher calorie numbers if recorded my skating sessions as "other" then if I used "cycling". I have no idea what sort of activity "other" is based on but I guessed that "cycling" was probably closest so I used that. With the 920xt, there are practical considerations that make it easier to record as "other" so that's what I use. I don't pay much attention to the number, though.

    2. Re:Garmin? by anjrober · · Score: 2

      i have had 4 different garmin running watches over the years and recently switched to the apple watch.
      the garmins all estimated a significantly higher calorie burn than the apple watch.
      the garmin's were also higher than i believed was correct and what my diet tracking and weight indicated.
      i believe they were estimating high. imho.

  6. Re:And further by Rick+Schumann · · Score: 2

    "Variability in the caloric content of foods"

    That's completely correct, too.

    Over 900 environmental causes have been identified as potential causes of obesity (and researchers are working through the list)

    One of the more alarming ones I've heard of is pesticide residues in common foods. For instance: glyphosate (active ingredient in Monstantos' Roundup) in wheat, peas, corn, and beans. They literally drench crops in it just before harvest to increase yield. It's a metabolic inhibitor. I'm starting to think that many people who think they have a problem with 'gluten sensitivity' actually have a problem with chronic exposure to glyphosate residue in wheat. Most 'gluten free' products tend to include 'organically raised' ingredients -- which means Roundup and other herbicides/pesticides aren't used on them at all.

    Obesity has, apparently, nothing to do with the amount or type of food you eat(*), and neither the amount of exercise you do(*).

    If it's really 'environmental' factors (including but not limited to what I mentioned above about glyphosate) then the damage being done is more than just biological; there's the whole 'healthy at every size' movement, which of course is nonsense, but those people have given up and are resorting to deep denial.

  7. Here is a link to the actual paper by Xoc-S · · Score: 2
  8. If "calories" are measured, the device is defect by ffkom · · Score: 2

    or at least very obsolete, given that the official SI unit for food energy is the Joule.

  9. Re:If "calories" are measured, the device is defec by thegarbz · · Score: 2

    I've yet to see Joules listed on nutritional labels, and I live in a metric country.

    The only thing defect would be to give people units they don't understand to compare to units that aren't listed anywhere to appease idiots who insist on SI for SI sake.

    People should use common units. Not SI units, but COMMON units. You hear that you weirdos with your miles?