Slashdot Mirror


Mobile Carriers Impose Handicaps On Smartphones

Nrbelex writes "A team at the University of Michigan and Microsoft Research has uncovered, for the first time, the frequently suboptimal network practices of more than 100 cellular carriers. By recruiting almost 400 volunteers to run an app on their phones that probes a carrier's networks, the team discovered, for example, that one of the four major U.S. carriers is slowing its network performance by up to 50 percent (PDF). They also found carrier policies that drained users' phone batteries at an accelerated rate, and security vulnerabilities that could leave devices open to complete takeover by hackers."

42 of 174 comments (clear)

  1. OMG a telco screwing its customers by Osgeld · · Score: 2

    What is the world coming to!

    1. Re:OMG a telco screwing its customers by AngryDeuce · · Score: 3, Insightful

      Human sacrifice, dogs and cats living together... mass hysteria!

  2. Wilfully drain batteries? by ArsenneLupin · · Score: 2

    Why the hell would they do that?

    1. Re:Wilfully drain batteries? by fuzzyfuzzyfungus · · Score: 5, Interesting

      " Eleven carriers are found to impose a quite aggressive timeout value of less than 10 minutes for idle TCP connections, potentially frequently disrupting long-lived connections maintained by applications such as push-based email. The resulting extra radio activities on a mobile device could use more than 10% of battery per day compared to those under a more conservative timeout value (e.g., 30 minutes)"

      Apparently, the desire is not to drain the battery; but the telco is willing to do so in order to cut down on the number of TCP connections they need to deal with.

    2. Re:Wilfully drain batteries? by geminidomino · · Score: 2

      Dead phones don't poll the network, cutting down on resources needed? (Just a WAG). OTOH, dead phones don't go over text or voice minute limits, either, so maybe it's a case of incompetence rather than malice (so hard to tell with the Telcos)

    3. Re:Wilfully drain batteries? by grasshoppa · · Score: 2

      Because at about the one year mark, people start getting itchy to get a new phone. A battery draining faster than it used to will often be the nudge they need to drop the money on a new phone, especially when the batteries in question are a significant fraction of the cost of a new phone.

      IE: cell companies acting like the slime they are.

      --
      Mod me down with all of your hatred and your journey towards the dark side will be complete!
    4. Re:Wilfully drain batteries? by firex726 · · Score: 3, Interesting

      Yea, they usually tout battery life as a selling point over the competition.
      Plus if the battery goes dead, you cannot use up your data/minutes and get hit for overages.

    5. Re:Wilfully drain batteries? by redshirt · · Score: 5, Informative

      Another issue is that a lot of developers are writing mobile applications the same way they might for a desktop computer in an office with a significantly more reliable Internet connection. They aren't considering the reality that a connection may be intermittent, or drop off unexpectedly, and the effort the phone goes through to re-establish that connection.

    6. Re:Wilfully drain batteries? by Jah-Wren+Ryel · · Score: 2

      I think we need more of a definition of what constitutes a "time out" - an idle tcp connection consumes practically no bandwidth and should only use resources on the end-points (i.e. the phone and the web server). So I don't see what sort of value the telco would gain by causing idle tcp connections to disconnect faster. If anything, it could lead to extra traffic as the connection gets re-established more frequently which probably means more than just the basic tcp 3-way handshake because it will involve higher layer protocols (login/password, etc).

      As for changing towers, I don't think that matters as the phone doesn't renegotiate a new ip address just because of a tower hand-off.

      --
      When information is power, privacy is freedom.
    7. Re:Wilfully drain batteries? by drolli · · Score: 5, Interesting

      Every push mail client which will malfunction or only slowly function by this, or the battery consumption of which (see the android battery stats) will drive the customer to turn it off will motivate the customers to use text messages for urgent things.

      If they manage to drive away 10% of the push mail users to sending 2SMS per day, they will already earn more on this than on the data transfer for the rest (lets not forget that in a flatrate they dont earn money on pushmail).

    8. Re:Wilfully drain batteries? by erroneus · · Score: 4, Funny

      Mod this fella up... or kill him... he's a redshirt and is expendable.

    9. Re:Wilfully drain batteries? by kwark · · Score: 3, Informative

      My telco uses NAT, idle connection still takes resources from the connection tracker.

    10. Re:Wilfully drain batteries? by Cyberax · · Score: 3, Informative

      I was involved in building a mobile operator network.

      It's typical for operators to run stateful TCP proxies to overcome the bandwidth-delay problem with TCP/IP. Without these proxies a lot of TCP/IP stacks have very poor performance. As far as I remember, we used 20 mins. timeout to conserve translation slots (which were limited by hardware).

      Second, a lot of providers do NAT. Which should be self-explanatory.

    11. Re:Wilfully drain batteries? by jhoegl · · Score: 2

      The point for canceling Idle TCP connections is to free up that port # for that network.
      I will admit that I doubt one node would overload with NAT/PATs because that would be a lot of users. Unless of course their phone had a bunch of stupid useless gadgets that continually need to talk to the internet.

      Frankly, battery life does not concern me, it is more of their IP spoofing vulnerabilities that concern me.
      We have already seen many applications that do some things to cause your phone bill to go up, such as the VM managers that have you call a completely different number, usually long distance, redirections, location specific data, and other little apps. How happy would you be if your phone was vulnerable to a virus that took out cel phones in the US because of their lax security?

    12. Re:Wilfully drain batteries? by iCEBaLM · · Score: 5, Informative

      Well, ActiveSync (exchange push) is one good use of these idle TCP connections. The thing though is that idle TCP connections use absolutely no bandwidth. ActiveSync will open an HTTP TCP connection and ping every now and then, increasing the time between pings to find out how long the network supports idle connections. Once it stops receiving replies to the pings, it tears down that connection, opens a new one, and keeps the ping interval at the last known successful time. If there's no actual data being processed (new emails being sent/received, calendar entries, etc) then no traffic other than the pings will be passed, and these are small packets. The goal being to find the longest time possible that the connection can stay open between having to send pings, as any data uses bandwidth, battery, etc. Once ActiveSync

      Setting up a TCP connection takes way more bandwidth and battery than leaving an idle connection open. And having to keep doing it, over and over, if the network operator is killing idle TCP connections, will drain a battery extremely quickly, and generate way more network traffic in the long run.

      So why do carriers do it? Shitty NAT implementations. Up here in Canada Rogers, until recently, used NAT and the 10.x.x.x block for all wireless data users. Their NAT router would kill idle connections quickly to keep overload ports available for all it's customers. At one point it got so bad that the battery on my iphone 3G was draining in 2 hours tops if I kept push on for my exchange server.

    13. Re:Wilfully drain batteries? by tlhIngan · · Score: 5, Informative

      It's typical for operators to run stateful TCP proxies to overcome the bandwidth-delay problem with TCP/IP. Without these proxies a lot of TCP/IP stacks have very poor performance. As far as I remember, we used 20 mins. timeout to conserve translation slots (which were limited by hardware).

      Second, a lot of providers do NAT. Which should be self-explanatory.

      It depends on the plan and provider, but you're absolutely right. It's what differentiates a featurephone "social networking" plan from a "blackberry data plan" from a "smartphone data plan" and a "laptop/vpn plan".

      After all, if a "social networking" plan gets you on facebook, why not pay $5/month for that and tether your PC to it? Why do you have to pay the $50/month for 1GB on a "laptop" plan when your smartphone gets 5GB for $20?

      It's all in the differentiation of services - the mobile network LOOKS like IP, but it isn't. Using proxies, firewalls, NAT, NATx2, etc.

      If you want the freest possible Internet connectoin, you've gotta pay for it (the "VPN" tier should get you a real exposed IP, while the "laptop" tier gets you NAT+firewall typically, etc).

      Someone needs to do a comprehensive study of all the tiers available and what they provide - are they NATed (and how many times)? Firewalled? Proxied (transparent or not) (transparent proxies are extremely common on smartphones - small screens don't need full-res images)? etc. What ports allow traffic (80, 443 only are common and most users won't notice).

    14. Re:Wilfully drain batteries? by GooberToo · · Score: 3, Insightful

      Apparently, the desire is not to drain the battery; but the telco is willing to do so in order to cut down on the number of TCP connections they need to deal with.

      That is exactly right. The issue is, many carriers still have large NAT deployments. This means they must NAT every connection originating from every smart phone in their network. In the old days this wasn't a problem because the number of connections were typically fairly small and limited. Now that smart phones are general purpose computing devices, the number of connections which must be tracked have exploded. In other to more closely guard their finite resources, they lower their timeouts.

      Of course, the proper solution is to migrate all smart phones to IPv6 and completely stop NATing. Its a win-win for everyone at that point.

    15. Re:Wilfully drain batteries? by LittlePud · · Score: 2

      And they shouldn't. This functionality should be handled at the transport/network/data-link layers of the telecommunications stack, not in the app.

    16. Re:Wilfully drain batteries? by jo42 · · Score: 4, Insightful

      I've seen 'tard mobile app developers keeping one, two or three continuously open connections back to a server for long poll. Then I ask them what if they get 10,000 or 100,000 simultaneous mobile users. Someone needs to beat them silly with a clue stick.

    17. Re:Wilfully drain batteries? by Cyberax · · Score: 2

      As I worked at an Eastern Europe provider, we didn't have any restrictions on data use (tethering? sure, go on!). We also used real IP addresses, no NATs.

      However, we still had to proxy TCP/IP. Here are some details:
      http://en.wikipedia.org/wiki/Bandwidth-delay_product
      http://en.wikipedia.org/wiki/TCP_window_scale_option

    18. Re:Wilfully drain batteries? by EXrider · · Score: 2

      According to TFA, they know that carriers are buffering traffic and they think that carriers may be doing deep packet inspection, causing TCP timeouts instead of retransmits:

      Surprisingly, packets of data sent across this network are buffered by the carrier itself. This means that when a packet of data fails to make it to its destination—a common occurrence on noisy wireless networks—it cannot be instantly retransmitted, as it would normally be on the Internet. Instead, the sending device must wait a long time—on the order of seconds—for a time-out to alert it to the failure. On a one-megabyte download, this slows transmission rates by up to 50 percent, the researchers report.

      --
      grep -iw skynet /etc/services
    19. Re:Wilfully drain batteries? by Aighearach · · Score: 2

      Most places, including most urban places, are not surrounded by tall buildings. Those few that are shouldn't really expect better radio connectivity than if they were in the forest. The only solution for those backwater glass jungles is going to be lots of wifi hotspots.

    20. Re:Wilfully drain batteries? by PickyH3D · · Score: 2

      Developers should understand the impact that their app has on the device that it runs. Not understanding that your connection constantly polling (such as with a weak signal, or no signal) is killing the device's battery because it takes significantly more effort by the hardware to create the connection in such conditions, simply means that you are writing a bad app almost regardless of its other features.

    21. Re:Wilfully drain batteries? by shadowfaxcrx · · Score: 2

      So I don't see what sort of value the telco would gain by causing idle tcp connections to disconnect faster.

      Well, if they're evil enough, they could gain the value of making you dissatisfied with your phone.

      "This piece'a shit! The battery life sucks and the connection is slow as crap. I'm'a go out and buy a Bionic the minute it comes out." ... And with me, if that's their strategy, it worked. -sigh-

      --
      "I disagree with you" does not equal "flamebait."
    22. Re:Wilfully drain batteries? by SETIGuy · · Score: 3, Insightful

      Why do you have to pay the $50/month for 1GB on a "laptop" plan when your smartphone gets 5GB for $20?

      That's pretty obvious. The average smartphone on a 5GB plan uses 0.2GB. The average laptop on a 1GB plan uses 1GB.

    23. Re:Wilfully drain batteries? by Rebelgecko · · Score: 2

      Sprint for example includes some spyware-y stuff called "CarrierIQ" in all of their phones. It uses battery to log and phone home what you're doing on your phone

      --
      CATS/Diebold '08- All your vote are belong to us!
  3. No names? by XanC · · Score: 4, Insightful

    How does this help me without naming names?

    1. Re:No names? by dkleinsc · · Score: 3, Insightful

      TFA states "Due to security and privacy concerns, we anonymize their names and label them as Carrier A and Carrier B."

      I'm guessing that's in fact BS, and the real reason they don't tell you which carrier is which is to protect themselves from massive lawsuits, or possibly because Microsoft Research can't offend the carriers because their corporate overlords want to have deals to sell Windows-based smartphones to them.

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    2. Re:No names? by R3d+M3rcury · · Score: 3, Funny

      TFA states "Due to security and privacy concerns, we anonymize their names and label them as Carrier A and Carrier B."

      Because corporations are people and people have a right to privacy.

  4. This happens in Sweden too, and they don't lie... by MindPrison · · Score: 5, Informative

    ...about it either.

    I moved out on the countryside, thinking that Sweden was one of the most developed & connected countries in the world, well...turns out it's something of a fad.
    Tried 3 different operators, Telenor, 3-Sweden and Comviq (essentially Tele2 on the cheap), Turns out that Telenor shares Cellphone-Relay point (antenna) with 3-Sweden, and Comviq has their own (again, owned by Tele2)...getting confusing yet?

    The thing is, I tried all of these without any good results, oh...the signal was at FULL capacity...full power (all 4 bars lit), but the oh-so-known 404 Error turned up every 2nd web page or so, sometimes I had to wait 10 minutes for the 6mbit connection to load one single web page.

    Then I got savy and tried a trick like "Kick-the-other-users-off-the-carrier"...how does that work, you ask? Simple...just disconnect to the network (3G!) and connect again. This logs you on at full speed, well...people found out about this and a storm of complaint came on, denied by all the telecompanies...of course.

    And then I called support, and they finally called back and told me - twice (two different technicians calling each time) - that your cellphone carrier is OVERLOADED.

    Then I asked them, well...will you expand this capacity since it's as you say ...overloaded? The answer was NO. From BOTH of them.
    The town of 13.000 people is too small to add another 1 Mill SEK (Swedish currency) cellphone antenna relay carrier...so we won't do that.
    BUMMER.

    Turns out they solved this by simply "sharing" the speed amongst the users, by limiting it. Not admitting this of course...but the results amongst our neighbors and me tells it's own story.

    Needless to say, I switched to LandLine based internet, good ol'l ADSL (or VDSL...as it's called now) and the speed blazes off a steady 13-14 Mbit without as much as a hickup. Despite this, the door-to-door sellers, claim that we all should DITCH the old wired connection because the new wireless one is MUCH BETTER and MUCH CHEAPER...

    Yeah ...riiight...we've experienced that... O__O

    Furthermore people are actually dumb enough to fall for it, and the masterplan from all the telecompanies is to DITCH the LANDLINES because ...in their own words...are too expensive to maintain.

    Goodbye reliable internet...People...please start protesting against this in YOUR neighborhood!

    --
    What this world is coming to - is for you and me to decide.
  5. Dial down the drama already. by geekmux · · Score: 2

    "...the team discovered, for example, that one of the four major U.S. carriers is slowing its network performance by up to 50 percent (PDF). They also found carrier policies that drained users' phone batteries at an accelerated rate, and security vulnerabilities that could leave devices open to complete takeover by hackers."

    Uh, a team "discovered" this?

    Telcos are screwing with us and not delivering what they advertise. Yeah, wake me up when there's actual news to report instead of wasting time and money proving the painfully obvious.

    Oh, and where the hell are these "more than 100" carriers?!? I think I can name five off the top of my head. I thought the giants pretty much bought everyone else.

  6. "Unauthorized Applications" by Belial6 · · Score: 3, Funny

    This must be the kind of app that the carriers meant when they said that it would be a problem if they allowed "Unauthorized Applications" on the network. See, they were right all along.

  7. Re:All I care about is by geekmux · · Score: 2

    I dont care about any of that, all I want to know is I can still access my facebook and tweet about it while I am updating my friends list?

    Ha, exactly. And now you know the reason that telcos get away with this kind of bullshit, because to be quite honest, this is all that 98% of their customer base cares about too.

  8. Re:OMG... ONE in FOUR?! by toadlife · · Score: 3, Informative

    Soon to be AT&T, Verizon and Sprint.

    And after that AT&T and Verizon.

    And after that AT&T.

    Resistance is futile.

    --
    I don't always use unix-like operating systems; but when I do, I prefer FreeBSD.
  9. Re:This happens in Sweden too, and they don't lie. by Kreigaffe · · Score: 3, Insightful

    HA! Thank you.
    This is precisely the sort of thing I've tried to argue about in the past and was repeatedly shouted down and told that I'm just an ignorant American and don't know anything.

    The awesome connectivity and speeds has more to do with population concentrations than anything else. America's a huge place, and not a very old place, so our population centers are, er, not very centered or contiguous. New York City is huge, Philly is huge, and the Baltimore/DC metro area is huge, but there's about 2 hours of driving through nothing to get between them (and baltimore/DC are about 30 minute to an hour apart, depending on traffic). Travel a half hour east from any of those places and you're either in affluent suburbs, or straight-up rural areas, with farms, and cows.

    A glance at a population density map is really all anyone needs to figure that out, but some people just don't get it. The cool thing to do is to consider anything Europe or Asia to be better than anything America, and that the sole reason for it is simply American incompetence. So frustrating. Impossible to actually ever discuss or improve anything when you're dealing with people like that, completely divorced from reality.

    'course your landlines are faster, but that's also tied in to land area and population density.. and also WW2 actually. Infrastructure upgrade cycles! 'course we missed out on our last one! Fucking US Gov't gave the telecoms god knows how much money to lay fiber, to build modern high speed backbones across the country. Good luck finding where that money ever went to, that was coming up on 20 years ago now iirc..

    --
    ... still waiting for this free-as-in-beer free beer I keep hearing about. :|
  10. they're not tampering with the phone by Chirs · · Score: 2

    They're just shutting down the connection and forcing the phone to re-establish it. Annoying, but I doubt it's illegal since every firewall and NAT box on the net has the same timeout mechanisms...they're just set for longer delays.

  11. Yes, it is for security reasons by davidwr · · Score: 2

    TFA states "Due to security and privacy concerns, we anonymize their names and label them as Carrier A and Carrier B."

    I'm guessing that's in fact BS, and the real reason they don't tell you which carrier is which is to protect themselves from massive lawsuits, or possibly because Microsoft Research can't offend the carriers because their corporate overlords want to have deals to sell Windows-based smartphones to them.

    Yes, it is for security reasons - the researcher's own security.

    They are clearly afraid of those behind the names.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  12. Simple solution: Truth in advertising. by davidwr · · Score: 2

    Prohibit any carrier - wireless or not - from advertising "Internet" unless they mean pure, unfiltered, unadulterated Internet.

    Let them advertise and sell "AT&T Data Access to the parts of the Intertubes we think you'll like at a speed we think you'll pay for" if they want to, just don't let them call it "the Internet."

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  13. Wikileaks by bill_mcgonigle · · Score: 3, Informative
    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  14. Re:My advice... by MagusSlurpy · · Score: 2

    American Telephone & Tard Mobile?

    --
    My sister opened a computer store in Hawaii. She sells C shells by the seashore.
  15. Re:This happens in Sweden too, and they don't lie. by Kreigaffe · · Score: 2

    Err, I frequently get 2MB/s, during the middle of the day, no problem. Cable, not DSL -- the DSL in this area was.... less than reliable.

    The argument carries over, though -- it's infrastructure. Infrastructure is infrastructure, wired or wireless.. more or less.

    In Europe, you've got these INCREDIBLY dense population centers that extend, well.. the whole damned continent, really. The only sparsely inhabited areas of Europe are in the far north, up near the Laplanders. That's roughly analogous to America's "fly-over country". Except it's less than half the size, and it's at the very edge of the continent. Here in the US, it's a majority of our land area, and it's between our population centers. Even our population centers aren't as densely populated as Europe's, nor do the high density areas extend as far and as contiguously as they do in Europe.

    Er, oh, and I'm giving speeds in MBps, not Mbps, soooooo actually that 2 MBps would be 16 Mbps. It's not half as bad as people make it out to be.

    'course, I'm fortunate. I'm 2 hours north of Baltimore/DC, 3 hours south of NYC, 2 hours west of Philly, 3 hours east of Pittsburg. There's decent infrastructure surrounding me, but I'm not in such a highly populated area that everything is oversaturated and I'm not so far away from the major population centers that there's nobody willing to lay down the Last Mile to get here.

    Now, you get a place like Japan or Korea? You get the same number of people in a smaller area, and the same thing as is the case in Europe is the case there but to an even greater degree. To reach 99% of the people with a connection of X speed, you've gotta put down big fat pipes over.. what, a few dozen miles maybe? Here in the states if you did that, you'd cover *maybe* two large cities, and tough balls to people living several hours away. America is a big, big, big place. People from Europe and Asia tend to not realize how large and expansive this country is.

    We're not Canada, with almost all our population in a thin ribbon stretching east to west. Or, for that matter, Australia, with their population only really living around the edges of the ocean. The population distribution of the United States actually is more close to that of sub-Saharan Africa. Yeah... yeah.

    Of course, that's just one excuse. The upgrade cycle is another -- Europe had to rebuild their infrastructure following WW2. We didn't. Most of ours was done in the 50s/60s/70s.. its life cycle wasn't far enough along to justify tearing it all up, whereas Europe's infrastructure needed replacement sooner.

    --
    ... still waiting for this free-as-in-beer free beer I keep hearing about. :|
  16. Wow, I'm SO shocked. by kheldan · · Score: 2

    Everybody providing broadband or wireless internet connectivity does the same thing: overstate the capacity of their network as a selling point, then oversell the capacity to maximize profits. I could go into business as a broadband provider and claim "Up to a TERABIT per second downloads!" and it's not false advertising because I said the two magic words "up to". Never mind that I'm overselling the network capacity by 100 times and that if everybody got on and downloaded high-def movies at the same exact moment, crashing the whole network; I said "up to", I didn't claim a guaranteed minimum throughput, so I'm not lying; tough shit.

    Everybody needs to know this, and understand it. Once that happens then everyone can get together and force them to change. Until then they'll claim whatever they want in order to get our money, and they'll get away with it.

    --
    Are YOU using the TOOL, or is the TOOL using YOU? Think about it!