Slashdot Mirror


NTT DoCoMo Asks Google To Limit Android Data Use

An anonymous reader writes "NTT DoCoMo has had enough of Android's effects on its mobile network in Japan. Following a service disruption due to Google's Android VoIP app, the company is now asking Google to look at reducing Android's data use. In particular, the amount of time allowed between control signals being sent either by official apps or 3rd party ones. Typically these occur as often as every 3 minutes, but scale that up to thousands of apps on millions of handsets and you can see the issue DoCoMo has. So, does DoCoMo need to invest more in its infrastructure, or is Android a data hog that needs reining in?"

160 comments

  1. Well that depends... by Ragun · · Score: 5, Insightful

    If all they are asking is for Google to optimize its network usage, as the article seems to imply, go all out.

    If its telling Google to try and control the amount of bandwidth the users decide to use, well, I think they are going to have a little trouble getting that done.

    1. Re:Well that depends... by kelemvor4 · · Score: 3, Insightful

      If its telling Google to try and control the amount of bandwidth the users decide to use, well, I think they are going to have a little trouble getting that done.

      TFA specifically states they are trying to control VOIP data usage. Not unlike the (failed) domestic attempts to limit voip on a smartphone in order to preserve traditional airtime revenues. Do you remember all the hubub when apple/at&t tried to ban Skype? It's a thinly veiled attempt to screw customers, and I'm sure Google has no particular interest in limiting their users traffic based on the content being transmitted.

    2. Re:Well that depends... by Suki+I · · Score: 1

      If all they are asking is for Google to optimize its network usage, as the article seems to imply, go all out.

      If its telling Google to try and control the amount of bandwidth the users decide to use, well, I think they are going to have a little trouble getting that done.

      I do not necessarily advocate this, but can't they detect individual users and throttle(?) or filter those control signals? If that takes more resources than just letting Androids bog down the system, I withdraw my question.

    3. Re:Well that depends... by AngryDeuce · · Score: 2

      First it was bit torrent traffic, then video streaming traffic, then VOIP traffic...

      They're just setting the stage for discriminating traffic so they can charge more to certain users to get back the money they lose from those customers not supporting their other services. The U.S. telecoms have been falling all over themselves trying to find a way to nullify Netflix to keep us from dropping their archaic tiered cable tv service.

      Why would a Japanese company be any different? The Skype folks are going to end up getting squeezed for more money, just wait...and some goon will be saying to himself "that'll teach 'em to stop using up their anytime minutes!!" the whole time.

    4. Re:Well that depends... by kbielefe · · Score: 5, Informative

      It's not that simple on a wireless connection where everyone shares the medium. For communications originating at the phone, the network provider can't do any throttling until the packet has already been received at their equipment, because they don't control the phone's transmitter. By that time, the bandwidth on the wireless link has already been consumed and wasn't available to other users. If the control signals originate at the server, the network provider could throttle it, but setting it up isn't trivial, and then you have problems like the servers sending retries because they aren't getting responses from the phone. The best solution requires cooperation from the OS and/or application writers.

      --
      This space intentionally left blank.
    5. Re:Well that depends... by Andy+Dodd · · Score: 5, Informative

      Docomo seems to claim that it's background sync/checking traffic - but Google makes a point of reducing this as much as possible. There's good reason to do this - the less often data is transferred to keep "checked in", the less often a device needs to wake up, and the better battery life is.

      This is, for example, why IM apps that use Google C2DM (Such as Google Talk - but any IM app author can use C2DM) have a minimal impact on battery life, while poorly written apps that are not even remotely suited to mobile devices (like Skype) are massive battery hogs.

      If Google's services are "checking in" that often on DoCoMo, it's probably because DoCoMo's NAT boxes are broken - http://conferences.sigcomm.org/sigcomm/2011/slides/s374.pdf

      --
      retrorocket.o not found, launch anyway?
    6. Re:Well that depends... by Anonymous Coward · · Score: 0

      Sorry, but that is so wrong. Bandwidth on the air interface is hardly the limiting factor in basically every wireless network. What is much more severely limited is the backbone capacity, and there it is actually very easy to throttle individual users (in most western countries at least, throttling speed after a certain consumption limit is standard practice). With all contemporary cellular networks, the handset needs to tell the base station who it is in order to be able to use the network, for example in GSM networks, it needs to transmit the IMSI and MSISDN, so the network knowns whether this handset is even allowed to use the network, and which calls to route to that handset. Based on that information, it is ridiculously easy to limit the backbone bandwith that this handset is allowed to consume. You can even disconnect a particular service altogether, or how else do you think network barrings work?

    7. Re:Well that depends... by kbielefe · · Score: 4, Informative

      It's not VoIP calls that are the cited problem, it's the periodic signals when it's not in use that tell the server, "Hey, I'm still here!"

      --
      This space intentionally left blank.
    8. Re:Well that depends... by ColdWetDog · · Score: 1

      It's not VoIP calls that are the cited problem, it's the periodic signals when it's not in use that tell the server, "Hey, I'm still here!"

      Does sound like a typical Geek problem, doesn't it?

      --
      Faster! Faster! Faster would be better!
    9. Re:Well that depends... by tripleevenfall · · Score: 3, Insightful

      Perhaps they shouldn't sell a product if they can't provide it, rather than stripping and restricting what people thought they were buying later?

      Should we just pray they don't alter the deal further?

    10. Re:Well that depends... by tragedy · · Score: 1

      That doesn't quite add up. The number of smartphones out there is on the same order as the number of high-speed connections in homes. The connection of cell phone towers to the backbone is extremely direct compared to high-speed connections in homes. And, finally, the total monthly bandwidth used by the typical phone is a lot less than the total monthly bandwidth of a home connection. So how is the backbone usage the issue when it's the same backbone as the home connections?

    11. Re:Well that depends... by ewanm89 · · Score: 1

      You mean the ones that are no different in load to the one the phone makes regularly to the base station for the same purpose. Those are a single packet or 2 usually.

    12. Re:Well that depends... by bryan1945 · · Score: 1

      Makes me wonder if the telcos spent just a fraction of the money they do on advertising and fighting all types of competitors, and used that to improve their product, what would happen? (Yeah, I know pipe dreams and all that)

      --
      Vote monkeys into Congress. They are cheaper and more trustworthy.
    13. Re:Well that depends... by similar_name · · Score: 5, Informative

      They have a right to make money in return

      No, they have the right to try to make money in return. If they can't make money without constantly changing the rules instead of their strategy they should go out of business. I'm sure others could use the spectrum.

    14. Re:Well that depends... by Oliver+Wendell+Jones · · Score: 2

      How old is your Sig? I'm trying to figure out if it is new and and you're suggesting we replace the current crop of politicians with monkeys, or if in fact this is an old sig and explains our current predicament?

      --
      A computer once beat me at chess, but it was no match for me at kick boxing -- Emo Phillips
    15. Re:Well that depends... by Anonymous Coward · · Score: 0

      This is why content providers should not be the same companies as distributors.

    16. Re:Well that depends... by Anonymous Coward · · Score: 0

      Perhaps they shouldn't sell a product if they can't provide it, rather than stripping and restricting what people thought they were buying later?

      That's fine they will no longer support of sell Android phones.

    17. Re:Well that depends... by wrook · · Score: 2

      I think there may be something to what you are saying. To be honest, I was very surprised by this article (I would really like to see the original Nikkei report in Japanese... too bad they don't link it).

      I'm on DoCoMo at the moment and I have had nothing but terrific service. I live out in the sticks, but no mater where I am I get good signal, good data availability, *very* good bandwidth and decent ping times. I've even tunnelled X through ssh on it and it was (barely) useable. That's considerably better than anything I would expect. Even on my occasional journeys to Tokyo or Osaka, I've never, ever had even the slightest problem. So if they are struggling, it's definitely not obvious.

      However, up until November, the gmail app was seriously draining my battery. I ended up going to manual updates and suddenly all of my battery problems were fixed. Then I upgraded to 2.3 and ended up re-enabling auto-update on gmail. No problem. I attributed it to the OS upgrade, but it definitely could have been an infrastructure problem that they have fixed in my area.

      I wonder if this is simply some technical issue that they are having and that the cheapest way for them to fix it would be to make changes to Android. In other words a non-story that some reporter got the wrong end of the stick for...

    18. Re:Well that depends... by Anonymous Coward · · Score: 1

      First they came for the bit torrenters,
      and I didn't speak out because I wasn't a bit torrenter.
      Then they came for the video streamers,
      and I didn't speak out because I wasn't a video streamer.
      Then they came for the VOIPers,
      and I didn't speak out because I wasn't a VOIPer.
      Then they came for me
      and there was no one left to speak out for me.

    19. Re:Well that depends... by ackthpt · · Score: 1

      It's not VoIP calls that are the cited problem, it's the periodic signals when it's not in use that tell the server, "Hey, I'm still here!"

      If that's indeed the case, it is understandable - it's like some idiot calling you up and then telling you to stay on the line while they get around to you. I've had telemarketers do this (yeah, I know about the Do Not Call List, and so do they -- they're choosing to flaunt it) because they dial a bunch of numbers at once, then respond to the first one that picked up.

      Probably a good engineering way around it - could also be NTT DoCoMo doesn't want to put any money into upgrading their network.

      --

      A feeling of having made the same mistake before: Deja Foobar
    20. Re:Well that depends... by Anonymous Coward · · Score: 1

      If they did that, the costs would be prohibitive. Modern communication systems are cost-effective because they time-share trunk lines based on statistical analysis of usage patterns. Everything from ancient Strowger electro-mechanical exchanges to modern ATM networks are based on the concept of the "butterfly switch". Every end-point has a communication link, but as most calls are local, switching can be done locally, so there is more capacity dedicated to those than to national or international. No different from "external lines" on a company telephone exchange.

      Start using the internet for service, and there is no longer any difference to the user between a local service and a service on the other side of the planet. Only the network provider suddenly notices more demand for national and international traffic. Either traffic use is reduced or Google extends their data network directly to the local mobile phone networks

    21. Re:Well that depends... by sys_mast · · Score: 1

      That outlines an important question. Is the weak link between the phone and the tower, or between the tower and the internet(provider links or uplink)
      Though you only ask about the cell to tower link, is that some something you know to be the issue, or a guess?

      --
      Those who can, do.
    22. Re:Well that depends... by icebike · · Score: 2, Informative

      It's not VoIP calls that are the cited problem, it's the periodic signals when it's not in use that tell the server, "Hey, I'm still here!"

      Which, by the way, are usually just keep alive packets sent on sockets that are already open.
      Seriously, if these tiny packets are hurting their network how cramped must their bandwidth be?

      Admittedly, these SIP/Voip clients could use the more common method of opening a socket and letting it sit there till the socket times out, then re-initiate. This needs to be done once every 15 to 18 minutes, and no actual data needs to go across the link in the mean time. (In fact the radio's can go into deep sleep mode).

      However, every email check, facebook check, check-in, or weather update causes way more data transfer than a few packets sent back and forth on an already open socket.

      I've got a SIP connection up on my smartphone 24/7, and I've seen zero impact on my data usage, even when I get several calls per day over 3G. The software uses keep-alive packets at an interval I can set to detect early connection failure. Many SIP providers haven't yet set brought their servers up to the point where they can rely on socket timeout as a signaling method, and simply drop the registration of the sip client when this happens.

      --
      Sig Battery depleted. Reverting to safe mode.
    23. Re:Well that depends... by icebike · · Score: 2

      Its a tcp/ip connection, that's all.

      Because the networks are so unreliable many sip clients send a packet back and forth, using CRLF-CRLF ping answered by a single CRLF pong, according to RFC5626.

      So the load is WAY different than connection to the base station: Its WAY SMALLER, and WAY LESS FREQUENT.

      --
      Sig Battery depleted. Reverting to safe mode.
    24. Re:Well that depends... by zaphod777 · · Score: 0

      I live in kanagawa and commute to Shinagawa and on my daily commute there is a good 30 min where data is iffy at best. That is even when I have a "good signal" so there is something weird going on there.

      --
      "Don't Panic!"
    25. Re:Well that depends... by icebike · · Score: 2

      Throttle?

      The Keep-Alive per RFC5626, consists of 2 CLRF pairs sent from the hanset (4 characters plus TCP wrapper) answered by a single CLRF pair (plus wrapper). Minimal wrapper, IIRC is about 16 bytes, so every 3 minutes twenty bytes out, followed by 18 bytes back in.

      Pretty hard to throttle that down to anything less if you ask me.

      They need to fix their network.

      --
      Sig Battery depleted. Reverting to safe mode.
    26. Re:Well that depends... by similar_name · · Score: 1

      Since the Internet was designed to be usable at a local level even if the national level was actually destroyed that is an epic fail of the Internet Protocol if what you say has any merit and even worse as an excuse.

    27. Re:Well that depends... by Suhas · · Score: 2

      I live and work in downtown Tokyo and DoCoMo performance has gone down the drain *significantly* in the last few weeks. 3 times in January alone the service completely stopped for 3-4 hours, as in, no data signal, only voice. This is true for all DoCoMo users. I would guess that a few thousand users per cell tower out in the sticks is not a good indication of network reliability for say Shibuya-ku or Minato-ku where you can have a million customers crammed in a few square kilometers.

    28. Re:Well that depends... by ppanon · · Score: 1

      That's fine. As long as it's a GSM network (true outside of the US), you can just get their cheapest phone that supports a data plan, pull out the SIM and put it into your independent purchase of an unsubsidized, unlocked Android phone.

      --
      Laissez lire, et laissez danser; ces deux amusements ne feront jamais de mal au monde. - Voltaire
    29. Re:Well that depends... by YoopDaDum · · Score: 1

      That's actually incorrect and quite way off. A normal telephone does NOT report its presence every 3 minutes as the quoted VoIP applications (value coming from TFA). A location update is done only every few hours, or when changing location areas. So it is much less frequent, and will also be much more efficient as the phone returns to low-power / silent mode after the minimum exchange of packets. Whereas the VoIP keep-alive, being data, will lead to a wake-up and the phone will go back to idle after a timeout a few seconds later typically. So you replace a few packets back and forth every few hours by several seconds of active time every 3 minutes. It does make a difference.

      I'd rather see operators be more open to OTT services, as frankly they have quite a poor record in providing interesting services. But to run services efficiently on a mobile network some infrastructure still need to be put into place. It's not necessarily rocket science. For example, instead of each application doing its own uncoordinated and fast keep alive polling, they could rely on a platform keep alive service provided by the OS (and it seems both Apple and Google already support that, but I'm no expert on that). Just this centralization would save a lot of needless traffic and grief. And this centralized OS service could be integrated with the network keep alive system, with a connection between the home location register and the Apple or Google keep-alive back-end. Then there would be no additional keep alive polling compared to what the telecom network is already doing.

      As you see, it's not super complex. But it requires cooperation between the few platform makers and the many telecom operators. As the cost is born by operators and the effort would be mostly on the platform makers, I don't expect much improvement until the operators start to apply pressure. This is what DoCoMo is starting to do. For once, it's a move that makes sense and that can also benefit the end user with less drain on the phone battery.

    30. Re:Well that depends... by YoopDaDum · · Score: 1

      Please see my reply to ewanm89 just above. It's very small at the TCP/IP level, but it's actually MUCH BIGGER and MUCH MORE FREQUENT ;) than the keep-alive done by the telecom network. It's not even very useful, adds inefficient signalling (particularly in 3G vs. 4G) and drains your phone battery for nothing.

    31. Re:Well that depends... by vix86 · · Score: 1

      I can concur with this. Anytime I hit the heavy crowded areas, Shinjuku, Akihabara, I basically lose my connection a lot. As soon as I'm headed back up north toward Saitama and Ibaraki, signal/connection comes right back no problem. I use a Galaxy S2.

    32. Re:Well that depends... by rioki · · Score: 1

      I am reverting my mod points on this discussion just to comment on this nonsense. You are right that networks are designed based usage patterns. The usage patterns for standard voice communication favors local. (e.g. 80% of all mobile calls are done in sight distance) But with data it's not the case, you connect to some server that is somewhere in the world. That is how the internet works for decades now, so there is nothing new. The problem comes now that mobile carriers are seeing more data traffic that before and there are two problems associated with that. First you have radio band saturation, but there is not much you can do about this; it is also not a data problem, more users for voice do the same thing. The second is that data traffic creates more traffic on the backbone infrastructure and that are cables. In this case the mobile service provider is either lazy and/or not very clever. Either they failed to upgrade their backbone infrastructure to meet demand and they knew is was coming. The second problem is probably their peering setup, there are ISPs that can bare the load easily. In contrast to e-mail spam and torrent traffic, the additional mobile traffic is peanuts. The mobile provider just has to establish more local hand-off points for data traffic. We are talking status updates here, that is puny in contrast to other traffic on the internet. Other non mobile ISPs can work cost efficient and there is definitely no bias for local communication. (Remember this post is sent around half the world...)

    33. Re:Well that depends... by YoopDaDum · · Score: 1

      Yes, this centralization of keep-alive / sync / update if very key to operate efficiently on a mobile wireless network. And even though both Google and Apple have some support, I guess not all applications are using it. An application designed for a fixed platform where the network is truly always on and dirt cheap will just do its own polling, and a fast polling it will be compared to what is suitable for a mobile network. This same application on a mobile wireless network will create a lot of signaling and drain batteries for nothing (although users and operators are one different sides for OTT applications, they both win if applications are more mobile savvy and efficient. The operators see less signaling data, the user less battery drain).
      So I guess there's some education to do so that developers understand the constraints of a mobile network and do properly use the mobile specific services. And providing visibility on the applications data usage (how frequent does an application initiate connections? etc.) may help too. It would allow knowledgeable end users seeing what are the inefficient apps and put pressure on the developers to improve them.

    34. Re:Well that depends... by mariasama16 · · Score: 1

      You forget, this is happening in Japan, the land where everything is done via cellphone (I do kid... kinda). I'd bet typical data usage there is different than typical data usage here in the States (or even Europe).

    35. Re:Well that depends... by zaphirplane · · Score: 1

      if the _return_ traffic is throttled, does that not throttle the connection? a layer 8 conversations goes send a request, wait for a reply, get a reply, send another request.
      so if the reply is slow, I would think the whole conversation is slowed down, kind of a L8, tcp window size shrinking (excuse the mixed layers)

    36. Re:Well that depends... by Anonymous Coward · · Score: 0

      ...you know DoCoMo is in Japan, where they have the exact same issues wrt carrier/handset incompatibility that the US does, yes? It's not the swap-sim paradise that is, apparently, the rest of the world outside our two countries.

    37. Re:Well that depends... by AmiMoJo · · Score: 1

      You are only looking at the TCP/IP stuff, but there is a radio layer in there too. It isn't like wifi either, there is much more overhead, and connections have to be tracked between base stations too.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    38. Re:Well that depends... by Anonymous Coward · · Score: 0

      Hey, just to clarify.
      NTT Docomo announced that they will be spending millions of money in upgrading their network.
      But this incident occurred in tokyo, one of the biggest city in the world.
      So there isn't much they can do unless they get tons of extra
      network bandwidth in that area.

    39. Re:Well that depends... by Anonymous Coward · · Score: 0

      That's fine. As long as it's a GSM network (true outside of the US), you can just get their cheapest phone that supports a data plan, pull out the SIM and put it into your independent purchase of an unsubsidized, unlocked Android phone.

      In Japan and Korea, some networks lock the SIM card to a particular IMEI code, so the unlocked phone would presumably not have that IMEI, and would not be allowed on the network.

    40. Re:Well that depends... by ppanon · · Score: 1

      I did not know that. Wow, that sucks.

      --
      Laissez lire, et laissez danser; ces deux amusements ne feront jamais de mal au monde. - Voltaire
  2. English usage by Anonymous Coward · · Score: 0

    "reign" a kingdom. "rein" a horse. Please.

    1. Re:English usage by K.+S.+Kyosuke · · Score: 1

      "reign" a kingdom. "rein" a horse. Please.

      The anonymous writer was actually the shy King Richard III of England.

      --
      Ezekiel 23:20
    2. Re:English usage by The+Mister+Purple · · Score: 0

      Your signature makes me smile!

      --
      "For a successful technology, reality must take precedence over public relations, for nature cannot be fooled." Feynman
    3. Re:English usage by Anonymous Coward · · Score: 0

      This is slashdot, people don't HAVE signatures! Or do you have to be logged in to see them or something?

  3. NTT DoCoMo is the standard gold of mobile networks by Anonymous Coward · · Score: 5, Interesting

    Having been to Japan, and several locations around the world, I can say with fair certainty that NTT DoCoMo has the best network service I have *ever* seen. It allowed me to measure what is due to the iPhone's failings, and what is due to the network operator's failings. By contrast, in New York, AT&T makes getting signal a game of hide and seek. France stands somewhere in between the depths of AT&T and glory of NTT DoCoMo.

    All this to say that if NTT DoCoMo feels Android is unoptimized... than I pretty much take their word for it.

  4. Both by JavaBear · · Score: 4, Insightful

    Both Apple and Google need to be aware of their bandwidth usage, but it is not just those two, but the app developers as well. Better to spend a few more CPU cycles and compact the data a little more than to bring down the network. XML is fine, but hardly the most efficient way to transmit data, especially not without compression.

    On the other hand, the providers must realize that the trend are for increasing data usage, as we take our daily communications with us, rather than sitting at home with our fixed line broadband connections.

  5. Yes, it's an esoteric Android issue. by jeffb+(2.718) · · Score: 4, Informative

    It's some "control-traffic" issue that you, the customer, really shouldn't have to think about. It's nothing to do with an application that routes voice traffic over a data connection, thereby disrupting the carrier's finely-crafted billing practices.

    1. Re:Yes, it's an esoteric Android issue. by Anonymous Coward · · Score: 0

      "The leading Japanese mobile phone service provider identified an Android application, which enables free-of-charge voice communication, as a major cause behind a service disruption that occurred on Wednesday, the business daily said."

      Yep, that was my first impression as well. I'm assuming the unnamed app is Skype.

    2. Re:Yes, it's an esoteric Android issue. by b0bby · · Score: 1

      Yeah, the control traffic every three minutes is *just* as important to them as stopping the VOIP apps...

    3. Re:Yes, it's an esoteric Android issue. by kwark · · Score: 1

      My guess is that the control traffic related to voip might be SIP over UDP. That kind of traffic is soley controlled by the application and the server, if the client is NAT-ed an abundance of SIP control packets might be necessary for keeping the portmapping alive. But these persons who though that a control protocol should be done over UDP, should be the first againt the wall in my book.

    4. Re:Yes, it's an esoteric Android issue. by viperidaenz · · Score: 2

      But these persons who though that a control protocol should be done over UDP, should be the first againt the wall in my book.

      Its actually a protocol that can run over UDP, TCP or SCTP. Someone who thought a control protocol should be able to run over many different underlying protocols should be the last against the wall.

  6. What happened to the Japanese? by bogaboga · · Score: 0

    The Japanese used to be very pragmatic people. What happened to them? Some have said the South Koreans have taken over. I am inclined to agree when I look around my home.

    Android is 'open'. The Japanese build and maintain their networks. The problem they describe is can be stemmed by a [simple] software 'update'. Why don't they do just that?

    Again, what happened to the Japanese?

    1. Re:What happened to the Japanese? by medv4380 · · Score: 1

      Yes it is open source. But how many handsets from how many manufactures are out their that need the update. It would be easier to just update the core OS and then convince the manufactures to get their version of the OS updated. Then they can do an over the air push of the updates. Otherwise you have to write the fix yourself for each version. Convince the manufactures to give you the keys needed to push the update. Then do it all over again for each brand when the OS has other updates because your update isn't in the Core OS.

    2. Re:What happened to the Japanese? by Grishnakh · · Score: 1

      I dunno, but if you look at the automotive world, the south Koreans have certainly stolen the Japanese's thunder there.

    3. Re:What happened to the Japanese? by Anonymous Coward · · Score: 0

      All the handsets from different makers on DoCoMo run with Android versions modified specifically for their network. Heck, until smartphones took off the whole product line was running NTT's in-house developed OS. Compared to maintaining that it wouldn't be a lot of work to just write a patch and compile it into future OTA updates.

  7. Re:NTT DoCoMo is the standard gold of mobile netwo by Chuckstar · · Score: 1

    I live in NYC and rarely have any problems getting a signal on AT&T. Actually getting any data or calls to my phone over that signal, however, is a distinct challenge. ;-)

    I often experience dropped calls and slow data rates while my phone happily shows "5 bars" of signal.

  8. subtext translation: by Thud457 · · Score: 1, Offtopic

    "Andloid's not done until VOIP won't run."

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  9. Control signals- NOT Data by sonicmerlin · · Score: 5, Interesting

    Uh... Control signals have nothing to do with overall data consumption quantities. When you send a text message, you send the 160 or so bytes of data through control signals. The issue here is that Android doesn't control the way its apps try to contact the towers, basically hammering them if they don't respond properly. This issue is one of the reasons Android has massive standby battery drain problems, as detailed in this 300 page xda thread: http://forum.xda-developers.com/showthread.php?t=1179809

    The galaxy nexus has its own 100+ page thread dedicated to battery drain on standby.

    1. Re:Control signals- NOT Data by StikyPad · · Score: 1

      Yup, and if there are this many misguided comments conflating control signals with data usage on Slashdot, imagine how easily the issue can be spun by carriers to intentionally misrepresent the issue to an ignorant consumer base.

    2. Re:Control signals- NOT Data by Anomalyst · · Score: 1

      If DoCoMo (sounds like a Beach Boys song) thinks this is an issue, let them dedicate some of THEIR resources to provide an open source solution, whether it be kernel changes or an ECMA API spec that would that would allow tuning the communications flow that they find so disruptive. Make a positive contribution instead of having your suits whinging about how bad it is. I have no doubt that mutiple apps are sending keep alives and other such stuff which could be consolidated. I am sure DoCOMo will have no objection to volunteer server resources to centralize the notifications.

      --
      There is no right to feel safe thru security vaudeville at the expense of everyone's freedom, privacy and tax money.
    3. Re:Control signals- NOT Data by robmv · · Score: 1

      Android problem or applications problems? What is the difference of Android vs a Laptop with 3G? If some Windows applications is using a lot of network, could the telco ask Microsoft to change Windows so that doesn't happen? The same way, If a Window application is on an infinite loop, consuming all the batery, is Windows the culprit here?

      Stop blaming a multitasking OS for the failures of the applications. Android 4.0 is adding data usage limits per application so user can identify those buggy applications

    4. Re:Control signals- NOT Data by Miamicanes · · Score: 4, Insightful

      What Android desperately needs is a nice, API-level convenience method that lets you create a http(s) request, complete with args, then hand it to the OS and say, "You don't have to do this *right this millisecond*, but at some point within the next ___ seconds/minutes, please wake up the phone (if necessary), establish network connectivity, make the request, then fire {this-intent} with the server's response (or failure info)" (and optionally, if the request fails, try making a test request to something like 8.8.8.8 and/or 8.8.4.4 to make sure the phone's internet access is REALLY working before assuming failure, so the program only has to deal with the failure of its own web service, instead of having to deal with the failure of the phone itself to sustain a robust network connection).

      Believe it or not, right now, there's NO good, reliable, graceful way to do the equivalent of having a cron job fire off a http request when the phone is asleep. There are ways to kludge it, but they're all either unreliable (the phone will go back to sleep before it even has a chance to MAKE the http request, the network might be down because it hasn't finished reconnecting yet, etc) or dangerous (holding partial wakelocks in static variables, with no way to guarantee their release if something crashes).

      Android gives developers lots of power, but it also imposes enormous amounts of responsibility that maybe 1% are really equipped to handle. In the real world, the network failure strategy of most Android applications can be summed up as "relentlessly keep beating away at the URL in the hope it might eventually work". Oh, most semi-new Android devs don't SET OUT to be irresponsible... the problem is, anybody who tries to make a single network call and fail politely and exit if it doesn't work quickly discovers that an average Sprint user will have the app die within 10 minutes (thanks to the stupid way Sprint phones thrash between 3G and 4G in quite a few real-world indoor usage scenarios). So they adopt "keep trying over and over again" as a strategy, because it makes their app work on Sprint phones, but kills the battery of anybody who's somewhere like a subway tunnel when the phone decides to make its next http request. If Google gave developers a nice, bulletproof way to politely make asynchronous http requests that can be gracefully scheduled and batched, instead of trying to hack together buggy solutions that almost work, we'd all be better off.

    5. Re:Control signals- NOT Data by scamper_22 · · Score: 1

      Which begs the question of this is an Android problem or a wireless issue. I really don't know where one begins and the other ends.

      To what extent can network operators control the wireless devices?

      Like is there a 3G/LTE command that DocoMo can send a device to tell it to limit its traffic to X kpbs, or pause sending for y seconds...

    6. Re:Control signals- NOT Data by SchroedingersCat · · Score: 1

      Sounds like you are describing AlarmManager

    7. Re:Control signals- NOT Data by Anonymous Coward · · Score: 0

      8.8.8.8 and/or 8.8.4.4

      you mean 2001:4860:4860::8888 and 2001:4860:4860::8844

    8. Re:Control signals- NOT Data by Anonymous Coward · · Score: 0

      Stupid developers are at fault here. You can check the connectivity status to see if you have WIFI or 2G/3G connectivity. A simple if clause around this will check that you actually have it. So if you write a service that starts on phone start up and runs in a background thread to check connectivity and make a request, that's not a problem. You could schedule the thread to run at a set interval, or do a delayed handler.

      This is not an issue, nor is it difficult.

    9. Re:Control signals- NOT Data by Miamicanes · · Score: 2

      Alarm Manager is part of the PROBLEM.

      Yes, you can schedule your task through AlarmManager. You can even be polite and use InexactRepeat to batch requests. There are two specific problems:

      1. You aren't allowed to do anything time-consuming (like make a http request) in the BroadcastReceiver that runs when AlarmManager fires off the Intent. You have to start a background service to do it. Unfortunately, Android makes no guarantees that it will even execute the BackgroundService onCreate() method before exiting the BroadcastReceiver, and Android can (and will) put the phone back to sleep the nanosecond the BroadcastReceiver's intent handler finishes running. Pure multithreaded joy.

      2. The only way to guarantee that the phone can't go to sleep until the http request gets made is to grab a PartialWakeLock in your BroadcastReceiver, and release it from the background service. The thing is, you can't pass the PartialWakeLock to the background service in the call that starts it up, you can't call methods of that background service without getting a connector, and you can't tell Android to keep the BroadcastReceiver's handler running (and the phone awake) until you get that connector. So... you basically have one option left: create a class with a static PartialWakeLock (or HashMap of PartialWakeLock objects), store it there, and pray to ${deity} that Android doesn't decide to kill the class off and garbage-collect it before the service gets created, because if it does, your phone now has a zombie wakelock that can't be released.

      It's a catch-22. There is LITERALLY no way for an intent fired off by AlarmManager to guarantee a successful attempt to make a http request without doing dangerous and ugly things with static references to PartialWakeLock objects. It's one of those "ohshit" API decisions that seemed like a collection of good individual ideas, then kind of fell down in one embarrassingly common real-world use case... and something anybody who writes an Android app that needs to occasionally communicate with a server in the background gets confronted with in short order.

      Making matters worse, Gingerbread now kills even well-behaved background services if it thinks they've been running for "too long", even if they spend 99.999% of their existence politely using TimerTask and Java's Thread API to yield and sleep. So, the one semi-solution that used to work politely and reliably (start the service, then spend most of the time sleeping) now breaks, with no reliable and safe alternative.

    10. Re:Control signals- NOT Data by Miamicanes · · Score: 1

      Sorry, but Android networking is nowhere close to being that straightforward once you throw deep sleep behavior and powered-down network interfaces into the equation. Just to give one blatant example, my Motorola Photon routinely gets itself into situations where it powers down all the network interfaces, and takes an ETERNITY to re-establish the network unless I launch the stock browser long enough to manually wake it back up. I've had it showing "Zzz" for the wireless network, and observed HUNDREDS of failed requests by Apache HttpClient in a row that didn't budge the phone, and only saw the network re-connect after I manually launched the stock browser. It's almost like they hardwired Webkit to manually launch a network connection if necessary, then forgot to do the same with HttpClient. (I captured the logcat output to SD using CatLog).

      If you check for connectivity, and give up without a fight or even trying to make the request anytime you see it's down, it's quite likely that you're going to go for a REALLY long time before seeing network connectivity when the phone is in deep sleep mode, even if it's allegedly connected to wi-fi and sitting next to a tower.

      THIS is why we need something like "AlarmManagedHttpRequest" that gets fired on schedule, but doesn't begin executing until the phone is guaranteed to have made every reasonable effort to establish network connectivity first, and keeps the phone awake until the request either succeeds or fails. It's a straightforward thing to do at the Android framework level, but it's extremely hard to kludge safely and ROBUSTLY using the existing public API.

    11. Re:Control signals- NOT Data by Miamicanes · · Score: 1

      Argh. Accidentally wiped out a major edit, too.

      Relying on a long-lived background service doesn't work anymore. As of Gingerbread, Android will kill background services it thinks have been running for "too long", even if they're spending 99.999% of their time waiting politely and allowing the phone to sleep as necessary. Officially, you're now damned if you do, and damned if you don't.

    12. Re:Control signals- NOT Data by sonicmerlin · · Score: 1

      It's both hardware and software. AT&T asked Apple to do the exact same thing. And now Apple has had some battery drain issues with the introduction of notifications and such. Of course Apple will eventually fix those issues with iOS 5.1, while Google's OEMs don't really care.

    13. Re:Control signals- NOT Data by sonicmerlin · · Score: 1

      You realize AT&T asked Apple the exact same thing DoCoMo is asking here? It was announced as "apple and att are working together to decrease network load of iphone devices" back in the early days.

    14. Re:Control signals- NOT Data by sonicmerlin · · Score: 1

      It's sometimes google's own applications doing the damage (like talk and latitude)

    15. Re:Control signals- NOT Data by sonicmerlin · · Score: 1

      So here's the thing about wireless bandwidth. Current LTE gets 5-12 mbps down. Upcoming LTE Advanced has 10x the capacity. It triples capacity in the same spectrum, and allows aggregation of nonadjacent slices of spectrum. This allows the carriers and your phone to use all available spectrum. LTE A can achieve 1 gbps over 67 MHz. Verizon and AT&T have 100+ MHz each. They'll both be capable of 2 gbps eventually. Obviously it will take time to transition spectrum over from CDMA to LTE, but due to the massive cost advantage of IP based networks over circuit switched ones, all carriers are rushing to roll out 4G.

      5th generation wireless networks, the generation after LTE Advanced, are predicted to achieve 5 times greater capacity.

  10. Re:Both by Omnifarious · · Score: 3, Interesting

    I agree. But I would add one more thing...

    Perhaps Google could come up with a standard for pushing all these control signals and keep alives through a single gateway. That way apps could piggyback on each other to reduce traffic.

    I must have at least 5 different ways to asynchronously receive messages on my phone. I would love a way to combine the traffic for all of these down to something small. Especially if (and I realize I'm an extremely rare case for wanting this) I could redirect it through a web app or something running on my server at home.

    It's like how almost every social website grows some form of instant messaging that's relayed through the website's servers. Why can't they all just use Jabber and be done with it?

  11. The anthem by Caerdwyn · · Score: 0

    So, does DoCoMo need to invest more in its infrastructure, or is Android a data hog that needs reigning in?"

    Isn't the Slashdot mantra always "It's open source! Therefore, it's someone else's problem when it comes time to pay the bills!"?

    --
    Everybody gets what the majority deserves.
    1. Re:The anthem by noh8rz2 · · Score: 1

      a.k.a, "Information wants to be free (to me)!"

  12. format and rhymes by bhcompy · · Score: 0, Offtopic

    DoCoMo
    MoDaCo
    Comodo

    Where is the originality?

    1. Re:format and rhymes by meerling · · Score: 1

      It's Japanese, if you knew the alphabet you'd understand a bit more.

    2. Re:format and rhymes by Anonymous Coward · · Score: 0

      Then please enlighten those of us who don't know the alphabet.

      Snide comments are not helpful.

    3. Re:format and rhymes by Anonymous Coward · · Score: 0

      I don't understand what you are trying to say, there are about 100 other sounds in the "alphabet", what is so special about do, ko and mo.

    4. Re:format and rhymes by newcastlejon · · Score: 3, Informative

      A quick look on wikipedia tells me that DoCoMo is short for "do communications over the mobile network", while the Japanese word "dokomo" translates to "everywhere".

      --
      If God forks the Universe every time you roll a die, he'd better have a damned good memory.
    5. Re:format and rhymes by DinDaddy · · Score: 1

      I saw a Docomo poster in Tokyo that read "DOing COmmunications the MObile way". If that's the basis of their name, not sure how the Japanese "alphabet" enters into it.

    6. Re:format and rhymes by wasme · · Score: 1

      The Japanese love to come up with abbreviation with double meanings.

      Even more so if you can work some English into it.

      So, as newcastlejon mentions above, DoCoMo was picked because it was an abbreviation of an English phrase *and* when pronounced became the Japanese word for 'everywhere.'

  13. Re:Both by Chuckstar · · Score: 2

    Yes. But everyone (users and network providers alike) would rather that users' data usage focus on data the user actually wants, and less on "checking in" with various servers. I would think users would be just as annoyed to find out that Android handsets are really using 10x the bandwidth on idle tasks as other handsets (assuming it is true, that is).

  14. A little less vague? by vlm · · Score: 3, Interesting

    So I've got one of them gen-u-ine android phones. Which apps are supposedly hammering the network?

    My guess is the GOOG latitude GPS plotting thingy must be updating fairly often. So in the big list of blacklisted apps, I've got one "i donno maybe guess".

    This is important to me because my batteries life is very short... Enabling latitude position tracking thingy meant my battery died in about 10 hours (which is an issue for a guy who works 10 hour shift bracketed by a modest commute), so I shut it off, gaining me at least 6 more hours, making it very easy not go thru a working day without charging. I wonder if I disable "something else" if I'll magically gain yet another 6 hours... or more...

    --
    "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
  15. Re:Both by getto+man+d · · Score: 2

    Oh yes, the providers (at least in the US) are well aware of this trend. It's reflected in the current data usage pricing scheme and the "unlimited" plan max caps.

  16. Re:Both by JavaBear · · Score: 1

    "Perhaps Google could come up with a standard for pushing all these control signals and keep alives through a single gateway. That way apps could piggyback on each other to reduce traffic."

    That is actually a very good idea, but it will add latency. Then again, a little latency on a line updated perhaps once every 2 minutes would hardly be the end of the world.

  17. Re:Both by poptix · · Score: 2

    Google already has a standard for pushing those control signals over a dedicated persistent TCP/IP connection (when your signal indicator goes from white to green it's connected). Many apps choose not to use it for one reason or another, Facebook Chat for example posts a huge XML request every minute or so to poll for new messages.

    Also, Jabber sucks mostly due to its use of XML.

    --
    Just because you disagree doesn't mean it's not true.
  18. Re:Both by sgt+scrub · · Score: 1

    Isn't there SSH for Android? You could tunnel specific traffic through it like a VPN. If it works for you then set up VPN and forward everything through it. Also, last time I looked ejabberd had extensions for most all of the IM services. They might have modules that can work, or be modified to work, for your social media site(s).

    --
    Having to work for a living is the root of all evil.
  19. Re:Both by Anonymous Coward · · Score: 0

    I was with you until "XML is fine."

  20. I don't see it by hawguy · · Score: 1

    TFA:

    Typically these occur as often as every 3 minutes, but scale that up to thousands of apps on millions of handsets and you can see the issue DoCoMo has

    I still don't see the issue they have... what is the issue? What are these "control signals"... is it TCP traffic or cellular network control signals? What resources are they consuming? Have other carriers had the same kind of problem or is it specific to DoCoMo? What update frequency do they recommend if 3 minutes is too often? 4 minutes? 6 minutes? 60 minutes?

    1. Re:I don't see it by viperidaenz · · Score: 1

      Perhaps DoCoMo are the first to have these issues as they have over 57 million customers, half the entire Japan market which is made up of high (the highest revenue per customer in the world) value customers (read: lots of data usage).

    2. Re:I don't see it by Suhas · · Score: 1

      Not to mention all those customers crammed into an area smaller than California.

    3. Re:I don't see it by YoopDaDum · · Score: 1

      It's cellular level signaling. To save battery the mobile device should spend most of its time in idle mode. In this mode the device mostly sleeps, and wake-up only for a short duration every paging cycle (from 640 ms to 2.56 s typically) to listen for a possible paging from the network telling it to wake-up because there's data to receive. In this idle mode, the device does not transmit, and only receive a few milliseconds every paging cycle. The UE will perform a sort of keep-alive (location tracking really), but only infrequently. So idle is very power efficient.
      Also, in idle mode the base stations do not track the mobile at all. It's state is still remembered in the network thought.

      Now, when the application level does its polling on top of IP, this will take the mobile our of idle mode and it will have to reconnect.
      First, it will have to establish a link to the nearest base stations. Using a contention channel, as the base station doesn't yet know about it. The contention channel is the first signaling resource used.
      Then, the BS (NB in 3G or eNB in LTE) will have to fetch the mobile context from the back-end. This lead to further signaling between RAN and core network.
      Then, the IP link is operational again, and the stupid couple application IP level polling packets that do nothing but tell "I'm still there" can happen.
      Then, the mobile will stay active for a while. Because there's no link between the application and radio layers, the radio layer will only put back the mobile in idle mode after some inactivity timeout. While the mobile is active, some channel maintenance is required that will consume some radio resources.
      And, at last, the mobile will go back to sleep.

      As you can see, this is inefficient in the extreme. It's really really bad, anyway you take it. Major waste of resource and battery. And it can be done otherwise using a centralized slow polling at least (even better if the back-end uses the radio network status instead of doing its own polling, but that would just be icing on the cake). It's just that application developers need to understand wireless is not wired, and use the proper tools to be efficient. In other words, it's a problem of education (for everyone: broadband data over wireless at scale is still young).

  21. There are limits though by Sycraft-fu · · Score: 4, Informative

    The problem is that pesky Shannonâ"Hartley theorem. Basically it says that your data throughput is equal to your channel bandwidth and SNR. With a wired connection, there's a lot you can do there. With wireless, there's serious limits. SNR is fixed by environmental conditions, unless you are willing to up the S part a lot which requires lots of power and thus isn't suitable for mobile.

    Bandwidth is limited since you have to share the airwaves with lots of stuff and certain frequencies are good for certain things. So going with 60GHz might sound great because a 1GHz channel would be no problem, but you find that it has trouble with attenuation due to water in the air, never mind walls. 700MHz cuts through walls pretty nice, but your channel will be much smaller.

    Then of course there's the real sticking point: You share with everyone else in the same area. If your throughput is, say, 100mbps total you are sharing that 100mbps between anyone on the same segment as you. So have 100 users, all trying to go full blast and you'll each get 1mbps or so.

    The only solution is to build out the segments smaller. However there's limits to how much of that you can do. You can't realistically segment the network down to an arbitrarily small level.

    The "JUST UPGRADE THE NETWORK!" thing that geeks like to scream is very unrealistic in the case of wireless. Yes, with fibre we can have shit tons of bandwidth, when you are talking carriers in the hundreds of Terahertz, you can have some bigass channels, you can have lots of channels, SNR is quite good in fibre and you can always just lay more of it. However wireless has some real physical limits you butt up against.

    We have to accept that when you are using wireless, especially longer range wireless, that there are limits to deal with.

    1. Re:There are limits though by ColdWetDog · · Score: 4, Funny

      The problem is that pesky Shannonâ"Hartley theorem

      Well, since it's just a theory, it probably isn't true. Like evolution and such.

      So, just ignore it.

      --
      Faster! Faster! Faster would be better!
    2. Re:There are limits though by viperidaenz · · Score: 1

      Except it is not that simplistic. The cellular networks use code division, which lets users transmit over the air simultaneously, dramatically increasing the bandwidth available.

    3. Re:There are limits though by doshell · · Score: 4, Insightful

      CDMA techniques do not get you a free pass around Shannon-Hartley's channel capacity theorem.

      --
      Score: i, Imaginary
    4. Re:There are limits though by Anonymous Coward · · Score: 1

      Exactly. In CDMA, one man's signal is another man's noise.

    5. Re:There are limits though by L1mewater · · Score: 1

      I know it's just a joke, but it's worth pointing out that "theorem" and "theory" are not synonymous.

    6. Re:There are limits though by Anonymous Coward · · Score: 0

      With a wired network, you get around the Shannon-Hartley theorem by building more separate cables, each of which gets its own band. With a wireless network, you get around the Shannon-Hartley theorem by having a denser network of cellphone towers; hence smaller cells, fewer phones per cell sharing the same band, and more band available per phone.

      So yes, you can improve data rates by upgrading the network. Put a nanocell tower on every office building - they've already got power and data hooked up, so piggyback on that. The obstacles are administrative, not technical.

      Ultimately, if we reached the limit of one tower per phone, we could make further improvements by having multiple antennas per phone. It takes a lot of signal processing to disentangle the very-slightly-different signal paths that each antenna receives, though. Wait a few decades for the power requirements to come down to something a phone battery can handle.

  22. Re:Both by Kagato · · Score: 1

    I tend to agree. I would say that Phones in Japan have been much smarter and data heavy than the US equivalents for some time. So it's not like the Android phones are replacing a bunch of Nokia Feature phones. For that reason I also think NTT DoCoMo knows what it's talking about as far as optimization.

  23. Re:Both by Blue+Stone · · Score: 1

    Maybe there should be a rating system for apps (and the phones themselves) similar to the Energy Star Rating, but for data instead.

    --
    Corporation, n. An ingenious device for obtaining individual profit without individual responsibility. - Ambrose Bierce
  24. Re:Both by Anonymous Coward · · Score: 1

    XML is fine, but hardly the most efficient way to transmit data, especially not without compression.

    When can always tell when you have a VERY inexperienced developer - they think XML is a silver bullet to everything. In the vast number of cases I've come across XML in use, it should have NEVER been used nor even considered.

    If you're a developer and you've used XML for local application configuration, please put a barrel in your mouth and pull the trigger. Interestingly enough, a disproportionate number of these developers seem to develop on Java as their primary language.

  25. Re:Both by shutdown+-p+now · · Score: 1

    Perhaps Google could come up with a standard for pushing all these control signals and keep alives through a single gateway. That way apps could piggyback on each other to reduce traffic.

    The catch is that you then need to migrate the existing protocols to use that service. End result, we end up with a bunch platform-specific protocols (push for iOS, push for Android, push for WP etc).

    A big attraction of Android for myself is that it's the only mainstream mobile platform that lets you use existing protocols, because apps can just open a socket and do what they need to it, even in background. Meaning you can write a Jabber or ICQ client that connects directly to existing servers, without going through Google's servers, or those of the app author.

  26. Re:NTT DoCoMo is the standard gold of mobile netwo by interval1066 · · Score: 3, Interesting

    So what? The world is heading to MORE digital data usage, not less, that's a fact. And the prices for use are going to drop, that's also a fact. Maybe NTT DoCoMo needs to up their capacity, not worry about throttling it so much. Words all providers need to take to heart.

    --
    Python: 'And then suddenly you have a language which says "we're all stuck with whatever the whiniest coder wants".'
  27. Re:NTT DoCoMo is the standard gold of mobile netwo by Andy+Dodd · · Score: 5, Insightful

    Considering that Google has a SERIOUS interest in making control signal intervals as long as possible for battery life purposes - if they are too often, the carriers only have themselves to blame. Too many carriers have aggressive NAT firewalls with short TCP connection timeouts, and it's much better for the handset AND the carrier to send a keepalive within that timeout period than to have to detect a dead connection and set up a new one.

    Google "netpiculet" or look at my last post earlier on this article for an eye-opener of how network providers shoot themselves in the foot.

    If Google is sending control signals too often - DoCoMo should take it up with the carriers that deployed broke-ass NAT boxes that forced Google to do this.

    --
    retrorocket.o not found, launch anyway?
  28. Re:Both by Andy+Dodd · · Score: 4, Informative

    They already do - it's called Cloud to Device Messaging (C2DM).

    If C2DM is sending syncs/keepalives every 3-5 minutes, it's because broken carrier NAT boxes are forcing them to.

    http://conferences.sigcomm.org/sigcomm/2011/slides/s374.pdf

    --
    retrorocket.o not found, launch anyway?
  29. One more option by Ichijo · · Score: 1

    So, does DoCoMo need to invest more in its infrastructure, or is Android a data hog that needs reigning in?

    Given that this is a shortage, and that a shortage is when demand exceeds supply, DoCoMo can either add supply by investing in its network, or they can reduce demand by raising the cost of bandwidth, at least during peak periods. This gives DoCoMo two options to eliminate congestion on its network.

    Raising the cost of bandwidth could be done pretty easily by setting caps on peak hour data usage.

    --
    Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  30. Re:NTT DoCoMo is the standard gold of mobile netwo by Pieroxy · · Score: 1

    I pretty much agree. Plus, upping their capacity will make them reduce power emissions from their antennas which will calm down the GSM-is-microwave freaks.

  31. Which app? by Andy+Dodd · · Score: 1

    Was this a third-party app or an official Google app? If it's third-party, Google has no control. One packet every 3 minutes is, honestly, pretty damn good for some apps. Skype can cause a device to wake up once every few seconds (which is the main reason it's an epic battery hog).

    Google's own apps are about as efficient as they can be in order to minimize periodic data, because keepalives and checkins wake the device, draining battery. The problem is that some major carriers have broken NAT boxes ( http://conferences.sigcomm.org/sigcomm/2011/slides/s374.pdf ), forcing Google to reduce keepalive intervals so that these carriers don't kill TCP connections - which forces an expensive (in terms of time, battery, and network resources) connection setup sequence.

    --
    retrorocket.o not found, launch anyway?
    1. Re:Which app? by TuringCheck · · Score: 1

      Even worse, having some type of Instant Messenger connected will cause a lot of traffic with friends coming on and off-line. I see pople having hundreds of friends online at any time.
      GTalk for mobiles (not only Android) already tries to address these issues by pooling together updates. This sucks. The overall result is making mobiles 3rd world parties in the Internet game.
      When I go online from a desktop I appear online in seconds on other desktops. On a mobile it may take several minutes to be noticed. Go on and off-line a few times and the situation can become very confusing - a stale state may persist for hours.

  32. Precedents by carrier+lost · · Score: 1

    ...does DoCoMo need to invest more in its infrastructure, or is Android a data hog that needs reigning in?

    640k ought to be enough for anybody.

  33. Well FU. by Anonymous Coward · · Score: 0

    *YOU* started it by superlow tcp timeouts. Give the users a public IP without double- and tripple-nat that's mainly intends to screw with our sessions for profit-maximisation (by breaking IM and voip-apps), *then* you can demand that users don't use the data their ****** PAYING for!

  34. Re:Both by Dog-Cow · · Score: 1

    iOS lets you do this.

  35. sigh, false dichotomy by John+Meacham · · Score: 1

    I know it makes articles sound more dramatic and controversial, but sometimes the answer is obvious:

    "So, does DoCoMo need to invest more in its infrastructure, or is Android a data hog that needs reigning in?"

    The answer is clearly "both". Apps and android should optimize their data usage, doing so increases battery life and gives a better user experience all around. If DoCoMo is identifying particularly troublesome apps, then that is helpful to decide where to start hacking. _Also_, DoCoMo should be upgrading its infrastructure. It is clear that data use will only rise, and they certainly would like to have more customers, apps reducing their usage is a good thing, and will create a better experience, but not a solution to the problem that people actually have uses for all that data, and said usage will grow.

    --
    http://notanumber.net/
  36. Re:Both by Dog-Cow · · Score: 1

    I hate XML more or less as much as the next guy, but it has one advantage not really shared by any other format: every relevant development environment has libraries out the wazoo to manipulate it. That means less custom parsers and crap that is likely to introduce bugs.

    Cocoa Touch, for example, uses plists, which are XML when stored in text form, extensively. The framework classes have lots of support for them, including loading and saving class hierarchies with a single method call.

  37. lol by Charliemopps · · Score: 1

    So after Google tells them to go screw themselves, what are they going to do? Ban the operating system?

    The solutions to these problems are simple. If you have 100 customers, and you have 100MB/s of bandwidth on your network, don't sell them all 5MB/s plans. ITS SIMPLE MATH. To blame this on Google is like an all-you-can-eat buffet complaining to a local taxi service that they're dropping off too many fat people. Who do you expect to pay for all-you-can-eat? Twiggy?

  38. Re:Both by shutdown+-p+now · · Score: 1

    Does iOS lets an app in the background keep a socket open to a random port for an indefinite time period?

  39. Network usage by Anonymous Coward · · Score: 0

    Seems like they really shouldn't oversell their network.

    You can't offer high end services and phones and expect people not to use them. This sounds awfully familiar to North American telecos offering Unlimited* service and complaining when users actually use their bandwidth.

    1. Re:Network usage by Anonymous Coward · · Score: 0

      Seems like you should see the absurdity in your statement.

      It's the war cry of the geeky idealists that a telecom system should be designed to handle 100% utilization from 100% of the users 100% of the time. Were the network designed that way, cellular service would cost $10,000 per month.

      Go take a class in economics and then come back and contribute something useful to the discussion.

  40. Re:Both by Samantha+Wright · · Score: 1

    The primary reason mobile IM programs like eBuddy for iOS use bouncing servers isn't a technical necessity. There are plenty of IM programs that go straight to the source, in fact; even IRC, FTP, and SMB clients exist. One reason that eBuddy in particular connects through its own server is to provide an answering service, like an IRC reverse proxy. Simply put, it caches messages when you're out of signal range; if you have something like an iPod touch with no ubiquitous cell tower coverage, this is quite useful. (Of course, it also lets them read your stuff, but fortunately there are plenty of alternatives.)

    --
    Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
  41. Re:NTT DoCoMo is the standard gold of mobile netwo by tlhIngan · · Score: 4, Interesting

    I live in NYC and rarely have any problems getting a signal on AT&T. Actually getting any data or calls to my phone over that signal, however, is a distinct challenge. ;-)

    I often experience dropped calls and slow data rates while my phone happily shows "5 bars" of signal.

    That's because AT&T is suffering from the same problem NTT DoCoMo is suffering from - control channel congestion. You're getting 5 bars alright, but the big problem is stuff like dialing and establishing data connections consume control channel bandwidth. Dropped calls happen because your phone's trying to switch towers and can't because it can't get a word in edgewise on the control channel.

    Slow data ditto - the phone on 3G needs to establish multiple PDP data sessions to get 3G speeds, and if it can't talk to the tower because the control channel is busy, well, it suffers.

    Control channel congestion (caused by all this plus texting) is why AT&T service can be horrible, despite having plenty of free channels available for data and voice. It's what took T-mobile down once (a bad IM app overloaded the control channel).

    Think of it as the old-timey POTS phone days where you lifted the handset and told the operator who you wanted to talk to. And now have lots of people do the same and the operator's now overloaded trying to establish and tear down connections, leading to phone calls not going through, the operator not responding to you, etc.

  42. Re:Both by Anonymous Coward · · Score: 1

    Perhaps Google could come up with a standard for pushing all these control signals and keep alives through a single gateway.

    That's called blackberry push technology. Some company called RIM came up with it more than a decade ago.

    Maybe people should actually use it...

  43. Let me see here... by fish_in_the_c · · Score: 1

    Should Android be more efficient, and every app it runs. OF COARSE. There is not such thing as efficient enough, but Google has to decide if it is worth
    their money right now.

    Should the network provide stop wining because their network is running up against the physics of
    allowing too users on it and just fix the problem. Probably.

    Sorry, but don't take on more subscribers then you can service. And if their are devices that you don't like their affect feel free to ban them.
    If that doesn't make you money , that's called business. It's balance. Either provide what people want , or go out of business.

    --
    âoeTolerance applies only to persons, but never to truth. Intolerance applies only to truth, but never to persons.
  44. Re:Both by viperidaenz · · Score: 2

    If you're a developer and you've discounted a valid option purely because other people misuse that option then please, put a barrel in your mouth and pull the trigger.

  45. Sprint on iPhone network effeciency by __aazsst3756 · · Score: 0

    Sprint's Dan Hesse said the iPhone is so data-efficient, it will help Sprint keep its mobile data plans unlimited. He claims they do not ping the network near as much, and are better at handing off data to wireless networks. http://www.forbes.com/sites/elizabethwoyke/2011/10/26/sprint-ceo-iphone-will-help-us-keep-unlimited-data-plans/ Assuming that was a comparison to Android?

  46. Re:Both by shutdown+-p+now · · Score: 1

    I understand that iOS apps can open sockets pretty much willy nilly. The question is, can they keep them open while they're in the background, and accept and respond to packets that come during that time? It would be a pretty useless IM client if it could only receive messages when it's opened.

    From what I've seen in the App Store with respect to XMPP clients, my understanding that the only way to receive any kinds of network notifications in background is to use Apple's push service, so existing protocols don't just work. At least I don't know how else to explain why all apps that connect directly to my XMPP server don't support notifications (e.g. Crosstalk, Monal, Talkonaut, Jabba and many others). OneTeam supports push, but only with a proprietary server extension (which I believe routes it through the regular Apple push stuff).

  47. Re:Both by dargaud · · Score: 1

    Yeah, that and a way to tell some apps to only use wifi when available and never 3G.

    --
    Non-Linux Penguins ?
  48. Re:NTT DoCoMo is the standard gold of mobile netwo by treeves · · Score: 1

    I'd guess they've already upped their capacity, and they probably think you should up yours.

    --
    ...the future crusty old bastards are already drinking the Kool-Aid.
  49. Just wait until Sili is released! by Anonymous Coward · · Score: 0

    *Then* they'll have bandwidth problems.

  50. Re:Both by treeves · · Score: 1

    Similar to Energy Star rating, but actually useful, would be a better criterion I should think.

    --
    ...the future crusty old bastards are already drinking the Kool-Aid.
  51. Re:Both by danbob999 · · Score: 1

    Just what we need. A proprietary protocol that only works with devices from one vendor.

  52. Re:NTT DoCoMo is the standard gold of mobile netwo by bloobamator · · Score: 1

    IANANetworkEngineer, but it sounds to me like you are saying we need a separate network for the handheld devices, to deal with the different TCP settings. Is that even possible with a cell carrier? Can we do something like a VLAN?

    --
    "Crude and slow, clansman. Your attack was no better than that of a clumsy child."
  53. Re:Both by Samantha+Wright · · Score: 1
    OS News discussed this in an Android review:

    In iOS, application programmers can only perform the following seven tasks in the background:

    Background audio - application continues to run in the background as long as it is playing audio or video content
    Voice over IP - application is suspended when a phone call is not in progress
    Background location - application is notified of location changes
    Push notifications
    Local notifications - application schedules local notifications to be delivered at a predetermined time
    Task completion - application asks the system for extra time to complete a given task
    Fast app switching - application does not execute any code and may be removed from memory at any time

    So basically, no; the program is suspended if it isn't using one of these facilities. The OS obviously supports true multitasking, and there is a Cydia program called Activator which lets you control how individual programs behave, but it no longer works on iOS 5, and Apple tries to sandbox app developers as much as possible to control this component of the UI experience. Their reasoning, whether you agree with it or not (and I don't think many geeks do) is that such constraints prevent "Where is my battery going?" moments for the especially non-technical. Apparently ensuring the approval of this portion of the market was more important than permitting the flexibility that true multitasking obviously allows. Since Apple makes money anyway, they can always offer to remove these artificial limitations in a later update.

    But don't get too upset over that last part about money—the fact that Apple gets a cut of every single sale is still way more unnerving.

    --
    Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
  54. Re:Both by Anonymous Coward · · Score: 0

    Yeah, that and a way to tell some apps to only use wifi when available and never 3G.

    Android already has that. You can also restrict apps to only use the mobile data network if they are not in the background.

     

  55. Re:Both by Suhas · · Score: 1

    >Also, Jabber sucks mostly due to its use of XML. Well, the solution is simple enough. XML is like violence, If it doesn't work the first time, use more!

  56. Core network packet switch capability issue by Anonymous Coward · · Score: 0

    DoCoMo has admitted that their core packet switcher capacity is insufficient. The recent downtime they had, they hit 16 something packets/sec when the system only had capacity for 14. And they are predicting hitting 20 soon. Apparently they use some sort of traffic prediction capability to manage their network, but how that is applied (edge/tower throttling?). So this is basically DoCoMo saying they were woefully unprepared for the smartphone revolution in terms of network capability (but note this is not necessarily an issue of bandwidth at the tower level, since japan has an enormous concentration of towers). They were halfassing smartphones only a year or two ago, and doing network gear rollouts are multi-year endeavors, so their earlier plans are now inadequate. DoCoMo and the other carriers are already throttling inside the core Tokyo area at the tower level it seems as a temporary measure to cover their core inadequacy. DoCoMo got caught with their pants down on smartphones since imode seemed to be king here until the iPhone showed just how bad the dumbphones here were in terms of usability.

    They try to blame the recent disruptions on Google and a domestic android VoIP app service. DoCoMo's only solution is to spend the big money on their core network that they haven't been doing enough of. But they've been blowing their wad on their 3.9G LTE rollout (Xi).

    A secondary issue is that DoCoMo is EoL their MOVA(2G) service since they have to vacate a frequency band, so you have a lot of people switching up to new data intensive dumbphones and smartphones running on FOMA(3G-UMTS). The deadline is March to jump up before service is cut, so perhaps the recent performance problems in the last 6 months may be attributable to the changeover users upgrading and blowing out the UMTS infrastructure that was installed quite a while ago and will not be upgraded (likely replaced with Xi(3.9G-LTE)).

  57. IPv6 by jprupp · · Score: 1

    I wonder why nobody mentioned it, but moving to IPv6 will largely mitigate the issue. Every device will be able to have a public IPv6 address and keepalives don't have to be frequent to cater to evil NAT boxes. As a fact, keepalives will not be needed at all at the network level, but only in the application if it is to provide presence notification. Think UDP over IPv6.

  58. Re:NTT DoCoMo is the standard gold of mobile netwo by YoopDaDum · · Score: 2

    Exactly. And increasing control channel capacity is not free, as it reduces resources available for users data. Plus the control channel need robust encoding so are comparatively more expensive than data on average. Plus the standards have some flexibility on dimensioning control channels, but it's not fully flexible either. There's some assumption built in.

    So operators may increase the amount of resources allocated to signaling, but this is only possible up to a point and would reduce data capacity (so increase cost per user level data).

    So the way to get out of this with everyone wining is to make sure mobile phone applications use the network efficiently, and don't waste signaling capacity just out of ignorance. It seems both Google and Apple provide centralized polling / notification services already, so blaming them may be unfair. But I'm pretty sure there's a lot of developer education still to do. And maybe adding tools in the platform to see what are the wasteful applications would help. Knowledgeable users could spot the offenders, and make some noise so they improve their behavior.

  59. Re:Both by YoopDaDum · · Score: 1

    It doesn't need to add latency: if you replace polling with push notification you will both use the mobile network more efficiently AND reduce latency. So as far as latency goes optimizing for mobile can really be win-win.

    The only fundamental con is that you need to optimize the application for mobile. To use a centralized optimized push notification service instead of each application doing its own polling for example. But I don't think there's a way around that: a wireless network is fundamentally different from a wired network, and if you treat mobile as a wired network you will use the network inefficiently (both increasing signaling usage and decreasing useful data capacity, and draining battery).

    Broadband wireless data is still pretty new, with a lot to learn on both sides. I'm not sure playing the blaming game as DoCoMo does will help much, but there's still a lot to improve for sure (even inside telcos, where the IP network guys may not do the most efficient things for the radio network part).

  60. Re:Both by YoopDaDum · · Score: 1

    Interesting, and it goes on to show that even inside the telcos the IP network guys do not necessarily know what to do to best use the radio access network (which is the scarce resource to optimize for). So blaming developers or Google as DoCoMo does is not very fair. There's some learning to do all around I'd say.

  61. Android push study shows the problem by Anonymous Coward · · Score: 0

    There is a nice study on this topic from last year, showing why Android push protocols (the control signals being referred to in the article) can be data hogs. Although the same can be said for push-based protocols on iPhone I guess.

    A paper and a presentation available here:
    https://sites.google.com/site/sachinkagarwal/home/publications-talks/gis-2011-infocom-2011

    In particular,
    https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxzYWNoaW5rYWdhcndhbHxneDoyMDVmZTBjYzU3MGQ5MmI2&pli=1

    Slides 7,8,9 where the author says that multiple HTTPS connections are being continuously maintained by the Android device.

    Abstract:
    "Push message delivery, where a client maintains an “always-on” connection with a server in order to be notified of a (asynchronous) message arrival in real-time, is increasingly being used in Internet services. The key message in this paper is that push message delivery on the World Wide Web is not scalable for servers, intermediate network elements, and battery-operated mobile device clients. We present a measurement analysis of a commercially deployed WWW push email service to highlight some of these issues. Next, we suggest content-based optimization to reduce the always-on connection requirement of push messaging. Our idea is based on exploiting the periodic nature of human-to-human messaging. We show how machine learning can accurately model the times of a day or week when messages are least likely to arrive; and turn off always-on connections these times. We apply our approach to a real email data set and our experiments demonstrate that the number of hours of active always-on connections can be cut by half while still achieving real-time message delivery for up to 90% of all messages."

  62. Re:NTT DoCoMo is the standard gold of mobile netwo by Anonymous Coward · · Score: 0

    or they could just deploy ipv6 and avoid the need for broke-ass NAT boxes mucking around with the content of user's TCP sessions and packets.

  63. Re:NTT DoCoMo is the standard gold of mobile netwo by ace123 · · Score: 1

    It's funny that you say that, because based on (admittedly half year old) data that an app developer collected about reconnect rates, Japan was by an order of magnitude the worst country with regards to number of reconnects that this app had to perform (DoCoMo was the second-to-worst carrier around the world).

    Reconnects happen because the cell carrier closes a connection or times out--a good cell carrier won't change your IP address or RST your connections when you switch towers, but a bad one might decide to assign a new IP address each time. On some apps, reconnection may consume up to 1MB of bandwidth each time as they attempts to resync data (Yes, good apps shouldn't do this, but I have seen it happen.)

    The problem is not Android -- the problem is the shitty QoS that most mobile carriers put on their networks, combined with the fact that they often kill connections at the NAT layer without notification, time out connections over unwanted ports and block protocols that they don't like.

    The end result is that everything on a cell network has to happen over port 80 or port 443, with the SSL negotiation overhead that involves, combined with sending keepalives every 4 minutes. Yes, Android is unoptimized. DoCoMo might be doing everything right, but they bear the price of all of the terrible cell carriers that go out of their way to block data (AT&T, T-Mobile, I'm looking at you). Android 4.0 has a Data usage monitor that helps a ton in debugging misbehaving apps, but data is a fact of life.

    That said, Apple may have made a good decision by forcing app developers to use push notifications when the app is in the background. Android messed up push notifications by tying them to Google Talk and Android Market -- this means apps that require push will not run on a large fraction of android devices around the world (including the Kindle Fire). The result is that apps don't use push and implement their own (often buggy/wasteful) push system.

    Finally, if DoCoMo doesn't want users to send/receive data, then limit their bandwidth for crying out loud. Don't whine when you provide fast service and people use it. What is complaining to the OS manufacturer going to do? They provide a platform, not the apps or the service they run on.

  64. Re:NTT DoCoMo is the standard gold of mobile netwo by ace123 · · Score: 1

    Yes, if I had mod points, I'd mod you up.

    I'm an app developer, and I've had to deal with countless network problems (usually NAT's dropping connections without RST) that ended up being resolved by stupid strategies like "f it, lower the keepalive interval to 5 minutes", and killing a connection if it was not ack'ed in X seconds (you can be more agressive with killing TCP connections by adding protocol-level acks on client&server).

    But despite this, I've managed to reduce bandwidth greatly by making my protocol independent of TCP connection -- in other words, I connect, tell the server who I am, and keep going with my connection, slowly making forward progress even if my layer 3 connection is killed every few seconds. At this point, TCP port 443 becomes basically a heavyweight datagram protocol (with a SSL handshake) because you can't rely on anything.

    I'd rather use push notifications, but they have two glaring holes: 1) You can't rely on messages arriving on time. This means it's useless for a VOIP app where you expect it to ring within a few seconds. 2) Google C2DM requires that you have android market installed. This means your app won't work on half the phones around the world.

  65. It's a business negotiation. by KramberryKoncerto · · Score: 1

    DoCoMo would be stupid to just sit there and yell, but it's never wrong to ask Google to take some burden, especially as they make money from each other.

  66. Re:Both by Anonymous Coward · · Score: 0

    They are japanese, so they think like bureaucrats, that is their culture.
    I hate to see them do that :
    A - We have a problem
    B - Who is responsible?
    A - I dunno ... Not me!
    B - Not me either, let's find the(it means a, one, anyone here!) culprit
    A - Not me, not you ... I know there is the third parties, I never liked them ...
    B - Me neither, we help them make money and not a thank you or an access fee!
    B - You hear me C, get your act together and fix this! It is your mess after all! And really quick or we'll ask for damages in court!

    PS: the captcha was profits (!), it is priceless ;)

  67. Re:NTT DoCoMo is the standard gold of mobile netwo by Chuckstar · · Score: 1

    The article claims Google's notification system is particularly egregious.

    Also, Apple's system should be differentiated at least to some degree. Android gives developers more opportunity to utilize the network in the background. Apple's APIs give developers much less leeway in that regard.

  68. Re:Both by Half-pint+HAL · · Score: 1

    Way to be racist, dude. The important thing (as noted in multiple parts of this thread) is that C2DM is part of the Android Marketplace, not part of Android. If you don't have an Android Marketplace-compatible phone, you don't have C2DM. And that means that most Android devices in the world do not have C2DM.

    --
    Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
  69. Re:NTT DoCoMo is the standard gold of mobile netwo by Andy+Dodd · · Score: 1

    At that point you're probably better off writing your own reliability protocol layered over UDP...

    --
    retrorocket.o not found, launch anyway?
  70. Re:NTT DoCoMo is the standard gold of mobile netwo by Andy+Dodd · · Score: 1

    That's one thing I wish wireless providers would "get" - rather than marketing insanely high transfer rates with ridiculously low caps, they should sell tiered rates...

    The T-Mobile and AT&T "unlimited" policy of full speed up to a ridiculously restrictive throttle wall is ridiculous - it makes FAR more sense to reduce the initial speed, and make the throttle a little gentler. If throttling of high users weren't so severe (a "soft cap" that degraded as your usage got higher, instead of a "hard threshold" after which your device is nearly unusable) people wouldn't be so damn pissed off.

    I would have no problem with trading peak and average speeds in order for not worrying about "brick wall" overage thresholds. Plus, this would be better for the network - instead of congestion when people's billing cycles reset the limits, data would be spread more evenly over the month.

    --
    retrorocket.o not found, launch anyway?
  71. Re:Both by Andy+Dodd · · Score: 1

    "Perhaps Google could come up with a standard for pushing all these control signals and keep alives through a single gateway. That way apps could piggyback on each other to reduce traffic."
    They already have it - it's called Cloud to Device Messaging (C2DM).

    --
    retrorocket.o not found, launch anyway?
  72. Re:Both by Andy+Dodd · · Score: 1

    My experience was that until the Kindle Fire, most Android devices around the world DID have the Market and C2DM.

    The Kindle Fire is the first Android device other than cheap Chinese KIRFs that I've seen without Market support. It's the first device to actually sell in any significant quantity without Market support.

    --
    retrorocket.o not found, launch anyway?
  73. failure by Anonymous Coward · · Score: 0

    If you can't handle the data use, stop selling the phones in such high quantities. I have no sympathy for cellular providers. They were blind with greed for years seeing how profitable smartphones can be, and now when they have finally sold millions and millions they try to blame anyone but themselves for their networks shortcomings.