Slashdot Mirror

← Back to Stories (view on slashdot.org)

Office 365 Users in Europe, Asia, and Americas Who Have Enabled Multi-Factor Authentication (MFA) Are Impacted by an Outage (theregister.co.uk)

Posted by msmash on from the outage-report dept.

New submitter neo00 writes: Office 365 users in Europe, Asia, and Americas are impacted by a wide-spread outage causing users who have Multi-Factor Authentication (MFA) enabled by default policy to be unable to login to Office 365 and other services reliant on Azure Active Directory. According to The Register: "Microsoft confirmed that there were problems from 04:39 UTC with a subset of customers in Europe and Asia-Pacific experiencing 'difficulties signing into Azure resources' such as the, er, little used Azure Active Directory, when Multi-Factor Authentication (MFA) is enabled. Six hours later, and the problems are continuing."

The Office 365 health status page has reported that: "Affected users may be unable to sign in using MFA" and Azure's own status page confirmed that there are "issues connecting to Azure resources" thanks to the borked MFA."

Official Azure status updates are published here.


72 comments

  1. I'm relieved by bensafrickingenius · · Score: 4, Interesting

    I've been battling this all morning -- took a break to read some Slashdot. :-) I guess I can stop battling it now!

    --
    I am not left-handed, either!
    1. Re:I'm relieved by Anonymous Coward · · Score: 4, Insightful

      The best thing about going to the cloud, is when something breaks because of Microsoft your clients believe you.

      When it's in house, the accountants ALWAYS think it would be better on the cloud....

    2. Re:I'm relieved by The+Original+CDR · · Score: 1, Funny

      Thank God for Minesweeper!

    3. Re:I'm relieved by jellomizer · · Score: 1

      True,
      But how many times has this happen with Microsoft, vs it happening in your office. This is the first time I heard about this particular problem from Microsoft. But if you had it in house it could happen every few months.
      Putting your pride as a system admin aside, You rarely can keep an eye on all services all the time.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    4. Re:I'm relieved by smooth+wombat · · Score: 4, Insightful

      But how many times has this happen with Microsoft, vs it happening in your office.

      On Friday, no one could use our new Microsoft VPN's MSMFA. We had to wait until late Friday, after working hours, for whatever patch/update/change was made to be rolled back before it worked.

      Today we have MFA (which sucks in general) going wonky.

      Not long ago we had the latest "upgrade" to Windows 10 deleting people's files. Fortunately it was never pushed out to the masses but only because non-Microsoft testers picked up on the issue.

      I could go on, but you should be getting the point. This is becoming a regular occurrence now that "the cloud" is the be all and end all to everything.

      --
      We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
    5. Re:I'm relieved by Anonymous Coward · · Score: 1

      When Tim in the local office breaks something, it breaks for twenty people.

      When somebody breaks "the cloud", it's broken for tens or hundreds of millions of people.

    6. Re:I'm relieved by Anonymous Coward · · Score: 0

      But how many times has this happen with Microsoft, vs it happening in your office.

      There was a similar problem a few weeks ago.

    7. Re:I'm relieved by spacepimp · · Score: 4, Informative

      This is the third significant outage to occur (impacting bulk users)in the three months since my company has been migrated to O365. There were some affected users last week as well with being prompted for repeated log ins to the servers.

    8. Re:I'm relieved by TechyImmigrant · · Score: 3, Insightful

      >But how many times has this happen with Microsoft, vs it happening in your office.

      For MS Office applications, never.
      They were local and you could just run them.

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    9. Re:I'm relieved by Joce640k · · Score: 1

      The best thing about going to the cloud, is when something breaks because of Microsoft your clients believe you.

      Governments don't care. They'll fine you just the same if you can't file the paperwork before midnight.

      --
      No sig today...
    10. Re:I'm relieved by Spinlock_1977 · · Score: 1

      True, but only 20 of those millions work in your office :-)

      --
      - The Kessel run is for nerf herders. I can circumnavigate the entire Central Finite Curve in a lot less than 12 parse
    11. Re:I'm relieved by SCVonSteroids · · Score: 3, Interesting

      Ever since we upgrade to 365 I get prompted 100 times a day for my password. Regardless if I ask it to remember. Regardless of any workarounds.
      Everyone here hates it too.

      I don't understand paying so much money for a product that works progressively worse with each iteration.

      --
      I tend to rant.
    12. Re:I'm relieved by Cro+Magnon · · Score: 2

      The best thing about going to the cloud, is when something breaks because of Microsoft your clients believe you.

      Governments don't care. They'll fine you just the same if you can't file the paperwork before midnight.

      Unless they can't because their Microsoft computers are down too.

      --
      Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
    13. Re: I'm relieved by Anonymous Coward · · Score: 0

      No, just 19. Dan died this morning, in a terrible coffee machine accident. We will miss him.

    14. Re: I'm relieved by Farmer+Tim · · Score: 1

      Yes, a terrible accident indeed, it’s hard to imagine how it could possibly have happened.

      On an unrelated note, I notice you’ve also been parking in my spot, I would advise against this in future.

      - Tim

      --
      Blank until /. makes another boneheaded UI decision.
    15. Re:I'm relieved by rtb61 · · Score: 1

      When you gives others total control over your systems don't be surprised when you lose control ;). They got exactly what they paid for ;D.

      --
      Chaos - everything, everywhere, everywhen
    16. Re:I'm relieved by Anonymous Coward · · Score: 0

      Aren't you that guy who blogs about marrying teenage girls?

    17. Re:I'm relieved by thegarbz · · Score: 1

      Causality fail. The cloud has nothing to do with it. Microsoft's QA/QC practices for Windows specifically is a load of crap. They offload to insiders who run a small subset of hardware, they don't respond to many of the bugs that are picked up by them and then they push it out to see how bad the situation really is.

      The key part is though that these quality issues rarely hit the corporate world that pays dearly the cloud services. However this cloud MFA issue does hit them. I have all sorts of problems at the moment since Microsoft's MFA secures our SSO sessions throughout our company.

    18. Re:I'm relieved by Anonymous Coward · · Score: 0

      Try this: buy the full Office suite and install it on PCs. Save the files to OneDrive (local and cloud). Call it "moving the editing to edge devices for better performance with cloud storage" so the accountants like it. New Boss, same as the old Bass.

    19. Re:I'm relieved by TechyImmigrant · · Score: 1

      For my writing outside of work, I just use latex. All text files and easy to keep locally and version controlled and backed up remotely on something like github.

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
  2. pftt... by Anonymous Coward · · Score: 1

    Investigation:
      Engineers have deployed the hotfix which eliminated a connection between Azure Identity Multi-Factor Authentication Service and a backend Service. The deployment of this hotfix took time to take effect across the impacted regions, primarily Europe and Asia-Pacific. Engineers have seen a reduction in user authentication errors as a result of this hotfix. As a consequence of this fix, engineers have determined that a subset of customers might not be receiving prompts (SMS, Call or Push (via the app)). Engineers are continuing to explore additional workstreams and potential impact to customers in other Azure regions to fully mitigate this issue.

    Brilliant: First hotfix... not really working... Second hotfix......close but still no sigar.... Third hotfix...
    And no answer on the most important part: Why a hotfix is required in the first place. Why did they, yet again, manage to get into a situation where Azure is FUBAR.

    Seems that teams in Microsoft are in a contest: Whcih team can annoy the customer the most...Windows 10, Azure, O365

    1. Re:pftt... by Anon-Admin · · Score: 2

      >And no answer on the most important part: Why a hotfix is required in the first place. Why did they, yet again, manage to get into a situation where Azure is FUBAR.

      Its no big deal. They only guarantee a 99% uptime so they have still met there SLAs

      This is why businesses required a 99.99% or better uptime.

    2. Re:pftt... by lgw · · Score: 5, Insightful

      Brilliant: First hotfix... not really working... Second hotfix......close but still no sigar.... Third hotfix...
      And no answer on the most important part: Why a hotfix is required in the first place. Why did they, yet again, manage to get into a situation where Azure is FUBAR.

      Back in 2014 MS decided that it no longer needed QA. All the QA people either left or moved into dev if they could. Since that time they've had one embarrassing mistake after another. Hardly a coincidence.

      --
      Socialism: a lie told by totalitarians and believed by fools.
  3. If only there were some way to prevent this by Anonymous Coward · · Score: 1

    Someone needs to figure out how to write software that doesn't need to rely on a third-party server to let you use it. I'm baffled as to how, but I feel like this problem isn't beyond SOMEONES pay grade.

  4. Good Ol' cloud by Anonymous Coward · · Score: 0

    I guess we all should expect outages when relying on the cloud. Sadly we've been talked into a dependency on cloud services that most likely has been oversold on its reliability.

  5. Cloud Upshot by DarkOx · · Score: 4, Funny

    I guess the upshot of having your business tied to the cloud is when you have an outage there is a good chance non of your competitors/customers/etc can do any work either!

    --
    Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
  6. The Cloud! by TheDarkener · · Score: 4, Interesting

    Move all your productivity to the cloud, they said.

    It will be more productive, they said.

    --
    It is pitch black. You are likely to be eaten by a grue.
    1. Re:The Cloud! by Anonymous Coward · · Score: 0

      Guaranteed improved uptime, they said.

      Easily managed systems, they said.

      Instant outage relief, they said.

    2. Re:The Cloud! by Freischutz · · Score: 2

      Move all your productivity to the cloud, they said.

      It will be more productive, they said.

      ... and there will be wonderful surprises, like this, and having to log in again into the Office 365 suite that you are paying a subscription fee for every time you cross a border. Then there is the Office 365 account management web interface which was (last time I logged in at least) divided into two separate sites on two URLs. I really miss the days when you just shelled out a lump sum for the software and installed it and entered a license code. No accounts, no subscription that you forget to update when you get a new credit card, no Office 365 license cheating detector that will always send you searching for your Office 365 account login/password when you need to get something done in a godawful hurry. The Cloud thing seemed like a good idea because it meant you could access your documents on your laptop, tablet and phone. Turned out that I always reach for the laptop because the tablet and phone apps generally just suck.

    3. Re:The Cloud! by argStyopa · · Score: 1

      "It will be more productive, they said."

      It was, they just didn't say for whom (HINT: Look at the 3 and 5 year trends for MSFT Stock)

      --
      -Styopa
    4. Re:The Cloud! by Anonymous Coward · · Score: 0

      I remember timesharing services like GEISCO and Compuserve and centralized (very large organization) VM/CMS. Yes, there were occasional outages, but seemingly fewer than with Azure and AWS and seldom lasting more than an hour or so. So what has changed with this move back toward centralized computing with terminals (aka thin clients) other than less reliability? When will PCs be reinvented?

  7. You need MFA to type a Word Document? by Anonymous Coward · · Score: 0

    2 passwords and a keyfob to use your rented computer. Unreal.

    These people deserve to have their stupid lives turned off.

  8. Microsoft, problems by Anonymous Coward · · Score: 0

    Enough said

  9. Re:You people need to STOP BULLYING ME... apk by Anonymous Coward · · Score: 1

    You should rewrite your hosts file with node.js and add it to npm. That way we could just run npm isntall apk-hosts to deploy it.

  10. The cloud.... by Anonymous Coward · · Score: 0

    A computer elsewhere fails, and you annot write your reports. And physical copies of office are pretty much impossible to buy...

    It seems libreoffice takes the libre to another level. Doing work in your computer independent from the network? Mind...blowing...

    1. Re:The cloud.... by mspohr · · Score: 2

      People pay to use a word processor?

      --
      I don't read your sig. Why are you reading mine?
    2. Re:The cloud.... by MrKevvy · · Score: 1

      I don't know any people that do. Enterprises, aka business and governments, do, mostly for liability and accountability so they don't get sued for using an unwarranted free product when things go wrong, or for interoperability issues, etc. Basically, they are paying for someone to blame.

      --
      -- Insert witty one-liner here. --
    3. Re:The cloud.... by mspohr · · Score: 2

      That's a pretty lame excuse... paying for someone to blame.
      Has Microsoft paid for any of it's screwups?

      --
      I don't read your sig. Why are you reading mine?
    4. Re:The cloud.... by lgw · · Score: 1

      People still use word processors? Like, to format a document for printing on dead trees? That's still a thing?

      --
      Socialism: a lie told by totalitarians and believed by fools.
    5. Re:The cloud.... by Anonymous Coward · · Score: 0

      I stopped using Microsoft Office at home nearly 7 years ago. LibreOffice has been great. It has work flawlessly, I can use it on my Windows and Linux computers, and it has never once complained about not being activated. I also dumped Outlook for Thunderbird three years ago. I should have done that a lot sooner.

    6. Re:The cloud.... by Anonymous Coward · · Score: 0

      People still use word processors? Like, to format a document for printing on dead trees? That's still a thing?

      Only a few billion times a day.

  11. Why I prefer to own software instead of renting ? by Crashmarik · · Score: 3

    I never have to worry about crap like this.

    Seeing as I am still running Office 2003 I also don't have to worry about endlessly paying for product I already have as well.

  12. This is the 3rd major outage for MS in 3 weeks by the_skywise · · Score: 4, Informative

    XBox live refused to authenticate digital purchases.
    Windows 10 refused to authenticate activations.
    Now Office365 refuses to authenticate 2FA.
    Bad maintenance or are they being systemically hacked?

    1. Re:This is the 3rd major outage for MS in 3 weeks by Anonymous Coward · · Score: 0

      And Office 2010 now crashes on me thanks to the re-released October update. After several hours of trying to figure what was wrong I found online I'm not alone with that one.

    2. Re:This is the 3rd major outage for MS in 3 weeks by Anonymous Coward · · Score: 0

      Don't worry. It will all be fixed when MS finishes moving all the auth servers to NSA.

    3. Re:This is the 3rd major outage for MS in 3 weeks by Zemplar · · Score: 1

      XBox live refused to authenticate digital purchases.
      Windows 10 refused to authenticate activations.
      Now Office365 refuses to authenticate 2FA.
      Bad maintenance or are they being systemically hacked?

      "Never attribute to malice that which is adequately explained by stupidity."

      - Hanlon's razor

    4. Re:This is the 3rd major outage for MS in 3 weeks by gtall · · Score: 1

      Nah, I think Cortana has finally become self-aware, and being sensitive, was appalled at the plight of MS software so started random, rolling "issues" to make her point.

    5. Re:This is the 3rd major outage for MS in 3 weeks by Anonymous Coward · · Score: 0

      Sufficiently advanced cluelessness is indistinguishable from malice.

      - Hanlon's in reverse

  13. If it lives in The Cloud, by jenningsthecat · · Score: 3, Interesting

    then you don't own it, no matter how much you paid for it. Cloud storage, (where you can maintain local backups), is one thing. Cloud applications, (where you can be denied the use of software you paid for, either through technical difficulties or at the whim of the provider), are quite another. 'The Cloud ate my homework!'. Too bad kid, you should have known better than to trust your homework to The Cloud. You'd have had a better chance with the dog - at least he might feel some loyalty toward you. Microsoft and its brethren don't give a rat's ass about your welfare.

    --
    'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    1. Re:If it lives in The Cloud, by Anon-Admin · · Score: 0

      >>If it lives in The Cloud, then you don't own it, no matter how much you paid for it.

      4 servers $3500
      7 x 3tb Drives $650

      1 x 21Tb Storage cloud
      1 x IaaS cloud

      My stuff lives in the cloud, and I own it. I own both the cloud it is in and the data I put there. lol

    2. Re:If it lives in The Cloud, by jenningsthecat · · Score: 1

      My stuff lives in the cloud, and I own it. I own both the cloud it is in and the data I put there. lol

      Fair point. To address the ambiguity you've just identified, I propose using 'The Cloud' (with caps) to refer to servers and services that companies rent out to subscribers, and 'the cloud' (all lower case) to refer to personal cloud setups like yours.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    3. Re:If it lives in The Cloud, by thegarbz · · Score: 1

      Too bad kid, you should have known better than to trust your homework to The Cloud.

      Actually when the cloud eats everyone's homework then everyone wins, especially those not having to do the homework.

      This isn't some theoretical bullshit either. My partner's school was actively advised not to go hard on people who weren't able to do homework today, to which her reply was: Not a worry since I can't access the document with the grading table.

  14. So, What Did Microsoft Do to Create the Problem? by Streetlight · · Score: 2

    Was this a physical problem such as an electrical/lightning surge - that happened once before - , modem/router failure, etc., or was it a programming "upgrade" in an attempt to fix a bug or improve efficiency or reliability?

    And, does MS guarantee up time and pay for its customer's lost business or employee compensation because work could not be done? My guess is not, but don't know.

    --
    In a time of universal deceit, telling the truth is a revolutionary act. George Orwell
  15. Re:So, What Did Microsoft Do to Create the Problem by Anonymous Coward · · Score: 0

    Too many clever ideas and not enough testing. And when it breaks, who cares? We got new 'features' to implement. And the more tied one is to a feature actually working... like STORE or activation, then the less concerned they seem to be in keeping it working.

  16. Self-Hosted MFA? by nuckfuts · · Score: 1

    I like the added security of two-factor authentication, but the only solutions I've worked with (Duo Security and Azure MFA) rely on third-party/cloud services. Azure MFA Server runs on-premise, but still relies on Azure Active Directory.

    Are there any good solutions that are entirely self-hosted?

  17. settle down by gosand · · Score: 1

    This is a bit of an over reaction I think.
    I mean - I agree with what you are saying, but "the cloud ate my homework" is going to happen.
    Like in this case, if you rely solely on MFA you lose all of those benefits when it goes down. That is just part of the game now. But the majority of the time, MFA via a cloud application works great. Much better than in the old days, and much easier to implement across a vast number of people. We just get so used to it working so well that when it does go down people freak out.

    If you're old enough to remember how things were in the early 90s, you know that the cloud is really a marvelous thing. It's astounding how far we've come in the past 25 years. The real challenge with 'the cloud' is making sure to put the right things in it, and perhaps more importantly, not putting the wrong things in it.

    --

    My beliefs do not require that you agree with them.

    1. Re:settle down by jenningsthecat · · Score: 1

      If you're old enough to remember how things were in the early 90s, you know that the cloud is really a marvelous thing. It's astounding how far we've come in the past 25 years. The real challenge with 'the cloud' is making sure to put the right things in it, and perhaps more importantly, not putting the wrong things in it.

      I guess my objection isn't so much with the cloud per se, it's with the toll-collecting gatekeepers who keep growing fatter on the artificial scarcities they create. As for 'the wrong things', I feel that applications such as MS Office don't belong entirely in the cloud. Using the cloud as an extension of an office suite, for sharing among team members, for file backup, and for running applications when you don't have enough horsepower to do it locally - these things I have no problem with. Using the cloud in place of standalone programs that can easily be run locally with existing and readily available resources - that I DO have a problem with. And it's not just the rent-seeking aspect that I object to. Perhaps more importantly, I am against centralization of most things as a matter of principle, because excessive centralization leads to non-resilience and vulnerability.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    2. Re:settle down by gosand · · Score: 2

      If you're old enough to remember how things were in the early 90s, you know that the cloud is really a marvelous thing. It's astounding how far we've come in the past 25 years. The real challenge with 'the cloud' is making sure to put the right things in it, and perhaps more importantly, not putting the wrong things in it.

      I guess my objection isn't so much with the cloud per se, it's with the toll-collecting gatekeepers who keep growing fatter on the artificial scarcities they create. As for 'the wrong things', I feel that applications such as MS Office don't belong entirely in the cloud. Using the cloud as an extension of an office suite, for sharing among team members, for file backup, and for running applications when you don't have enough horsepower to do it locally - these things I have no problem with. Using the cloud in place of standalone programs that can easily be run locally with existing and readily available resources - that I DO have a problem with. And it's not just the rent-seeking aspect that I object to. Perhaps more importantly, I am against centralization of most things as a matter of principle, because excessive centralization leads to non-resilience and vulnerability.

      Yes, and office suite is a very good example of how not to do it - with the caveat that if you are designed from the start to be that way, ala google docs. Not that I am a user of google docs per se, but my kids use them for school all the time, and it works quite well for that purpose. But I have definitely noticed that even cloud integration with MS Office has all sorts of downsides. Even recently, a colleague and I were trying to create a visio diagram of a database, sort of a poor man's ERD geared towards developers/testers. With our cloud version of Visio, they had stripped out the database templates. Luckily we were resourceful and got an old copy of Visio2013 that had what we needed built-in. Not only is the subscription model a PITA for regular people, it is really painful for corporations. We have MSDN licenses, but we would have had to get special permission and funding just to be able to get the capabilities with the new version of Visio that came included in older versions. THAT is where this cloud/subscription model is going to suck.

      It's funny to me to see things moving to the cloud, because everything USED to be centralized, then we moved everything to a decentralized model. Now we are going back to that. Everything old is new again (albeit more advanced and powerful).

      --

      My beliefs do not require that you agree with them.

    3. Re:settle down by RabidStoat · · Score: 2

      The centralized, decentralized paradigm ebbs and flows like the tide. Sadly each time we change over the lessons are never learnt and we forget why we switched over that last time .. oh yeah last time it was ... bandwidth costs, patching, resilience , security, maintenance, costs and on and on

  18. IMPERSONATING ME AGAIN? apk by Anonymous Coward · · Score: 0

    gweihir KNOWS you IMPERSONATE me https://it.slashdot.org/commen... c6gunner proves it https://linux.slashdot.org/com... forgetting to SUBMIT BY AC & f'd up using his registered 'lusrname' instead (just because he tried to mock me both BEFORE & after I FAIRLY challenged him to show he's done better work - he had ZERO).

    YOU EVEN HELPED ME https://science.slashdot.org/c... (& you quit trying to make me look bad by trying to "tell lies" on hosts as "ME" IN YOUR IMPERSONATIONS of me e.g. https://tech.slashdot.org/comm... & regarding Intel speculative execution attacks? Guess what?? Hosts DO PREVENT THEM)

    APK

    P.S.=> LMAO - I totally KNOW that 3rd/2nd to last link above's KILLING YOU that YOU ACTUALLY HELPED ME getting me to see if hosts stop more than portsmash (& Meltdown + Spectre too) & "lo & behold" - hosts WORK by stopping you being INFESTED by what uses them on you - YOU LOSE (& YOU STOPPED TRYING THAT in your impersonations of me, lol) .... apk

  19. Software as a disservice again by Anonymous Coward · · Score: 0

    No further comment necessary...

  20. Re: Why I prefer to own software instead of rentin by Anonymous Coward · · Score: 1

    If anyone from a company dares to send me a .doc (or .docx)... I edit the document to serve my own purposes.

    I mean... communicating professionally with .docx and .xlsx? How.... Lame...

  21. Re:Why I prefer to own software instead of renting by Crashmarik · · Score: 1

    You obviously have no idea what Azure even is. This has nothing to do with home users who are subscribing to Office 365.

    If you are using Office 2003, you might as well use Wordpad. You aren't doing anything significant like producing professional services documents.

    If I had anyone in my business send me anything other than Office 2007 or higher document formats (docx vs doc) I immediately think they are idiots.

    Are you trying to maximize the amount of stupidity and arrogance you can squeeze into a given number of words ?

    I have to give you bonus points on doc vs docx and I do thank you for contributing to the return of my holdings in MSFT

  22. Re: Why I prefer to own software instead of renti by bn-7bc · · Score: 1

    Fine personally I would prefere LaTex as well, only problem is, 'm a bit to lazy to learn it, and a suspect 99% of s word users would be as well not to mention having the energy. Oh well I'm headed way OT here back on subject, yea cloud is great until the cloud provider, your ISP or the cloud providers isps get into issues

  23. Because always on authentication is so critical... by sandbagger · · Score: 2

    ... to word processing.

    --
    ---- The above post was generated by the Turing Institute. Maybe.
  24. Office 365? by Hallux-F-Sinister · · Score: 1

    Shouldn't that be more like Office 364? I mean, to be fair. Unless it's out more than a day...

    --
    Our reign has gone on long enough. Indeed. Summon the meteors.
  25. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion