Slashdot Mirror


Microsoft Unhappy With Beta Testers, Demands Answers (computerworld.com)

Freshly Exhumed writes: Microsoft has mandated that the feedback functionality built into Windows Insider Preview beta be switched on -- a change from earlier when testers could block questions from the company about what users thought of specific features. Starting with Build 14271 and newer, the frequency in which Windows 10 will ask for your feedback will be locked to 'Automatically (Recommended)' in the Settings app. This would seem to disrupt what has traditionally been seen as a tacit understanding between corporations and their beta testers/sandboxers in that the latter would volunteer their time, effort, CPU cycles, possible hardware failures/breakage, and more as part of a bargain to receive feedback or to test fly the beta OS with internal software environments in private. Microsoft would now seem to be altering that relationship.

26 of 355 comments (clear)

  1. The solution seems obvious to me... by Frosty+Piss · · Score: 5, Insightful

    Oh good grief! If you don't want Microsoft to gather information from your beta testing of Microsoft products, don't become a beta tester. I mean, is that what beta testers do, use the product and give feed back as requested? The simple solution if you don't like this policy is to not sign up to beta test Microsoft products if you don't really want to be hassled with feedback, "telemetry", and so forth.

    --
    If you want news from today, you have to come back tomorrow.
    1. Re: The solution seems obvious to me... by Anonymous Coward · · Score: 5, Insightful

      Yeah..... Bizarre ask a beta tester to give feedback....what's this work coming too? Will someone please think of the children!

    2. Re: The solution seems obvious to me... by Anonymous Coward · · Score: 5, Insightful

      This.
      Seems to me microsoft was tired of people using the beta test as a way to just get early updates.
      I don't think it's unreasonable of them to expect feedback.

    3. Re:The solution seems obvious to me... by Bite+The+Pillow · · Score: 5, Insightful

      Beta test seems like something you do to the OS. Then when preview builds come out you test compatibility. Anyone integration testing on beta is really too far ahead in the cycle

    4. Re:The solution seems obvious to me... by Nunya666 · · Score: 5, Insightful

      You are confusing two different types of beta testing.

      Microsoft's beta testing is designed to test their software using your environment. Both problems and feedback are expected.

      Your beta testing is designed to test your software with stable versions of Windows. In fact, your beta testing should be done with every version of Windows that is supported at the time of your testing. Currently, that means Win7, Win8 and Win10. Most testers do that by having a VM for each version that they need to test. Using VMs makes it easy to roll back the VM to a known good state if problems are encountered, or after testing the installation of your software. For your testing, you should avoid beta versions of Windows.

    5. Re: The solution seems obvious to me... by kenh · · Score: 5, Insightful

      You are confusing two different types of beta testing.

      No, you are confusing 'beta testing' and 'evaluation'.

      Microsoft makes software available for beta testers who want to help Microsoft debug/improve their software... This is called 'Beta Testing'.

      When you want to test Microsoft's software in your environment, with your applications, on your hardware it is called an 'evaluation'.

      Beta testers get early access to pre-production software, evaluators get free access to (time-limited) released software.

      As noted previously, if you are doing compatibility testing with beta-level software you are testing too early, as beta software is very likely to change from release to release, and you wind up constantly re-evaluating compatibility as the code base changes dear neath you... You are chasing a moving target.

      It is perfectly acceptable for MS to require feedback from pre-production beta testers to ensure on-going support/updates to your beta release software.

      --
      Ken
    6. Re: The solution seems obvious to me... by Anonymous Coward · · Score: 5, Insightful

      Except now the user is the product. With Windows 10, you're paying Microsoft to be sold to companies as advertising targets.

      If there was a time to switch to Mac and Linux, it's right now.

    7. Re: The solution seems obvious to me... by afidel · · Score: 4, Insightful

      Windows IS now a moving target, CBB has a 6-9 month release cadence so if you're not getting on each build as it's available you're likely to miss something. You don't necessarily CHANGE anything based on a beta release but you can put in a tracking bug to check whether a particular feature is still broken when the release build is available. You only have 4 months after a CBB release to apply it or you have to do an in-place upgrade to the next LTSB to get current again, 4 months is a very tight window for most enterprises hence why many are getting testing in early with the insider builds.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    8. Re:The solution seems obvious to me... by gstoddart · · Score: 1, Insightful

      Oh good grief! If you don't want Microsoft to gather information from your beta testing of Microsoft products, don't become a beta tester. I mean, is that what beta testers do, use the product and give feed back as requested

      Sorry, but the entire release cycle of Windows 10 has been a fucking public beta ... shove people towards running an OS still in development, take away their control of the platform, and keep doing it to them.

      They've been finishing Windows 10 by making everybody the beta testers, and treating it like some agile development turd.

      And sooner or later the extent to which they've pissed off everybody will become apparent, and then hopefully they find themselves wondering how to win people back after all the bullshit they've pulled with Windows 10.

      Beta tester or no, you're getting telemetry shoved up your ass whether you like it or not.

      --
      Lost at C:>. Found at C.
    9. Re: The solution seems obvious to me... by sonamchauhan · · Score: 3, Insightful

      The OS knows more about you than a browser window ever could.

    10. Re: The solution seems obvious to me... by SeaFox · · Score: 4, Insightful

      Which knows more about you, an OS you wont give feedback on, or a website you spill your guts to?

    11. Re: The solution seems obvious to me... by Njorthbiatr · · Score: 3, Insightful

      Then don't volunteer to become a beta tester?

      You're not being forced to do anything.

    12. Re: The solution seems obvious to me... by sonamchauhan · · Score: 2, Insightful

      The OS that watches you spill your guts on _every_ website.

    13. Re: The solution seems obvious to me... by mrprogrammerman · · Score: 1, Insightful

      I kind of side of with the beta testers. With all the telemetry, MS built into Win10 the tester probably felt MS was already getting all the feedback.

  2. Less altering, more enforcing by Todd+Knarr · · Score: 5, Insightful

    Less altering the relationship I think than enforcing it. Too many beta testers were, it sounds like, treating the beta test as a sneak preview or early-access program and taking advantage of the offering without providing the feedback that's their part of the agreement. All Microsoft's doing is taking out the switch that lets them avoid being bugged for the feedback they agreed to give. It'll annoy people who were giving feedback but aren't having problems with those particular areas, but they're heavily outnumbered by the people who weren't giving feedback at all. Yet another case of the greedy breaking things for everybody, I suppose.

  3. Playing Devil Advocate by Freeman-Jo · · Score: 3, Insightful

    Not saying that everyone should or shouldn't give feedback per the term they agree with. But imagine certain group of people like journalists/reviewers, and MS know about them using beta products to gain insight/benchmark and writing review. Obviously you don't want MS to start gaming the system knowing which beta copy they are using and tweak the setting that would work well for particular system/task, but not working well in real life. So, yes, there are certain exception that I would rather have MS not knowing everything, even if those people accept the terms.

    --
    -=-=-=-=-=-=-=-=-=-=-=-=-=- If picture worth a thousand words, how many megapixels is it? -=-=-=-=-=-=-=-=-=-=-=-=-=-
    1. Re:Playing Devil Advocate by Billly+Gates · · Score: 1, Insightful

      It is not dishonest if those are the terms and yes it is beta software.

      However, what irritates me and most here is MS fired it's QA last year. Literally not a single QA person and this is why it has telemtry and demands feedback. We are the beta testers.

      If you install WIndows 10 as a fresh install which 90% of people do not do then woe is yoU! Bugs. I think this is bs. We need real QA as we have work to do and are willing to pay for Windows (corporations and those with win32 apps) if they make a good product.

      I am on 8.1 and will stay here for awhile. Shucks as it gets a bad rap but I have work to do in the meantime

    2. Re:Playing Devil Advocate by Anonymous Coward · · Score: 4, Insightful

      However, what irritates me and most here is MS fired it's QA last year. Literally not a single QA person and this is why it has telemtry and demands feedback. We are the beta testers.

      posting A/c to preserve modding. But this comment needed responding too as it is utter BULLSHIT. Microsoft has a shit ton of QA people across all product lines (though it might not seem like it sometimes), last year they got rid of redundant/overlapping areas. If you have information that says they fired them all then I think a citation is in order.

  4. is this really still an OS anymore? by nimbius · · Score: 2, Insightful

    For those still running windows, and not Chrome OS, Mac, Linux or BSD consider this...an intervention on behalf of the slashdot community. im sure you have some immediate concerns -- reasons perhaps -- that you cannot part with your abuser. ill try my best to assuage your fears.
    1. But I use windows for gaming! Steam has more than 200 titles that run just fine in Linux. Popular indie games and mainstream shoot-em-ups alike. they even offer steam machines as a platform if youd rather not fuss with Ubuntu.
    2. I need it for office documents. No, it needs you. Libreoffice and a host of other tools let you edit and author office documents easily from any modern operating system.
    3. well its what my office uses so... your office and about a million others use windows, but likely still windows 7. Things like email, calendaring, and federated login have existed for decades before Microsoft bundled them into their OS. Most of the services you use online arent contingent on your windows domain. Windows exists in the office out of comfort, standard, and price. corporations license their infrastructure for a fraction of what it would cost you to buy it.
    4. $os_name is hard. it doesn do $feature.
    its hard because learning new things requires effort. that other OS might not do exactly what windows does, but it still accomplishes the same tasks you need it to do in a different way. Maybe it even does it better. But like a productive relationship, it helps you do important things with respect. and this brings us to our #1 point:

    Windows does not respect you or your work. It insults your intelligence and flagrantly ignores your privacy. it sacrifices your productivity and needs for its own. the things it shows you and teaches you arent always things you set out to do or want from the OS, but theyre things the OS wants from you. Buy a new videogame, download a new app, pay for a new upgrade. Your operating system is shallow and narcissistic. perhaps 8 years ago it was meaningful, but times have changed.

    --
    Good people go to bed earlier.
    1. Re:is this really still an OS anymore? by CFD339 · · Score: 4, Insightful

      How about, "But I like my Windows machine."

      Seriously. I know linux, and use it on servers. ChromeOS seems to me like a bad idea, just trading one giant corporation for another. Apple drives me crazy enough on my iOS toys, and I'd rather not pay their premium.

      --
      The problem with quotes on the internet, is that nobody bothers to check their veracity. -- Abraham Lincoln
    2. Re:is this really still an OS anymore? by Anonymous Coward · · Score: 4, Insightful

      I'm a fan of Linux but have to say:

      1. There are plenty of people who have over 500 Steam titles, so that's not necessarily a good trade-off (losing over half my library?). Also graphics drivers are still pretty hit-and-miss on Linux unless you're lucky to have specific hardware.

      2./3. Libreoffice is great for personal use, but if your whole company/job doesn't use it then you might be stuck with whatever they use for formatting and compatibility reasons. Hopefully it's Google Docs/Sheets/etc. or you're stuck back on Office for Mac or PC. In general the alternatives, to OS-specific software, are always going to be lacking one or more features the original program has even if they have a bunch of other great features added.

      4. There is an efficiency involved in using the tools you're experienced with, especially for those who are using a tool on Windows or Mac OSX that doesn't play nice with other operating systems.

      "#1 point" Really not sure where that's heading, but you could say the same about Mac OSX and Chrome OS, as well as Ubuntu or the GNOME interface. Pretty much every modern operating system except perhaps some more advanced variations of Linux and BSD will "insult your intelligence" by making assumptions that are meant to improve work-flow.

      The privacy stuff going on with Windows 8+ is probably the same as what already happens with the Google Chrome OS, but still worrying.

    3. Re:is this really still an OS anymore? by LordLucless · · Score: 5, Insightful

      1. But I use windows for gaming! Steam has more than 200 titles that run just fine in Linux

      It does. But like 90% of everything, most of them suck. There's a handful that are good. Games aren't fungible - it may be that just a single, specific title not being available on Linux is enough to keep certain people on windows.

      Personally, I run a linux machine and a windows machine, with a kvm switch. I game on windows, and do everything else on linux. Works for me.

      --
      Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
  5. To much of something is a bad thing by Zorak30 · · Score: 5, Insightful

    I actually was a Windows Insider and loved it but then I started getting dinged with prompts for feedback every time I opened a new program or used a new feature they added. It isn't that bad, but when you're in the middle of trying to do something it is annoying as hell so I don't answer them. Over time this actually changes my habits and made me stop answering any of them all together. I was giving them feedback. They asked for more and I started giving them none.

    1. Re:To much of something is a bad thing by Anonymous Coward · · Score: 4, Insightful

      In other cases, the questions just plain sail over me.
      Q: What do you think of such-and-such new capability in Cortana?
      A: Just haven't got into the habit of using Cortana for anything yet, sorry.

      And that's the real issue here. I've ignored the feedback requests because I know damn well there is no option for "Cortana is useless shit, get rid of it" and "The entire Windows 10 UI is a fucked up mess that is significantly worse than Windows 7".

      And even if there was, those responses would be ignored.

  6. yes, it is for many many people by batistuta · · Score: 4, Insightful

    Interesting points, and I fully agree with you when it comes to tech people like us.

    But if you think that your comments are scalable, then you probably have not dealt with non technical people, who are just trying to get work done(tm)
    For instance:
    - girlfriend works in some marketing/accounting/business unit and needs to finish some documentation at home during the weekend because of a late request
    - grandma wants to see her grandchildren photos, which are embedded in that powerpoint. Background music is important.
    - Non-Tech father needs to rework some documents done in the universal tool of all Lords, namely Excel, which office people bastardize via macros and whatever to serve a schizophrenic life of being spreadsheet, text editor, database, time planner, bug tracker, and version control tool all at once.
    - Friend want to install password manager, tax program, adobe lightroom/Picasa, iTunes, pick non-web-based program, etc. and doesn't feel like learning anything about wine unless he/she is going to drink it.

    So if you truly believe what you wrote, then you are either too young, or you work in a small technical company, or are a freelancer, or are one of those people expecting the world to change and learn to think and behave like us.

    My heart is with you. I even use Linux (Xubuntu) as my daily driver at home, and I used to think like you trying to change the world. But as you have said yourself, times have changed and I have learned the reality. And even I need to dual boot to Windows every once in a while.

  7. Insider build on phone, but feedback too soon by Fencepost · · Score: 3, Insightful

    I have an Insider build of Windows 10 on a Lumia that I'm not using as a daily driver, and it feels like it'll update overnight, then ask me in the morning how stable this build is. I don't know, I've probably had less than 15 minutes of "on" time on the phone since the last update! Further, 99% of the crashes I see on the phone are because the primary app I use (PocketCasts for podcasting) was released, updated once, and has a variety of significant bugs.

    Windows Phone itself? Has been fine, I actually like it, but was a little too locked-down for my use and is of course lacking in apps.

    --
    fencepost
    just a little off