Analyzing the Analysts
Very cool, very deep story at Information Week about the IT "analysis and research" firms you often see quoted as authoritative sources in assorted media, and how accurate their predictions are - or aren't. A quote from the story: "The leading analyst firms
have become so
influential that their
opinions can help IT
chiefs gain
senior-management
approval for technology
investments." Obviously, these firms carry plenty of weight. Should we be scared of their growing power? Or have they become an essential part of the computer and Internet business scene?
Just want to add a few cents.
I know several 'big' firms who provide their clients professional advisory on IT, like what kind of tech architecture you need, why you have to setup a web site to embrace eC.
but i have to say few of those professional have first-hand experience, they just quote something from vendor's bullitin and benchmark data.
The real problem here is that since the area is so complicated that few people can get an insight into it, how to solve a complicated problem in limited time and with limited resource.
Li Jingyi Shanghai, China
I renember how many of these companies simply blew linux off. IMHO, that says it all.
While I appreciate the support meant by your post, The very fact that you can argue any point that you want shows that there is not a an order of magnitude difference between one product and the other in terms of what it can offer. Any time a position can be supported factually while another position in the same argument holds water just shows that 'from a distance, there is peace and harmony' and it doesn't matter *that* much. You'll never see the MacOS in server OS tests because it doesn't fit in the world of servers, but in the world of big-time servers, you can do all the things you need to lots of different ways.
+-------+ between the wish and the thing lies the world - All the Pretty Horses
I wonder how many of the "small, hungry, unknown" companies are reading Gartner while at the same time flying under their radar...
--Jim
As far as I've seen, the free software movement took the analysts completely by surprise, and they're even now scrambling to catch up. But I wouldn't say the era of the analysis firm is a bad thing for the free software movement - it's more the other way around.
--
Do I look like I speak for my employer?
In my experience, these self-proclaimed IT Consulting Experts are just as platform-bigoted and dogmatic as the rest of us... maybe worse, because they're even more certain of their infallibility.
-- "Those who cast the votes decide nothing. Those who count the votes decide everything." -Joseph Stalin
Microsoft has been aware of analyst's influences for a long time. As a support tech at Waggener-Edstrom, MS's PR firm, I attended an in-house "PR Basics" seminar. One of the ideas stressed was that these type of analysts were the most important "influentials". If we could win over the analysts with MS PR, the press and the world would follow. There is a lot more credibility if an analyst is quoted the PC Week article, instead of "a spokesman for Microsoft".
I have used many different analyst companies while working for different organizations, and in every case I have seen, their advice was either obvious to any competent geek, or else just plain wrong (e.g. see above references to Linux). They all made predictions, but I have never seen any independent analysis of analysts predictions. This article promised some objective reporting, but failed to deliver. Too bad, it's something we really need.
Information is not Knowledge
It's worse than that. Consider the MIS degree. It used to be that companies wanted technical people. Now they want people to manage technical people. Instead of hiring a good sysadmin, they'd rather hire someone to rent a sysadmin.
I suppose I shouldn't complain -- I wouldn't have my job if it weren't for A Big Company deciding that it is too expensive to hire people with technical skills. (Instead, it started a program with two additional layers of management and various contract negotiations and secretaries and the like.)
I wonder, though, if the desire to save quick cash is going to bite some of these companies on the backside when something goes wrong and no one has the foggiest clue how to fix it. Sucks to fire all of the network guys, eh? Sucks to pay me $2000 to show up, type in three commands, and spend the rest of the day at home, wondering how many people you could have hired at $25 an hour to catch these things before they happen.
The moral of the story? If you're renting brains to tell your company how to run its business, your company is in a heap of trouble. I'd short it.
--
QDMerge 0.4!
how to invest, a novice's guide
It is comforting to note that, at least in your examples, the analysts don't seem to have had much long-lasting influence!
Presenting a straight detailed truth and presenting material for mass consumption are two entirely different beasts. CNN is good at what they do -- but they must reach a very wide target market and in so doing must make compromises that may make them seem:
a) stupid
b) sweeping stereotypists
c) not in the know
Remember, they have to sugar coat their material and present it in such a way that it is accepted by everyone.
----------
Laugh. The only analyst material I have ever trusted is PCData; and only because the majority of their information is hard numbers.
----------
I've thought that IT analysis firms were a waste of money since the OS/2 debacle back in the early 90s. Go to your local library and get a PC Magazine from 1990 or 1991 -- you'll see dutiful reporting of the latest analysis firm announcement that OS/2 would supplant DOS in 2 years. Even when it was clear to anyone with a brain that Windows was going to beat the tar out of OS/2, the reports persisted.
Why does this happen over and over again? Well, why do people buy Gartner Group reports? To learn that current trends are going to continue? Of course not; people buy these reports so that they don't miss the big changes, the ones that remake the face of their industry -- and which could put them out of business if they don't keep up with the rate of change.
The problem is, the analysis firms make their judgements about what the Next Big Thing is by looking at the market leaders and asking what they are doing. On its face, this makes some sense; after all, who knows more about a market than the market leader? So the analysts work closely with IBM (in the old days) or MS (today), for example, to divine what's going to happen next in the OS marketplace. And the market leader, rationally enough, says "The Next Big Thing is our evolutionary upgrade product, which will add great features and preserve compatibility." So the analysts take demand for the current product, apply a fancy demand curve to it, and predict that the evolutionary upgrade will see exponential growth in demand over the next 3-5 years, and this is The Next Big Thing.
The problem is, revolutionary change never comes from the market leader! It almost always comes from some small, hungry, unknown (or less known) firm that is less worried about cannibalizing current product lines than it is about building the absolute best product. But these are the very firms that fly under Gartner's radar -- because they're not the market leader yet. So Gartner leans on its old sources, which of course are going to predict that current trends will continue to follow a nice steady upward-sloping demand curve. Why would the market leader anticipate revolutionary change? The market leader will do anything to prevent revolutionary change!
So the analysis firms lean on IBM advice on OSes right when Microsoft is about to eat IBM's lunch, they lean on MS sources right when Linux is about to clean MS's clock, and ten years from now they'll all be palling around with people from Red Hat (or whoever) when The NEXT Next Big Thing roars along and steals the spotlight again. And all the clueless PHBs in the world will scratch their heads and wonder how the high-priced analysts could have gotten things so wrong -- while the high-priced analysts scramble, two or three years behind the folks in the trenches, to get to know the geniuses du jour.
Pretty sad. But if you're in the technology business and you can't take the time to really understand the technology you work with, or to muster up some love for the market you serve, you probably deserve whatever nasty fate befalls you by hiring megacorps to do your thinking for you.
-- Jason A. Lefkowitz
Read my blog.
I think in a proprietary software world, all these IT pundits cheering Windows were probably right from a business sense. Microsoft was giving them just what they needed: a "good enough" solution that a predictable amount of dollars and that drone employees could handle, far better than a "quality" solution by a techie who might ask for a raise!
BUT, Microsoft pushed the aesthetic limits of the techies way too far. The Open Source Code Development Model and related business models based on it are a direct result, I believe, of people's frustrations with Microsoft's inferior products, destruction of standards, "unfair" destruction of competition, etc. The best evidence is Judge Jackson's findings of fact. Open Source is for many of us, including the VCs, SGI, etc., is a revolt against the monopoly.
IT analysts have to be business-minded, offering formularic "solutions" based on case histories. They could not have seen the Open Source revolt coming. The business case history wasn't there. Once open source models become an accepted business formula, the IT analysts will be out there peddling them as well.
If all these info-brokers, and sites like Slashdot etc. continue in their way, I think the IT analysts might find themselves hard pressed for a job in the future as opinion, successful practice, etc., starts to permiate from the web itself. Karma!
"... and most people can usually tell the difference"
:).
Seriously. Have you ever dealt with management in any software or hardware companies? Besides those who were originally cs or engr graduates, I've found very few who actually know their stuff in the companies area of expertise. The good ones will establish good relationships with their "people" as well as sampling the industry using a variety of sources. Do they actually know their stuff? Not usually. They rely on trust and good relationships to keep the gears rolling in the right direction. This is why companies want managment with 5-10 years industry experience. That way discression is used wisely.
Analyst firms have their uses. This is especially true for companies ready to jump on the internet bandwagon. If I was going to, say, rework a companies entire distribution network, I could probably go to an analyst (or two) to point me in the right direction. Of course they will have their biases and buyoffs -- but it's better than blindly testing a bunch of companies, especially if I don't know what prices to expect. Like IBM is going to tell me one of their solutions doesn't exactly fit my business model.
As for market trends though, anyone taking what they say for an absolute is incredibly ignorant. It's like asking an economist how the economy will be in a year. They might be able to provide some insight into what direction your company may take -- but you have to question the motives of someone doing this for money. If an analyst told me to get into such and such industry I might wonder how many other people he or she gave the same advice. I might also wonder where his numbers are that are predicting trends, using numbers that could go either way. It's disconcerting to even think about what's going on in the mind of the group of people running these firms. Could they be receiving kickbacks from companies for shoving clients in their direction? Yes of course these firms live on reputation -- but they aren't going to look out for your best given a number of in company politics and motives (especially if they're backed by certain big businesses). In other words, they aren't directly tied to your success.
So take their advice (if you need it), but tread lightly. Remember, analysts can provide insight, but they can't predict the future (no matter how many industry ties they have)
----------
I've noticed a lot of people I know in the professional field have moved from a technical position to a 'Market Analyst' position. Apparently they see the demand, and as far as I can tell, the workload is easier for much more money.
Anyone ever read 'The Peter Principal'? (No relation)
Levine
While we're on it, lets review the views on analyzing the analysts on slashdot.
/. that would get me a Funny moderation.
Oh damn, I'm really desperate for trying to post something on
-PovRayMan
----------
Check out my blackbox styles
Perhaps there is a way. If I have a company and mindcraft publishes a report which is obviously flawed and people use this report in such a way (from a rival company) that I loose revenue can it be claimed that Mindcraft is in theory capable of libel against said company?
Slashdot social engineering at it's finest
Usually this can be seen (not always) using the following method. Take the grain of truth from each of the opinions (for example: Linux is a stable operating system) and look at how many people with essentially nothing to loose say about it. Or even better perhaps some of the biased stuff. If someone can speak in a biased manner even this shows something about what the person thought. If people are saying the same thing on different pages using equally balanced sources it is usually right on the money that it is right.
However there is an equal chance that someone based their opinion in a biased fashion from an unreliable source (for example Windows NT blue screens every 5 seconds and causes baldness, the plague, blights your family with bad breath for 10 generations, etc taken from an AC off slashdot or a post on usenet) then that can be perpetuated in a systematic fashion inadvertently unless the person in question uses a proper bibliographic method (MLA, Trabian, etc).
Slashdot social engineering at it's finest
I looked at the article and then thought for a while about what exactly would this imply for anyone who actually picked good sources in the first place. There are plenty of sources good and bad in this world and most people can usually tell the difference. I could just as likely quote Abraham Lincoln or Adolf Hitler for something about what public policy should be towards our fellow men. As far as technology goes we should look for the people who have the best results and use as many results as possible to get a balanced view. I usually go on the web and get as much information as possible to do a report and then cite all these things in my decision. It shows objectivity and evenhandedness
Slashdot social engineering at it's finest
Mindcraft can burn in a firey hell for all I care.
Pity, tho, the poor IS team, headed by a CTO or CIO who has NO knowledge whatsoever, only a resume made up of accomplishments of his former underlings at previous employers. The same idiot who brings in these "analysts" to tell them what they need and which direction they should be going. And the poor guys, the only ones with a clue, are stuck implementing various levels of junk, garbage, and non-functional crap by night, and trying to keep it running during the day.
The overall lack of knowledge is damagin, and scary.
I have become, comfortably numb
... you can argue any position you want. important is that you are smart enough to select the one that fits what you want and that you can argue it a bit yourself..it is not rocket science: buy into this technology and you pay for the next 10 years with no end or take this free piece of code and have the future wide open...
mond.
Among amalysts there are good ones and bad ones. Just like any other field. Look at the new reporters. There are good reporters like the BBC and Salon, and there are bad ones like ZDnet.
Please dont moderate me down to -99 (it'll hurt my karma) or start a flame war. Just trying to share my thoughts.
Mark "Erus" Duell
Who is to say that all the rather occultish things don't have their place. The subconcious mind has the ability to process data in ways that allow for individuals to make decisions based on information that is gathered in ways we cannot detect or were conciously trying to avoid (an annoying co-worker, boss, whinny kid at the burger window). PS on a related note check out this for something that might work.
Slashdot social engineering at it's finest
On the one hand, we have pundits, analysts and experts.
On the other hand, we have yarrow sticks, crystal balls and tea leaves.
I know which I would place more trust in.
When you see these blown out claims that NT is advancing on the enterprise, and marketshare figures showing Unix is in decline, it's a fair bet that an analyst has invested heavily in Microsoft stock.
These people have no system of ethics or checks and balances like lawyers or sports figures do, they do not dispute each other, nor is there any way for someone to verify their figures or findings. By and large I think they're mostly in bed with Microsoft as much as Ziff Davis is.
The problem with analysts, is that they are (more often than not) wrong. Even the most reputable of them suffer from this: witness Gartner perdicting the victory of OS/2 of Windows, witness Gartner and everybody else predicting the death of the PC and the rise of NC, witness most of them explaining away the Linux phenomenon behind a wall of corporate (== risk averse) logic. The have turned vision into a bean counting excercise ... the most surprising aspect of their existance however is the weight many a clueless person places on their guesses ...
An other thing that ticks me off about them: they all seem to take MSs promises at face value, even though many things they announced never saw the light of day. Yet it is the Linux people who (according to them) have no roadmap.
Fortunately in this informed age that sort of thing is likely to backfire. It's not like 5 years ago when any schmuck could start an Analyst company and make broad (and completely untrue) statements about any given product and ZD would pick it up and print it. These days, any schmuck can start an Analyst company, make broad and completely untrue statements which ZD then picks up and prints and then someone picks it up, posts in here on /. and 150,000 angry slashdotters flame them in E-Mail for the next two months.
Isn't progress great?
I'm trying to teach myself to set people on fire with my mind... Is it hot in here?
Yes and no. Using the threat of coercive power isn't always necessary. Use varies as per managment position (middle and upper management isn't in direct line authority of so called underlings); type of work; hygiene factors; their job market; their pay; their work related knowledge et al.
If you're unable to establish good relationships based on respect and friendliness, company influence, expert knowledge, or power to reward -- then obviously the only alternative left is to exact coercive power and strike fear into your employees by threatening discipline or firings.
The problem is that this is very situational. However, remember that the manager may be just as bad for the job as the employees under him. So if you look at your situation and you see other alternatives -- maybe you should change your management style to do your job well.
----------
A great philosopher of the 1950's once said that too much "analyzation causes paralyzation". Yogi Berra might not have been talking about the IT industry when he uttered those words, as a matter of fact, historians have not been able to discern what he was talking about at all, but I digress; Actually, I have digressed to the point where I have to log out and regather my thougths. Fare thee well.
Hates people who have stupid little sigs
There's a reason it's an MIS degree instead of an ISM or SIM or SMI or whatever
Management (or derivatives) is the first word.
Information is 2nd.
Systems is 3rd.
That's pretty much the priority in the mindset of the 'MIS' folks I know.
Management, red-tape, infrastructure, buzzwords, blahblahblah is what these people do. Information? Oh yeah, that's what we're trying to get out.
Systems? Yeah, whatever that guy from MS said will do just fine....
If IT/Tech departments *wanted* tech people, they'd come after CS types, instead of MIS folks.
Why else (at least at my Uni.) do you think MIS is a business-school degree instead of an Eng./Tech. one?
Blech. Signatures.
If firms like this reach critical mass in terms of acceptance then whatever they say and/or predict will, in all probability, become a reality.
One of the reasons that M$oft has risen so far is because "people supposedly in the know" have told the corporate world that M$oft is the way to go because of X. Whether this X factor actually has any substance is irrelevant, it becomes a snowball rolling down a hill...
Seems like the movers and shakers are just a bunch of sheep after all.
These analyst firms get soo.. much wrong, in fact it's difficult to think of stuff that they got right.
Jeez I thought the guys at the top were paid to think, not just be herded along with all the other schmucks.
Deleted
The best reports I've seen gave some detailed sources for data, as well as reasoning behind conclusions. That way, even if you decide that you don't agree, you have some data to back you up (and hopefully some references too)
The single best source of information available to managers, the one least frequently used, the closest one to them, is their colleagues, coworkers and employees. Frequently, coworkers have knowledge broad, or deep, or both, on subjects outside their immediate job description. These people may have real-world experience having used the products under consideration or worked on a similar project but no one asked them about it. The problem is that artificial barriers such as competition, fear, ignorance, and elitism prevent the exchange of information.
I've harped on this before but it bears repeating: these organizations provide exactly the required service- making one an instant expert in time for the meeting- but nothing more. The wisdom and experience is acquired only by those who actually trudge across a mountain of documentation, suffer a test implementation, and sift through newgroup and listserv archives.
A few months after the project is underway which individual will have a better understanding of the subject? Without question, the latter will be able to explain their decision and the reasoning behind it. The former will fall back on an empty appeal to what amounts to a marketing report. It's good to see that some of the managers cited in the article demonstrate an understanding of the limits of the analysis. It's more worrisome that so many others, not mentioned, blithely accept it as gospel.
Aside, I'm a titled a Business/Systems Analyst but spend most of my time administering and supporting the projects we build rather than turning out white papers (something I'm required to do distressingly often). Am I biased? Yes, probably. Am I off target? Probably not.
There are a number of reasons why anything coming from a market research company should be taken with a pinch of salt.
Firstly, there is the age-old problem of motivation. These guys are in it for the money, and will say whatever it takes to get them the most sales, sponsorship or consultancy fees. At best, you have to question the validity of research coming from a company subject to these pressures. At worst, people are being deliberately misled in the name of the good old bottom line.
All the good things about academic research are completely lacking with these guys. You don't get anything like the level of rigour and peer review that guarantees the quality of most academic work. Market research organisations in general aren't interested in checking someone else's work because there won't be much profit repeating something that's already been done.
There's also the issue of unequal publicity. Some studies get blown out of all proportion to their intrinsic worth. This can happen for a number of reasons, but usually because some big backer who likes the outcome throws the results everywhere in their publicity material for the next year. Either that or someone mentions it on slashdot. What's worse, the tendency is for more controversial or flawed studies to attract the most attention.
Finally, most of the stuff I've seen from market analysis organisations is unscientific twaddle. They don't seem to know the first thing about performing simple regressions. They commit just about every possible statistical sin. Even if they did do some solid groundwork, this gets cut in any published material because the target audience wouldn't have a clue what it meant. This all adds up to pretty meaningless conclusions.
The only reason I read market research at all is that it can give me a real competitive advantage to know exactly what all the bandwagon bozos are thinking.....
What if I get caught with absolute trash? If I publish something that could haunt me for 50+ years in my field of technical expertice? Do people like to live dangerously nowadays? What ever happened to job security? A little fear never hurt anyone in the pocketbook.
Slashdot social engineering at it's finest
I won't say that this is true of all decision makers that depend on such research but in my experience this culture of cowardice does exist to a degree because its easier for many of these managers to regurgitate and react to information than to take it in, think critically about it and then make informed (sometimes tough & risky) decisions on it. The research itself varies in quality from vendor to vendor so if the decision maker is taking the latter approach to evaluation and implementation then the research that is of little value gets priced down or out of the market and in the end the analyst loses the necessary credibility to impact how or in what directions their clients will move.
I have great faith in fools. Self confidence, my friends call it.
AFAIK, market analysts are full of it.
Just from the top of my head, two instances I remember quite well.
The first one took place about the time Gigabit Ethernet specs were close to completion. The e-mail I saw with my own eyes was from one of the highly respect market research group. I din't save the whole thing, unfortunately. But its subject was something like this: Gigabit Ethernet is a horrible mistake. We have to explain all our clients that ATM is the only correct technology above 100Mbps Ethernet... Or something like this, I don't remember exact wording. I don't think I should comment on this.
Another case took place about a couple of years ago. Once again, I was there. Few market analysts were discussing the fugure of portable computing, especially with respect of integrating mobile phones with PDA. The point they have made was
'The future is Windows/CE as a platform'. Someone
asked them 'And what about a PalmTop?' Their answer was something like 'We did an extensive market research and came to the conclusion that PalmTop has no future, and Windows CE is the only viable platform'. At the very moment I remember thinking 'Suckers! Extensive research, my ass. They've simply decided that 'you won't make any mistake with Microsoft'. What a bunch of idiots'.
Grunt. Oink, oink.
OK, I already knew these people existed & were highly paid & used by corporations. I even used some of the free Gartner Group stuff for uni assignments. So what?
I was really hoping to see a little more evaluation. Or at lease some critical focus. Who does watch these watchers? Do they need watching? Are they misusing their powers for Eeevill? It could have been so interesting, and it wasn't.
I feel let down.
No matter how cynical you become, it's never enough to keep up.
Eventually the generall public will catch on. It's unavoidable. Eather that or people will let us install what ever we want and charg what ever we like. "Oh yeah this 6402 running Forth is top of the line"
/. Linux Today Os Opinion and the pro Linux ZD articals and let nature take it's course. :)
[No insult to Forth and 6502.. if you ask me everyone should use Forth 6502 trainner].
Basicly as long as someone is ready to gather information they need only be pointed in the right direction.
Give em
Don't be conforntational. Be a good little employee just helpping his boss be as informed as he can be.
I wonder what Dilbert would say to this tactic?
I picture Dogbert screaming "No thats dangerous.. he'll.. acually.. try.. to.. do.. somthing.."
Computer blows up to show pointy haired boss sitting at it "I installed Linux.."
your results may vary
I don't actually exist.
If I am a boss in the traditional sense I will have to have fear to gain respect. People all know that I do little but If they feel that I have little competence then I become a real clown. Therefore one must cause fear in the subjects. Now granted a society based on fear is usually a bad thing but corporate culture is not society as we know it. Slavery and bondage (child labor, 18 hour work days) were common in the 19th and early 20th centuries because the culture was light years behind what the culture was like or tolerant of at the time. Now we see a resurgence of the ability of people to become more fallable or more vulnerable in some respects with feelings, opioions and the ability to ask questions. The phrase "there's no such thing as a dumb question" will eventually full incorporate itself into the culture of the work place.
Slashdot social engineering at it's finest
What's interesting about analsyts to me is twofold. One, they're target audience is a group of senior "managers" often responsible for large technology projects. This group of managers has little (if anything) to do with the day-to-day implementation and hands-on management of technology; the last time they actually did anything with a computer may have been writing COBOL on a mainframe. In order to sell services to these people you have to be of a similar mindset and background.
Hence, the analysts are often the same kinds of people -- managerial, disconnected from the kinds of daily use of technology that leads to true understanding.
What's amusing is that the less these people know, they more they make. Vague, inaccurate predictions that don't come true only lead their clients further into the dark, where their clients need even *more* incorrect information. A vicious cycle.
Future job for Linux zellots as Linux consultents?
The problem is thies industry experts are accually just Windows experts. A dangerous position to be in. If Microsofts market domonence is weakend to much they could be out of a job.
Instead of worrying they just tell themselfs what they tell there clients... Microsoft is forever.
But in reality if Microsoft is cut back to 55% of the market with everyone else holding the 45% thies experts won't be able to give "working" advice.
[Working advice meaning advice that works to spite being wrong. This is enough to convence clients your right sence they can't see whats wrong unless it blows up in there faces]
I don't actually exist.
The reason to subscribe to Gartner, IDG or any other profile is to gain insight where it my dangerous and expensive to tread. Unlikely will you see someone be able to implement 4 different SAN solutions and hope for the best one or undertake the building of enterprise server farm to determine if Novell, NT, Solaris or Linux fit their organzation best. As long as people use it much like a book, "Glean information and synthesize", which most people will do. We will not worry.
Hangtime
Unfortunately for the crystal ball gazers, the "inferior" technologies had major strengths that were overlooked. They had an installed base with a lot of people who were interested in how they work and they were extremely flexible and could be updated easily to meet newer demands.
In a reasonably fair fight, the more resilient technology will emerge victorious.
Those who can, *do*.
Those who cannot, Analyze...
I have met many "analysts" who spew out IT buzzwords like a magazine, but don't have more than an overview of what they actually mean/do. All you have to do is spend 5 minutes talking to them and you know they are clueless about it.
But, you sit in a meeting with them and upper management and even though you know he has about 1/4 of a clue, they have no clue... and you watch as their eyes glaze over from being "dazzled by his technical expertise" and the next thing you know "the analyst has all the answers we need."
Amazing sometimes how us 10+ year employees who know how everything fits together and know the technology (and usually the answers to the problems) are somehow found less knowledgable than a guy who spends a few weeks and has "all the answers".
are usually the people who are doing the work right now, your employees. Unfortunately, us "empowered" employees usually get ingnored by management... after all, we make $100K/yr, and the Analysts are making $250K+/yr... obviously they *must* be more knowledgable.
Actually, I think the formula should be more like:
actual knowledge = 1 / salary$
The more you make, the less you know.
Most PHBs still want to hear that Microsoft provides the lowest risk solutions, so what do you know, that's exactly what they're told.
Douglas Hofstadter had an interesting article on fortune tellers in Metamagical Themas, which you should all own anyway.
Bruce
A former boss had a regular subscription to Gartner Group reports. He would always favour Gartner advice over our own.
:-( - he would be telling us how an NT only world was "inevitable", and pointing to Gartner to back it up. (Remember how anti-Linux Gartner used to be 2 years ago?)
This was especially weird, since we were a small New Zealand university, and about as far away from the environment that these reports were written for as one could imagine.
The underlying problem was that the boss (as bosses will) had lost touch with the technology, and was paranoid that his staff were trying to pull one over on him. Rather than taking the high road - building a workforce he could trust - he took the low road of ignoring their advice in favour Gartner's. Result: poor decisions based on advice that was never really relevant to our circumstances.
While we were building cheap effective linux based solutions that actually worked - see, that mistrust had become justified
Analyst reports have their place as preliminary reading before you do your own research, or as a second opinion. If you don't have time to do you own research, and you haven't hired someon whose judgement you can trust, you are not taking things seriously, and deserve whatever you get.
I remember long ago at University learning that there was no subsitute for primary sources. Secondary sources are only ever there to get you up to speed. Treating secondary sources as though they were reliable was always a recipe for disaster.