Yahoo! Switches Search Engines

Giorgio Baresi writes "As several sources are reporting, Yahoo! in the last hours dumped Google and rolled out a brand new search engine mainly based on Inktomi search technology and Overture sponsored results. On Monday Yahoo! also launched its own crawler, called "Yahoo! Slurp", which replaced former "Inktomi Slurp". Hey, it seems the search engine war has begun!"

Comments

The search engine war has begun?

[MullerMn]

I think you mean, "Begun, the search engine war has.".

Re:The search engine war has begun?

[GuyinVA]

That would be nice. Maybe now they can pull up something relevant to what I searched for in the first place.

How can you speak if you haven't got a brain?

Re:The search engine war has begun?

[paranode]

Does a Star Wars pun really rate that high of a mod?

Star Wars leads to quotes.. quotes lead to puns...

Puns lead to funny mods.

Much to learn, have you.

Re:The search engine war has begun?

[stephenisu]

That would be nice. Maybe now they can pull up something relevant to what I searched for in the first place.

Not likely, Overture (I love these guys, they are making me rich) lets you BUY the top spots without letting the user know it. Google, on the other hand only sells side bar positions. Darn those google people and their ethics (no wonder MS couldn't buy them...)

is it just me...

[glen604]

or does a webcrawler named "slurp" sound like something more appropriate for booble.com?

I doubt this is a major problem for Google

[The One KEA]

Yahoo has been talking about dumping Google for a real long time now, so I doubt Google is really surprised. Besides, with the recent update to their index that they just made, I have a feeling that Google is not going to succumb just yet.

Re:I doubt this is a major problem for Google

[garcia]

Of course it's not a major problem. I know very few people that still use Yahoo as their first choice in search engines (and I am not talking about computer saavy people either).

My mother uses the Google toolbar and knew about it w/o me telling her. My father refuses to use anything other than Google as his homepage.

My number one reason for believing that Google is the all important, #1 search engine: My girlfriend's parents said, "I'll just google for it." at dinner one night (and this is a family where they have a shortcut to every file on the desktop and they use AOL 6.0).

Re:I doubt this is a major problem for Google

[hendridm]

On a related note, I was at my parents home this weekend. They like to use Yahoo for their searching. No problem, but they were complaining of popups. I decided to install the Google toolbar for them. The thought crossed my mind to install the Yahoo toolbar, since they prefer Yahoo, however, it came down to a matter of trust. When Google says they're not going to resell my information or track my moves, they've given me no reason to disbelieve them. But seeing some of the ads on Yahoo makes me feel they're willing to do anything for an extra click. I appreciate that they're in the business to make money, just as Google is, but Google just makes me feel more comfortable about it.

Not a big deal either, since there's a goof chance my parents won't take notice the new bar anyway ;)

It is sad that you have to question every motive and move you make on the Internet thanks to all the toxic waste that is present. One wrong subscription and your inbox is hosed. I made that mistake the other day. Fortunately, I used a throw-away e-mail address so the damage was minimal.

Re:I doubt this is a major problem for Google

[Popageorgio]

Yahoo has far more traffic than Google: Alexa says so.

But under 10% of Yahoo's traffic goes to their search sections: Again, Alexa.

Re:I doubt this is a major problem for Google

[martijnd]

My (limited) observation is that Googles dominance is limited to the area they are playing in.

My European websites obtain 90% of their hits from Google.

My Chinese/Japanese language sites obtain 90% of their hits from the local Yahoo.

The browser wars are far from over outside of the ASCII 1-128 area.

Re:I doubt this is a major problem for Google

[naoiseo]

No need to be so warm & fuzzy with Google. That toolbar they distribute, that 'sends information back to google' -- well, SEOs have realized that you can view a web-page that google does not have indexed, with their toolbar installed, and a few minutes later the googlebot will come along.

Google claims they do not do this, and that sites are only indexed via incoming links. Privacy issues worthy of note. webmasterworld thread on the topic

Somebody isn't telling the truth, and I doubt it's the log files. Point is, left hand and right hand are not familiar with eachother, even in the land of making order from chaos, ye ole googleplex.

Re:I doubt this is a major problem for Google

[claar]

You made a good decision not installing the Yahoo search bar. I haven't bothered to read why exactly, but the Spybot -- Search & Destroy software labels it and/or its components as spyware.

For some reason, whenever I run across machines that have the Yahoo Search bar, this lovely "Search Assistant" thing that gives extra pop up windows when searching is on the machines as well..

Result relevance

[Tet]

Google prides itself on having not just the largest number of indexed pages, but more importantly, the relevance of the returned results. In general, I've found them to be ahead of the pack for this, which is one of the reasons I switched to them in the first place (the other being the uncluttered interface). I was quite surprised, then, when a couple of test searches with the new Yahoo engine returned more relevant searches than Google. I'm not going to switch just yet, but it's certainly something I'll be keeping an eye on...

Re:Result relevance

[costas]

Well, the good news is that Yahoo is trying to innovate, which in turn should push Google even further. For example, Yahoo is now linking directly to RSS feeds if you are using RSS-autodiscovery within your page's HTML. That's pretty cool.

Re:Result relevance

[puppet10]

Also I think its a good thing if there are a number of search engines with results on the same order of relevance as google returns but using different algos to get there.

The more there are the harder it is for the people trying to distort the results to succeed in distorting all of the various methods.

Somewhere, on the deck of the USS Yahoo!

[Noryungi]

Gentlemen! Start your slurping!

You goal is to slurp more than 6,000,000,000 elements of the World Wide Web! It's a fight we cannot afford to lose! Now, go, and may Bob be with you!

Yahoo has been planning this for ages

[naoiseo]

It's been live for about 6 months in some parts of the world.

I still have google results, but can see the new ink results by appending &tmpl=E088 on the end of the SERP url.

I can picture the board meeting

[ProudClod]

CEO: We want a search engine that evokes pride and confidence. Disgruntled Employee: *aside*Let's face it, compared to google it's gonna suck. */aside* How about "Slurp"? CEO: Slurp! I like it!

I love Google.

[Chess_the_cat]

I love Google (the new deskbar rocks) and I also frequent Yahoo! for chess and Fantasy Hockey. What I want to know is this: why is being the number search engine worth fighting over? Other than selling services to corporations and little text ads, how does Google make money? Or more importantly, why does Google need to be the number one search engine to make money? This reminds me of the browser wars. The logic was, you owned the browser, you owned the 'net. And although you could make the case that IE won the war, how does IE being the most popular browser translate into money for MS when they give it away for free? I didn't understand it then, and I don't understand it now.

Re:I love Google.

[L-s-L69]

Google to a lot of people is the ONLY search engine. Its become a brand much more so than IE, or even (arguably) Windows. The phrases 'to google' and 'googling' are fast becoming part of the english language on both sides of the pond. In order to google to keep getting the fat ad subs they live off it still needs to be number one. With IE it was just to eliminate the competition.

Re:I love Google.

[sugar and acid]

>Other than selling services to corporations and little text >ads, how does Google make money?

Ummm by selling services to corporations and little text ads. Googles advertising model is a very good way to make money on the internet by servicing both types of customers well, the normal google user and the advertisers.

Why, well the text ads are unobtrusive and obvious as advertisement links, and often welcome by the searcher. Why are they welcome, because they relate directly to the search term used. So you search for widgets, and widget inc. pays to put themselves on the first search page. The company gets trade, and the customer gets what they are looking for. In the real world this is the equivalent to the yellowpages directory where companies pay money to be listed with a small advert under a relevant indexed title like plumber or something.

So why does google have to be number one, because the more eyeballs they have the more money they can charge for an ad and the more companies that will be clamouring to get their little ad link under the "widgets" search term. Again for the yellowpages, in the US ever seen those ads from one or the other yellowpages directory saying that they are the preferred yellowpages by consumers, they are advertsising to potential advertisers in their directory implying that you will get the most value if you advertise in our directory and not the competitions. Same reasons google needs to be number one to maximise their profit.

Flawed idea

[Bish.dk]

From the CNET article:
One of the key ways Yahoo plans to make money from its search platform is to charge companies for more rapid and frequent inclusion into its index--a program called paid inclusion.

Read: "Google is still king". I want an objective search engine, not one where companies can pay for placement. It seems very stupid of Yahoo! to introduce a product that is flawed this way, if they really want to take on Google. Google has the advantage of currently being considered the best search engine by almost everyone, so Yahoo! needs a superior product if they are serious about getting more popular.

How does this improve Yahoo!?

[yog]

Most people use Google as their default search tool, even a lot of those unsophisticated Windows users whose IE still comes up with the default MSN page. It's entered the vernacular as a common verb.

How does Yahoo! improve its service by switching away from Google? Unless they have developed an equivalent if not better search engine, which up until now no one has done, all they are doing is downgrading the quality of their service.

Thumbs down, Yahoo. Use the best tool for the job.

Re:How does this improve Yahoo!?

[bad-badtz-maru]

Yahoo's objective isn't to improve their service, their objective is to improve company revenues. Since Yahoo has owned Inktomi for over a year, it's ridiculous for them to continue to license results from Google.

As for what is the "best tool for the job", you might want to actually take a look at the new Yahoo results instead of blindly pimping Google. It looks entirely possible that the current Yahoo/Inktomi algorithm returns results that are more relevant than Google's current algorithm.

Re:How does this improve Yahoo!?

[Unwise One]

How does Yahoo! improve its service by switching away from Google?

I don't believe that improving their service is a necessity here. Simply providing something roughly equivalent is probably OK. Most users never knew that Yahoo search and Google were the same thing, despite the "powered by Google" logo next to it. A very talented network guy commented to me the other day that he preferred using Yahoo search to Google since he got similar results without Google's advertizing. He was stunned when I pointed out the obvious reason for this.

But the real reason for the switch has nothing to do with providing an improved service: they are either making more of a profit with their own engine than by licensing Google, or believe that they will in the near future.

Re:How does this improve Yahoo!?

[XaXXon]

Thumbs down, Yahoo. Use the best tool for the job.

Unfortunately, the job in this case is "Make money." Google has all these ethics things that get in the way of that. Things like not resorting their main search results order to include paid results, always putting advertisements in color. Advertisers don't like that.

It's kind of weird.. The way I look at it is this: Guys always want the virginal girl.. but they don't want her to stay a virgin around them. Advertisers want a search engine just like that. They want a search engine that everyone respects, except they want to underhandedly move their results up to the top.. which loses respect. Google does everything it can to keep the respect. Sure, for a few dollars, it might let you feel it up, but if you go around claiming that you shagged it, it goes and changes its entire rating system and drops your pages to the bottom of its list.

Google frickin' rules.

Re:How does this improve Yahoo!?

[Dun Malg]

Yeah, google is real pure and kicks total ass. Ever notice how many spammy search results redirect to ebay and amazon? Why can't they fix that? Oh wait, notice how many of the adwords displayed on the side are for ebay or amazon?

Not really Google's fault there. That just shows how ebay and amazon are agressive marketers. In addition to paying for google ads, amazon has a bizarre affiliate-type program that basically replicates their pages on other people's sites, essentially spamming ALL search engines. How many times have you popped up results for a word combo or phrase that happened to appear in someone's amazon review and gotten the same damn thing, on different sites, over and over? This, for example, is what I got when I was looking for hacks to the REB1200 ebook reader. I'm sure google would kill that crap if there was an easy way. For the time being I suggest just picking an unusual word from the offending amazon review and exclude it, like this.

Re:How does this improve Yahoo!?

[joeykiller]

Why give Yahoo! thumbs down for using their own technology? If you're an average Slashdot user, shouldn't you be an advocate of choice?

To simplify: We have Gnome and we have KDE, we have Windows, Linux and Mac OS X, we have Perl and Python. Would you like a world where everbody used Windows, or everybody said that Perl was mandatory? Or to live in a one party state?

Maybe Yahoo! and MSN's new search engines won't be of Google quality in the beginning, but I guess they'll catch up. We should cheer them on. Google's starting to get a position where they actually can (if they want, I'm not saying they are) control the flow of information. So my position on this is that the more search engines, and the more equal they are both in capabilities and market share, the better.

Hey, it seems the search engine war has begun!

[JohnGrahamCumming]

Or not.

I mean this is just another stop along the way which has brought us the original Yahoo! directory, Altavista, Inktomi, Hotbot, Metacrawler, MSN Search, ..., Google, etc.

It's hardly worth thinking about. So Yahoo! dropped Google: good for them. The best thing we can have is competition between different vendors, then we'll get some innovation. After all, Google innovated like hell to be better than the other engines, now let's see what Yahoo! (or others) can do to be better than Google.

This doesn't have to be portrayed as some kind of war: that assumes that you take sides, and I'm not willing to be on Google's side. If something better comes along I'll switch.

John.

search results design

[bstil]

Yahoo has gone so far as to imitate Google's search results design:

title: blue, size +1
excerpts: two lines
date: green, size: green, "cached" link: gray, etc.

Yahoo does not have a time stamp for pages, but everything else looks very similar!

Yahoo is Inktomi

[Soukyan]

Yahoo! has owned Inktomi since March of 2003 so the name change is cosmetic issue. As to dropping Google, it was only a matter of time. I'm thinking Yahoo!'s Paid Inclusion Services to their search engine technology is making a tidy profit. The problem? Their search technology still doesn't appear to be as reliable, accurate or quick as Google.

Yahoo's Own Search

[faust13]

Overall, I'm pretty impressed with Yahoo's new search. It returned relavent results, and a little to my surprise that were different that what Google offered.

In the long run competition is good, and I hope that we yield the benefits from having two good search engines. Although, I'm still apprehensive about Yahoo's "paid inclusion." Which seems to offer misleading results to the Internet novice.

Check out what I'm trading

Yahoo's Google results were always a mess...

[blorg]

...hidden as they were among the enormous amount of other crap, it was difficult to tell which were the real results. As it was, I found Yahoo search to be so bad as to dilute Google's reputation if anything.

This new search so far seems better than the previous Yahoo search if anything, as they are putting the 'web' results up front, reasonably uncluttered, with everything else as seperate tabs. They could have done this with the Google ones before, but I presume they wanted to promote their own content.

Thank you..

[bob670]

Microsoft, for once your black touch came near something as simple and useful as Internet searches, everyone smelled blood and money in the water. Yahoo and anyone with a little cash will now try to turn searching into huge profits and advertising tie ins, it will become more difficult to do legitimate research, then we can have another round of dot.com funding, create another tech bubble and screw the industry up some more. With both Linux and Mac OS X having proven themselves as outstanding alternatives to Windows I do wish more people would wake up to switching and start depleting Microsft's cash coffers a little, that way they coudn't move in and screw up other industries like smart phones, gaming and now search engines. And if you don't see the tie-in between Yahoo's actions and Microsft overtures toward search you are not paying attention.

searches

[scarolan]

Lately the quality of Google's search has declined significantly, especially for less common phrases. Seems a lot of what comes up is spam/redirect pages that are just packed with keywords to get you to visit a porn site.

Results

[savagedome]

Searching for Yahoo on Yahoo comes up with about 102 million hits.

Searching for Yahoo on Google comes up with 119 million hits.

Google got depth :)
Yahoo can't even search its own kind!

Re:Didn't....

[NickFitz]

I couldn't find anything about it on the web

Did you try googling for it?

nice page

[minus_273]

i like the new lean yahoo page: http://search.yahoo.com/ also the results are comparable to google. Searching for my name turned out a few things i had never seen on Yahoo. Quite nice. I think i have another search engine to use. Gotta love capitalism!

Yahoo had a search engine??

[filtersweep]

Pardon my sarcasm, but their officially "approved" "directory listings" were never all that easy to break into if someone wanted their own site listed and I've always been very skeptical that sites paid for their placement as Yahoo supplanted their "free" services with more and more paid and subscription-based services. I'm not suggesting that they should not run as a "profitable" business, but what is advertising and what are legitimate search results? It is not unlike deciphering Fox News' editorial content from their 'journalism.' I'm sure this will all quickly devolve into a paid product placement scheme.

Re:Surely you mean

[DrSkwid]

Reverse Polish Notation, he speaks in.

Not quite rid of Google

[Tune]

> When will there be anything new from Yahoo!?

True. The front page still has that bloated good ol' Yahoo look-and-feel that caused the exodus to Google in the first place. It does not seem to be more responsive or more accurate either.
On top of that, did anyone notice they still seem to be using Google to retrieve images? At least, the result to searching for "$#@%" looks *very* familiar:

We didn't find any Web pages containing $#@%.

Suggestions:

- Check your spelling.
- Try more general words.
- Try different words that mean the same thing.

Also, you can visit the Yahoo! Search Help Center for more suggestions.

(I bet Google has those phrases trademarked, so they could sue Yahoo for providing useful clues... ;-)

Re:Oh yeah

[glpierce]

The sponsored links have a very odd system. Case in point: I tried a test search for (in quotes) in both Google and Yahoo!. Google gives no sponsored links for "cubital tunnel syndrome", one for "tunnel syndrome", and eight for "carpal tunnel syndrome" - all are relevant. Yahoo!, however, gives a sponsored link for carpal tunnel syndrome in a search for "cubital tunnel syndrome", three different links for a search of "tunnel syndrome", and eight for "carpal tunnel syndrome".

What's significant here? The search for "cubital tunnel syndrome" gives a sponsored link to a carpal tunnel syndrome site, despite the fact that it is not relevant, and the search terms were in quotes. More interestingly, that sponsored link does not appear in searches for "tunnel syndrome" or "carpal tunnel syndrome".

Something is wrong here.

Re:Wonder if it's Linux boxen?

[FooAtWFU]

Warning: OS detection will be MUCH less reliable because we did not find at least 1 open and 1 closed TCP port
Interesting ports on m1.search.vip.dcn.yahoo.com (216.109.117.133):
(The 1656 ports scanned but not shown below are in state: filtered)
PORT STATE SERVICE
80/tcp open http
Device type: general purpose
Running: Apple Mac OS X 10.1.X
OS details: Apple Mac OS X 10.1.5

Relevance?

[Anonymous Coward]

Just searched Google and Yahoo about "yahoo slurp". Guess which one's more accurate? (also, it's plainly obvious that Google can withstand /., but can Yahoo?)

Re:Relevance?

[Dutch_Cap]

"(also, it's plainly obvious that Google can withstand /., but can Yahoo?)"

Well yes, because after all, yahoo is only one of the biggest sites on the internet, with a mere 105 million hits per day

Re:Relevance?

[Fishstick]

the real test?

more evil than satan

miserable failure

and of course...
litigious bastards

seems to work just fine!

Competition is good ... and there will be more

[rm007]

Technology Review has a discussion of the coming rivals to Googol in this month's issue. One of them is an Australian outfit called Mooter which does some nifty clustering of results (somewhat familiar to those who remember Northern Light, once a web search engine, now a provider of enterprise search engines). They discuss several others, including efforts by Microsoft, but the general point is that Googol (and Yahoo and Alta Vista etc. before it) have shown the search business to be a very profitable area if you are the leader, so there are a lot of eager pretenders to the throne. Competition is good, web users will end up with better searching, whether from Googol or another provider.

Ya-who?

[WebGangsta]

While I know many people who use Yahoo for their tools (email, domain services, website hosting, calendar, address book, groups, etc), I don't know many who turn to Yahoo for their search results anymore. Google (and to a lesser extent, MSN - due to their tight Windows/IE integration for the uninitiated who haven't changed their preferences) IS becoming the defacto search engine on the web for the masses.

I think website referral logs reflect this as well. Using the y2003 visitor report from one of the websites that I manage, over 50% of search engine referrals came from Google; a little over 10% came from Yahoo. Other reports that I've reviewed offer similar findings.

As for the "slurp" name, since its been a familiar crawler for years (Inktomi), Yahoo would risk alienating some websites/website managers who would have to go adjust their Robots files just for the new name. (And let's not mention those folks who don't know how to update the Webtrends crawler ini file or their browsercap.ini files...)

On a related note: at some point, those spam-artist "Submit Your Site to 300 Search Engines" folks will be put out of business. Other than the top 7 or so, what other search engines/portals would be considered "major"? Yahoo, Google, MSN, Altavista/Teoma, All The Web, Ask Jeeves, About (out-of-date half the time), Looksmart, DMOZ. (Heck, even Lycos pulled out of search the other day)

Re:..its own crawler, called "Yahoo! Slurp"..

[LostCluster]

I take it you haven't been reading at -1...

misinformation on paid inclusion

[bad-badtz-maru]

There seems to be some confusion as to what is meant by "paid inclusion". It doesn't mean that you pay to get your site listed higher. It means that you pay to get a specific page spidered more often. That's all. If you don't pay, your site still gets listed - and PFI sites don't rank any higher than non-PFI sites.

Yahoo+Inktomi+Fast+Altavista+Overture vs Google

[celerityfm]

Before Yahoo got to the point where they could "dump" Google, they bought up Inktomi, their old search engine results provider before Google and Overture, the biggest pay per click ad distributor next to Google in order get to the point that they could even compete with Google.

As far as relevancy is concerned, think about how relevant MSN's search results were and you've got an understanding for Inktomi's results-- MSN relied on them for their base result set (after the overture/looksmart advertisements).

But here's the key-- Yahoo picked up Overture, who had just purchased both Altavista AND AllTheWeb-- Altavista used to be a killer search engine, and AllTheWeb is the best, most relevant search engine next to Google.. so Yahoo has really got a fighting chance here. Good news for competition. But the fact that Yahoo had to purchase up so many assets is just a sign to how strong Google is.

Now, keep your eye on Microsoft.

Gentlemen, start your search engines...

[LostCluster]

With Yahoo owning Inktomi and Overture, and Overture in turn owning both Alta Vista and AllTheWeb, this was a move that everybody could see coming. I even wrote about it about a month ago in my little blog.

In short, Yahoo's been on a quiet buying spree. Without attracting too much attention, they've aquired enough resources so that they no longer have any need to buy anything from Google, it's all available in-house.

So, Yahoo's out to take back its role as the #1 search site that Google took from it. Google for the first time in a while has a serious threat that's going to force it to improve just at at time where the result quality is starting to slip... this should be fun to watch.

An in-depth comparison

[scifience]

I have written up an in-depth comparison of Google and Yahoo that compares the number of results that each provides as well as user experience. The link to it is: http://www.scifience.net/. I would have posted it directly here, except there are screenshots and other such things that can't be posted as a Slashdot comment.

Google for Vicki Phillips

[Moderation abuser]

She was the stunt double for Gena Lee Nolin and plays the Darak'na in most of the Sheena episodes. See if you can get a photograph of her sans makeup.

I wanted to see what she looked like under the makeup once, happened to have the laptop running at the time and fully expected to find a picture in seconds through Google. Nope. Eventually using other search engines turned up her photo and stunt information.

I've said this before but it's good that there's competition, Google isn't the be all and end all of search engines. It looks fairly wide but shallow.

Re:Wonder if it's Linux boxen?

[ravydavygravy]

Also, what is the basis of a search engine?

Well, the paper from 98 that describes the PageRank algorithm (as used by Google) can be found here

Theres a simple explanation of various indexing/ranking schemes here, but if you really want to get up to speed on research into searching the web, try looking at some of the papers from the TREC Web Track

Happy reading,

Dave

Re:Wonder if it's Linux boxen?

[caluml]

To answer one of your questions:

Does anyone know?
I would imagine someone does, yes.

Re:Actually...

[Anonymous Coward]

Come on... size doesn't matter...

it is all about how you index it.

Compare the search results

[GoogleGuy]

Hi,

here's a small tool to compare the search results of Google and Yahoo.

Have fun.