Slashdot Mirror


Search Beyond Google

An anonymous reader writes: "'Search Beyond Google', the cover story of the March issue of Technology Review, is one of the few current Google stories that discusses whether their technology can stay ahead of the competition in the months to come."

97 of 248 comments (clear)

  1. All good things ... by Ernest+P+Worrell · · Score: 5, Funny

    ... or bad things ... or pretty much anything, come to an end sometime. Except Microsoft of course.

    I think Google has deviated too much from searching, with their Blogger aquisition, and other stuff like that. We'll see how long they stay around.

    1. Re:All good things ... by LostCluster · · Score: 5, Insightful

      It seems like Google is starting to admit that they've hit a wall at improving their search technology, so they're starting to expand into other portal areas to anchor themselves down the same way Yahoo did when their directory-search model hit the wall.

      But Yahoo seems to be investing in several of the surviving web crawlers from the early days. Clearly, they see Google's hold on the title as the #1 search engine as something they might be able to take back.

    2. Re:All good things ... by Ernest+P+Worrell · · Score: 5, Interesting

      They haven't hit a wall. They're just giving up. There is always always room for improvement in searching ... sure you can have natural language queries and stuff like that. But, getting rid of the Search engine "spam", and all those fake self-refering sites. C'mon google, that can't be that hard to get rid of. I mean, assuming you have a PHD and stuff ... right?

    3. Re:All good things ... by interiot · · Score: 4, Interesting
      Google is certainly trying to weed out the junk while keeping the good stuff. Anybody who's dealt with a spam filter knows how hard that can be, especially if you want to keep all the good guys happy.

      There have been two updates in the last couple months, named Update Florida and Update Austin by the SEO community. As typical, various webmasters have been devoting a lot of thought and emotion to them. But as a normal user, all I can see is that Google is definitely trying, and not succeeding yet.

    4. Re:All good things ... by indigeek · · Score: 5, Informative

      Google works approximately by modding up the sites that get linked to the most. All the contributing links have an equal weightage it seems. This allows scamming by forming webrings and similar circular linking schemes
      Another approach I heard being discussed is to give more popular sites a higher weightage. ie If a site has a lot of pages linking to it, the sites linked from this site must also be good. Apparently if done right, you can do a few iterations and get to a better algo.
      Or probably assign a number to (karma if you will ) to each site. Then divide this karma by the number of sites it links to and add this to all the linked sites. Eliminate the cycles in the graphs and iterate.

    5. Re:All good things ... by Anonymous Coward · · Score: 5, Insightful

      Perhaps they're trying to be the central information aggregator? Many of their initiatives, webpage search, news search, usenet search, store searches... have to do with sifting through more information than humans can possibly handle. The Blogger acquisition and the friendster thing could be seen as peripheral endeavours that may yield a profit, but also might yield information on how to sift for relevance. e.g. handle blog relevance by studying interpersonal relationships of sites like friendster. After all, their web search is based on relationships between webpages of a sort. In that vein, Google Answers could be interpreted as an experiment to leverage the power of people in finding relevant results.

      Or I could be reading too much into what is otherwise standard corporate behaviour. :)

    6. Re:All good things ... by NewWaveNet · · Score: 4, Funny
      Google works approximately by modding up the sites that get linked to the most.
      I can't seem to find a link to the meta-moderate page on Google ;)
    7. Re:All good things ... by trenton · · Score: 3, Informative

      Yes, this is kinda how miserable failure points to where it does. A bit on the technique behind this here.

      --
      Too big to fail? Does that make me to small to succeed?
  2. Search engine spam is the key... by PornMaster · · Score: 5, Insightful

    They key for google providing relevancy is certainly eliminating "search engine spam". Almost everything that comes up on the first page for most things I search for is a referral program selling either something I'm looking for information about, or selling something completely different.

    1. Re:Search engine spam is the key... by Mr.+Stinky · · Score: 5, Interesting

      Agreed. Until last week, I observed Google being bombarded by spammers of the 3rd level domain name. I belive that last week they tweaked their algorithm similary to the November 2003 tweak by throwing out results that contained the exact keywords in the 3rd level domain name. I run a legitimate business: snowboards-for-sale.com, and these jack-ass-holes have been funneling Googlers into their Amazon affiliate site by setting up shell websites like: http://flux-bindings.foo.com/ If you compare the result set between Google and Yahoo for the same query, I'm finding that Yahoo has slightly better technology for weeding out the spam; at least right now.

      --
      Nothing is foolproof because fools are so ingenious.
    2. Re:Search engine spam is the key... by DrEldarion · · Score: 5, Interesting

      The funny thing is that Google does this on its own sometimes, and not because people are manipulating it. I recently noticed that I've been getting a lot of hits from Google searches for "S635MP". I recently posted a deal for a S635MP motherboard w/ CPU for $5. (the deal is dead now, sadly, although there's one for $10)

      Google saw that link, grabbed it, and for a while mae me the #1 search result for "S635MP", even above the manufacturer. I've since been moved to #2 by another site similar to my own, and we're both still above the manufacturer.

      Now, I didn't TRY to do this. All I did was post a simple link in my forums. Google is filling itself up with spam.

    3. Re:Search engine spam is the key... by smellygeek · · Score: 3, Insightful

      I agree. I get tired of doing searches for uncommon topics just to have a large number of the web sites being crap. Not just irrelevant, but impure and utter crap. I would like to see a function that allows the user to "block web site/page from future searches." Heck, I'd pay for functionality like this.

    4. Re:Search engine spam is the key... by Anonymous Coward · · Score: 5, Insightful

      Google saw that link and grabbed it...

      Just like they do with all of their search results.

      Really, whether you tried to do it or not, doesn't matter. It's a fact that more people were referring to your site with links like "s635mp" than were referring to the manufacturer.

      Reacting to this is exactly what makes google, google and not Yahoo!. I mean, a search engine whose results can't be manipulated has existed a while. It's called a phone book. Yahoo! results are manipulated simply by keyword volume. Google results are manipulated by keyword volume and a proprietary heuristic based on links and pagerank.

      I'm surprised (in retrospect) that it took so many years for so-called ``google-whacking'' to emerge. I wonder how long they [google] knew it was inevitable, or at least a strong possibility (some really bright guys working there)...

    5. Re:Search engine spam is the key... by Andrewkov · · Score: 2

      I thought the whole concept of google was that it ranked pages higher if lots of other pages linked to it. So presumably if lots of snowboard related sites link to your site, your site should be prominint in googles ranking system. Or have the spammer gotten around this too? Maybe all these spam sites link to each other and fool google that way!

    6. Re:Search engine spam is the key... by mopslik · · Score: 5, Informative

      I thought the whole concept of google was that it ranked pages higher if lots of other pages linked to it.

      And this is exactly one of the problems that is now coming to light. Spammers set up hundreds of tiny sites that do nothing but point to each other, thus inflating their PageRanks. They've saturated Google to the point that searching for information about commercial products usually returns 2/10 legitimate pages.

      At least, that's been my experience.

    7. Re:Search engine spam is the key... by justMichael · · Score: 4, Informative

      try using this

      something interesting -site:example.com

      At this point there's no way to save it as a pref, but you could always drop it in a text file to keep a big list

    8. Re:Search engine spam is the key... by willamowius · · Score: 4, Insightful

      > ..a search engine whose results can't be manipulated has existed a while.
      > It's called a phone book.

      The phone book can't be manipulated, because it doesn't try to rank entries. Try to find the right person called "Smith" in a phone book...

      When you look at the Yellow Pages, they do some sort of ranking and they do get manipulated by those with a lot of money who can take out a bigger ad, but aren't better than any other business.

    9. Re:Search engine spam is the key... by mopslik · · Score: 2, Informative

      Yes, Google has tweaked their algorithms and added filters to strip out some of the obvious abuses. But lately it seems like each time they remove a link, two more replace it.

      Maybe they've got some super-sneaky solution they're working on right now to remedy this. It would certainly help prevent searches like:

      +product +information -buy -deals -ReferralFarmName -otherRedirectTerms -...

    10. Re:Search engine spam is the key... by aacool · · Score: 2, Insightful
      Consider this - a web where you have certain seedy neighborhoods (known to all by IP address ranges perhaps - a la zip codes) and 'good' neighborhoods. Consider also the dynamics that would cause traffic to flow between good and bad neighborhoods. Finally consider an indexer/aggregator of information that allowed you to traverse between sites in the same or similar neighborhoods.

      The semantic web? or would it be a form of segregation? And how would google, or a new engine distinguish between neighborhoods. Also, how would you gentrify a neighborhood?

    11. Re:Search engine spam is the key... by justMichael · · Score: 2, Interesting

      If you use a browser that supports keywords (don't they all now?) you can add them to the end of the keyword string

      http://www.google.com/search?&q=%s+-site:example .c om

      Of course you would have to add a +-site: for each one.

    12. Re:Search engine spam is the key... by Idarubicin · · Score: 3, Informative
      I'm surprised (in retrospect) that it took so many years for so-called ``google-whacking'' to emerge.

      A Googlewhack is a two-word Google query that returns exactly one result.

      The term you're looking for is probably Googlebombing, which refers to deliberately placing keywords and links on multiple domains to boost a site's PageRank. Originally, Googlebombs were pranks or in good fun, like a search for weapons of mass destruction.

      Now "Googlebombing" is being expanded by some to include manipulating PageRanks for commercial ends. I'll leave it to the armchair etymologists of Slashdot to decide if that is a correct use of the term.

      --
      ~Idarubicin
  3. Google can't rest on its successes by LostCluster · · Score: 5, Insightful

    Google has had the last few years virtually unchallenged as the #1 search engine, because nobody has yet come out with anything that's better than PageRank.

    But, five years is a long time to sit on an innovation without making it better. It gives the competition time to catch up. Furthermore, since PageRank doesn't seem to have seriously changed much, it's actually slipped backwards a bit as more and more people have figured out how to "beat the system" by posting nonsense sites with links to the site they want on top. Google's clearly trying to fight this, but that's an uphill battle.

    Meanwhile, Yahoo now owns three distinct web-crawl based search engines, AltaVista, AllTheWeb, and Inktomi. They also own Overture, which begain life as GoTo.com who was the first to associate real search results with targetted ads. Put all these pieces together. Yahoo also has the original mega-directory site, which Google tries to duplicate by presenting the Open Directory Project on their site. In short, Yahoo's got all the resources to launch a brand with everything that Google has going for it... and when you look at AltaVista and AllTheWeb they feel quite a bit like Google already. Clearly, Yahoo's gearing up to issue a challenge to Google.

    It really seems like Yahoo is making sure they have all the tech in place right now. When they're sure that they're better to Google, I fully expect to see a marketing campaign claiming that and inviting people to do head-to-head searches.

    Google, as it stands now, is going to look pale in such showdowns. They've got to seriously modify PageRank so that the link spammers get downranked before Yahoo issues that challenge, or else Yahoo could reclaim the search market under it's "Google-killer" product line, and then direct people back to the original Yahoo site for their other portal needs.

    1. Re:Google can't rest on its successes by DrEldarion · · Score: 4, Insightful

      The problem with Yahoo is that it tries to do far too much. When I want go search for something, I just want a little box asking me what I want to search for - not a huge page with a million links on it and a few flash ads.

    2. Re:Google can't rest on its successes by LostCluster · · Score: 4, Insightful

      The problem with Yahoo is that it tries to do far too much. When I want go search for something, I just want a little box asking me what I want to search for - not a huge page with a million links on it and a few flash ads.

      And I doubt Yahoo.com is going to change at all. However, look at the other two search portals they operate. It's quite likely that the offering Yahoo puts forward to fight Google won't be called Yahoo, but be flown under the AltaVista or AllTheWeb brand name.

      So, if you just want to search, they'll have a nice clean entry point to their network for you. If you want the full busy-screen portal, there will be another entry point for that. Nothing limits Yahoo to having only one major brand...

    3. Re:Google can't rest on its successes by Anonymous Coward · · Score: 4, Informative

      http://search.yahoo.com/

    4. Re:Google can't rest on its successes by edsarkiss · · Score: 2, Informative

      that's because yahoo *offers* much more than google does.

      if you want a simple search box, navigate to the yahoo! search page.

      --

      SIGUSR1
  4. Hopefully.. by HenryFjord · · Score: 5, Insightful

    Hopefully google will not go public anytime soon like they were talking about earlier. I fear that this would stifle their innovation and bring it closer to some of the other failed portals.. ie more ads in an attempt to satisfy investors.

    I think it is a good idea for other search engines to step up to the plate and challenge google. It stops them from beoming complacent and spurs innovation from a desire to be #1.

    1. Re:Hopefully.. by millahtime · · Score: 4, Interesting

      The only worry would be if Google goes public and then shortly there after someone develops a new way to search that's better and Google looses a bunch of market share. Then the stock would go down quick. This is now a high stakes game.

  5. I once thought Altavista ruled the universe by shoppa · · Score: 5, Insightful
    At one point I thought Altavista was the end-all and be-all of search engines. Since then it's become an also-ran (last time I tried it, it really wasn't working at all) and Google has taken its place.

    I see no reason why the cycle cannot repeat. In fact, the cycle may be much like the semiconductor memory business, which has seen boom-bust cycles every few years since the early 70's. Sometimes a name will ride out for many cycles, but usually the company (and as necessary the technology) behind the name changes radically.

    1. Re:I once thought Altavista ruled the universe by Octagon+Most · · Score: 2, Insightful

      I agree. At one time Altavista was the best, if somewhat hard to reach, search engine. The problem was that corporate owner Digital did not own the altavista.com domain. The fool that did got a ton of traffic and eventually sold out to Compaq (DEC's new parent) for $3.3 Million. [For what it's worth, I just used Google to verify that.]

      They then squandered the good name they had with misguided strategies, who knows how many different ones, to follow in Yahoo's footsteps and go from Search Engine to Portal. How ironic, and sad for them, that Google became successful by doing what AltaVista used to do so well - blazing fast searches from a clean minimalist interface.

  6. Vivisimo is not a search engine by morelife · · Score: 4, Interesting

    rather a document organizer. It gets some of its results from Google anyway and just reorganizes it. Search results have the flavor of


    See books about "more stupid f---ing shit" at Amazon.


    targeted organization as in targeted selling. All they want is your demographic datum.

    IOW google will crush them.

  7. Even if they don't... by AKAImBatman · · Score: 5, Insightful

    ...maintain their technological lead, goodwill toward them will give them some breathing room. I continued to use Altavista for quite a long time after Google came out. It was what I was familiar with, I liked it, and it worked. Why switch? Eventually, I realized that Google had keen "read your mind" powers and finally switched. :-)

  8. bigco by oogoody · · Score: 4, Interesting

    What will stop google is not their technology,
    but the ossification that takes over every
    large company as it grows. Changes won't be
    made because it is too big a change. Changes
    won't be made because it's not cost justified.
    Marketing concerns will override technology.
    People we get fat and happy. And unlike microsoft
    i can switch to a different search engine
    in a second. Yahoo is looking pretty good...

  9. This has been the "story" for the past two years by Anonymous Coward · · Score: 5, Insightful

    Every couple months it's "Can Google stay ahead of new competitor x?" And so far, everytime, the answer has been yes. People shift from search engines quickly when they no longer work, and people are still heading to Google.

  10. It's search people by Future+Linux-Guru · · Score: 4, Insightful

    I type something in and it spits an answer back at me.

    As long as that answer is in the first page, usually the first three items listed, people simply will not care about the backend technology.

    MS and others will brag about the vastness of the numbers of matching items they can find; most people only worry about finding one or two sites.

    This is going to be a big non-event...mark my word.

    1. Re:It's search people by LostCluster · · Score: 5, Interesting

      But look how that game has changed. Google's the one now bragging that they can search "6 billion items", while the others have worked at tweaking their sort routines to be more resistant to link spam... and there's the event.

      Google's starting to be the one wishing this was a non-event.

  11. Google's speciality & ubiquity by aacool · · Score: 5, Insightful
    Google, IMHO, has excelled in what truly counts in the consumer world - branding. As everyone, including slashdotters, knows, googling is now a verb, and not just in math textbooks.

    Enough branding studies have shown that it's very very hard to knock someone off their post once they seize a certain mindshare - e.g. Coke, Windows(grin), and now Google.

    So, irrespective of the technical competence, or otherwise of Google, it is going to be around and the leader, for a long time to come. P.S. My favorite missing google feature: search for bittorrent files

    1. Re:Google's speciality & ubiquity by JusTyler · · Score: 4, Insightful

      Enough branding studies have shown that it's very very hard to knock someone off their post once they seize a certain mindshare - e.g. Coke, Windows(grin), and now Google.

      This isn't entirely true. Take the 'New Coke' disaster of the late 80's. Pepsi actually overtook the flagship Coke at this time, until Coke Classic was released in 86.

      Google is not much different to Coke. As soon as the water starts to taste funny (and on many searches it does now) we jump to the other main brands. Unlike Coke, however, Google cannot afford to keep its flavor constant every year.. but it must at least make it taste fresh instead of spammy.

    2. Re:Google's speciality & ubiquity by SeinJunkie · · Score: 2, Interesting

      So, irrespective of the technical competence, or otherwise of Google, it is going to be around and the leader

      This isn't necessarily true, as Yahoo! had a great-working engine and very good brand recognition. Although the syllables in "yahoo" do not lend themselves very well to verb usage or even expletives, the name is very much still alive. There are reasons why a brand gets to the top position in the first place, but there needs to be lots more reasons why someone sticks with that brand.

      I hope Google stays fresh and at the top of the game, because it seems like the competition doesn't really care about the users at all. We can all agree that MS doesn't deserve a top spot for anything else. I don't think Yahoo! is in a position to take anything as far as search goes, but it might just be in my head. If Google needs to step their game up, certainly Yahoo! is long overdue. Their site seems to me woefully busy and somehow retains the look that nobody has messed with the design since 1998.

      All the other search engines either advertise too much to be useful (see: Ask Jeeves) or seem to withhold relevant information (see: About.com).

  12. Scout the talent, reap the benefits. by bad+enema · · Score: 5, Insightful

    Google has been successful due to original thinking. It needs to ride its wave of reputation now rather than later in order to snatch up some of the finest minds to stay on top of this industry that is all about originality and fresh ideas. They seem to be on the right track by providing the work environment that they do.

    But no more stuff like that Friendster wannabe site.

  13. A suggestion -- to stay competitive by ackthpt · · Score: 5, Interesting
    Keep it simple (as it is) and limit arbitrary changes.

    I'm utterly fed up with eBay with the bloodymindedness of their "enhancement" and roll-out policy. Holding a near strangle-hold on the online-auction market, they are blind to the aggrevations they inflict upon users.

    Radical changes to a familiar interface shouldn't take place without dire need, unfortunately some people think it's fine to dust users. Google is all I want in a search engine and it works very well. The only reason I'd seek another search engine is if they (Google) drive me away.

    BTW, did you know there's a calculator? I found it when I did a search for 'stones to pounds'

    --

    A feeling of having made the same mistake before: Deja Foobar
    1. Re:A suggestion -- to stay competitive by rholliday · · Score: 2, Insightful

      The good thing about Google Labs is that the innovations are done voluntarily, on the engineer's own time.

      But yes, the tendency to expand into new (and unrelated) realms is annoying. When Google starts supporting e-mail, as jwz's law predicts it will, we'll know we're in trouble. Oh, wait ...

      --
      Xbox reviews.. We think they're funny.
  14. DejaNews by netglen · · Score: 2, Interesting

    Don't forget that they also took in DejaNews. Doesn't Google no offer a free language translation service too? I think Google might want to reconsider offering so many service.

    1. Re:DejaNews by Aslan72 · · Score: 2, Insightful
      I would agree generally. I think what killed yahoo's dominance of the search engine market a few years ago was the cloudiness of their product. Why damage something so simple and uncluttered as a search engine by offering an e-mail service, language translation, etc. My advice would be to not cloud what it is that you do really, really well - searching.

      Google should leverage that freaking huge database that they have and dejanews. None of the other competitors have that comprehensive of a set of data. Don't screw with it by adding useless features.

      --pete

  15. Article is already out of date. by michael+path · · Score: 4, Insightful

    I've always been a google fan, but this article is essentially dated on its release, given the fact that the Yahoo! switch has already occured.

    I do hope Google can continue its innovation, and reduce much of the annoyance of bad results through blogs.

    I'm suprised more attention wasn't given to the Google IPO, and what affect that might have on the "relatively small" 1000 person company.

    -m.

  16. Still waiting by roman_mir · · Score: 4, Interesting

    for a p2p distributed transparent encrypted indexing system with voted super-nodes.

  17. It's inevitable... by UncleBiggims · · Score: 2, Insightful

    Once a really great tool goes "commercial" it's all downhill from there. One of the main reason I switched to Google back in the day wasn't because it was fast and accurate (which was great) but because it had such a clean interface. Now there are sponsered links that clutter things up. And who knows when/if popups will be a necessary evil to "stay in business".

    Are you Corn Fed?

  18. I for one.... by Lxy · · Score: 5, Interesting

    welcome our new search engine overlords. No, really, I'm serious.

    Google is awesome, and is by far the best search engine out there. Google became the best by being the best. I use it because it works, and it works well.

    In order to be dethroned, a search engine needs to work BETTER than Google. I welcome any search engine that can beat Google, as it has to be DAMN good to take that title. Microsoft search flat out sucks. If I look for articles on linux, I get articles about linux alternatives (mostly M$ content). If I google for linux, I get real linux stuff. This is just an example, but it's true across the board. I have yet to see a search engine superior to Google, and I welcome any tool that can prove itself better.

    --

    There is no reasonable defense against an idiot with an agenda
    :wq
  19. Every good web developer knows... by Anonymous Coward · · Score: 5, Funny
    that content is more important than technology (or bells & whistles).

    Forget about Yahoo and Microsoft. If I was google I would keep an eye on booble. No way they can compete.

  20. Lots of PhDs doing much good? by JusTyler · · Score: 3, Interesting

    Google pays hundreds of researchers and software developers, including more than 60 PhDs, to man the front lines in this technology war

    Google is famous for only hiring the academic best (except for those they pick up in acquisitions), but I'm wondering if things are getting stale over there at Google. Google Labs has shown us some interesting concepts, but when a company opens the field to everyone and asks for people to develop ideas for them (as in the recent $10k prize thing), does it mean those PhDs are sitting around eating pizza all day?

    PhDs are not the guys you leave around to do server maintenance or fix up problems in the clusters. They also don't make great coffee. So if you've got 60 extremely bright individuals (we're talking way into the top percentile) sitting around for a few years.. and Google has tons of money.. why aren't we seeing some major stuff coming out of Google?

    My theory is that either 1) the PhDs are being stifled by upper management, 2) the PhDs aren't really as smart as they're meant to be, or 3) Google has something absolutely massive just around the corner... Take your bets, gentlemen.

    1. Re:Lots of PhDs doing much good? by xyzzy · · Score: 3, Insightful

      Just because you have a PhD does not mean that innovation happens instantly. Research proceeds at its own pace, and you can only go so fast. There are very few problems out there that will actually buckle when you throw more talent at it.

  21. Re:This has been the "story" for the past two year by Anonymous Coward · · Score: 5, Insightful

    Exactly. When Google falls behind, you'll know it because you'll be using something else. This kind of "Entity XXXXXXX may suffer setback YYYYYYY any day now" story isn't reporting at all, it's speculation and ghost stories.

  22. Mousetraps by blogboy · · Score: 4, Interesting

    That's what technology is, isn't it? The constant search for something better than what's available? And the approach of many companies (insert any NASDAQ 100 company here) is wait-and-see. See how the poineer does it, do the same, but throw some more bells and whistles in, or just market it better.

    Google has a brilliant algorithm, thanks their 60 PhD's. But there's plenty of other PhD's out there, some of whom I'm sure are just finishing up their newest, succeeding algorithm. It's a constant game of king of the hill.

  23. Re:This has been the "story" for the past two year by FePe · · Score: 2, Interesting
    Although new searching algorithms and techniques are being developed and matured by researchers and used by new search companies, I don't think they will become more popular than Google is now. Google has reached a high popularity and is known by almost all Internet users. Maybe there'll be some who wants to use the new technologies that other search engines has to offer, but Google's popularity is hard to break down.

    And Google isn't exactly dead, its alive and coping with the new stuff all the time.

    --
    "Until you do what you believe in, how do you know whether you believe in it or not?" -- Leo Tolstoy
  24. google needs "stemming" by elwinc · · Score: 4, Informative

    I'm a heavy google user, but I still miss altavista's ability to search for stems. For example, an altavista search for "slid* rul*" will get 'slide rules,' 'sliding rulers,' and plenty of other variations. Google does support whole word wildcards (try "miserable * failure") but stems are even more useful.

    --
    --- Often in error; never in doubt!
    1. Re:google needs "stemming" by Kelerain · · Score: 3, Informative

      Google seems to do this by default (bottom of page). Notice the search for slide rules has several instances of 'rules' highlighted?
      Aditionally, in the 'one up the competition' category, google can search synonyms of words like this:
      Google: ~slide ~rule. I learned that one in the 'favorite google features' thread. More info on thier advanced help page (3rd down, "~" searches). I also really love (and use heavily) thier other search operators.

  25. Google has an advantage..... by sunami · · Score: 5, Insightful

    .....in that everyone uses it, and everyone HAS used it for the past five years, or longer. People trust it, and that is something that just doesn't vanish. Plus, they HAVE done new things, such as google news.

  26. Teoma by nucal · · Score: 4, Interesting

    After just a quick bit of playing around with Teoma (mentioned in the article), it seems to be better than Google. I was surprised ...

    1. Re:Teoma by LostCluster · · Score: 4, Interesting

      Some might claim that Teoma actually has the best find-what-you-want technology right now, but is suffering from a lack of crawling resources and promotion since Ask Jeeves, Inc. hasn't been bought up by any of the major resources. They seem like a project only being held back by lack of funding...

  27. In 3 months? by oGMo · · Score: 5, Informative

    People seem to think Google is simply a place to find HTML pages. You type in your words, and poof, you get some relavent sites. Could this be replaced in 3 months? Google has a huge index, a very good search algorithm, and works for most people, but (in theory) someone might come up with a working alternative in that period. However:

    • Images is great for searching for pictures. The results are uncannily good.
    • Groups lets you search Google's huge Usenet archive (remember when they purchased this from Deja?).
    • News is my primary source for world news.
    • Froogle is great when searching for where to buy almost anything.
    • Answers lets you pay for research when the rest don't cut it.
    • Catalogs lets you search mail order catalogs for when Froogle doesn't cut it.

    And more. Babelfish translation? Caching like a billion pages? Simple design, with text ads that are actually relavent? In 3 months.

    Yeah, right.

    --

    Don't think of it as a flame---it's more like an argument that does 3d6 fire damage

    1. Re:In 3 months? by glinden · · Score: 2, Interesting
      • [Google] News is my primary source for world news.
      In the shamless-self-promotion-department, if you like Google News, might give Findory News a try. It's similar to Google News, but which articles are featured depends on your reading habits.

      So, if you read many tech news related to Linux, for example, it will emphasis news articles that are interesting to people who like tech news on Linux. It adapts to your interests.
  28. Regexps, please! Anyone! by Eudial · · Score: 5, Insightful

    Someone should invent a search engine with regular expression support. *sigh* A world with regexp-enabled search engines... That would be a wonderful world to live in.

    --
    GAAH! MY PRINTER IS ON FIRE!!! PUT IT OUT! PUT IT OUT!
    1. Re:Regexps, please! Anyone! by LostCluster · · Score: 3, Informative

      The problem with regexps is that they can be used to create very database-expensive queries. No search engine is ever going to allow a query that returns the entire database as the result set either.

    2. Re:Regexps, please! Anyone! by roman_mir · · Score: 3, Informative

      but you wouldn't be able to run a regexp against the entire document base since Google does not store the entire document for the purposes of indexing (googlecache is for a different purpose), what kind of computing power would one need to search all documents in Googlecache with a regexp under one second? And for more than one user at a time?

  29. technology schmology by ohzero · · Score: 5, Insightful

    Google's market position when they IPO has nothing to do with their technology. It has to do with their brand. "Googling" for something is the effective equivalent of going to get a Kleenex. Noone asked for a tissue. The market is going to be buying faith in the Google brand, and it's loyal userbase.

    --
    -- http://www.criticalassets.com
  30. Google needs to Show some its Cards by toleransi · · Score: 3, Interesting

    Google is in a no man's land, of sorts. It has penetrated enough to be considered almost quasi-public, yet it does not have the security that such a status would offer, and must constantly watch its back. The company should know by now that users are not happy with the level of transparency. Yet, we see Orkut christened with very little explanation. End-users won't support a company that is overly secretive if there are alternatives.

  31. How I'd fix Google... by Flamingcheeze · · Score: 5, Insightful
    Doesn't it seem simple enough to have a feedback system of sorts? Say I search for "Dell LCD Monitor Reviews" and get nothing but vendor sites, I could check a box next to all the Googlespam that says "not helpful."

    It would be the rebuttal to Google bombing... searchers could fight back by giving the crap a thumbs-down. Of course, then you would have the bombers voting down all the ligit sites. Dammit.

    --
    The Philosophy of Liberty | lewrockwell.com
    1. Re:How I'd fix Google... by Ratcrow · · Score: 3, Informative

      This was posted on /. a while ago under a similar story, but in case you missed it, there is a place to report spam on Google:

      http://www.google.com/contact/spamreport.html

      I now have it as a bookmark so I can hit it quickly.

    2. Re:How I'd fix Google... by inxil · · Score: 3, Informative

      The google toolbar already has voting buttons. Not quite what you're talking about, but...

      --

      --
      Why the hell not? Here's some SEO: Home Inspector

  32. The issue's moot... by sammyo · · Score: 5, Interesting

    I kinda like this one, but not enough to not slashdot them. A cool pun, a funky gui, what more could you want in a nextgen search engine.

  33. Great calculator by jstave · · Score: 3, Funny

    Gotta love a calculator that can tell you there's 153,388,225 furlongs in a microparsec

  34. Re:pagelink by rholliday · · Score: 2, Interesting

    Exactly. I may have missed it, but has anyone mentioned the infamous GoogleBomb? When people can trick a search engine that easily, and that publicly and have it still work, then it's time to change something.

    I love Google. Google has saved my sorry ass more times than I'd care to admit, but it's going to be a close one. They'll have my search, but the market share is still up in the air.

    --
    Xbox reviews.. We think they're funny.
  35. Structure of Information vs Search for Knowledge by stuffduff · · Score: 4, Interesting

    Todays search engines work a lot like information sieves, or panning for gold. The idea seems to be to take a bunch of stuff and wash away the un-needed, leaving behind (we hope) what we were looking for. However the very nature of the web provides the opportunity for looking at the relationships between ideas, the synthasis of knowledge as opposed to just collections of information. While the 'tricks' from the microsoft research projects look promising; only a true 'learning machine' will be able to go beyond the information and delevop a 'meta-interpretation/representation' of the raw data in order to support a 'meta-understanding' that is traversible and navigable in that we can not only connect with what we don't know, but that we can explore the unknown in terms of its relationship with what we do know.

    --
    "Can there be a Klein bottle that is an efficient and effective beer pitcher?"
  36. Meta search engines by steve.m · · Score: 2, Informative

    I quite like Vivisimo (after I figured out how to make it include Google in it's query by adding 'google' to the 'sources=' part of the query URL).

    dogpile is also quite good, when you've got it set to display results by relevance rather than by engine.

    Remember, Amazon isn't the only online bookstore, ebay isn't the only online auction site and google isn't the only search engine...

    1. Re:Meta search engines by NewWaveNet · · Score: 2, Interesting
      I quite like Vivisimo (after I figured out how to make it include Google in it's query by adding 'google' to the 'sources=' part of the query URL).
      When I first read that, it made sense. Then I went to Vivisimo's site and realized that was...stupid.

      Why would Vivisimo happen to have a Google API ready to be loaded up when 'google' is appended to the query string? Why would they trust the client's query string and go digging through whatever loadable modules they may have for ones specified in by the query string? Why would they use 'google' and not 'Google' since all of the other sources are correctly capitzlized (yes, capitalization does matter; see [L|l]ycos in sources get field)? Who the hell mod'd this parent up?
  37. Google will still stay on top for a while. by bad+enema · · Score: 5, Insightful

    The majority of users who use search engines are just end users anyways and appreciate the simplicity of Google's page design. I go to Yahoo, Altavista and Lycos and there's half a million links all over the place. I go to Google, and there's a nice clean page with the text box smack right in the middle.

    Visual appeal still counts.

  38. The bar will be raised everywhere by Ars-Fartsica · · Score: 3, Interesting

    Someone of course will come in not so much with a better search, but a different search, and that will be equated with better. The major search engines will have to fold in these innovations to stay relevant. The newcomer will have to adopt the best of the entrenched players if they want to last. All around its a big win for users, until that fateful and unavoidable day when people start to realize that uber-searches are the de facto "big brother" everyone fears will materialze at some point.

  39. Three keys to the search game by LostCluster · · Score: 5, Informative

    There are three very distinct elements involved in creating a powerhouse search engine:

    - A large crawl: A search engine with nothing in its database isn't going to work very well. A search engine needs as big of a crawl as possible in order to have any results at all. This takes huge resources in terms of bandwidth and computing power. Some of the early search engines met their demise when they couldn't afford to keep their crawlers growing as fast as new web content comes out.

    - The Sorter: Once the long list of results that match the keywords are pulled out of the crawl, a sort needs to be applied in order to locate the best results and present them first. Google got vaulted to the top because PageRank was better than anybody else has ever put out. However, PageRank isn't perfect, so there is still room for somebody to make something better than PageRank.

    -Promotion: A web site just sits there unused if it isn't promoted. Google never spent much on advertising and it just relied on word of mouth since it was so strong in the other two areas. And now that everyone turns to them first without even checking other engines, that has given them the strong advantage of a strong brand image. However, we've seen plenty of cases where inferior technology has been beaten out by better marketing. If somebody's tech passes Google, without marketing it nobody will know about it. Therefore, look for the challengers to be launching major ad campaigns inviting people to at least try them before they assume Google is better.

    Can anybody put it all together? We're about to find out...

  40. technology ? by Tsiangkun · · Score: 5, Insightful

    I don't really care who has the most advanced search capabilities. I use google because all the paid links appear off to the side in a different color.

    Thats all I really want . . . to get my search result seperate from the commercially paid for product placements.

    --Tsiangkun

  41. Ranked by your internet favories by 8400_RPM · · Score: 3, Interesting

    Google should allow users to 'help' them. Install something on your computer so they can see when you bookmark something, and what bookmarks everyone has. For people have have 'good taste' in bookmarks, theres results count higher than someone with BS bookmarks. I think this would improve accuracy.

  42. I thought... by BlackShirt · · Score: 5, Interesting

    ... it could be great idea to publish unanswered questions as weblog.

    Even google cannot answer everything. Web is limited even if you don't believe it. You post your question. Answers will come through trackback, comments, email. Googling the web after you posted the question. Or not.

    All you need is some tag to mark post as answer or question. Hot list like metafilter to aggregate.

    Is it a good idea or does it belong to recycle bin?

    Mailing lists used to be about that. Discussing specific problems. Finding answers. Nowadays they are quite dead. Except some. Newbies, spam, whatever is the reasons. Problem is that those who possess knowledge don't have enough stimulus to share it. I don't solve that problem. The answer might be micropayments or gifts via amazon.

    But make a good deed today. Answer one or two questions. In a year it might make quite a lot. In some day you might need answer to something yourself.

    http://answers.google.com/answers/main
    http://i haventfound.blogspot.com/

  43. Google has added stemming by interiot · · Score: 5, Informative

    Google recently added stemming as a search of {quit smoke} will reveal. You can read about it in their help section. Stemming can be disabled on specific words. Otherwise the update came around November 15, 2003, but is probably still in flux, so there isn't too much good info about it yet.

  44. Google for google by DrugCheese · · Score: 2, Funny

    But google is an acronym for 'search the internet'

    Hey can you jump on your computer and MSN Search this for me ...

    Hey get on and Yahoo this term ...

    Nothing else will work ...

    --
    *DrugCheese rants*
  45. Building the wrong mousetrap by saddino · · Score: 4, Interesting

    A lot of articles (including this one) are focused with how Google (and their would-be competitors) can improve search via algorithms like PageRank; and again and again the proposed/imaged solutions are based on server-side computation. IMHO, the real solution to improving search is client-side -- and I don't mean search toolbars -- but rather using the computional power of the client to provide a better experience than what is available inside your browser. Searching in a browser is cool, but why not build a powerful Google search client app?

    As a simple example: if your a Mac user, Beholder is really a much more useful image search frontend than using images.google.com alone (yes, I've mentioned this before, but hey, a developer has to eat).

    1. Re:Building the wrong mousetrap by FreshFunk510 · · Score: 2, Insightful

      One issue I see is the user experience context.

      I'd say that 80-90% of the time when I want to do a search, I'm usually, at that point, doing something on the web. Having Google reachable at another website is convenient compared to having to fire up another client application to do a search.

      I think one feature that would be awesome in a client-side app (but wouldnt' be limited so) would be a user history of Google searches. I'm looking random things up all day and it would be cool if I could have those searches logged and organized for later review in case I want to look back at the searches I've conducted.

      --


      "Injustice anywhere is a threat to justice everywhere." - Martin Luther King, Jr.
    2. Re:Building the wrong mousetrap by GenetixSW · · Score: 2, Interesting

      The thing is, Google's servers are many orders of magnitude more powerful than your PC. It can calculate more search algorithms in a millisecond than your (or my) PC can compute in seconds. Seconds mean a lot when you're doing something like this. Very few people have the patience to wait and wait and wait, even if yes, it's fast.

    3. Re:Building the wrong mousetrap by saddino · · Score: 2, Interesting

      True, Google has optimized its search ahead of time so that its basic search is simply a matter of very, very fast hash lookups -- ones that can be handled by their server farms given the number of queries they typically work on simultaneously. And that is exactly the reason why Google can't offer more advanced data mining server-side. If ten million people wanted to perform an exhaustive analysis, Google would slow to a crawl. For basic searches, Google is fast. But for the "future of search" my bet is client-side (even P2P) computation on streamed data from Google.

  46. Re:Sometimes you want spam by chamilto0516 · · Score: 2, Insightful

    But then it is not SPAM anymore is it? SPAM is unsolicited commercial email. If you are aggregating it then it is no longer unsolicited.

    --
    Magic Eight Ball: Outlook not so good., Hmmm, how about Excel and Word?
  47. Back in Undergrad by ducomputergeek · · Score: 4, Interesting

    Google really helped with research papers couple years ago, but now I find there's too much spam. So much so, that now I'm into Grad studies, I am going to Lexis-Nexis to find out information about topics. Also I have found that the Internet is certianly not what it used to be either in terms of quality of content. There used to be a lot more academic sites appear when I searching for information on a topic. Now, especially being in an political science related field, International Affairs, doing a web search on some topics leads to dozens of ranting bloggers instead of more academic type work.

    --
    "The problem with socialism is eventually you run out of other people's money" - Thatcher.
  48. People who put the start by gnu-generation-one · · Score: 2, Funny

    of their message in the subject line

    remind me of

    tomshardware, and sites which think that too much information

    in once place might spoil things

  49. Look harder by stewby18 · · Score: 3, Informative

    Actually, there essentially is a meta-moderate link tucked down at the bottom of the page:

    Dissatisfied with your search results? Help us improve.

    It's not an automated system, but it does let you report "bad moderation".

  50. Or maybe they shot their wad by Ars-Fartsica · · Score: 2, Insightful
    Smart does not imply creative. Their research will be shaped by what Google is already doing - it is hard for people to truly get a new perspective - this is what the market provides for through competition.

    Also the risk-taking will drop off a cliff once they are public. The litmus test for new products is much more stringent once you have quarterly reports. And yes, they are going to have an IPO, stop debating it.

  51. Re:I've heard the New Coke disaster was planned by Shenkerian · · Score: 3, Informative

    Yeah, I'd read that, too. But Snopes claims it's not true.

    --
    You tell me how "whilst" differs from "while," and I'll stop calling you a pretentious jackass.
  52. Beyond google... by Anonymous Coward · · Score: 2, Informative

    Some of these smaller natural language engines are beginning to look very promising, see: answerbus,brainboost,webqa

    Interesting as to why the big boys are largely ignoring this domain. I suspect old man jeeves has turned people off to the possiblity of reliable QA.

  53. Yes, Google has some problems by Everyman · · Score: 4, Insightful

    Yes, Google has a spam problem. It has been getting worse over the last year. In April, 2003 Google stopped crawling the web once per month, and then recalculating PageRank based on that monthly crawl. Since then, there has been a question of whether PageRank can even be calculated accurately by Google.

    I speculated about a 4-byte docID overflow problem in an essay last June at Google Watch. In recent months Google started a "Supplemental Index" for some curious, unexplained reason. Their total number of pages indexed was recently updated to 4,285,199,774 -- just below the maximum for a 32-bit integer. It looks as suspicious now as it did last June.

    Last November, Google began using an on-the-fly filter to further refine the search results for ecommerce sites. Some spam was deleted, a lot of other spam took its place, and a lot of mom and pop ecommerce sites were dropped inadvertently. Many people were unhappy.

    Further evidence that Google's old ranking system is broken is the fact that three famous Googlebombs, "french military victories," "weapons of mass destruction" and "miserable failure" are all still working. The first one is eleven months old. It used to be that such Googlebombs were suppressed at the next monthly crawl, when PageRank was recalculated. Now it seems that suppressing them is beyond Google's ability. How else can you explain why Google puts up with these widely-publicized embarrassments?

    Google's results remain unsurpassed for noncommercial sites from EDU, ORG, and GOV domains, however. Their crawling of the noncommercial sector is the most complete of any engine. The reason Google does so well here is probably because spam isn't much of a problem in this area.

    So far Yahoo doesn't appear to be making much of an effort at covering the noncommercial web. It should be added that Google has more of a spam problem simply because spammers have been focused on Google for so long. Once Yahoo gets the same attention from spammers, then we'll be able to make a fair comparison of Yahoo with Google.

  54. Search as ongoing computer experience by hackrobat · · Score: 3, Insightful
    "Right now, when you want to search for information, you basically stop everything you're doing, pull up a separate application, run the search, then try to integrate the search result into whatever you were doing before," says Microsoft information retrieval expert Susan Dumais.

    FWIW, in Mozilla Firebird, you can select a bunch of text, right-click on it, and go "Search the Web"... . I've never had to open a separate window for searching. Now, it would be so nice to have this in other apps.

    Take email, for example. My idea is that when I'm posting a query to a mailing list, as I type in the words, the program should dynamically build a set of "related links" for the content I have typed in the email. That way, people won't have to ask me to STFW everytime I act clueless and send a simple query to the list.

    Alright, I'm kidding. I'm not a clueless user, but you get the idea. For any content on my screen at any given time, I'd like to be able to access "related content" from... er... a sidebar on the screen?

  55. KartOO by xandroid · · Score: 2, Insightful

    What about KartOO, which visually maps out relationships between sites? At the moment it's a meta search engine (the beauty's in the visuals, not the out-of-date results it gets from AllTheWeb and Lycos), but if it became the new way of looking at Google's results I think it'd be the Next Big Thang.

    --
    $ echo "ceci n'est pas une pipe" | sed -Ee 's/(eci n|pas )//g'