Slashdot Mirror


Google To Create "Blog" Search; Potentially Remove From Main

Skyshadow writes "Google, search engine of choice for pretty much everyone, has announced that it will begin a seperate index for blogs and remove them from the normal index, handling them instead in much the same way as their usenet archives. This will hopefully put an end to the recent difficulties locating primary source material among the mountains of blogs which are clogging the ratings system." There's been comments from elsewhere that says they won't be removing them - but that remains to be seen.

88 of 304 comments (clear)

  1. Good... now I can finally find some Porno by JohnnySkidmarks · · Score: 2, Funny

    lousy words is gettin in the way of my pictures

    --

    I went to battle MC Escher but drew a blank

  2. journals by asv108 · · Score: 5, Interesting
    Will /. journals be included in this?

    Is there any chance of having an RSS feature for journals, for everyone or even just subscribers?

    1. Re:journals by jawtheshark · · Score: 5, Interesting
      --
      Ahhh...the great dumpster continuum. Many a free computer will be found there. -- sowth (748135)
    2. Re:journals by jawtheshark · · Score: 3, Interesting

      Oh, wait.... It says "User-agent: Mediapartners-Google*" can scan everything. This surprises me however. Still, that's not "GoogleBot", which I see from time to time in my apache logs.
      Anybody got an idea what "Mediapartners-Google*" exactly is?

      --
      Ahhh...the great dumpster continuum. Many a free computer will be found there. -- sowth (748135)
    3. Re:journals by Anonymous Coward · · Score: 2, Informative

      You see that block of ads at the top of the page, that looks like some classifieds crammed into a banner?

      That's what "Mediapartners-Google*" is. Google driven ads for slashdot.

    4. Re:journals by Cyberdyne · · Score: 5, Informative
      Oh, wait.... It says "User-agent: Mediapartners-Google*" can scan everything. This surprises me however. Still, that's not "GoogleBot", which I see from time to time in my apache logs.

      Anybody got an idea what "Mediapartners-Google*" exactly is?

      Mediapartners-Google would appear to be Google's ad engine - it tries to determine "relevant" ads for the page by spidering it beforehand. Presumably, you would only see hits from that bot if you serve Google text-ads; GoogleBot is the crawler which drives the actual search engine.

      (Aside: Those text ads were quite tricky to filter out - not being images, there's no 'block images' option! Putting "127.0.0.1 pagead.googlesyndication.com" in /etc/hosts did the trick, though...)

    5. Re:journals by cygnusx · · Score: 5, Interesting

      > Those text ads were quite tricky to filter out

      You're entitled to block them if you wish, of course, but if the ads don't consume too many bits, and bring the site-owner some moolah, and don't interfere with your browsing, how does blocking text ads help?

      Knee-jerk ad-blocking will only kill free content on the net, imho.

    6. Re:journals by Stiletto · · Score: 2, Insightful


      Advertisements are intrusive no matter what form they take. Just because they use less bits and/or are smaller on the page doesn't change the fact that they are unwanted.

    7. Re:journals by fjordboy · · Score: 3, Insightful

      I'm not so concerned about the journals so much as just forums and discussion boards in general. The blogs don't bother me nearly as much as looking for something on google and the first 30 responses are just people spouting out opinions in messageboards....not unlike usenet. I've had to sift through page after page of forums and discussions to find the real information. I'm all for adding a blog.google.com or something, but I think that doing a similar thing with discussion boards and forums would be a good idea as well.

      However, I think there is a potential problem with blogs that also contain real content or at least original content. A lot of people have regular webpages that they just update regularly in a blog fashion...will there be a seperation?

    8. Re:journals by AndroidCat · · Score: 3, Insightful
      Putting "127.0.0.1 pagead.googlesyndication.com" in /etc/hosts did the trick, though...

      You might want to use 0.0.0.0 instead. That way you won't get an access attempt on localhost. I usually only block annoying ads (x10) or privacy problems (doubleclick). I don't see the point in blocking Google's text ads.

      One day I'm going to put a mini-server on 127.0.0.1 that serves up cute cat pictures instead of blocked banner ads. :^)

      --
      One line blog. I hear that they're called Twitters now.
    9. Re:journals by AndroidCat · · Score: 3, Interesting
      There Ain't No Such Thing As A Free Lunch. Google provides an excellent free service, and uses relevant text-only ads to pay for it. I look at most web sites as a package deal. If their ads are too much of a PITA, I tend to avoid the site.

      Ah well, your option. Some people do find ads matched to the search to be a useful feature.

      --
      One line blog. I hear that they're called Twitters now.
    10. Re:journals by jonfelder · · Score: 2, Interesting

      Why did this get moderated up? With respect to google, how else do you expect them to make money? Would you rather they charged you per search instead? In many cases ads are annoying, however google's are about the least intrusive as they get.

      In google's case, I'd say the service is worth the slight inconvienence of the ads.

    11. Re:journals by delphi125 · · Score: 2, Insightful

      Compare and contrast:

      A) The ad for HPC I/O: A brief history at the top of this slashdot page.

      B) The ad I get when I search for slashdot on google (It says: "Google is hiring (expert software designers)". YMMV)

      C) The ad on Dutch TV which has some bimbo checking if her white trousers are bloody around the crotch area. (Several variations, for both tampons and pads, she looks over her shoulders to check from behind in a mirror or kicks up in front of a mirror). Note that this occurs at maximum volume first thing in to the ad break.

      Now while I agree with you that ads can be intrusive, I personally don't mind even simple banners - my brain has learned to ignore them. As for pop-ups and flashing, Mozilla serves well. Interstitials (gamesp?) are rare as yet; we will work around those when we have to. Google ads are directed, and on the rare occasion I am search for a product rather than just information, I may well use them. By comparison, these are insignificant compared to TV ads.

      Which is why I want a Tivo in Europe!

    12. Re:journals by Cyberdyne · · Score: 2, Informative
      Could you provide more details on this please? I didn't find any reference to the host you mentioned in the google results page source (which had text ads)...

      Different system. Google's search results have the text inserted inline, by the search engine itself; I was talking about the "banner ads" carried by other sites (including Slashdot). Obviously, Google can't insert those ads inline as they do for their own site - instead, the site includes a snippet of javascript, which retrieves the appropriate banner ad from that host. Browse around Slashdot until you hit one of these ads, then look at that page's source.

    13. Re:journals by cheesyfru · · Score: 2, Insightful
      The real question is whether Slashdot itself will be included in this. I don't see how Google will determine if a given website is a blog, and if so, which parts of it are. Slashdot looks like a blog. It has stories posted by humans. Stories can be commented on. It offers an RSS feed.

      Then there are sites like mine, which is part blog and part my website as a singer/songwriter. How would Google determine which parts are which? I'd be pretty peeved if the whole site was tagged as a blog.

  3. blogs.google.com? by fewnorms · · Score: 5, Insightful

    Thing is, some of these blogs actually contain some pretty handy info from time to time, as blogs are becoming more and more used as a cheap and easy alternative to a content management system imho ....

    --
    Veni, Vidi, Velcro!
    1. Re:blogs.google.com? by GT_Alias · · Score: 5, Interesting
      Which is why Google is not eliminating them entirely, just moving them over to their own search.

      It's a reasonable solution, I think. Is it worth tainting the vast majority of the search results with useless blog entries just so that the (very) few blogs with good information will still show up?

      This solves their problem with bloggers manipulating search results, yet still keeps the information available to those who want it. Granted, you have to know to look for it, but it seems to me like a fair trade-off.

    2. Re:blogs.google.com? by simong_oz · · Score: 4, Funny

      some of these blogs actually contain some pretty handy info from time to time [my emphasis]

      yeh, that's true, but let's face it - the vast majority are complete and utter drivel and manage to make a cereal packet look like an interesting read.

      --
      "Because it's there." - George Mallory, when asked why he wanted to climb Mt Everest, March 18, 1923 (New York Times)
    3. Re:blogs.google.com? by ichimunki · · Score: 2, Insightful

      I don't see why a separate search would be useful. Perhaps if they had a keywords function that would apply to certain things, this would improve the ability to write a search in the first place. Something similar to the site tag where you coud then do search "foo bar keyword: -blog" to get results for foo bars that were not tagged as being in blogs. Conversely you could search +blog to only get blogs. Perhaps this could tie in with their directory-based listings as well.

      --
      I do not have a signature
    4. Re:blogs.google.com? by rf0 · · Score: 2, Insightful

      I must admit that I've sometimes found blogs more helpful than mailing lists as they normally give instruction on howto do something as the blogger just wants a personal copy for the next time they want to do it.

      Mailing lists on the otherhand sometimes just target one small part of the problem however they are both definitly useful. Of course I'm also nosy so do like to read other peoples live's ocassionaly :)

      rus

    5. Re:blogs.google.com? by Sethb · · Score: 2, Interesting

      I don't know, my blog has some very useful information that Google serves out to a lot of people needing help, for instance, this page is a lifesaver when you hose your Win2000 install using Easy CD Creator, and a lot of people still e-mail me, 2 years later, to thank me for writing it up.

      --
      When in danger or in doubt, run in circles, scream and shout. --Robert A. Heinlein
    6. Re:blogs.google.com? by poot_rootbeer · · Score: 4, Funny

      let's face it - the vast majority are complete and utter drivel and manage to make a cereal packet look like an interesting read.

      But Slashdot is a weblog... oooh, I see.

  4. 'Bout time by Surak · · Score: 4, Interesting

    I, for one, am sick of searching material only to find that the page is some asshat's blog. Nothing against blogs, but you never know where this material came from.

    OTOH, what constitutes a 'blog'? Is Slashdot a blog? Is this a blog? The lines are constantly being blurred, and I'm not sure it'll be easy for google to make that distinction.

    1. Re:'Bout time by NReitzel · · Score: 3, Insightful

      That's what makes google valuable, now isn't it? They consistantly do a good job (better than most) of separating the wheat from the chaff from the link farms.

      --

      Don't take life too seriously; it isn't permanent.

    2. Re:'Bout time by Qzukk · · Score: 4, Insightful

      Probably the distinction they will make will be between publicly-available blogging space (livejournal,deadjournal,pitas, and so on) and a personal website that is or contains a blog. This would be the easiest way, since it comes down to setting aside a few hostnames for the new search engine to crawl.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    3. Re:'Bout time by arvindn · · Score: 5, Insightful
      what constitutes a 'blog'?

      I was wondering about that too. Its not black and white, of course, especially when you want to automate it. I can think of several indications that a page is a blog, some weighted linear combination of these factors should work well enough in practice if you spend some time tweaking the weights:

      • Updated frequently
      • Keywords like "blog", "weblog", "posted by", "comments", "permanent link", and so on.
      • Got dates all over the place
      • Is hosted on one of the popular blogging sites (blogspot, lj, /. journals...)
      • Links to and is linked from other weblogs.
      This last factor is important. If you start from a rough heuristic and execute an iterative algorithm, similar to how they calculate pagerank, your blog detection algorithm will get better.
    4. Re:'Bout time by EinarH · · Score: 4, Interesting
      The other day I searched Google for some radio stuff. (helping my father find some equipment).

      Then I noticed that Radio Userland appeared very high on Google. In fact, when you search for "radio"* they get a #5 at Google. As far as i know they only existed for a year. And their popularity, as it appears on google, looks very inflated because of extremly many links in blogs.

      Checked out Daypop.com, which ranks articles/links based on the number of links in blogs. This is what I got:
      Searching All Weblogs for link:radio.userland.com... Found 3260 pages matching query.

      Thats insane. When so many blogs links to the same page their ranking on google gets very high based only on blog-popularity.


      *Searching for only radio is obvious a bad idea as google returns some 40 m. hits.

      --

      Melius mori in libertate quam vivere in servitute.

    5. Re:'Bout time by Anonymous Coward · · Score: 5, Insightful

      I, for one, am happy of searching material only to find that the page is some asshat's blog...

      because what is important, in my point of view, is to GET THE ANSWER to what I'm looking for.

      And if the answer is in a weblog that belongs to "Linux-freaks.Adhzerbahidjan", it still is the answer I'm looking for...

      I mean things like "Proftpd doesn't seem to accept fxp connections", why the hell is this part of my distro not working as I wish...can only be proposed by people having the same problem and discussing it in a blog.

      Another reason I prefer Weblogs to, say, IRC is that I don't have to humiliate myself asking "basic" questions to the 15 year old Guru that is nicknamed "EvilRootBeer" , I just have to parse a few blogs and get my answer without ANY fine manual to read.

      "Nothing against blogs, but you never know where this material came from." Because you KNOW where the news from CNN is coming from ? I mean, they show proof and research material everytime they air a show, or a major groundbreaking news ("Mass destruction weapons found in Irak","Terrorist Bretzel Fails Coup d'Etat"..."

      at least with blogs and the net, you can try and cross check the data, whereas with tv, you usualy only gulp some more mountain dew.

      I just wish you had to find you Linux docs using the manuals provided on the distro and absolutly no other acees to raw data...

    6. Re:'Bout time by mcmonkey · · Score: 5, Funny
      • Got dates all over the place

      Well, that rules out /. Anyone who spends a lot of time here certainly doesn't get dates all over the place.

    7. Re:'Bout time by samael · · Score: 2, Informative

      Radio Userland have been around for at least 5 years, if not longer.

    8. Re:'Bout time by Surak · · Score: 2, Insightful

      When searching for that kind of data, data from blogs is perfectly acceptable.

      But sometimes I search for non-tech related information (shocking, I know). In fact, I was searching for information about a rare debilitating disease that a doctor told my friend that she might have (can't remember the name anymore off the top of my head) a couple of months ago and I wanted to learn about it... I typed the name of the disease into google and the first link that came up was some asshat's blog about how his aunt had the disease and little useful info, followed by a gazillion bloggers that all were referring to the first blogger's site (apparently this blogger was quite popular).

      I was all like "Damn, I wish I could just tell google NOT to look at blogs." as searched through tons of other pages before I found a site with *real* medical information about the disease.

      As it turns out, my friend didn't have the disease. Although she had some of the symptoms, they turned out to be caused by normal fatigue or something and she was just advised to get lots of bed rest.

      But anyway, that's just one case ... there are many more times this has happened to me, but that one was particularly irritating to me.

  5. Great! by Negatyfus · · Score: 3, Funny

    Nobody wants to read your blog and this just proves that point!

    1. Re:Great! by Joe+the+Lesser · · Score: 3, Interesting

      Somehow I can't drop the feeling that this will be very similar to a spam filter...

      --
      "I only speak the truth"
      Karma: null(Mostly affected by an unassigned variable)
    2. Re:Great! by MagPulse · · Score: 2, Insightful

      I write my journal for friends, but I make my entries public. I want people who know me to be able to find my journal and read it. But it's not written for the masses, and those interested in the content will definitely use the Google Blog search instead of the standard one.

      I welcome the change, and I'm glad people won't be seeing my journal that don't want to.

  6. yay and aaah by DaLiNKz · · Score: 3, Insightful

    What about personal sites that may seem like blogs? example.. mine.. I have a blog but then again later on i plan for some more content and such.. hopefully it doesnt remove my site from the main index.. or will at least return it once the site becomes useful.

    --
    I've left to find myself. If you happen to see me, please, keep me there until I return.
  7. Yes! But will there be a metasearch? by DeHar · · Score: 5, Insightful

    This is a great idea, especially since many issues have much more commentary than source content. I love the quote "But what happens when the weblog fad dies down?"

    However, I hope they maintain links between the main search and the blog search. Finding primary sources, then a button linking to all blog comments on theis topic would be a great research tool.

    1. Re:Yes! But will there be a metasearch? by Glytch · · Score: 3, Funny

      People suddenly deciding to not talk about themselves at great length? Not frickin' likely, alas.

  8. Good to weed out.... by caffeinex36 · · Score: 5, Interesting

    Most of the useless information people put into blogs. Although, when you search for information, would you want to search 2 different locations? This is the whole claim to googles fame. I have found that many times people post how-to's in thier blogs along with other information.


    If it ain't broke...don't fix it

    -Rob

    1. Re:Good to weed out.... by Zathrus · · Score: 5, Interesting

      If you know how to do serious web searches via Google then you're already searching at least 2 locations - the main Google search and the Google Groups search. You may also search Google News separately (although the info from there is usually in the main search as well).

      I'm looking forward to this, since most of the stuff Google hits in blogs is completely and utterly irrelevant to what I'm actually trying to find. Google will probably just have another tab to click on, or perhaps a few top links to blog-specific searches if they think it's relevant (like they do with cross links to Google News searches currently). Perhaps even a configurable "Include Blogs" on the preferences page. Whatever, I don't care, just let me exclude the damn things.

      If I don't get what I'm looking for in regular search then may go search Blogs as well. After newsgroups.

  9. Personally.. by xchino · · Score: 5, Insightful

    I've found some of the best information on blogs. I have no problem with them making a blog specific search, but like the Linux specific search I hope relevant sites can still be found from the main search. It would be a pain to have to search every individual google engine for one bit of info. As it is now, I can use the main search and be pretty sure that I'm going to get a relevant result regardless of what category the site falls under. If I'm looking up what IIRC stands for, I don't really care if I get the info from a JoeBlow's blog or from howstuffworks.com.

    --
    Everyone is entitled to their own opinion. It's just that yours is stupid.
    1. Re:Personally.. by Fishstick · · Score: 2, Interesting

      Hmm, I'm hoping the results are excluded, and blog is a "tab" just like the web, images, groups, directory, news are now.

      I've found this mechanism to be really effective in helping me find what I want.

      I use the google toolbar - this defaults to a 'web' search. 95% of the time what I'm looking for comes up on the first page. If not, I can click on the 'groups' tab, where my search is repeated (like when I'm trying to figure out an error message or somesuch).

      If the thing I'm looking for is a business, or a product or something likely to be listed, then the 'directory' tab will give me good results.

      Having a 'blog' tab (and keeping the results out of the main web results), seems like a good arrangement to me. Most of the time I'm not interested in results from blogs, and it doesn't seem too much extra work to just click one more time on the main results page to repeat the search in a blog-specific area.

      I've found some of the best information on blogs.

      I think it depends on the kind of info you are searching for. In my experience, most of the blog results aren't helpful. I've wanted a way to filter them out (usually putting in -comments -posted or similar helps).

      --

      There is much cruelty in the universe, John.
      Yeah, we seem to have the tour map.

  10. Yes! by acehole · · Score: 5, Funny

    Now I can find and read about people's mundane activities more efficiently.

    e.g.

    9:30am :- ate some toast

    9:40am :- went to the toilet

    10:50am :- left the toilet to check the number of hits on my blog

    11:45am :- got a phone call, was wrong number. Might get a real call one day.

    and so on and so forth..

    --
    Be you Admins? nay, we are but lusers!
    1. Re:Yes! by Timesprout · · Score: 4, Funny

      By your toilet reference I can see you have obviously mistaken a stream of diarrhea for someones stream of consiousness .... easy mistake to make with many of the blogs out there.

      --
      Do not try to read the dupe, thats impossible. Instead, only try to realize the truth
      What truth?
      There is no dupe
  11. ID? by Acidic_Diarrhea · · Score: 2, Interesting
    How are blogs being identified as opposted to non-blog pages? I can see how newsgroups could be moved to a separate search but blogs aren't easily identifiable. Will Google rely on bloggers to identify their sites to Google? I suppose that could work as the article states that bloggers want to legitimize what they do through such a move as Google is approaching.

    I also like the analogy made by the article to the voting system where a page votes for a topic: an expert site on turtles voting for turtles once a day every year vs. a blog mentioning turtles once in that same period leads to the expert site winning.

    --
    I hate liberals. If you are a liberal, do not reply.
    1. Re:ID? by nycroft · · Score: 2, Interesting

      Probably by the source code located in the HTML template. For example, Blogger's code has to include case sensitive tags like [Blogger][/Blogger] to format the web-based posting. I'm not sure how they would tell for other types like Blog*Spot or Moveable Type. I assume they have some sort of the same types of tags. Or maybe by noting server applets related to the HTML template.

      O yeah, one more thing, Google bought Blogger, so that's another way they'll be able to tell.

      --
      Mr. Bond, they have a saying in Chicago: Once is happenstance. Twice is coincidence. The third time is enemy action.
  12. Will they at least link to the new search? by gleffler · · Score: 4, Insightful

    I just hope that Google does at least say "Hey, you might be able to find what you're looking for on our blog search" at the end or something - like they do now with Google Answers. I do applaud their effort to make their database even more relevant though, and is yet another reason I have to admit to being a shameless whore for Google.

  13. An end to 'Googlewashing'? by Snowhare · · Score: 5, Interesting

    I wonder if this is also intended to stop Googlewashing? Google has a history of trying to 'play fair' - and the power of a few well connected blogs to basically 'take possession' of any term works against that philosophy.

  14. /. is a blog, no? by Eponymous+Coward · · Score: 3, Interesting

    Am I the only one who thinks it is funny to see all the anti-blog comments everytime a weblog related story is posted? IMHO, Slashdot is a weblog.

    I think I originally found Slashdot on RobotWisdom-- yet another weblog. But that was a couple of years ago...

    1. Re:/. is a blog, no? by RobotRunAmok · · Score: 4, Interesting

      /. is a blog, no?

      No. SlashDot aggregates news stories. It's the Web generation of what the BBS guys had in CompuServe Forums and GEnie Roundtables. The staff is paid to aggregate and thread stories that are of interest to a particular community. (Sometimes they aggregate the really, really good ones more than once.) Technically, SlashDot staff don't submit the stories, members of the community do. Bottom line: it's a professional operation. (g'head, g'head, make the jokes, it's Monday, get 'em outta yer system...)

      Personally, I would use the litmus test of "professionalism" when doping out what is a blog versus what is "legitimate" content. If the "blogger" makes his living as a writer or journalist, then the blog is "supplemental online material." If the site is, as we referred to the vanity publishing phenomenon back in the early '90's, someone's "homepage," but with the added baggage of semi-regular diary entries, then it's a Blog.

      Use of "blogging software" doesn't make someone a writer, or a journalist, and it certainly doesn't automatically grant its user something worth saying, or even something factual to say.

      It's great to see Google realizing this and clamping down.

    2. Re:/. is a blog, no? by melonman · · Score: 2, Insightful

      To me, it makes sense to separate the search for primary material (like slashdot's links and features) from the commentary on it (the comments).

      I can't see how you could even begin to do this consistently. Most of the 'primary' (by your definition) material referred to on /. is summaries of or comments on something else. In many cases you could argue that it is 4 or 5 levels away from 'primary'.

      On the other hand, you often get genuinely creative stuff in response to someone else's article. In the academic community, it is not unusual for the responses to or critiques of someone else's work to end up being rated more highly than the 'primary' stuff they are commenting on (IIRC, Chomsky's review of one of Skinner's long-forgotten books is a classic example: in the process of trashing Skinner, he floated a radical new theory on linguistics).

      The Internet is all about linking content in non-linear ways. If we really want to go back to 100% primary sources, we are going to end up with "There is nothing new under the sun" as the only entry in the Google DB :-)

      (On the other matter, the O'Reilly manual title "Running weblogs with Slash" would appear to support your case...)

      --
      Virtually serving coffee
    3. Re:/. is a blog, no? by Eponymous+Coward · · Score: 2, Informative

      Take a look at RobotWisdom.com. This is one of the original weblogs and it seems very similar to Slashdot. Okay, there are no user comments (which arguably is where the value in Slashdot is), but the similarities are apparent.

      I would say that measuring the legitimacy of a site and it's content by the number of banner ads and subscriptions is foolish and far too narrow.

  15. hmmmm... by jeffy124 · · Score: 2, Funny

    maybe it'll solve CmdrTaco's troubles about him getting emails from people looking to crack hotmail.

    --
    The One Rule Of Chess You'll Ever Need: Don't play someone who carries a kit in their bookbag.
  16. blogs by Blocked+By+Sand · · Score: 5, Interesting

    One of the biggest newspapers in Norway, where I live, has recently said they believe blogs to be the new 'killer app' for delivering information on the net. The problem with that is that the treshold for publishing 'news' is so low, anybody can do it. This makes it very difficult for people to find the info they are looking for. At the same time there is no guaranty the info is useful or even correct. A good reputation will be more and more important for businesses and sites on the net.

    This move by google tells me newspapers in norway aren't the only ones seeing how influental blogs will/could become.This is a truly great step forward if Google could come up with a way of rating the different blogs. That way you could easily find serious tech-blogs.

    Wonder what rating /. would get though ;)

    --
    Be like the twenty-second elephant with heated value in space-Bark!
  17. is ./ a blog? ebay? by loomis · · Score: 5, Interesting

    As a previous poster briefly mentioned, what exactly is a blog? Would Slashdot forums be considered a blog? What about the myriad of ezboard message board forums out there, as well as other discussion websites? If the answer is no, it would be seemingly difficult and perhaps only of minor benefit to seperate just the true "blog" sites while ignoring the other sites.

    And what about ebay? Quite often I am searching for info on an old piece of electronics I've picked up someplace, and I do a goole search, hoping to find information about the item. Well, all I get in return are ebay links to a similar item that was sold on ebay a few months ago. And even then, I click on the link, hoping to see what the item sold for (and thus get an appraisal), but the auction has been removed from the database due to it being several months old. Why index ebay pages? It's really frustrating.

    Loomis

    --
    "The television is the retina of the mind's eye" - Videodrome
  18. The Register is... a bit off by friedegg · · Score: 5, Informative
    "GoogleGuy" (a real Google employee) commented on this on WebmasterWorld saying:
    I think Andrew Orlowski is taking a comment and taking it in the direction that he wants to go. I would take that article with a grain of salt.

    GoogleGuy, going for understatement. :)
    --
    Google doesn't index user sigs, so stop trying to "Google Bomb" with them.
  19. I'd rather they do this for mailing list archives by Thoguth · · Score: 4, Interesting

    I really don't mind finding blog links when I search for something, as they usually at least link to some relevant sources.

    On the other hand, it is really a pain to search for help on something, and instead of getting a useful, authoritative document, I'll get a half-dozen archived unanswered mailing list posts from people with the same problem. I would much rather Google address this dilution from mailing lists.

    --
    The requested URL /iframe/sig.html was not found on this server.
  20. Bad Idea by rwiedower · · Score: 4, Interesting

    I work at a company that has a blog-like recap of political news of interest for our clients and friends. If google tries to separate all sites with blog-like content, won't this naturally reduce my rank without actually increasing the source of information? Or am I missing something? How is google going to search for blog-like sites?

  21. Ummm... no by neurostar · · Score: 3, Insightful

    I think you're confusing a weblog with a "livejournal". A weblog is similar to slashdot (or warblogging.com and back-to-iraq.com). In fact, my weblog (http://privon.com) deals with politics, science, and civil rights as well as opinion pieces I've written about various issues. A weblog is another source of information.

    What you're thinking of is commonly called a "livejournal" and it's exactly that - a journal. Some blogs are also journals. For example, I've got two 'blogs'. One is the one I mentioned above. The other is slightly more journal oriented, with me posting about things I've done that my family and friends (and possibly others) might find interesting. For example, I've recently posted about visiting the Trek Bicycles Demo Day as well as some of my latest photography experiences.

    It might be beneficial for you to review your definition of a blog. Blogs can be an excellent source of information, not just a diary.

    neurostar
    1. Re:Ummm... no by tekunokurato · · Score: 2, Insightful

      What are you talking about? Are you saying that the average content of Blogger is any different from the average content of Livejournal? They're just different branded terms for the same thing- a personal site following a chronological updated format, containing whatever people want to put in them. For example, in my livejournal, which I call a livejournal because it uses code from www.livejournal.com, I write articles on politics, movies, creativity, or any other topic I happen to feel like writing about. On very infrequent occasions, I may write about what I did during a day. This is no different from someone who's journal slathers on about their day constantly- these sites, whether livejournal or blogger or whatever, provide a public forum for us to get our ideas and feelings down on paper for anyone who happens to want to read them.

    2. Re:Ummm... no by neurostar · · Score: 2, Interesting

      Well, I guess I shouldn't have specified live journal. My guess would be that easy publishing websites (blogger, live journal, etc...) are more often (but not always) used by people who just want an online journal. Also, the name "live journal" implies that it's a journal, not a blog.

      In fact, my first 'blog' was hosted on blogger. It was mostly a journal. Then I switched to hosting it myself with more advanced software (movable type) and my blog migrated into a more news-oriented feature. As a result, I split my blog into a more journal-oriented blog and a news/science/politics blog.

      I agree completely that a blog is about getting what you want to say out there. That's what I use mine for. I was merely responding to a comment that indicated that all blogs were just about mundane things that happened during the day.

      neurostar
  22. Wouldn't it be better by arestivo · · Score: 2, Insightful

    Wouldn't it be better if they include blogs in their searches by deafult and then have a 'remove blogs from this search' link.

    I think this solution would make everyone happy.

  23. Blur by limekiller4 · · Score: 4, Insightful

    Why not just create a "-source" flag or, as has been suggested, "-noblog"? Why are blogs being marginalized as any less authoritative than other hits? Why is using "-" (eg: ["trading cards" -hockey]) utilized for weeding out certain criteria but not employed here when the goal is the same? Could we at least have a flag for combining the two results?

    A comparison is being made between blogs and the newsgroups which are worlds apart in a number of different ways not the least of which is the thread-nature of the groups.

    What defines a blog, anyway? What defines a not-blog? Is CNN.com a blog? Is it not a blog because many people write for it, because of the number of hits it gets or because it has press credentials? Which category does indymedia.org fit into?

    Will I only get news results when I search for "ferret care?"

    What if the source IS a blog? If the subject IS the blog, will a news site reporting on the blog wind up in the main search results while the subject itself -- the blog -- be only in the blog search?

    --
    My .02,
    Limekiller
  24. Great idea. by Musashi+Miyamoto · · Score: 2, Interesting

    I love this idea... and I have been waiting for something like it for some time...

    Think about it... I would love to search the blogosphere to see how widespread certain news items have become, or how widespread a certain opinion is...

    You could use something like this to measure the spread of ideas (at least within a vocal and technologically suave minority).

  25. Don't forget Google News... by crashnbur · · Score: 3, Insightful
    ...remove them from the normal index, handling them instead in much the same way as their usenet archives...
    One would think that the Google blog search would work more similarly to the Google News search, which searches headlines from online news publications all over the web from all over the world. Google Groups is, as you know, just usenet... Google News, however, like the new Google blog search, will be indexing sites on the world wide web (ostensibly removed from the normal index).

    Ehh, the point of this message is to inform the uninformed of the wonderfulness of Google News. It automatically features prominent headlines from all over the web, and you can search for topics, keywords, etc. in the search bar and have results sorted by relevance or date. News articles are mostly excluded from the normal index, which makes Google News the best headline locator on the Internet, by far.

  26. Blogs removed from google = FUD by lysurgon · · Score: 5, Insightful

    There's no indication whether or not blogs will be left in or out of search results. This is very different from USENET, which was never part of the web in the first place. Orlowski is far from an unbiased source on this, having published many articles critical of bloggers in general. While two source are cited which are critical of the effect that blogs have had on the google ranking algorythm, none are cited which show the contributions personal publishers have made to the info-sphere.

    Far more authoratative sources that I have already weighed in on this.

    While there's certainly a lot of innane content available in blog form, this isn't really any different than it was before. I have never had to wade through 500 pages of results to find an original source either. The whole thing reeks of FUD to me Methinks that Orlowski and Roddy have their own axes to grind.

    1. Re:Blogs removed from google = FUD by lysurgon · · Score: 4, Informative
      (replying to own post)

      So here's what should be the final word:


      If Google didn't find that blogs improved the results (and I don't know, I would assume they test these things, like, constantly), do you suppose they'd increase the frequency at which they crawl them, or decrease it? Yes, that's what I think.


      From evhead
    2. Re:Blogs removed from google = FUD by eadz · · Score: 3, Informative

      Even more authorative
      GoogleGuy saying its FUD :
      "I think Andrew Orlowski is taking a comment and taking it in the direction that he wants to go. I would take that article with a grain of salt.
      GoogleGuy, going for understatement. :) "

  27. Re:Ev from Blogger by Anonymous Coward · · Score: 4, Informative
    Right, go to this entry at evhead, and view the source, you'll see:

    <span title="you know, in order to spread more 'Google censors Evhead' suspicions"></snip></span>
    <!-- Andrew Orlowski strikes with another brilliant theory designed to get attention from bloggers (even though the number of their readers is of course "statistically insignificant"). Well shit, I'm biting.

    Based on Eric Schmidt's mentioning of a blog search, Orlowski suggests that Google will remove blogs from the main index.

    This shouldn't surprise many people, but as far as I know, Orlowski is full of crap. Again. If Google didn't find that blogs improved the results (and I don't know, I would assume they test these things, like, constantly), do you suppose they'd increase the frequency at which they crawl them, or decrease it? Yes, that's what I think.

    Too bad my headline isn't any truer than the Register's.-->

  28. Weblogs vs. the World by Bartmoss · · Score: 3, Interesting

    Alright, fair enough - but how do you identify a weblog? They can do this for blogger/blogspot/whatever that they bought, and maybe standard software like moveable type etc. But what about sites based on slash, phpnuke or totally custom code? And where does a weblog begin and a news site end?

    Filtering out usenet news is relatively easy, but weblogs? Mhhh, I shall remain sceptical until I see it implemented.

    1. Re:Weblogs vs. the World by Jace+of+Fuse! · · Score: 2, Interesting

      That's a great question. Does a site with "News and Commentary" fit in the blog catagory if only one or two people write it?

      What if it looks like a blog, but has nothing but on-topic posts (whatever the news-site's topic may be)? It has too many opinion spots, though, so it can't really be purely news. Does the fact that it's about a subject, and not some person mean it's no longer a blog?

      The line between Blog-NotBlog is so fuzzy at times, I don't see how they can fairly make a distinction.

      After all, in a way, Slashdot is just a blog for the editors. Certainly some people would consider my sites blogs.

      --

      "Everything you know is wrong. (And stupid.)"

      Moderation Totals: Wrong=2, Stupid=3, Total=5.
  29. They should separate mailing list archives first by Anonymous Coward · · Score: 5, Insightful

    If they really want to make their search engine useful, they ought to separate out Web archives of mailing list discussions. Blogs usually link back to where they got the story, so with only a little digging, you can find the original material. Mailing list discussions, though, are often out of date, irrelevant, and lacking in easy-to-follow references. They annoy me much more when I'm looking for things on the Web.

  30. Thanks for the link by benploni · · Score: 3, Funny

    Thanks for making Google a link to Google's web site. I would never have been able to find it! Maybe I could have googled for it. Oh wait, nevermind.

  31. Re:What is a Blog anyway? by Phoenix · · Score: 2, Insightful

    The thing about a Blog is the simple fact that while it may contain information that is of value to a person, most of the time it is simply a day-to-day journal of random thoughts and events.

    A Web Page created by a person is usually created for a task in mind - Showing off a project (case mods, hacks on furbys, peep surgery), a fan information page (Dr. Who, Anime, Star Trek, Babylon 5), or a page created for a group (Local SCA Group, Computer User's Group, MMORPG Guild Page).

    A Blog is usually created as a online journal or diary, often for a group of friends.

    What tends to trip off the search engines are the Blog sites that link to other people by common interestes. WWW.Livejournal.com allows you to have linke by friends, and common interests. Were I to have a blog with them and I set up as one of my interests as Star Trek, then I'll likely end up with several hundred names of people that also like star trek.

    Google goes out and farms new sites. It hits so-and-so's blog in Livejounal. It sees a link mentioning Star Trek and follows it...then it sees about 1000 more ST links... 1001 ST links that likely won't have a dang thing about Star Trek on the pages (unless someone happens to brag about how he scored ST:TNG season 1 on ebay for a song).

    More and more people are blogging and hence this is why blogs (which have been around for quite a while) are now starting to become a concern for the search engines trying to filter out the signal to noise ratio.

    I like Google's idea. One of the reasons blogs like together is often so people can network with people who share common interests. If you don't and want to learn about Star Trek can find real information by going to hte main page while the people looking for fellow ST fans can go to the blog page.

    Makes sense to me

    Phoenix

    --
    -- Wiccan Army, 13th Airborne Division "We will not fly silently into the night"
  32. How to tell a weblog from content by Call+Me+Black+Cloud · · Score: 2, Funny
    Commenters have asked how Google will tell weblogs from other web content. Obviously there is not one universal way to do this so the search engine will have to look at a number of indicators:

    How often does the phrase "current mood" appear?

    How often does the phrase "listening to" appear on the same page as "current mood"?

    Does "George Bush" or "shrub" appear on the same page as "dictator", "simian", or "ass"?

    Is Wil Wheaton mentioned on the page?

    It's a start. Google will have to pay me for more...

  33. Bloogle or Bloggle? by Bonewalker · · Score: 5, Funny

    I can just see the red, blue, yellow, and green logo...BLOOGLE. Will the new term for searching blogs explicitly be "Bloggling", or will it be "Bloogling"?

  34. Re:ID? Categorization algorithms! by davids-world.com · · Score: 2, Interesting
    Categorization algorithms that combine different features would work quite well here, I believe!

    There is a wealth of categorization systems out there. Generally, they "position" the sites in an imaginary, highly-dimensional space, depending on whether keywords occurr (and how often/prominent etc.), and on certain structural properties of the documents. You can then try to define separating hyperplanes, which are functions that devide the ("feature") space into separate compartments, so you can group documents together.

    Usually, these systems are trained on a set of sample documents that are already categorized, in this case, for instance, a thousand blog pages and tenthousand non-blog pages.

    An example for this would be Support Vector Machines and Joachim's text classification algorithm.

    Relevant keywords (from the field) to look for include "Maximum Entropy Models", "classifiers", "categorization", "Bayesian *" (whatever), "Neural Network Classifiers", "Data Mining"...

  35. Bullshit. Please read. by sethadam1 · · Score: 4, Insightful

    Slashdor IS a blog. Because we're not talking about some Google employee sitting around and making a judgement call on every link on the net, it's obviously going to be automated by robots.

    Slashdot, like other blogs, pollutes search engine searches with their "permalinks," which, although they might be useful, certainly constitute a blog. In fact, one of the problems with blogs and search engines is that they generate thousands of clickable hyperlinks effortlessly. It's great for someone reading a blog and trying to bookmark a certain section - it's terrible for the guy who wants information on combatting spam through more effective use of his SMTP server and has to search through 30 pages of /. and K5 chatter to find some substance.

    Certainly, Google's criteria for what defines a blog might be helpful, but it seems to me like you're subjectively deciding which blogs are legitimate news sources and which are "some kid rambling on." Say whatever you like about the legitimacy of /., but make no mistake about it, it's a blog.

  36. Re:I'd rather they do this for mailing list archiv by _Sprocket_ · · Score: 2, Insightful

    Perhapse its more of an issue with technical questions. I constantly use Google to look for answers to, amoung other things, technical questions. More often than not, I find an answer or at least a lead that gets me pointed in the right direction. Oddly enough, they're usually from archived mailing lists if I do a web search. And I find that the quickest route is often via Google's usenet search. So yea... maybe a seperate mailing list search might be a very useful thing indeed.

    As an aside, my most recent dead end involved a Win2K error that's been popping up on one of my boxes. Usenet is full of variations on this error reported over the years without any good answers to what causes it. That doesn't mean that my Linux and Solaris searches are always gems - but it does suggest that such dead ends can be found for almost any platform on a case by case basis.

  37. ephemeral content by esme · · Score: 3, Interesting
    i don't know that i have any particular need to have blogs filtered out of the google index (i don't see them very often in the searches i do...).

    but filtering out ephemeral content in general would be good -- blogs would be included in this. so would mailing list archives, news stories, online stores, auctions, discussion groups, etc.

    when i'm searching, i almost always prefer a page that somebody authored and put up as a permanent resource (or as permanent as the web allows). the top-level pages of the ephemeral sites would probably be good to keep in the main index, though i'm not sure how you index, e.g., the /. homepage.

    -esme

  38. Offtopic... by jasno · · Score: 3, Insightful

    I've never had any problems with blogs, but the archived mailing lists are what really bugs me. Searching for something, only to have the first 10 pages of hits be duplicates in various archives of a list makes finding relevant information a bit more difficult.

    --

    http://www.masturbateforpeace.com/
  39. The real story: Orlowski (successfully) trolls /. by marmoset · · Score: 5, Informative

    Oy. If Slashdot had managed to perform even a minimum amount of editorial diligence (which, pot, here's kettle, is what the Register rails on bloggers for not doing), they'd have found pretty quickly that this article is yet another installment in Andrew Orlowski's (an up-and-coming Dvorak-wannabe) ongoing jihad against weblogs. Don't believe the hype.

  40. Re:Google's games go on... by kalidasa · · Score: 2, Informative

    Did you report it to the bug database - where it ISN'T OFFTOPIC?

  41. what is a blog by mboedick · · Score: 2, Insightful

    Determining what is and what is not a blog will be a lot harder than determining what is and is not in a newsgroup.

    I think this is a bad idea. Google has made a mistake if they think what we call currently call "blogs" are a novelty item. Blogs are the future of the web, even if a lot of people are using the technology for toy purposes today.

    I want to be able to search the entire web in a single index, blogs and all. If PageRank is giving too much noise and not enough signal due to blogs, then fix PageRank.

  42. Not Quite by emmastory · · Score: 5, Informative

    Google hasn't announced any such thing, at least as far as removing weblog content from the main search is concerned. If you read the article, you'll note that it's Orlowski speculating about a Slashdot comment, of all things - specifically, a comment from the William Gibson blog thread. evhead posted about this Register article on Friday.

  43. Is SourceForge.net a blog? by yerricde · · Score: 2, Insightful

    Updated frequently ... "posted by" ... dates ... hosted on one of the popular blogging sites ... Links to and is linked from other weblogs

    Sounds like the news sections of most SourceForge.net projects I've run into. They're updated frequently (release early, release often), the maintainers frequently post status updates on given dates, SourceForge.net has a lot of them, and they link to other projects that use their code or that contribute code that they use.

    Is SourceForge.net a blog?

    --
    Will I retire or break 10K?
  44. Re:The real story: Orlowski (successfully) trolls by beebware · · Score: 2, Informative

    It's not just weblogs he's against: just search on "El Reg" for "google" and see what strange articles you come up with "google news is edited by humans yet google claims it is by computer program - but who programs the computers?" style article. The author? His surname starts with O...

  45. a limiting interface IMO by Tablizer · · Score: 2, Interesting

    Rather than separating stuff, why not make it a series of choices using check-boxes. Example:

    Include Web-pages: [X]

    Include Blogs: [ ]

    Include Usenet: [X]

    And so forth. You can get better combos this way, If they add other "web types" in the future, you can combine searches without having to go to each one. They could still include a dedicated listing if they want, but I hope they don't hard-wire their data that way to prevent or reduce multi-factor searches in the future.

    Even more generic would be to have a pull-down list of the "strength" of each search. Thus, if you wanted weblogs included, but given less weight, you might assign it a lower number. Zero would be the same as a no-check above. However, this is perhaps too confusing to most users.

  46. How about if... by Uncle+Gropey · · Score: 2, Interesting

    ...they remove the blogs from main, then re-incorportate the highest-hitting blogs from the new search back into the main? Then you may not miss a relevant and useful blog while avoiding the one that is mainly about some highschool girl and funny text messages that she got from her friends?