Slashdot Mirror


Reluctant Wikipedia Lifts Lid On $2.5M Internet Search Engine Project (theregister.co.uk)

The Wikimedia Foundation has finally disclosed details of its controversial Knowledge Engine grant -- and it confirms that Wikipedia is getting seriously into search, despite Jimmy Wales' categorical denial that WMF is "doing a Google." After a Wikipedia signpost article, and coverage at El Reg this week, the WMF caved and posted the Knight Foundation's approval of the $250,000 grant. The grant provides seed money for stage one of the Knowledge Engine, described as "a system for discovering reliable and trustworthy information on the Internet." The discovery stage includes an exploration of prototypes of future versions of Wikipedia.org which are "open channels" rather than an encyclopedia, analyzing the query-to-content path, and embedding the Wikipedia Knowledge Engine "via carriers and Original Equipment Manufacturers."

51 comments

  1. Sounds like he want to make Wikipedia even more... by Anonymous Coward · · Score: 0

    biased. Sad to see what could have been a great site go downhill.

  2. Re: Sounds like he want to make Wikipedia even mor by Anonymous Coward · · Score: 0

    He hasn't put an end to the out of control deletionists so he dies support censorship.

  3. how useless by jtrainor · · Score: 2, Insightful

    Cool, I look forward to having a search engine primarily full of family guy episodes, anime characters, and a million roads and tiny towns in rural England.

    1. Re:how useless by Anonymous Coward · · Score: 1

      Don't forget two fat guys arguing over what should and shouldn't be added to the My Little Pony page.

    2. Re:how useless by flopsquad · · Score: 1

      Welcome to Brian's Totally Bitchin Wikindex of Portmanteaus, Inuyasha Characters, and Roads Between Penistone and Scunthorpe!

      --
      Nothing posted to /. has ever been legal advice, including this.
    3. Re:how useless by Anonymous Coward · · Score: 0

      Cool if you are, but you're not being forced to use it if you don't! If you don't plan on using it and legitimately have no interest in it, then it's probably fine to just not post a comment about it that doesn't at least include some feedback about the type of search engine you wish it'd be instead of just dissing three random subjects that Wikipedia happens to have plenty of articles about.

    4. Re:how useless by amyreyna · · Score: 1

      Next..there will be search engine for kid, groceries...even special search engine for xxx content

  4. Hopefully will end self-referencing by im_thatoneguy · · Score: 4, Interesting

    One of Wikipedia's largest problems is that it cites things which cite things which end up citing Wikipedia if you go far enough back.

    It would be great to have Wikipedia akin to Wolfram Alpha but less math and more about factual primary sources.

    1. Re:Hopefully will end self-referencing by Anonymous Coward · · Score: 0

      One of Wikipedia's largest problems is that it cites things which cite things which end up citing Wikipedia if you go far enough back.

      That's like sucking your own dick; we'd all do it if we could.

    2. Re:Hopefully will end self-referencing by wonkey_monkey · · Score: 1

      Eh. It's overrated.

      --
      systemd is Roko's Basilisk.
    3. Re: Hopefully will end self-referencing by Anonymous Coward · · Score: 0

      It's easy to spot the guys who have been sucking themselves, because they have a hunched back.

    4. Re: Hopefully will end self-referencing by Anonymous Coward · · Score: 0

      It's easy to spot the guys who have been sucking themselves, because they have a hunched back.

      Is that what happened to Dilbert?

    5. Re:Hopefully will end self-referencing by jenningsthecat · · Score: 1

      One of Wikipedia's largest problems is that it cites things which cite things which end up citing Wikipedia if you go far enough back.

      This. I see a lot of notes on Wikipedia pages looking to correct / expunge 'original research'. WTF? I get that they'd like some corroboration on and confirmation of details forming part of an entry - but every footnoted citation that they consider acceptable, links directly or indirectly to original research somewhere back up the line. If a bunch of previous sources say the sky is green, does that make it so?

      I would expect Wikipedia to encourage original research, along with the rigorous fact-checking and independent confirmation that would make it trustworthy and valuable. Previously-published material isn't inherently more reliable than original material which sees its first publication in Wikipedia.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    6. Re:Hopefully will end self-referencing by westlake · · Score: 2

      It would be great to have Wikipedia akin to Wolfram Alpha but less math and more about factual primary sources,

      The problem with primary sources is that they are rarely accessible to the general reader. The appeal of a traditional encyclopedia like the Britannica lay in the opportunity to explore in some depth subjects outside your own specialty.

    7. Re:Hopefully will end self-referencing by Anonymous Coward · · Score: 0

      The core problem is that wikipedia is camped by dumbasses who protect articles: last time I tried to edit something the edit was reverted 8 minutes after I started and 2 minutes (!) after my last edit with the reason "No sources". No matter the quality of the sources or the relevance of the change - that moron did not even give an editor the time to add the sources before reverting!

      Which means I am, again, done with contributing for at least five years.

      Also, when reading Wikipedia there are tons of "non sourced" claims, but some get to stay, some get reverted. I have not checked in detail but I bet "that buddy there wrote it, it gets to stay - some stranger wrote it, it gets to go".
      You cannot imagine my want to remove all "non sourced content" from that article I edited, it would have been at least 80%.

      Wikipedia has a problem and that are its admins.

    8. Re:Hopefully will end self-referencing by Anonymous Coward · · Score: 0

      Previously-published material isn't inherently more reliable than original material which sees its first publication in Wikipedia.

      The thing is that, if I remember correctly, the original intent of the "no original research" rule was to force people to base their writings on *peer-reviewed* and *reliable* sources. Then the bureaucratic nutjobs took over Wikipedia and just applied the rule to the letter. Kinda the same story with the deletionists. Once they won, I quit editing.

  5. Controversial? by Anonymous Coward · · Score: 0

    Wikipedia is a massive trove of knowledge. How is creating a search engine to search said knowledge "controversial"?

    1. Re:Controversial? by bestweasel · · Score: 3, Interesting

      The short article in the link has this:

      Wikimedia’s reluctance to detail the restricted grant, from the Knight Foundation, was a factor in the departure of community-elected WMF board member James Heilman in December.

      Whether that's controversial depends on whatever's been going on between the Wikimedia Foundation and Mr Heilman and how you view their motives and attitudes towards openness and those of the Knight Foundation - "Volunteers feel WMF management has purposely kept them out of the loop”. Maybe the bit about embedding the Wikipedia Knowledge Engine “via carriers and Original Equipment Manufacturers” means they hope for a commercial product, which might be controversial.

      Page 2 of the agreement asks "Would users go to Wikipedia if it were an open channel beyond an encyclopedia?"

      I expect Google would say it's controversial but that's another matter. Wikimedia intend to create "a system for discovering reliable and trustworthy information on the Internet" which is not Google's main aim: doing a Google would be trying to monopolize search and make as much money as possible.

      The John S. and James L. Knight Foundation is an American private, non-profit foundation dedicated to supporting "transformational ideas that promote quality journalism, advance media innovation, engage communities and foster the arts."

      You might want to keep an eye on their page for favourable edits. Their money came from Knight Ridder publishers. Wikipedia helpfully adds "Not to be confused with Knight Rider (disambiguation) or Night Rider (disambiguation)."

    2. Re: Controversial? by Anonymous Coward · · Score: 0

      It says a search engine to discover things on the internet. Not just Wikimedia websites.

  6. They heard Firefox OS got shitcanned by Anonymous Coward · · Score: 1

    Now they want their turn

    1. Re:They heard Firefox OS got shitcanned by jenningsthecat · · Score: 1

      Now they want their turn

      Where are my mod points when I need them? Still laughing out loud - thanks!

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    2. Re:They heard Firefox OS got shitcanned by Anonymous Coward · · Score: 0

      The comment didn't seem the least bit relevant to me. I'm thinking it's fine that you didn't have mod points to spare.

    3. Re: They heard Firefox OS got shitcanned by Anonymous Coward · · Score: 0

      Whooooooooooosh.

      Wow AC, you are a real piece of work.

      If you can't figure it out by now, then spare us the pain of reading your post and leave.

  7. what is this? by Anonymous Coward · · Score: 0

    Are moderators creating content now and promoting it on the frontpage? If you guys start shoving TechCrunch, NYT, ArsTechnica, and Forbes articles down my throat, I'm outta here. I was coming to Slashdot for things I don't see on my Twitter feed, not the same big-media PR-promoted and biased crap. Get your shot together XBIZ... this site is powered by the community, not mod-generated content.

    1. Re: what is this? by Anonymous Coward · · Score: 0

      You must be new here.

    2. Re: what is this? by Anonymous Coward · · Score: 0

      If you think that Wikipedia isn't slashdottable, then I would disagree.

    3. Re:what is this? by Anonymous Coward · · Score: 0

      You're leaving? That's too kind. We appreciate it and we're glad you finally took the hint. Do us all a favor, if you don't mind? Could you consider writing one more borderline mentally retarded post before you go? You know, for old time's sake? We'd be much obliged if we could just sit and giggle at the mental midget that feels they're anything but and posts about it constantly.

      Judging by your posting style, you just ticked the AC box. You probably didn't delete your cookies or change your IP address. You'll be here in a later article, within a day. You're not fooling anyone. See you then, liar. You've been powerlessly whining and trying to control things for a while now. You're even too cowardly to do it without ticking the AC box. Kinda pathetic, don't you think?

  8. That would be amazing by Anonymous Coward · · Score: 1

    I have a severe problem finding useful information on Google right now. Search the title of any song. The results are always 1) 1,000 lyric websites 2) 1,000 shopping websites 3) 10,000 random linkbait blogs that spam you with ads or try to trick you into downloading malware, and 4) A Youtube link and a wiki page if it's popular enough. Sometimes #4 is useful, but often it's not. I find it incredibly difficult to find what real people are saying about a topic when artificially-generated pseudo content puts so much effort into gaming the search.

    1. Re: That would be amazing by Anonymous Coward · · Score: 0

      What information are you hoping to find when you search for a song? Lyrics, ways to buy or listen to the song sound entirely relevant.

    2. Re:That would be amazing by Anonymous Coward · · Score: 0

      Searching for pop-culture isn't the best way to test a search engine's relevance. There simply isn't any meaningly useful information about Taylor Swift's latest hit, or whatever else is hot right now. If you want "real people" you can go to tumbler for all the hot-takes and weird, content-free introspection you like.

  9. Not Interesting? by Anonymous Coward · · Score: 0

    One hour into the posting, and there are only ten comments. Also, the summary says $2.5 million, but the initial outlay is a mere $250,000. This is the cost of a couple of corporate executives; so, no big deal.

    1. Re: Not Interesting? by Anonymous Coward · · Score: 0

      I think you mean 1 or less corporate executive ?

  10. In my experience... by wwalker · · Score: 1

    described as "a system for discovering reliable and trustworthy information on the Internet."

    So, Wikipedia isn't going to be the top result for many searches?

    1. Re:In my experience... by Tony+Isaac · · Score: 1

      You mean, kind of like it is on Google?

  11. Google has lost its mojo by Anonymous Coward · · Score: 0

    Wikipedia is privacy focussed, Wales has sued over the NSA warrantless surveillance, Google is a surveillance operation largely driven by the need to shove more ads into peoples faces. So this is good news.

    Plus Google these days is actually not good. Search tries to drive you to log in all the time. Prompting all the time. The results are no better than DuckDuckGo, I usually don't switch back to Google unless DDG doesn't find anything, but am rarely happier with Googles result.

    Look at Maps, its a fragmented mess, want to add a map, "Open My Maps", the zoom levels all over the place, lots of maps that are one solid green block with an arrow in the center, you zoom out to see where the f*** the map is suposed to be. Dialogs that are "Unavailable at this time", WTF.

    I think Google has lost its mojo.

    (BTW try maps.here.com for online maps).

  12. We need a nonprofit google replacement by Anonymous Coward · · Score: 0

    IMO when something becomes as large as google and is a private company there are serious dangers to manipulation and control of it's users(who to vote for, and exploitation of personal info). I know of no other organization so well positioned to provide an unbiased, non-exploitive internet search tool; If they could some how get a functioning peer to peer; backend for search it could even be cheap...

    I'd throw my own money behind something like that, do it wikipedia! plz

  13. $2.5 million dollars by flopsquad · · Score: 2

    Confirming the $250.00 grant, estimated to be worth $2.5 million, Wales admitted, "Yes, we received a $250,000 grant. But we are only spending $2.5 billion of it on search. The other $25 is going to expand our article on the base 10 number system.

    --
    Nothing posted to /. has ever been legal advice, including this.
    1. Re:$2.5 million dollars by bestweasel · · Score: 2

      Hee hee. I thought it was the common Slashdot lack of proof-reading, sub-editing, all those old-fashioned skills, and then The Register's mistake but no: the $250,000 grant is the first stage of a project costed at $2.5m

    2. Re:$2.5 million dollars by Anonymous Coward · · Score: 0

      That's the typical board meeting at the age of internet economy.

    3. Re:$2.5 million dollars by Andreas+Kolbe · · Score: 1

      Actually, the first stage is costed at 2.5 million, of which the Knight Foundation is only covering $250,000. The rest is coming out of donations. The other three stages will each cost more than the first.

      From this write-up, linked in the article (the link is on the word "costed"):

      "Page 10 of this text specifically says that the cost of the first stage of "Knowledge Engine by Wikipedia" is $2.5 million, and that the grant is for 1 year starting in September 2015. Page 2 says that the whole project is in 4 stages, each lasting approximately 18 months = 6 years. This grant of $250,000 therefore only covers 10% of the cost, of the first stage, of the total project."

  14. Wikipedia Search Engine by Anonymous Coward · · Score: 0

    "a system for discovering reliable and trustworthy information on the Internet."

    All searches point to Wikipedia website. Enough said.

  15. Re:Sounds like he want to make Wikipedia even more by Anonymous Coward · · Score: 0

    Honest question, but what kinds of articles do people who complain about Wikipedia's bias look at? I'm legitimately at a loss of knowledge here.

    Partially related- I look up things like info about the latest processors from Intel, articles on cities abroad, hard drive manufacturers, etc., and so far the only bias I've seen was one edit that I removed myself which was an advertisement for some website that violated the rules about self-promotion for a website that sold something I was researching.

  16. Hopefully will end self-referencing-semantics by Anonymous Coward · · Score: 0

    Maybe we'll finally get the semantic web everyone's been talking about for the past decade?

  17. How Ironic by drinkypoo · · Score: 1

    Their Android app doesn't even select the search field when you press the search button (it's a standard Android key code, and it used to be a common physical button back when touchscreen phones still had those) and they want to get into search?

    This is why I don't send them money. How's about spending some money to hire some professional mediators to moderate some of these article wars? That would actually be useful and make Wikipedia a better encyclopedia.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  18. Citogenesis by GuB-42 · · Score: 1

    You mean this : https://xkcd.com/978/ ?

  19. You Forgot by Anonymous Coward · · Score: 0

    You for got to carry the 2.5. You're off by a magnitude of eleventeen.

  20. Re: Sounds like he want to make Wikipedia even mor by Anonymous Coward · · Score: 0

    You have your head in the clouds my friend. All you need to do is Google for the answers you seek.

  21. Integrity and transparency (not search) at stake by peteforsyth · · Score: 1

    Several commenters here have suggested that building an alternative to Google, based on values like Wikimedia's, may be a good thing. This is a worthwhile point, and a worthwhile discussion; but it misses the point of what's problematic here.

    The problem here, the thing that has many Wikimedians worried, is that Wikimedia trustee Jimmy Wales has apparently been telling outright lies about whether the organization has considered pursuing a search engine to rival Google et al. He has made a number of unequivocal statements in recent weeks -- he himself has accused ousted trustee James Heilman of lying on the subject (but Heilman's narrative is now verified by the published grant application).
    https://wikimediafoundation.or...

    The thing that has shaken Wikimedia up is not the idea of search, but the question of whether we can expect honest communication from those entrusted with the Wikimedia brand and organization. Beyond that, it's whether that organization in fact wishes for the input of Wikimedia's stakeholders in determining its strategic direction -- something it actively pursued five years ago, but is pursuing only minimally and reluctantly now, with the Knowledge Engine grant as merely the strongest indicator of how its activities fail to align with any strategic document with strong buy-in.

  22. Re:Integrity and transparency (not search) at stak by Andreas+Kolbe · · Score: 1

    Well said. It's gotten to the point where whenever Wales starts badmouthing people and calling something "utter fucking bullshit" or a "total lie" (as he did in this case), you have to suspect that something very much resembling the exact opposite of what he says is actually true. At the same time, he claimed in those discussions he was "a much stronger advocate of transparency than James [Heilman]", the community representative he and the others had thrown off the Wikimedia board.

  23. Re:Integrity and transparency (not search) at stak by jwales · · Score: 1

    The problem with your rant, Pete, is that I have told the absolute truth at every point here. We are not pursuing a search engine to rival Google et al. This grant is not about that type of project, and that type of project would be - quite frankly - ludicrous to attempt on a $250,000 grant.

    Discovery at Wikipedia is awful, this is universally understood and acknowledged. This grant is the beginnings of an exploration of how to improve it.

    The bullshit - and it is bullshit, and I have said it before and will say it again, that this is some kind of google competitor or was ever conceived to be - is a fantasy based on absolutely no facts of any kind, and a very very very skewed and aggressive reading of a preliminary document.

    --
    Wikia