Slashdot Mirror


After 19 Years, DMOZ Will Close, Announces AOL

Its volunteer-edited web directory formed the basis for early search offerings from Netscape, AOL, and Google. But 19 years later, there's some bad news. koavf writes: As posted on the DMOZ homepage, the Open Directory Project's web listing will go offline on March 14, 2017. Founded in 1998 as "Gnuhoo", the human-curated directory once powered Google and served as a model for Wikipedia.
A 1998 Slashdot editorial prompted Richard Stallman and the Free Software Foundation to complain about how "Gnu" was used in the site's name. "We renamed GnuHoo to NewHoo," a blog post later explained, "but then Yahoo objected to the 'Hoo' (and our red letters, exclamation point, and 'comical font')." After being acquired for Netscape's "Open Directory Project," their URL became directory.mozilla.org, which was shortened to DMOZ. Search Engine Land predicts the memory of the Open Directory Project will still be kept alive by the NOODP meta tag.

The site was so old that its hierarchical categories were originally based on the hierarchy of Usenet newsgroups. As it nears its expiration date, do any Slashdot readers have thoughts or memories to share about DMOZ?

60 comments

  1. Archive team Go! by sims+2 · · Score: 1

    Hopefully the archive team will get a good mirror of the site.

    --
    Minimum threshold fixed. Thanks!
    1. Re:Archive team Go! by Anonymous Coward · · Score: 1

      The DMOZ has kept downloadable archives of their entire directory. I'm sure it will be cloned by dozens of people.

      It's sad to see this project go under. I used their directory data to back one of my first web projects. I also discovered a lot of resources related to my interests through it that I wouldn't have found otherwise.

    2. Re:Archive team Go! by koavf · · Score: 5, Informative

      I've already contacted Jason at Archive Team and the community will fork and continue on at a new location. MusicMoz has agreed to host a static version until then.

    3. Re:Archive team Go! by ls671 · · Score: 1

      Sadly, I never heard of DMOZ. Time to download the archive I guess.

      Back then, I used to use Lycos which is 4 years older than DMOZ an a year older than Yahoo.

      --
      Everything I write is lies, read between the lines.
    4. Re:Archive team Go! by Anonymous Coward · · Score: 0

      It appears that there hasn't been a whole lot to hear about lately. Considering how little activity there was on the forums, it seems like the project ground to a near-halt a while ago.

      It is possible, however, that archive.org might be able to put some life back into it.

  2. dmoz was awesome by Anonymous Coward · · Score: 3, Insightful

    i ran a motorcycle related website for several years. i listed the site on dmoz. was consistently at the top of searches because of it.

    i started getting phone calls from SEO companies, claiming they could get my website to the top of all searches. so i asked how they found my website. was told they searched for it. and where were they finding it? already at the top. silly people.

  3. Re:More evidence our society is collapsing by Anonymous Coward · · Score: 1, Insightful

    Let's start with eradicating people who don't know when to make a paragraph.

  4. Only one thought by 93+Escort+Wagon · · Score: 1

    The site was so old that its hierarchical categories were originally based on the hierarchy of Usenet newsgroups. As it nears its expiration date, do any Slashdot readers have thoughts or memories to share about DMOZ?

    Yeah... don't let the door hit you on the way out.

    Seriously - this is an idea whose time past many, many years ago.

    --
    #DeleteChrome
    1. Re:Only one thought by ArchieBunker · · Score: 4, Insightful

      I never heard of the site until this very moment and it sounds like what Yahoo was doing in the early days. I never ever recall using Yahoo even when AltaVista and Lycos were the kings.

      --
      Only the State obtains its revenue by coercion. - Murray Rothbard
    2. Re:Only one thought by Hans+Lehmann · · Score: 1

      ... whose time passed...

      --
      09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0
    3. Re:Only one thought by Gravis+Zero · · Score: 1

      ... whose time passed...

      whose or whomse? ;)

      --
      Anons need not reply. Questions end with a question mark.
    4. Re:Only one thought by nsuccorso · · Score: 2

      Seriously - this is an idea whose time past many, many years ago.

      Yeah! Just like spelling and grammar and stuff! It's all, like, so yesterday! We're just in it for the kicks, dude-bro!

    5. Re:Only one thought by drinkypoo · · Score: 1

      I never ever recall using Yahoo even when AltaVista and Lycos were the kings.

      Well, back when Hotbot was the king, Yahoo! was still a useful thing. My drinking games site was listed there and got many referrals from Yahoo.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    6. Re:Only one thought by Anonymous Coward · · Score: 0

      We're just in it for the kicks, dude-bro!

      What you said, bromate!

  5. whatis DNS? by Anonymous Coward · · Score: 0

    or is this prejudiced DNS protocol? why notburnit on CDROM and deliver by Snailmail for $1?

  6. Boo Hoo by turkeydance · · Score: 1

    or Boo Gnu. funtimes.

  7. Community fork by koavf · · Score: 5, Informative

    If you want to help us continue the Open Directory Project, you can join at the Resource Zone: https://www.resource-zone.com/

    1. Re:Community fork by Frosty+Piss · · Score: 0

      If you want to help us continue the Open Directory Project, you can join at the Resource Zone: https://www.resource-zone.com/

      No, not really.

      --
      If you want news from today, you have to come back tomorrow.
    2. Re:Community fork by koavf · · Score: 1

      Oh wow. Then it will be one of an infinite number of things you don't do. No need to update us on all of them.

    3. Re:Community fork by ArchieBunker · · Score: 4, Funny

      Hey can I join your web ring?

      --
      Only the State obtains its revenue by coercion. - Murray Rothbard
    4. Re:Community fork by koavf · · Score: 3, Funny

      Of course—just sign the guest book.

  8. Alphabetical... by Anonymous Coward · · Score: 0

    Yeah, I remember I worked at a newspaper and the publisher mistakenly thought that since we were listed toward the top of our category on DMOZ, that we'd be listed as such on Yahoo, Google, etc. It was next to impossible to tell her how wrong she was so I let her keep believing it. AFAIK, she's probably still thinking that the paper's name has some form of positive influence on their ranking.

  9. I've been in the game a while... by Anonymous Coward · · Score: 0

    I have never heard of this site (I resisted the temptation of saying "hurd of this site").

    I've been using "the internet" since 1988 or so when I thought it was called "arpanet". I am very familiar with usenet. Pretty sure this thing never really mattered.

    1. Re: I've been in the game a while... by Anonymous Coward · · Score: 0

      How were you using the Internet in 1988 when you were born in 2005?

    2. Re: I've been in the game a while... by Anonymous Coward · · Score: 0

      lol-- math burn. I never said I grew up.

    3. Re:I've been in the game a while... by SpaceDave · · Score: 3, Interesting

      Pretty sure this thing never really mattered.

      Oh it mattered. In the mid/late nineties it was a very important part of SEO. Back in the days when it was actually cool to be involved in SEO, DMOZ was one of the very few human-curated and trusted directory of genuine websites. It was enormously influential and surprisingly difficult to get into. There were also rules about "duplicate sites" which actually just meant "similar in concept" - they actually thought that each idea only needed one website per category. It seems incredibly quaint and naive now, but if you weren't the first website of your type listed in a category, you risked summary judgement as a copycat and excluded forever.

      DMOZ was also mirrored all over the place. In the early days of Google Pagerank, link numbers were all that mattered and DMOZ gave you a large number for free. Of course DMOZ itself was high PR too. Honestly,every time I got a website into DMOZ I had a party to mark the occasion.

      Of course it didn't last, nor should it have. The submission process became a joke. New submissions weren't even being considered while outdated sites kept their listings. Editing wars got petty (I was an editor for my geographic region but I eventually walked away). It was very sad to see its demise but frankly I was lucky to have been accepted into its ranks early - if I had been a few years later I would have been excluded and disadvantaged. It was a nice idea suited to a younger less mature Internet.

    4. Re:I've been in the game a while... by stevesliva · · Score: 1
      I don't recall any overly stupid "duplicate site" rules. "Geographic regions" were the worst for this sort of thing. You'd have people with sedona-arizona-hotels.com, sedona-arizona-trips.com, sedona-arizona-camping.com and they were all handwritten HTML with multicolor comic sans, and yeah, we didn't want to list all three because we're fricking human beings who can recognize your crappy family of websites. No doubt some well meaning people tried to codify that.

      But yeah, that's way outdated. It's not like anyone's eyeballs are scrolling through the category any longer. Google basically killed that idea with shockingly good search results.

      --
      Who do you get to be an expert to tell you something's not obvious? The least insightful person you can find? -J Roberts
  10. DMOZ was awful by Anonymous+Brave+Guy · · Score: 3, Interesting

    Some years ago, a site I was involved with was moving. Someone contacted DMOZ with a simple request not to keep listing the old address, because their influence on search engines was distorting the rankings and putting the old, soon-to-disappear, out-of-date site higher than the new, up-to-date one. That was creating significant problems for people getting the wrong information, and that in turn was causing a lot of hassle and wasted time for our volunteer organisers who had to clean up the mess. The DMOZ rep basically told us they wouldn't change anything because they were there for users not site operators. They couldn't seem to understand that what we were asking was in the interests of those users, nor why we blocked all traffic giving their site as a referrer from both sites afterwards. From our perspective, it might have been a well-intentioned idea, but it was run by people with a terrible attitude and ultimately did more harm than good.

    --
    If you disagree, post your argument. (-1, Overrated) isn't your personal censorship tool for views you don't like.
    1. Re:DMOZ was awful by Anonymous Coward · · Score: 1

      this is where all the dickhead editors at wikipedia cut their teeth.

    2. Re:DMOZ was awful by alphatel · · Score: 1

      Sadly I must agree. Initially I was able to get a site or two listed but as time drew on, everything became impossible at DMOZ. It was easier just to do SEO and let Google rank the pages based on an algorithm rather than hoping someone at DMOZ saw your site as being worthy of indexing. I once read an article about the politics of being an editor, which far outweighed any original interest to serve the public good. It's been trash for over 10 years and although it is sad to see another chapter in the web close, its relevance faded long ago.

      --
      When the foot seeks the place of the head, the line is crossed. Know your place. Keep your place. Be a shoe.
    3. Re:DMOZ was awful by Anonymous Coward · · Score: 0

      While I agree it was difficult to get anything added or changed on Dmoz after a certain time, a simple 301 redirect from your old site to your new site would have been simple to implement, beneficial for your users, and kept the benefits provided by the link for search engines to your new site.

      You do know that Dmoz was a directory edited by volunteers, right?

    4. Re:DMOZ was awful by Anonymous+Brave+Guy · · Score: 1

      IIRC, we no longer had control of the old site at that point. Everyone's access had been transferred to the new system but the old one wasn't removed from the hosting service as quickly as it should have been for some reason, so it was just sitting there as a misleading zombie for a few weeks. That was why we wanted the link updated.

      As for volunteers, lots of things on the Web are updated by volunteers (including the site I was talking about) but if you're knowingly screwing things up for other people then I think it's fair to call you out for it.

      --
      If you disagree, post your argument. (-1, Overrated) isn't your personal censorship tool for views you don't like.
    5. Re:DMOZ was awful by Anonymous Coward · · Score: 0

      Yup, getting anything listed after 1999-2000 was near impossible, seemed to me that the editors thought they where some type of internet god.
      If you had a project that needed a list of site urls it worked pretty good other than that I am surprised its still up and not dead since 2002

  11. They were dead 10 years ago. by Kaenneth · · Score: 2

    Massively out of date and useless, and not accepting new volunteer help as well for the last 10 years.

    A dead organization.

    1. Re:They were dead 10 years ago. by solanum · · Score: 5, Interesting

      I was an editor for a couple of sub-categories for quite a few years, starting soon after the ODP was set up. In the end I gave up though, as you say, it was massively out of date. It was a nice idea, and remains a nice idea, but is simply impractical these days. When the web was largely static it was useful. Now, not so much, sadly.

      --
      Si hoc legere scis nimium eruditionis habes.
    2. Re:They were dead 10 years ago. by Anonymous Coward · · Score: 1

      I offered to edit a few categories and took their "test" and actually took a fair amount of time doing so. They rejected me because I had a conflict of interest with websites that I didn't disclose. I was involved in one website, which I listed, but they said, "Nope." I wrote and asked, "What sites are you talking about?" They wrote back that they were under no obligation to respond to my questions. That was the last time I ever went to their site. I think the year started with a "1".

    3. Re:They were dead 10 years ago. by LWATCDR · · Score: 2

      I miss the directory idea. Search helps you find what you are looking for but directories helps you find what you did not know existed.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
  12. DMOZ Historical Archive by Anonymous Coward · · Score: 2, Informative

    Will the internet suffer from not archiving DMOZ. Probably not. If possible a list of original websites registered with DMOZ within the first couple of years should be archived for internet historical reasons. I had a handful of websites registered with DMOZ. I'm old.

    Back then if your website wasn't registered with DMOZ and spidered it was almost considered part of the dark web. DMOZ was a very important thing if you were a web designer. DNS wasn't as prolific back then so you actually had to register your site to get crawled by spiders. Any site worth mentioning was registered with DMOZ, from Intel's website down to your domain name hosted on Geocities or Angelfire. It was a guaranteed way to get your content indexed by search engines during a time when there was no guarantee that a search engine could find you. So yeah DMOZ did help a ton of aspiring web designers to get their websites noticed by major search engines during the internets infancy.

    The internet doesn't work that way today, you can't even put up a public facing homepage on your home network without it getting crawled within a day. Today every IP and port in the world is constantly being pinged, scanned, and scraped by spiders. 1997-1999 was completely the opposite, it was hard to get discovered! You had to go out of your way and register your website with spidering sites. Each search provider like Yahoo/Google/DogPile/etc.. had their own online form so registering with each spider was very tedious. DMOZ consolidated all of them into 1 form saving you a ton of time and effort. Search providers found you by traversing DMOZ, saving them resources as well. If you wanted your website to be publicly visible DMOZ really helped get that process started for you or your company, for free.

    DMOZ played a very important role. I remember them fondly for making my life easier.

    1. Re:DMOZ Historical Archive by Anonymous Coward · · Score: 1

      DNS wasn't as prolific back then so you actually had to register your site to get crawled by spiders.

      How does this have anything to do with DNS?

  13. Astalavista Baby by future+assassin · · Score: 1
    --
    by TheSpoom (715771) Uncaring Linux user here. I have nothing to add to this but please continue. *munches popcorn*
  14. This. by Anonymous Coward · · Score: 0

    This attitude killed dmoz long before it became outdated, and it threatens much of the web today. No site may be under a legal obligation to disclose why a particular decision was made, but they are all under a moral obligation; and, I believe, it is only a matter of time before it becomes a legal one for the big ones.

    It will be a good thing. Too many are harmed when sites monopolize entire fields or means of social contact without accountability or interest in transparency.

    No my friends, you must disclose if you wish to have any integrity. You may have made an error. You may have misidentified a user, or their background, or something else - and if you are never willing to tell them, they can never correct you and you can never be better.

    And you must be better.

  15. Organic SEO requirement - get listed on DMOZ by AndrewFlagg · · Score: 2

    as in my days (daze), to get a better SEO reputation, getting listed by DMOZ was on the checklist. i liked DMOZ just like WINGNUT and GOPHER stuff... ahhhh how the days have passed when CUTEFTP and WINZIP were really needed. alas, i concede... gzip and other open source solutions at least still live on...

  16. Was a good thing, back in the day... by bradley13 · · Score: 2

    Back in the day, when search engines were nearly useless, curated directories like DMOZ were the best way to find what you were looking for. I used it a lot, and also curated some topics.

    That said, I haven't even thought about the site in over a decade. This article prompted me to check: some of my entries are unchanged after all these years. Which just goes to show how inactive DMOZ has become. I'm actually surprised that it still exists - certainly, it is no longer relevant to the modern web.

    --
    Enjoy life! This is not a dress rehearsal.
  17. Re:More evidence our society is collapsing by Anonymous Coward · · Score: 0

    If you're using a monitor more than 1280 pixels wide don't complain you dumbfuck. Also, learn to use the zoom function.

  18. And so it ends by lucasnate1 · · Score: 2

    More and more of the internet is dying, siphoned away into google or facebook.

    1. Re:And so it ends by tbuskey · · Score: 1

      I used to read usenet. My reader had killfiles that could exclude specific authors, subjects, content, etc. I'd skim the subject line then dive into the articles if I was interested.

      Now I use an rss reader. I'd love to have anything like killfiles.

  19. Those were the days... by confused+one · · Score: 1

    I remember the internet in the early '90s. You could go out and find an index that listed almost every site that existed, by category. DMOZ is a classic example of this. Mosaic browser on Unix machines... That brings back memories.

  20. I was an editor there.. by Dynamoo · · Score: 3, Interesting
    I was an editor there.. in fact I still am, and over my years I achieved editall status.

    It was a great idea when it was created, but over time the landscape of the web changed. DMOZ was founded before Wikipedia and even Google, back in the days that finding stuff was *hard*. DMOZ editors would curate lists of sites that would give a good overview of the topic, but it turns out that Wikipedia's approach to topic curation was better in the long run (and I think that many DMOZ editors are also Wikipedia editors). Directories also died a death as search engines got better, and in the end DMOZ was only really important for SEO purposes.

    A long outage at the end of 2006 didn't help at all, and many editors didn't come back after that. Every time I log in I am horrified at the enormous backlog of submissions. For a long time, DMOZ was a great and useful resource. I don't think it has been the case for a while though, but the data it curated is still of value and it would be good if it could be preserved somehow.

    --
    Never email donotemail@WeAreSpammers.com
    1. Re:I was an editor there.. by retroworks · · Score: 1

      Yep, I was an editor from about 1999 to 2006. It did have a positive effect on SEO back then. But then I had to reapply to be an editor, and since it was kind of a thankless task I gave up. As wilth Wikipedia, it was fairly easy to detect the personality of the people in charge of the group one was subgroup/topic editor of, and sometimes there was suspicion of bias in the industry website DMOZ approval/disapprovals. Overall quaint, I have some fond memories, but wouldn't bother to resurrect the thing.

      --
      Gently reply
    2. Re:I was an editor there.. by stevesliva · · Score: 1

      Every time I log in I am horrified at the enormous backlog of submissions.

      The last time I logged in, apparently about 10 years ago, I was horrified at the enormous backlog of everything. And I could look at everything, because I was a metaeditor.

      The last time there may have been any balance was when it was easy to become an editor and the site hadn't become a peer to Yahoo. Most editors weren't malicious, might add their own site if that's all they wanted to do, and buzz off. Of course they'd be keyword loaded crap, but there might be someone else around to fix it.

      Those halcyon days may have ended somewhere in 1999. Once it became clear that sites needed to be in there for good SEO rankings, there was absolutely zero volunteer will or throughput to deal with that tsunami. And given that there was basically a dialtone on the other end when it came to submitting sites, people simply applied to become editors and *that* backlog became ridiculous and unresponsive too. Made worse by the fact that the solution to malicious editors getting in was for the meta-volunteers to insist amongst themselves that they spend tens of minutes on editor applications that we at one point reviewed in tens of seconds.

      It's been interesting in the ensuing years to see sites like Wikipedia, Stackoverflow, Reddit, and Quora deal with reputation and hierarchies, and anointing people with too much time on their hands.

      I have to tell you, being blessed with superpowers is a lot more fun before they start bogging things down in process. I'm pretty sure I was the first root editor of "Business" and had what they called catmv permissions, so at that point I could just create and move categories based on 1-2 opinions. Having all the tools available to fix the problems that you identify, and simply being able to do it... nice. A few years later and not being able to do it without a forum thread... less nice.

      --
      Who do you get to be an expert to tell you something's not obvious? The least insightful person you can find? -J Roberts
  21. Before the Big Backbones... by Anonymous Coward · · Score: 0

    I recall well the brief window between the appearance of the WWW (that's what we called it) and the establishment of robust private backbones, when WWW access was good enough for individual site access (despite still using dial-up modems) but was horrible for doing bulk address scanning to find servers (still called "war dialing" for a while - terminology change took time). Accessing sites wasn't the problem, finding them was.

    The first "link aggregators" were simple text pages full of links, typically hosted on academic servers and often shared via USENET. This process was error-prone and tough to keep current, just as was previously the case with BBS phone number lists shared via FidoNet.

    But there was an early tool that helped: Just as "war dialing" for modems relied on accessing all numbers in the local exchanges (to avoid long-distance and interstate tolls, which once was a thing), a tool (whose name I forget) soon appeared that would scan for web servers across IP blocks based on latency: IP blocks with long latencies were skipped. The tool creators asked that its results be shared only when scanning public networks, though it was also used to probe internal accounts for unknown servers started by curious engineers. It was based on earlier tools used to find FTP, Gopher and Finger servers.

    We used the IP scanning tool not only to find sites, but also to compare ping times to these sites from various ISPs, leading to the first ISP performance ranking charts (as well as modem and IP stack performance comparisons).

    Many of us also wrote our own tools to obtain better statistics and automatically update link lists. The first online database application I ever used was one I helped build to bridge together a scanner, dBase, and a bare-bones WWW server on a creaky PC/AT running MS-DOS. I recall getting it to scan while serving was a major victory (I had to get the server to run as a TSR routine - remember those?).

    It didn't take much for my little site to become popular enough to make it extremely unstable. And my ISP started to notice my saturated connection. The experiment ended within a few months.

    If only I had thought to create a link ranking algorithm...

  22. Poor Pence by Kozar_The_Malignant · · Score: 0

    Oh no. Whatever will Mike Pence do for a search engine?

    --
    Some mornings it's hardly worth chewing through the restraints to get out of bed.
  23. free ontology by djradon · · Score: 1

    I fantasized about stealing their category hierarchy RDF file (i.e., structure.rdf.u8.gz ) - for building a classification thingamajig of my own. Here's their short sample: http://rdf.dmoz.org/rdf/struct...

    1. Re:free ontology by djradon · · Score: 1

      oops, bad URL! This one works: https://www.dmoz.org/rdf/struc...

  24. Re: More evidence our society is collapsing by Anonymous Coward · · Score: 0

    Or just not bother reading posts from retarded antisocial obsessives.

  25. Sad remembering early listings for our sites by Paul+Fernhout · · Score: 1

    I had not know DMOZ was the early basis of some part of Google... Sad to see the loss of the scaffolding of the web -- but it is true that communities move on or at least individuals do. Glad Archive.org and others are making a copy of it -- but you can't as easily make an archival copy of a community.

    One issue with DMOZ was that you got (at the time) at most two listings per item. The book "The Disciple of Organizing" shows instead how one can have a facet-based approach with multiple categories instead of, or in addition to, to a single hierarchical one.

    Some of our listing for work by my wife and I from way back when (and the sadness is also much more for remaining unrealized potential on the projects -- still wanting to redo them in JavaScript for the browser -- than just DMOZ's passing):
    http://www.dmoz.org/search?q=k...

    Kurtz-Fernhout Software
    Formerly commercial programs now available for free. Garden with Insight is a garden simulator, and PlantStudio is botanical illustration software.
    http://www.kurtz-fernhout.com/
    Home > Gardening > Landscaping
    [That should really have been under Science > Software > Simulation]

    Embedded Squeak, Speech Synthesizer
    By Kurtz-Fernhout Software: version 1.0 for Squeak 2.2, by Paul Fernhout. Zip file has standalone Exe file to run Squeak in Win95 text-only console, and all source code (VC++ 5.0, Squeak 2.2) to produce it. [Open Source, Squeak license]
    http://www.kurtz-fernhout.com/...
    Computers > Programming > Languages > Smalltalk > Squeak > Software

    PlantStudio
    Tool for creating pictures of 3D plants. It simulates herbaceous (non-woody) plants like wildflowers and cut flowers, vegetables, weeds, grasses, and herbs using a parameter-driven simulation of plant growth and structure.
    http://www.kurtz-fernhout.com/...
    Computers > Software > Graphics > 3D > Rendering and Modelling

    StoryHarp Audioventure Interactive Fiction
    Voice-operated interactive fiction including text-to-speech, sounds and music.
    http://www.kurtz-fernhout.com/...
    Games > Video Games > Adventure > Text Adventures > Design and Development > Authoring Systems

    OSCOMAK: Open Source Community On Manufacturing Knowledge
    Goal: create a distributed global repository of production knowledge of past, present and future processes, materials, products.
    http://www.kurtz-fernhout.com/...
    Computers > Open Source > Open Content

    --
    A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.