Slashdot Mirror


How Many .com Domain Names Are Unused? (singaporedatacompany.com)

Christopher Forno, CTO at Singapore Data Company writes: When looking for .com names, I've been frustrated by how many are already taken but appear to be unused. It can feel like people are registering every pronounceable combination of letters in every major language, and even the unpronounceable short ones. Is there rampant domain speculation, or do I just think of the same names as everyone else? Let's look at the data.

There are currently 137 million .com domain names registered. Of these, roughly 1/3 are in use (businesses, personal websites, email, etc.), another 1/3 appear to be unused, and the last 1/3 are used for a variety of speculative purposes. I started by crawling a random sample of the domains from the top-level .com DNS zone file, until reaching 100,000 valid domains. [...] For most categories I've included a random sample of screenshots from that category, excluding redundant ones: Content (31% or ~43 million), Ads (23% or ~31 million), No Web Server (11% or ~16 million), Empty (9.2% or ~13 million), For Sale (7.1% or ~9.8 million), Error (5.7% or ~7.9 million), Parked (4.8% or ~6.5 million), Gambling (3.0% or ~4 million), Mail (2.6% or ~3.5 million), Redirect (1.1% or ~1.6 million), Private (0.64% or ~0.9 million), and Porn (0.59% or ~0.8 million).

29 of 158 comments (clear)

  1. Ooh! Ooh! I know! by 93+Escort+Wagon · · Score: 3, Insightful

    ”Is there rampant domain speculation, or do I just think of the same names as everyone else?”

    Yes and yes.

    --
    #DeleteChrome
    1. Re:Ooh! Ooh! I know! by Solandri · · Score: 4, Informative

      Even if there is rampant speculation, and assuming a 26-character alphabet, there are 1.46*10^11 domain names between two and 10 characters. If 137 million of these are registered, that means only 0.0001% of all possible domain names have been taken.

      About a decade ago, I was trying to think of a domain name to register for a website. I wrote a short program to put together English phonemes to generate every possible pronounceable word (up to 7 letters).. Then I had the program do a whois database lookup for each fictional word as a .com domain, outputting a list of the unregistered domains. (Yeah, I'm probably part of the reason why ICANN now makes you solve a captcha before doing a whois lookup).

      All the 4-letter .com domains were gone. Most of the 5-letter domains were gone too, and the few which weren't sounded horrible. Most of the 2-syllable 6-letter domains were gone. But there were lots of 3-syllable 6-letter domains still available. There were lots of 7-letter domains still available. So many that I killed the program part-way through (at domains starting with the letter 'f' if I remember). The list of available domains it was generating was becoming so long it would've taken me too much time to look through it, trying to find one that seemed decent.

    2. Re:Ooh! Ooh! I know! by 93+Escort+Wagon · · Score: 2

      Sounds like a good time to jump on that four-syllable, eight-letter "cocacola.com" name I've been meaning to register!

      --
      #DeleteChrome
    3. Re:Ooh! Ooh! I know! by Oligonicella · · Score: 4, Insightful

      Never search for a domain. Just make a prioritized list of acceptable ones and start registering. If it's taken, it will tell you; if not, it's yours. If you search, there's no guarantee that won't be detected and squatted. Happened to me.

  2. Did you try... by hcs_$reboot · · Score: 4, Funny

    ...prefixing with 'www.'?

    --
    Slashdot, fix the reply notifications... You won't get away with it...
    1. Re:Did you try... by mindwhip · · Score: 4, Insightful

      It is a mistake to assume just because there is no web page the domain is inactive.

      Not all active domains carry public web pages. I have a number of domains that I only use for email and other non-web things such as game servers or have web pages on non standard ports and require authentication for special uses such as my private family photo archive.

      --
      [The Universe] has gone offline.
  3. obvious.com by Anonymous Coward · · Score: 4, Insightful

    Same as Land in the US, only tiny fraction is used while 100% is owned by someone. Domain names are just internet real estate, wouldn't expect it to be any other way.

  4. Wonder how many empty and error just don't have in by raymorris · · Score: 5, Insightful

    A lot of servers we do security for have stuff at http://domain.com/employeeport... and http://domain.com/he/ or whatever, but nothing on the index page.

    Another chunk are non-web servers. Domains aren't just for web sites, of course. Others are only accessible from certain networks and VPNs, something like DellTeamNet.com for Dell employees or whatever.

    I wonder how many of the "empty", "error", "unused", and "no web server" are actually used - just not for a public web site with a normal index page.

  5. "No Web Server" by XanC · · Score: 2

    There are plenty of domains in heavy use for things other than the Web. Classifying these as "unused" is probably not right.

  6. How do they know it's not in use? by mark-t · · Score: 4, Insightful

    Just because a domain doesn't have a website doesn't mean that it isn't used for something.

    1. Re:How do they know it's not in use? by dissy · · Score: 5, Informative

      How do they know it's not in use?

      He says if no web-server was running, he went by DNS records.

      Just because a domain doesn't have a website doesn't mean that it isn't used for something.

      From his report, he has two categories for "No A record but does have MX" and "No MX record but does have A records with no apparent web server"

      Mail (2.6% or ~3.5 million)
      Any domain not in any other category, but with MX DNS records (for email), I categorized as Mail. I did not attempt to see if the mail server was working or if delivery was possible. It's possible that many of these domains are not actually used for email, but I've given them the benefit of the doubt.

      No Web Server (11% or ~16 million)
      If I was unable to connect to, or receive a valid response from, port 80 or 443 for either the top-level domain or the www subdomain and the domain had no MX records, I placed the domain in this category. Some of these domains likely have some non-web use, such as an FTP or video game server, but I expect them to be a small fraction. Additionally, the crawling server was only configured for IPv4, so any IPv6-only websites would have been grouped here.

      It would seem all the other categories were determined from data returned by a web server.

    2. Re:How do they know it's not in use? by Obfuscant · · Score: 2

      and doing an name lookup will not resolve to any IP address.

      If it is a domain for email it better have at least an MX record (or whatever the IPv6 equivalent is), even if it has no A or AAAA. That's "resolving".

      If such domains are not in use, how is email sent and received through them?

      If the name does not resolve to any IP address, how is email sent to it?

    3. Re:How do they know it's not in use? by Obfuscant · · Score: 2

      A domain can exist for the sole purpose of sheltering subdomains.

      Those snowflake subdomains should get a thicker skin and learn to live on the Internet like the rest of the domains.

    4. Re:How do they know it's not in use? by Aighearach · · Score: 2

      If the name does not resolve to any IP address, how is email sent to it?

      One obvious answer that everybody on slashdot should already know; mail can be sent from systems with the right hosts file!

      Or in general, you don't have to send mail out through a mail gateway, your mail client can instead connect directly to the recipient server.

      You might have a setup where email can be routed normally inside a private network, but from the outside you have to know the IP. Like for an emergency sysadmin contact in case the private network is down, in a situation where normally everything is on the private network.

      Not saying it is common or recommended, just that there are lots of obvious places that an IP address might come from.

  7. Public www is not the only use case for domains by Anonymous Coward · · Score: 2, Interesting

    How many of these might be domains that are used only for email or other services other than www?

  8. Squatters by DaFallus · · Score: 4, Interesting

    My last name isn't incredibly common, so I thought I would buy the .com domain. Turns out it is owned by Tucows who offers to rent it to me for $35 a year under their RealNames service. I contacted them about actually purchasing the domain outright and the response I received was that sale of their domain names start around $5000.

    --
    No one cares what your captcha was

    Houston TX, USA
    1. Re: Squatters by Dynedain · · Score: 5, Informative

      Back in the first internet boom (when we wore onions on our belts since it was the style at the time) a startup registered the 20,000 most common US surnames as .com domains. They were selling email accounts. In the inevitable bankruptcy the whole thing was sold to Tucows.

      --
      I'm out of my mind right now, but feel free to leave a message.....
    2. Re: Squatters by Monster_user · · Score: 2

      Mozilla encountered this with Firefox. They didn't own the Firefox.com domain, but they arranged to share it for a while.

      I seem to recall various laws on the books rendering cyber squating largely illegal. Squatters are legally required to surrender the domain, as squatters typically cannot justify ownership of a domain.

      The question isn't whether they should give one of the alternate TLDs up. The question is whether your organization has been around for longer than the owner, to have a claim and prior art to back it up. The question is also whether the alternate domain suits your organization better than the holder.

      Dot Coms were intended to be commercial entities. Apple.com would be either Apple Computer or Apple Records. While .org would be non-profits, Apple.org would be an agricultural or educational group.

      These days .Com is a rather generic entity, similar to .net, and simply implies a web presence. The .biz tld implies a smaller company or startup, and shouldn't squatted by major entities, unless there is a significant profit to be made by spoofing their .com domain.

    3. Re: Squatters by Obfuscant · · Score: 2

      There oughta be some kind of term limit in place if you don't actually use a domain for a period of time.

      I think a point being made in this discussion is that it is hard to determine that a domain isn't being used. I have a domain that I've held for twenty-five years. It has a DNS entry, and it has an MX record to a mail server. Is it "in use"? Is that all it takes? Then your "term limit" is so trivially met that it is meaningless.

  9. All 3-4 letter combinations taken by xpiotr · · Score: 3, Informative

    Probably 5 letter combinations too... https://whoapi.com/blog/we-are...

  10. godaddy is the culprit by magarity · · Score: 4, Informative

    Years back I tried an experiment: put a domain name in a browser and not no response. Went to GoDaddy to register it and was told it was taken. Tried in the browser again and got a 'this address is for sale!' banner and an email to the address I had given GD offering to sell it to me within minutes. GD pretty much exists to suck up domain names people submit and then try to sell their idea back to them.

    1. Re:godaddy is the culprit by Anonymous Coward · · Score: 4, Informative

      If this is truly the case then you should be able to put together a reproducible test of randomized words into a domain. At that point you could document it and possibly even automate it. Once it's that obvious you can get some attention from media, ICANN and/or some other places.

    2. Re:godaddy is the culprit by Anonymous Coward · · Score: 2, Informative

      It usually takes a little more than just trying to resolve the domain name. It is well known that some domain registrars reserve domains that you look up through their web site (e.g. to see if they're available). There's even a name for it: domain name front running.

    3. Re:godaddy is the culprit by Aighearach · · Score: 2

      I've had an enom reseller account for over 15 years, and this has never happened to me.

      A few times I used the linux command-line whois tool, which queried whois.verisign-grs.com and it never happened to me there, either.

      But when a business asks you to call them "Daddy," expect to get treated the way you'd expect to get treated.

  11. Re:Interesting by 110010001000 · · Score: 2

    You don't understand: that is the equivalent of what AI is in 2019. In fact, this guy missed an opportunity to label his work as AI.

  12. They are all gone by xaosflux · · Score: 2

    Man, I can't even get a name for my startup company, even furryballsploppedmenacinglyonthetableinc.com is being park squated by a registrar!

  13. Porn Sites Primarily Chinese? by MDMurphy · · Score: 2

    I wouldn't have guessed, but not too surprised when it showed that gambling sites were primarily in Chinese. What did surprise me was the same held true for porn sites. My guess is that the great firewall would filter those out, though that was just an assumption. if true, are those sites aimed at ex-pats? Just for research purposes only, I searched Google for the word "porn" and got 4.2 billion hits. Searching for the Chinese word for porn gave me 600 million. Then I searched for the Chinese word for pornography which gave more hits, 700 million. Interestingly, clicking on "images " for the Chinese word for porn showed almost all very explicit images, while the word pornography showed suggestively, but not explicit images. Searching in English is similar, but where porn gives you porn images, searching for pornography gives you mostly anti-porn images.

  14. Re:Wonder how many empty and error just don't have by The-Ixian · · Score: 2

    You are assuming that the silos can coordinate with each other efficiently.... Never the case in a mega corp....

    Easier for the remote access team to set up their own domain than to try to navigate the waters necessary to open and maintain a sub-domain.

    --
    My eyes reflect the stars and a smile lights up my face.
  15. goatrape.com by jwhyche · · Score: 5, Funny

    I was going to make a joke about goatrape.com not being taken. Then i checked to make sure. That was a mistake.

    --
    I read at +2. If your post doesn't reach that level I will not see or respond to it.