PDA

View Full Version : Lookup Registered IDNs


seesawgame
19th September 2012, 01:04 AM
This post from here (http://domainclub.org/showthread.php?t=33585)

I think this website is good tools for IDNers :)

Hello there,

Today we want to announce a new website developed for IDN lovers,
this site is dedicated to providing access and detailed WHOIS information of all registered Internationalized Domain Names.

Let's take 北京(Beijing) as an example:
http://idnlookup.com/search.php?query=%E5%8C%97%E4%BA%AC&submit=IDN+Lookup

You will see that there are 3,138 registered IDNs related to 北京.

And 中国(CHINA):

http://idnlookup.com/search.php?query=%E4%B8%AD%E5%9B%BD&submit=IDN+Lookup

You will find 43,702 results.

Please visit our website for further information: http://idnlookup.com

squirrel
19th September 2012, 01:38 AM
well done

Steve Clarke
19th September 2012, 01:44 AM
Nice!

Drewbert
19th September 2012, 07:16 AM
website owner must be watching his stats because he's just joined up :)

Option to order listings by domain length rather than alphabetical might be useful :)

niche
19th September 2012, 07:55 AM
Hello everyone,

I am the website owner of IDNLookup.com (http://idnlookup.com),
Thanks for accepting my membership!

For now IDNLookup.com has 1.3 million registered IDNs in the database,
which are composed of .com, .net, .org, .info, .biz (updated once a week).

I will add some more TLDs like .tel .name.... into our database soon,
any feedback is welcome!

Drewbert,
I will make the order searchable by domain length shortly,
thanks for your suggestion! :)

Drewbert
19th September 2012, 08:04 AM
Here's another suggestion. Don't put a lot of time into adding loser TLD's like .tel or .name - hardly worth the effort.

DktoInc
19th September 2012, 08:41 AM
This is fun. hmmm, let see who the biggest TM holder is. :lol:

thegenius1
19th September 2012, 05:27 PM
A nice feature to add would be if they could be sorted by oldest registration date.

Ryu
20th September 2012, 12:36 AM
Quite amusing to see what sort of names people have registered that contain my favorite keyword.

A fun tool.

sbe18
20th September 2012, 05:46 AM
thank you for a very nice service.

the 43,000 ++ , China in IDN's is a very nice figure to finally know..

domainguru
27th September 2012, 03:06 PM
Any idea how often this tool is updated i.e. re-read the IDNs from the zone files?

niche
27th September 2012, 05:57 PM
Hello domainguru,

It will be updated once a week,
we just renewed the database today. :)

By the way,
the "sort by" function was launched last weekend,
we will add some more functions next week.

domainguru
27th September 2012, 05:59 PM
Hello domainguru,

It will be updated once a week,
we just renewed the database today. :)

By the way,
the "sort by" function was launched last weekend,
we will add some more functions next week.

That's great, niche, and thanks for the quick update. Really nice tool, and adds another viewpoint on valuing domains!!

Keep up the great work.

If you ever add an API, please let us know.

bumblebee man
27th September 2012, 06:53 PM
Cool site.

Checked a few of my keywords. The top scores so far:

- a Turkish one with 118
- a Russian one with 243

squirrel
27th September 2012, 07:06 PM
you should sell your technology to Sedo

bumblebee man
27th September 2012, 07:35 PM
you should sell your technology to Sedo

... if you want it to be destroyed.

They fuck up everything. A couple of weeks ago they introduced their new "Domain Exposé" which was supposed to show stats like GAKT search volume. Guess what shows up now:

?&?%? has 0 monthly searches.

They even fail to fail at failing.

domainguru
27th September 2012, 08:23 PM
Cool site.

Checked a few of my keywords. The top scores so far:

- a Turkish one with 118
- a Russian one with 243

I've got one with 6,000 - but that's cheating as its a single-letter domain :-p

Best to date for a real keyword of mine is 311 - เชียงใหม่ [chiang mai] - my home town. Bit of a shock actually, was expecting top Thai one to be เกมส์ [games] or เพลง [music / songs], but it beats them both into a cocked hat.

Sure there must be bigger hitters in languages with more IDNs regged, like Russian.

Anyone with a keyword scoring over 500? or 1000 even?

Dimkin
27th September 2012, 08:23 PM
Very nice, good job. I think it will be very popular instrument for description of the domain before selling ))
I also checked few domains and once of my Hebrew domain that I registered month ago, there is missing
What deflection can be expected?

bumblebee man
27th September 2012, 09:04 PM
Sure there must be bigger hitters in languages with more IDNs regged, like Russian.


Not mine (unfortunately :no:) but 网 with 51k will be hard to beat.

TrafficDomainer
28th September 2012, 02:15 AM
Not mine (unfortunately :no:) but 网 with 51k will be hard to beat.

Wow, Chinese really love the red colour - 网 (auspicious I suppose). 51k is surely hard to beat. The highest Thai keyword I have is รถ [car(s)/vehicle(s)] at 1,043.

jose
28th September 2012, 02:53 AM
First try o mine it fails: I tested a popular Portuguese letter:
http://idnlookup.com/search.php?query=%C3%A9&submit=IDN+Lookup

domainguru
28th September 2012, 04:27 AM
Wow, Chinese really love the red colour - 网 (auspicious I suppose). 51k is surely hard to beat. The highest Thai keyword I have is รถ [car(s)/vehicle(s)] at 1,043.

Nice try, and a good domain, but as you know, domains containing "รถ" could be about any of the following (plus dozens of others):

รถไฟ - train
รถตู้ - minibus
รถบรรทุก - truck
รถเมล์ - bus
รถจักรยาน - vehicle
รถกระบะ - pick-up truck
รถเข็น - trolley
รถทัวร์ - coach
รถไฟฟ้า - sky train
รถถัง - tank
รถบัส - bus
รถโดยสาร - bus
รถราง - tram
รถไถ - tractor
รถพยาบาล - ambulance
รถเครื่อง - motorcycle
รถลาก - rickshaw
รถพ่วง - trailer

But Thai, being essentially monosyllabic, is like that. Words (= domains) often only gain real meaning when a qualifier word is added.

TrafficDomainer
28th September 2012, 05:27 AM
Nice try, and a good domain, but as you know, domains containing "รถ" could be about any of the following (plus dozens of others):

รถไฟ - train
รถตู้ - minibus
รถบรรทุก - truck
รถเมล์ - bus
รถจักรยาน - vehicle
รถกระบะ - pick-up truck
รถเข็น - trolley
รถทัวร์ - coach
รถไฟฟ้า - sky train
รถถัง - tank
รถบัส - bus
รถโดยสาร - bus
รถราง - tram
รถไถ - tractor
รถพยาบาล - ambulance
รถเครื่อง - motorcycle
รถลาก - rickshaw
รถพ่วง - trailer

But Thai, being essentially monosyllabic, is like that. Words (= domains) often only gain real meaning when a qualifier word is added.

Sure it could be used as a qualifier too, that's why I translated the term รถ in my earlier posting to be either car(s) or vehicle(s). The above examples you provided used รถ to mean vehicle as a qualifier. However รถ can also be used as a stand alone term to refer to car(s).

In my opinion, this makes the term รถ [car(s) or vehicles (s) ] in Thai very powerful as a domain, as you could develop รถ.com to being a site more than just for selling cars, it could be used as a classified website to sell cars plus any of the above vehicle you mentioned and more, if so desired.

niche
28th September 2012, 06:24 AM
First try o mine it fails: I tested a popular Portuguese letter:
http://idnlookup.com/search.php?query=%C3%A9&submit=IDN+Lookup
I still don't know why but it looks like some european characters are deemed to be the same as their similar "english characters", for example:

e
è
é
ê
ë

I will try to figure out the problem later,
sorry for the inconvenience at this moment.

niche

glow
28th September 2012, 09:08 AM
Nice tool! Very useful

alpha
28th September 2012, 10:55 AM
I still don't know why but it looks like some european characters are deemed to be the same as their similar "english characters", for example:

e
è
é
ê
ë

I will try to figure out the problem later,
sorry for the inconvenience at this moment.

niche

It's not just latin characters, check out the results for this Japanese domain: オカマ
it shows 3 results, the 1st result has none of the characters above おかま.com

edit:

comparing the punycodes for these 2:

オカマ xn--kckc7m
おかま xn--t8jc7m

the only similarity is in the punycode, surely you're not comparing punycodes as your identifier of what strings are similar :facepalm:

potentially a great tool by the way

edit again for the irony watchers:

both of those domains while in different scripts translate (http://www.csse.monash.edu.au/~jwb/cgi-bin/wwwjdic.cgi?9U)to the same thing
(n) volcanic crater; buttocks; male homosexual :eek:

welkin
28th September 2012, 11:53 AM
It's not just latin characters, check out the results for this Japanese domain: オカマ


i noticed this as well, it seems to treat corresponding katakana / hiragana as the same. like when you search for a katakana character in a document, it will find the equivalent hiragana well.

still a cool tool.

alpha
28th September 2012, 01:13 PM
i noticed this as well, it seems to treat corresponding katakana / hiragana as the same.

sure it makes it an interesting tool for that, but its usefulness declines.

it would be better if it simply did a unicode character match. the punycode is irrelevant

welkin
28th September 2012, 01:59 PM
sure it makes it an interesting tool for that, but its usefulness declines.

it would be better if it simply did a unicode character match. the punycode is irrelevant

for sure, actually this very thing could be what's causing the issue:

http://stackoverflow.com/questions/7050221/mysql-difficulties-hiragana-and-katakana-are-treated-as-the-same

jose
28th September 2012, 02:20 PM
I have been doing character match for ages and never had any issue.

Mysql is fine, as long as one uses UTF8 to store all the values.

Now, PHP might be an issue since there are many string manipulation functions which were not fully utf8 compatible.

I remember finding a library to deal with that, but the latest PHP has solved all the issues, I think.

Also, niche should sanitize the input better because the site is vulnerable to injections... you forgot to sanitize the ?page input ;)

niche
28th September 2012, 03:50 PM
I have been doing character match for ages and never had any issue.

Mysql is fine, as long as one uses UTF8 to store all the values.

Now, PHP might be an issue since there are many string manipulation functions which were not fully utf8 compatible.

I remember finding a library to deal with that, but the latest PHP has solved all the issues, I think.

Also, niche should sanitize the input better because the site is vulnerable to injections... you forgot to sanitize the ?page input ;)
Hello Jose,

Thanks for explaining the issue to me,
I will try to fix the utf8 compatible problem this weekend,
and I've already fixed the page input. :)

niche
29th September 2012, 01:57 AM
for sure, actually this very thing could be what's causing the issue:

http://stackoverflow.com/questions/7050221/mysql-difficulties-hiragana-and-katakana-are-treated-as-the-same

Thanks for your link,
it works like a charm!

The problem for latin, katakana / hiragana characters has been solved.

i.e:
http://idnlookup.com/search.php?query=%C3%A8&submit=IDN+Lookup

Really appreciate all of your feedback. :)

domainguru
29th September 2012, 05:43 AM
Sure it could be used as a qualifier too, that's why I translated the term รถ in my earlier posting to be either car(s) or vehicle(s). The above examples you provided used รถ to mean vehicle as a qualifier. However รถ can also be used as a stand alone term to refer to car(s).

In my opinion, this makes the term รถ [car(s) or vehicles (s) ] in Thai very powerful as a domain, as you could develop รถ.com to being a site more than just for selling cars, it could be used as a classified website to sell cars plus any of the above vehicle you mentioned and more, if so desired.

Yep its a very decent domain for sure. I should know, I regged it :-p

domainguru
29th September 2012, 05:51 AM
Thanks for your link,
it works like a charm!

The problem for latin, katakana / hiragana characters has been solved.

i.e:
http://idnlookup.com/search.php?query=%C3%A8&submit=IDN+Lookup

Really appreciate all of your feedback. :)

There's an issue with Thai search as well. It can't tell tonal marks apart it seems e.g.

ป่า (forest)

contains all the domains with:

ป้า (crazy)

in. Totally understand its a mySQL / php issue, not yours. Do you use the mySQL fulltextsearch to search keywords? I'm guessing so.

Oh, i just read that link to stackoverflow and also tried your tool (oops, bad phrasing) again this morning and the issue is fixed :)

So can I ask, just adding the "BINARY" to the SELECT statement completely solves all these search issues? If so, that's epic. I'm doing a Thai site at the moment that needs a bug free search tool so if would like to know the solution :)

niche
29th September 2012, 09:46 AM
So can I ask, just adding the "BINARY" to the SELECT statement completely solves all these search issues? If so, that's epic. I'm doing a Thai site at the moment that needs a bug free search tool so if would like to know the solution :)
Yes! Adding the "BINARY" to the SELECT statement completely solves all these language issues. :yes:

domainguru
29th September 2012, 12:33 PM
Yes! Adding the "BINARY" to the SELECT statement completely solves all these language issues. :yes:

Awesome, thanks!!

g
30th September 2012, 09:23 AM
works very well with arabic, great tool thanks ))) :yes:

alpha
30th September 2012, 10:26 AM
works great now! thanks. rep added.

Drewbert
30th September 2012, 10:32 AM
both of those domains while in different scripts translate (http://www.csse.monash.edu.au/~jwb/cgi-bin/wwwjdic.cgi?9U)to the same thing
(n) volcanic crater; buttocks; male homosexual :eek:

Well, I'm pretty sure you weren't searching for volcanic craters.

Awkward.

niche
2nd October 2012, 03:19 PM
Hello Everyone,

we are happy to announce that we just added the translation function for IDNLookup.com,
for example, when you search "美国" in IDNLookup.com, you will not only see the chinese keyword, puny code, but also its meaning in english.

i.e.

美国 (xn--vcsx75g) United States
http://idnlookup.com/search.php?query=%E7%BE%8E%E5%9B%BD&submit=IDN+Lookup&page=1

動画 (xn--hhr831f) Video
http://idnlookup.com/search.php?query=%E5%8B%95%E7%94%BB&submit=IDN+Lookup

Currently we only support Chinese and Japanese, but we will make more languages available soon. :)

domainguru
29th October 2012, 06:00 PM
you don't seem to have updated the db in the last few weeks. Are you planning a "refresh" soon?

thx

domainguru
7th November 2012, 01:13 AM
What happened to the announced "once a week" update? Its been a month or more now.

Or is this another project with initial enthusiasm that quickly peters out?

domainguru
19th November 2012, 01:40 AM
Still no updates ... sigh. Another great idea fired by initial enthusiasm but no business plan :no:

squirrel
19th November 2012, 03:13 AM
you seem genuinely disappointed

domainguru
19th November 2012, 04:58 AM
you seem genuinely disappointed

I am. Really just because I was using it as a trending tool to see how many new domains regged in various markets. If the developer has said "we plan to update annually" or "every 3 months" I would have been fine with that, its free after all, but he said "weekly updates".

I know ... best laid plans of mice and men .....

I don't expect something for nothing, if he's given up on the regular updates fine, just nice to be know one way or the other.

niche
5th December 2012, 11:19 PM
Dear all,

Sorry for disappointing you in the past month,
I was very busy on my own work so there was really no time for me to do other things...

Finally, I got free time and I just updated the database today so it is now up-to-date. (Dec 5 2012) :)

At the beginning I hope to earn a little money from AdSense via IDNLookup.com,
However, my AdSense account got banned soon after by Google due to external links to adult contents,
because there are a few IDNs with "porn" keywords in the domain database...

You know everyone of us wants to make a living from the Internet, for now I can't promise "once a week" update but I will still try my best to maintain the service,
I think "once a month" may be an achievable frequency.

Currently I use "semi-manual" method to update the database,
so it takes me a lot of time, however, I will develop an automatic method to do the process in the future, which will make it "daily update", but I am not sure when I will be able to finish it, please allow me a few more months.

Before that I will post every update notice here. (may be once a month like what I mentioned above)

Thanks for your support!

http://idnlookup.com
(http://idnlookup.com)
niche

domainguru
6th December 2012, 03:03 AM
that's brilliant news, and thanks for keeping us in the loop. Its a very difficult thing to monetize for sure ..... can you post when you do an update? :) (At least until you have the fully automated daily solution)

niche
6th December 2012, 03:13 AM
that's brilliant news, and thanks for keeping us in the loop. Its a very difficult thing to monetize for sure ..... can you post when you do an update? :) (At least until you have the fully automated daily solution)
Sure I will post when I do an update! :yes:

niche

domainguru
7th December 2012, 05:42 AM
Sure I will post when I do an update! :yes:

niche

A couple of ideas if I may:

1) Domain sites rarely make any money from Google Adsense. CTR rates are terrible, lack of inventory, something like that ...

2) To be commercial, you need sponsors. The site can't cost a lot to run if you get it even semi-automated, so you could charge relatively little, and just get a few sponsors to break even. But to get sponsors, the service has to be good, which it is, and update regularly.

3) To get into search engines, and grow traffic organically, you need to turn look-ups into static pages. So if someone looks up "ผม", you have a script that turns that into a static page e.g. idnlookup.com/keyword/ผม

Then when someone else looks up the same keyword, you show them that static page, and update it "as they look".

This is roughly how who.is works.

Without producing static pages, you are basically a one-page site. You will be much better off as a growing dynamic site which Google can see as such, and also other sites can link to these new static pages.

niche
23rd February 2013, 12:39 AM
Thanks domainguru!

I will take your suggestions into consideration.

By the way, I've just updated the IDNLookup database yesterday. :)

Currently there are more than 940,000 registered IDN .com and around 280,000 .net

We also launched another new website called Dict.to http://dict.to

which is a multi-language dictionary service,

for example, when you type http://dict.to/idn into your browser,

you will find that IDN means 国際化ドメイン名 in Japanese, 国际化域名 in Chinese and so forth, another example is http://dict.to/domain .

Hopefully these tools are useful to you guys.

bwhhisc
23rd February 2013, 07:00 PM
Thanks for the update!
Quite a few .nets still registered.

alpha
20th September 2013, 08:20 PM
I guess this service has stopped

domainguru
21st September 2013, 02:49 AM
I guess this service has stopped

There's a shock. Website that costs money to maintain but has no business plan stops operation :-p

Its a pain actually. I linked to that site on every domain listing page on www.thaidomains.com, so potential buyers could instantly see how popular a keyword was ........

Bummer - have to remove the link. Thanks for the heads up!!

niche
3rd December 2013, 04:09 AM
Hello Everyone,

I feel terribly sorry to announce that IDNLookup.com is closed permanently due to non-profitable.
However, if you still want to check the current zone file (registered domain records),
I can sell you the text copy of all IDN .com & .net database as a package at only $100 per every request. (once)

There are 1,024,008 IDN .coms and 319,159 IDN .nets as of today. (2 Dec 2013)

P.S. The zone file database is renewed on a daily basis, if you want to buy it, please send me a PM, and I will send you the most up to date version after receiving the payment.

Thanks!

mulligan
3rd December 2013, 06:01 PM
Edit: I can't be arsed

alpha
3rd December 2013, 08:14 PM
I feel terribly sorry to announce that IDNLookup.com is closed permanently due to non-profitable.

If everyone took down non-profitable IDN sites, there would be no idntools, idnnews, idnblog and the countless other sites out there that people have up with the simple goal of furthering the IDN cause.

oh and this forum wouldn't be up either.

jose
4th December 2013, 12:28 AM
And idn.bz :)

niche
22nd January 2018, 06:58 AM
Hello everyone, after almost 5 years I've launched a new tool for searching all registered domains called dotDB.com (https://dotdb.com), it includes all gTLDs, new gTLDs and also ccTLDs, most importantly it supports punycode(IDN) perfectly. :)