Finding out the language of an IDN

[sevent]

Given just the punycode, is it possible to decode the language characterset of a domain?

Also, it seems that both Chinese and Japanes can have the same character, but these are different IDN's. From what I have heard, if one is taken the registry prevents you from reserving the same character in another language. Is that correct?

Thanks!

[bramiozo]

http://idntools.net/bulkpuny3.php to get the characterset from punycode.

Yes there is a thing called variant blocking, this is described here.

[sevent]

Originally Posted by bramiozo

http://idntools.net/bulkpuny3.php to get the characterset from punycode.

Yes there is a thing called variant blocking, this is described here.

Thanks for the info! I did a check of a name and it converted fine to the native looking characters but the script was labeled:

CJKUnifiedIdeographs

Does that seem right? Is there a way to find out from this info what language you are really talking about (ie. Chinese simplified)?

[Drewbert]

Originally Posted by sevent

CJKUnifiedIdeographs

Does that seem right? Is there a way to find out from this info what language you are really talking about (ie. Chinese simplified)?

What do you think might be a way of figuring out if a text string is Chinese, Japanese or Korean, or multiples of them?

[bramiozo]

Originally Posted by sevent

Thanks for the info! I did a check of a name and it converted fine to the native looking characters but the script was labeled:

CJKUnifiedIdeographs

Does that seem right? Is there a way to find out from this info what language you are really talking about (ie. Chinese simplified)?

There are unicode-ranges which are used for several languages (latin,kanji,romaji etc.), if each char of a string is within the overlapped range it is impossible to determine the language directly. One would have to rely on char-groups, char positions etc., the statistical occurrence of a certain combination would then determine the probabilities of the different languages.

It's possible but it requires quite an effort into the relevant languages if you want to pull it off.