Lingua::DetectCharset - Routine for automatically detecting cyrillic charset.
use Lingua::DetectCharset;
$Charset = Lingua::DetectCharset::Detect ($Buffer);
The returned $Charset is either 'WIN', 'KOI8', 'UTF8' or 'ENG'. The last is return when no single cyrillic token are found in buffer.
This package implements routine for detection charset of the given text snippet. Snippet may contain anything from few words to many kilobytes of text, and may have line breaks, English text and html tags embedded.
This routine is implemented using algorithm of statistical analysis of text, which was proved to be very efficient and showed around 99.98% acccuracy in tests.
John Neystadt <john@neystadt.org> Portions by M@kr <http://pub.kem.ru/dev>
perl(1), Convert::Cyrillic(3).
Part of "WWW Cyrillic Encoding Suite" Get docs and newest version from http://www.neystadt.org/cyrillic/
Copyright (c) 1997-98, John Neystadt <http://www.neystadt.org/john/> You may install this script on your web site for free To obtain permision for redistribution or any other usage contact john@neystadt.org.
Drop me a line if you deploy this script on your site.
To install Convert::Cyrillic, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Convert::Cyrillic
CPAN shell
perl -MCPAN -e shell install Convert::Cyrillic
For more information on module installation, please visit the detailed CPAN module installation guide.