The new version is ready to be applied to your tree.

http://www.pathname.com/~quinlan/software/spamassassin/textcat.patch
http://www.pathname.com/~quinlan/software/spamassassin/lm.tar.gz

(Apply the patch first, then unpack the tarball; the tarball will overwrite
a few files that are in the patch, but the contents are the same.)

Changes:

  - all of the languages use ISO 639 names now (like locales) instead
    of English names
  - language model files are named uniformly
  - moved a few extremely unlikely languages (some are dead languages)
    into an "inactive" directory
  - added models for ja.iso-2022 and tr.iso-8859-9 (someone could
    probably generate better ones, but these seem to work pretty well)

One quick thing that I just noticed is the $opt_d in TextCat.pm.  It's
hard-coded to be a file in /usr/local.  Can you get that?

Generating good language models is harder than I expected.  I tried
replacing a few of the existing models that seem to be less accurate,
but never managed to come up with a model that was always better than
the old one.  (I had one better in most cases, but worse in some, but
my sample is too small so I chickened out.)

Electronic books (text format) seem to work best since they are long
and more devoid of English and technical words and pretty-printing.  I
avoided using spam as inputs since it's too short and often bizarre
while the intent is accuracy (matching both good email and bad).

Let me know if you have any problems.