Bug 833 - Tool to help hand tweaking of GA'd scores
Summary: Tool to help hand tweaking of GA'd scores
Status: RESOLVED FIXED
Alias: None
Product: Spamassassin
Classification: Unclassified
Component: Score Generation (show other bugs)
Version: unspecified
Hardware: Other other
: P2 enhancement
Target Milestone: ---
Assignee: SpamAssassin Developer Mailing List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2002-09-05 04:41 UTC by Matthew Cline
Modified: 2002-10-17 04:01 UTC (History)
0 users


Attachment Type Modified Status Actions Submitter/CLA Status
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Matthew Cline 2002-09-05 04:41:09 UTC 
There should be a command-line tool which can be given spam and non-spam
corpusii, plus a scores file, and spit out the FP and FN rate, plus the
fitness value of the rule set; that way if someone thinks that the GA
made a bad score, they can fiddle with the score and see if that improves
things, and if it does they'll have the evidence to back it up.  And if
we find rules for which human intuition does better than the GA, we can
use that info to tweak the way the GA works to produce better results.
Comment 1 Theo Van Dinter 2002-10-12 15:24:13 UTC 
Oh, BTW...  Please don't add a new bug saying "revise this old bug", it's 
extremely annoying.  You can just add a comment to the actual bug...
Comment 2 Theo Van Dinter 2002-10-12 15:26:22 UTC 
Subject: Re: [SAdev]  Tool to help hand tweaking of GA'd scores

On Sat, Oct 12, 2002 at 03:24:14PM -0700, bugzilla-daemon@hughes-family.org wrote:
> Oh, BTW...  Please don't add a new bug saying "revise this old bug", it's 
> extremely annoying.  You can just add a comment to the actual bug...

Hmmm.  This should have gone against bug 1108. :|  Oops.
Comment 3 Justin Mason 2002-10-17 12:01:42 UTC 
about time I closed this.  This has been in CVS, for a while,
called "fp-fn-statistics" ;)

You simply run mass-check, tweak the scores, and run this; it'll
spew out the FP/FN rate, and a TCR. Repeat steps 2 and 3 to
taste.