Bug 6139 - remove "rulesrc" external from SVN tree
Summary: remove "rulesrc" external from SVN tree
Status: RESOLVED FIXED
Alias: None
Product: Spamassassin
Classification: Unclassified
Component: Building & Packaging (show other bugs)
Version: SVN Trunk (Latest Devel Version)
Hardware: Other All
: P1 major
Target Milestone: 3.3.0
Assignee: SpamAssassin Developer Mailing List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-06-29 04:40 UTC by Justin Mason
Modified: 2009-07-16 02:30 UTC (History)
0 users



Attachment Type Modified Status Actions Submitter/CLA Status

Note You need to log in before you can comment on or make changes to this bug.
Description Justin Mason 2009-06-29 04:40:22 UTC
from an email thread --

'Also, I would also like to get rid of the "rulesrc" external, and instead
just put its contents into each branch, separately.  I don't think the
idea of sharing rules in this way between branches has worked out; in my
opinion it's caused more trouble than help (unanticipated dependencies,
complexity, SVN external = horrible anyway).  Is anyone still attached to
this idea?'

nobody piped up, so rulesrc will be going the way of the dodo (yay).
Comment 1 Justin Mason 2009-06-29 04:40:51 UTC
hm.  to clarify: it'll still be there, but just as a normal SVN directory, not a wierd SVN "external" link.
Comment 2 Mark Martinec 2009-06-29 09:47:13 UTC
> hm.  to clarify: it'll still be there, but just as a normal SVN directory, not
> a wierd SVN "external" link.

I'm not sure if I'm doing the right thing at the right place,
but some rules need adjusting for 3.3:


rules/25_dkim.cf, rules/50_scores.cf:
- remove DomainKeys rules (Bug 6098);
- drop scores of ENV_AND_HDR_DKIM_MATCH
  and ENV_AND_HDR_SPF_MATCH as a great goldmine
  for spammers;
- added new rules DKIM_VALID, DKIM_VALID_AU,
  DKIM_ADSP_*, __DKIM_DEPENDABLE;
- dropped scores to 0 for old rules
  DKIM_VERIFIED, DKIM_POLICY_*, while keeping them
  for compatibility with existing uses .cf files
Sending        rules/25_dkim.cf
Sending        rules/50_scores.cf
Transmitting file data ..
Committed revision 789382.
Comment 3 Mark Martinec 2009-06-29 10:26:25 UTC
Btw, I have a couple of adsp_override rules (comparable to def_whitelist_from_*,
but in the opposite sense, only applicable to 3.3), such as the ones below.
Should I put them in some .cf file? Where?

adsp_override ebay.com       discardable
adsp_override *.ebay.com     discardable
adsp_override paypal.com     discardable
adsp_override *.paypal.com   discardable
adsp_override paypal.co.uk   discardable
adsp_override ealerts.bankofamerica.com
adsp_override alert.bankofamerica.com
adsp_override americangreetings.com
adsp_override yahoo.americangreetings.com
adsp_override msn.americangreetings.com
adsp_override egreetings.com
adsp_override bluemountain.com
adsp_override hallmark.com
adsp_override update.hallmark.com
adsp_override *.hallmark.com
adsp_override amazon.com            all
adsp_override amazon.co.uk          all
adsp_override amazon.de             all
adsp_override amazon.fr             all
adsp_override birthdayalarm.com     all
adsp_override astrology.com         all
adsp_override linkedin.com          all
adsp_override *.linkedin.com        all
adsp_override facebookmail.com      all
adsp_override *.greenpeace.org      all
adsp_override lists.sourceforge.net all
Comment 4 Justin Mason 2009-06-29 14:51:08 UTC
ok, as of

: 500...; svn commit -m "bug 6139: add note indicating obsolete status of this copy"
Adding         README.txt
Sending        sandbox/jm/20_sought.cf
Transmitting file data ..
Committed revision 789460.


the rulesrc dirs in 3.3.0 trunk, and the 3.2.x maintainance branch, are entirely separate.

Mark: feel free to put those in a .cf in the 'rules' dir.
Comment 5 Justin Mason 2009-06-29 14:53:21 UTC
oh dear.  this is annoying:

: 36...; sudo -u automc -H svn up
Password:
svn: Failed to add directory 'rulesrc': object of the same name already exists
: exit=[1] uid=jm Mon Jun 29 21:51:36 GMT 2009; cd /export/home/automc/svn/spamassassin
: 37...; sudo -u automc rm -rf rulesrc
: uid=jm Mon Jun 29 21:51:50 GMT 2009; cd /export/home/automc/svn/spamassassin
: 38...; sudo -u automc -H svn up
A    t.rules/MIME_BASE64_TEXT
[... etc.]


In other words, "svn up" can't cope with the replacement of an external with a normal dir, and needs a manual "rm -rf rulesrc" to help...
Comment 6 Justin Mason 2009-06-29 15:00:53 UTC
actually, it's worse than that.  Every SVN checkout needs the following, it seems:

svn propdel svn:externals . ; rm -rf rulesrc ; svn up


sorry folks.  won't happen again!
Comment 7 Mark Martinec 2009-06-29 15:39:35 UTC
>> Btw, I have a couple of adsp_override rules (comparable to
>> def_whitelist_from_*, but in the opposite sense, only applicable
>> to 3.3), such as the ones below. Should I put them in some .cf file?

> Mark: feel free to put those in a .cf in the 'rules' dir.

Adding rules/60_adsp_override_dkim.cf
Committed revision 789478.
Comment 8 Mark Martinec 2009-06-29 16:37:25 UTC
> Adding rules/60_adsp_override_dkim.cf
> Committed revision 789478.

Hmm, sa-update did not copy this file to the
/var/lib/spamassassin/3.003000/updates_spamassassin_org

What else needs to be done please?
Comment 9 Mark Martinec 2009-06-30 16:42:22 UTC
> Hmm, sa-update did not copy this file to the
> /var/lib/spamassassin/3.003000/updates_spamassassin_org
> 
> What else needs to be done please?

Reopening just so that my question is not forgotten.

Seems like sa-update is not supplying the current version
of 3.3 rules and scores from the SVN 'rules' directory.

(It is quite possible it's only happening to me due to
fudging soft links to make SVN SA coexist with the one
from FreeBSD ports - am I the only one?)

The release notes should boldly state the change in fetching of rules.
Comment 10 Justin Mason 2009-07-01 04:01:13 UTC
: 692...; svn commit -m "remove the 'make install' step from updates generation; it no longer works to copy rules around" build/mkupdates/run_part2
Sending        build/mkupdates/run_part2
Transmitting file data .
Committed revision 790114.


I think that's fixed it.  reopen again if not.
Comment 11 Karsten Bräckelmann 2009-07-15 18:15:12 UTC
So, from now on -- do we need to put rules for testing in trunk, too, in addition to our sandboxes? Or is the sandbox still sufficient for testing?
Comment 12 John Hardin 2009-07-15 18:51:11 UTC
Rules go in trunk/rulesrc/sandbox/{you}/

rules/trunk/{etc...} is deprecated.
Comment 13 Justin Mason 2009-07-16 02:30:49 UTC
(In reply to comment #12)
> Rules go in trunk/rulesrc/sandbox/{you}/
> 
> rules/trunk/{etc...} is deprecated.

yep.

If you want to backport rules for 3.2.x updates, you have to _manually_ add them to branches/3_2_x_updates/rulesrc/sandbox/{you}/ , as well.