Bug 3387 - Can't locate Net/DNS/RR/ ... Fails with sample-nonspam.txt, quantity of DNSbl queries causes the problem
Summary: Can't locate Net/DNS/RR/ ... Fails with sample-nonspam.txt, quantity of DNSbl...
Status: RESOLVED FIXED
Alias: None
Product: Spamassassin
Classification: Unclassified
Component: Rules (Eval Tests) (show other bugs)
Version: 2.60
Hardware: PC FreeBSD
: P5 minor
Target Milestone: 3.1.0
Assignee: SpamAssassin Developer Mailing List
URL:
Whiteboard:
Keywords:
Depends on: 4260
Blocks:
  Show dependency tree
 
Reported: 2004-05-13 17:36 UTC by Spam Assassin at Anitech Systems
Modified: 2005-04-13 05:24 UTC (History)
0 users


Attachment Type Modified Status Actions Submitter/CLA Status
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Spam Assassin at Anitech Systems 2004-05-13 17:36:54 UTC 
SpamAssassin 260 DNSBL BUG?
 Can't locate Net/DNS/RR/SOA.pm in @INC
 Can't locate Net/DNS/RR/CNAME.pm in @INC
 Can't locate Net/DNS/RR/NS.pm in @INC

Used in perl script:
... use Mail::SpamAssassin; ...
... my $SpamTest = new Mail::SpamAssassin ({ ...
... $MessageObject = $SpamTest -> check_message_text($Message); ...
... $MessageObject -> get_report ()); ...
... $IsSpam = $MessageObject -> is_spam(); ...
... $Hits = $MessageObject -> get_hits (); ...

perl -v
 This is perl, v5.8.2 built for i386-freebsd
echo|perl -MNet::DNS  -lpe '$_=$Net::DNS::VERSION'
  0.46

Typically runs in ~22Mb memory, although works up to ~30Mb mem (larger e-mails)
 Failures with sample-nonspam.txt happen <~23Mb
 (so mem available does not seem to be the prob)

Fails when testing against some incoming e-mail, num_check_received ?(various)
Fails when testing against SA255 sample-nonspam.txt, num_check_received 9
Fails when testing against SA260 sample-nonspam.txt, num_check_received 9
 (HOW MANY QUERIES, seems very relevant)

Works when testing against some incoming e-mail, num_check_received ?(various)
Works when testing against SA255 sample-nonspam.txt, num_check_received 3
Works when testing against SA260 sample-nonspam.txt, num_check_received 3
Works when testing against SA255 sample-spam.txt, num_check_received 9
Works when testing against SA260 sample-spam.txt, num_check_received 9
 {not much to check in the G-Tube}


13 DNS-BLs (more of less don't seem to be the DIRECT problem) {local.cf}
...
debug: checking RBL AS11938.rbl.cluecentral.net., set ASnumber
debug: checking RBL AS6561.rbl.cluecentral.net., set ASnumber
debug: checking RBL bl.spamcop.net., set spamcop
debug: checking RBL dnsbl.ahbl.org., set AHBL
debug: checking RBL dnsbl.njabl.org., set njabl
debug: checking RBL dnsbl.sorbs.net., set sorbs
debug: checking RBL fresh.dict.rbl.arix.com., set arix-df
debug: checking RBL l1.spews.dnsbl.sorbs.net., set l1.spews.dnsbl.sorbs.net
debug: checking RBL l2.spews.dnsbl.sorbs.net., set l2.spews.dnsbl.sorbs.net
debug: checking RBL opm.blitzed.org., set opm
debug: checking RBL reject.the-carrot-and-the-stick.com., set reject.the-carrot-
and-the-stick.com
debug: checking RBL stale.dict.rbl.arix.com., set arix-ds
debug: checking RBL t1.dnsbl.net.au., set dnsbl_t1
...

Fails (not immediately) after 52 DNS-BL queries (HOW MANY QUERIES, seems very 
relevant),
 SA255 sample-nonspam.txt, num_check_received 9
...
debug: rbl: launching DNS A query for 
134.62.172.199.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
134.62.172.199.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 134.62.172.199.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
199.102.192.208.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
199.102.192.208.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 199.102.192.208.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
20.62.172.199.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 20.62.172.199.AS6561.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 20.62.172.199.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.fresh.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 20.62.172.199.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 20.62.172.199.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 20.62.172.199.stale.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 20.62.172.199.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.AS11938.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 5.62.172.199.AS6561.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.ahbl.org. in background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.fresh.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.l1.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.l2.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 5.62.172.199.stale.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS TXT query for 134.62.172.199.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 199.102.192.208.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 20.62.172.199.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 5.62.172.199.bl.spamcop.net. in 
background
...
debug: running header regexp tests; score so far=0
debug: running body-text per-line regexp tests; score so far=0
debug: running raw-body-text per-line regexp tests; score so far=0.011
debug: running uri tests; score so far=0.011
debug: uri tests: Done uriRE
debug: running full-text regexp tests; score so far=0.011
debug: DCCifd is not available: no r/w dccifd socket found.
debug: all '*From' addrs: dawson@world.std.com tbtf-approval@world.std.com
debug: all '*To' addrs: foo@foo.com tbtf@facteur.std.com tbtf@world.std.com
debug: DNS MX records found: 0
debug: DNS MX records found: 0
debug: forged-HELO: from=std.com helo=std.com by=netnoteinc.com
debug: forged-HELO: from=std.com helo=std.com by=std.com
debug: forged-HELO: from=std.com helo=std.com by=std.com
debug: forged-HELO: from=std.com helo=std.com by=std.com
debug: forged-HELO: from=std.com helo=std.com by=std.com
debug: forged-HELO: from=std.com helo=!208.192.102.193! by=std.com
Can't locate Net/DNS/RR/SOA.pm in @INC (@INC 
contains: /home/anitech/sausr/lib/perl5/site_perl/5.8.0 /usr/local/lib/perl5/sit
e_perl/5.8.2/mach /usr/local/lib/perl5/site_perl/5.8.2 /usr/local/lib/perl5/site
_perl /usr/local/lib/perl5/5.8.2/BSDPAN /usr/local/lib/perl5/5.8.2/mach /usr/loc
al/lib/perl5/5.8.2) at (eval 18) line 3.


Although works ok after 65 DNS-BL queries,
 SA255 sample-spam.txt, num_check_received 9:
...
debug: rbl: launching DNS A query for 
142.249.10.63.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 142.249.10.63.AS6561.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 142.249.10.63.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.fresh.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 142.249.10.63.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 142.249.10.63.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 142.249.10.63.stale.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 142.249.10.63.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.AS11938.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 15.35.17.212.AS6561.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 15.35.17.212.dnsbl.ahbl.org. in background
debug: rbl: launching DNS A query for 15.35.17.212.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.fresh.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.l1.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.l2.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 15.35.17.212.stale.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 15.35.17.212.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
213.21.195.128.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
213.21.195.128.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 213.21.195.128.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 213.21.195.128.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 213.21.195.128.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 213.21.195.128.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 213.21.195.128.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 213.21.195.128.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 213.21.195.128.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 213.21.195.128.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 213.21.195.128.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 213.21.195.128.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
254.105.28.200.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
254.105.28.200.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 254.105.28.200.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 254.105.28.200.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 254.105.28.200.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 254.105.28.200.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 254.105.28.200.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 254.105.28.200.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 254.105.28.200.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 254.105.28.200.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 254.105.28.200.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 254.105.28.200.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
52.130.184.208.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
52.130.184.208.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 52.130.184.208.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 52.130.184.208.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 52.130.184.208.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 52.130.184.208.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 52.130.184.208.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 52.130.184.208.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 52.130.184.208.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 52.130.184.208.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 52.130.184.208.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 52.130.184.208.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS TXT query for 142.249.10.63.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 15.35.17.212.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 213.21.195.128.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 254.105.28.200.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 52.130.184.208.bl.spamcop.net. in 
background
...


Although works ok after  39 DNS-BL queries
 SA255 sample-nonspam.txt, num_check_received 3
...
debug: rbl: launching DNS A query for 
134.62.172.199.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
134.62.172.199.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 134.62.172.199.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 134.62.172.199.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 134.62.172.199.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 
199.102.192.208.AS11938.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 
199.102.192.208.AS6561.rbl.cluecentral.net. in background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.ahbl.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.fresh.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.l1.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.l2.spews.dnsbl.sorbs.net. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 199.102.192.208.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 199.102.192.208.stale.dict.rbl.arix.com. 
in background
debug: rbl: launching DNS A query for 199.102.192.208.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.AS11938.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 5.62.172.199.AS6561.rbl.cluecentral.net. 
in background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.ahbl.org. in background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.njabl.org. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.fresh.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.l1.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.l2.spews.dnsbl.sorbs.net. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.opm.blitzed.org. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.reject.the-carrot-and-the-
stick.com. in background
debug: rbl: launching DNS A query for 5.62.172.199.stale.dict.rbl.arix.com. in 
background
debug: rbl: launching DNS A query for 5.62.172.199.t1.dnsbl.net.au. in 
background
debug: rbl: launching DNS TXT query for 134.62.172.199.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 199.102.192.208.bl.spamcop.net. in 
background
debug: rbl: launching DNS TXT query for 5.62.172.199.bl.spamcop.net. in 
background
...

 See also some related past posts (by me):
http://sourceforge.net/mailarchive/message.php?msg_id=6199706

http://sourceforge.net/mailarchive/message.php?msg_id=6183891
http://sourceforge.net/mailarchive/message.php?msg_id=6182818
http://sourceforge.net/mailarchive/message.php?msg_id=6182817
http://sourceforge.net/mailarchive/message.php?msg_id=6174877
http://sourceforge.net/mailarchive/message.php?msg_id=6166372


I most often run into this, right after I add a new BlackList,
 for evaluation with a low score.

Switching which blacklists are used does not seem to make any difference.

How many queries to the BlackLists that are used, DOES make a big difference.
 (Although some with more queries work ok, when others with a few less fail.)


Thanks for your Support;
SpamAssassin@Anitech-Systems.com
Comment 1 Justin Mason 2004-05-13 17:58:04 UTC 
looks like you need to increase the number of file descriptors available to SA
-- it's running out of fds, hence perl can't load the .pm file to evaluate the code.
Comment 2 Spam Assassin at Anitech Systems 2004-05-24 12:44:55 UTC 
A file descriptor limit does seem to have been the problem.
After they were increased form 48 to 128,
 the problem no longer occurs,
  even if setting num_check_received 9
   and 30 DNSbls were queried with the sample-nonspam.txt
   {where it previously failed with 13 DNSbls & num_check_received 9.}

Thanks for your support.
SpamAssassin@Anitech-Systems.com
Comment 3 Justin Mason 2005-04-13 13:24:57 UTC 
bug 4260 would fix this