Issue 58303 - mails from certain domains get rejected/bounced
Summary: mails from certain domains get rejected/bounced
Status: CLOSED FIXED
Alias: None
Product: Infrastructure
Classification: Infrastructure
Component: Mailing lists (show other issues)
Version: current
Hardware: All All
: P2 Trivial (vote)
Target Milestone: ---
Assignee: Unknown
QA Contact: issues@www
URL:
Keywords:
: 58656 (view as issue list)
Depends on:
Blocks:
 
Reported: 2005-11-22 13:06 UTC by grsingleton
Modified: 2007-02-20 04:34 UTC (History)
13 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---


Attachments
refused mail (2.96 KB, text/plain)
2006-01-20 10:00 UTC, paolomantovani
no flags Details
Mail received under moderation even if it passed on ML. (4.38 KB, text/plain)
2006-01-21 21:18 UTC, davide
no flags Details

Note You need to log in before you can comment on or make changes to this issue.
Description grsingleton 2005-11-22 13:06:06 UTC
the mailserver at collab.net has been inoperative and refusing connections for
at least the past hour. This is to bring it to the attention of the admins.
Comment 1 stx123 2005-11-22 14:16:28 UTC
thanks for filing the issue; reassigning to support.

CollabNet has been notified Monday 15:30 EST via extranet issue 43.
Comment 2 Unknown 2005-11-22 15:11:10 UTC
This issue is also followed in
https://sun-openofficeorg.extranet.collab.net/issues/show_bug.cgi?id=43

The ops are currently working on this issue. Will update you as soon as I get
any updates from them.

Thanks,
Karishma-Helpdesk
Comment 3 pavel 2005-11-23 13:29:50 UTC
The URL is inaccessible for mere mortals.
Comment 4 grsingleton 2005-11-23 13:33:30 UTC
As of this morning, the mailserver is still refusing connections. As a matter of
fact, it appears to be stalled or dead:

sendmail -v -q

Running /var/spool/mqueue/jANDSnOf031260 (sequence 1 of 1)
<users@openoffice.org>... Connecting to asmx1.sfo.collab.net. via esmtp...
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net
Comment 5 lsuarezpotts 2005-11-23 13:55:35 UTC
according to helpdesk (CollabNet), as of 08:42 UTC:  

Engineers have updated us that the nearly 229644 messages are queued and this
takes bit more time to clear up.They can see that mails can be sent and but
received slowly. They are still monitoring on its performance proactively.

Not known how long it will take to go through the queue.  Support, anything you can do to expedite it?

Louis

Comment 6 pavel 2005-11-23 21:04:55 UTC
It is

Wed Nov 23 21:01:33 UTC 2005

now and I have seen only ~10 mails from OOo today. So the queue is probably not
processed.

There is no incoming mail possible:

pavel@paveljanik:~> telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
Connected to asmx1.sfo.collab.net.
Escape character is '^]'.
220 asmx1.sfo.collab.net ESMTP Sendmail 8.12.8/8.12.8; Wed, 23 Nov 2005 13:01:52
-0800
helo q
250 asmx1.sfo.collab.net Hello gate.rudna.net [195.122.192.66], pleased to meet you
mail from: pavel@janik.cz
451 4.7.1 Please try again later

So why the queue is not able to process it? My old notebook handles ~10000 mails
a day for me. Why the site is not able to handle 300x more?
Comment 7 cdriga 2005-11-23 22:05:52 UTC
One new behaviour that makes this mail server failure different from previous
ones is the fact that the postings to mail lists do not even get to the archives.

Usually, the messages were getting instantly on the lists archives and depending
on the load...they were later (in some hours) reaching the subscribers.

I've sent some messages to a list (dev@ro.openoffice.org) 5-6 hours ago and they
are not even in the archive yet.


~cristian
Comment 8 ooo 2005-11-24 07:13:42 UTC
I got about hundred mails with a 75kb attachment (probably a virus) where the
To: field is ending in @openoffice.org.

Some of the subjects are:

  Paris Hilton & Nicole Richie
  You_visit_illegal_websites
  hi, ive a new mail address
  Mail delivery failed
  smtp mail failed

Could this be related to the mail problems
Comment 9 pavel 2005-11-24 08:05:19 UTC
cs: the To: header is irrelevant. What is in the headers - have you got these
mails *via* openoffice.org/CollapseNet mailservers?
Comment 10 pavel 2005-11-24 10:22:09 UTC
Update:

Thu Nov 24 10:21:39 UTC 2005

pavel@s:~> telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
Connected to asmx1.sfo.collab.net.
Escape character is '^]'.
220 asmx1.sfo.collab.net ESMTP Sendmail 8.12.8/8.12.8; Thu, 24 Nov 2005 02:19:51
-0800
helo q
250 asmx1.sfo.collab.net Hello s.janik.cz [81.27.197.66], pleased to meet you
mail from: pavel@janik.cz
451 4.7.1 Please try again later

so still no incoming mail
Comment 11 cdriga 2005-11-24 10:35:06 UTC
Hi,

I get hundreds of such messages per day..sent to my @openoffice.org address.

Here are the full headers for one of them:
================================
X-Account-Key: account1
X-UIDL: aa7ae201b15c8d105833e1cad7c04d41
X-Mozilla-Status: 0201
X-Mozilla-Status2: 10000000
Return-path: <admin@cyberconxion.com>
Envelope-to: cdriga@kfacts.com
Delivery-date: Thu, 24 Nov 2005 06:16:22 +0200
Received: from s002.sfo.collab.net ([64.125.133.202] helo=openoffice.org)
	by muntenia.romedchim.com with smtp (Exim 4.52)
	id 1Ef8X0-0005Cl-Er
	for cdriga@kfacts.com; Thu, 24 Nov 2005 06:16:22 +0200
Received: (qmail 12495 invoked by uid 5302); 23 Nov 2005 12:48:11 -0000
Delivered-To: tigrisq-Surveys@www.openoffice.org
Received: (qmail 13722 invoked from network); 22 Nov 2005 21:42:02 -0000
Received: from asmx1.sfo.collab.net (64.125.133.81)
  by s002.sfo.collab.net with SMTP; 22 Nov 2005 21:42:02 -0000
Received: from fvksil.com ([70.105.166.108])
	by asmx1.sfo.collab.net (8.12.8/8.12.8) with SMTP id jAMLeg1q021671;
	Tue, 22 Nov 2005 13:40:43 -0800
From: Admin@cyberconxion.com
To: emailserv@openoffice.org
Date: Tue, 22 Nov 2005 21:33:53 UTC
Subject: Paris_Hilton_&_Nicole_Richie
Importance: Normal
X-Priority: 3 (Normal)
Message-ID: <a9dbfdce155eab59afe@cyberconxion.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===2b7fb0.bc11ebb20bbf5e1"
Content-Transfer-Encoding: 7bit

This is a multi-part message in MIME format.

--===2b7fb0.bc11ebb20bbf5e1

The Simple Life:

View Paris Hilton & Nicole Richie video clips , pictures & more ;)
Download is free until Jan, 2006!

Please use our Download manager.
--===2b7fb0.bc11ebb20bbf5e1
Content-Type: application/octet-stream; name=downloadm.zip
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="downloadm.zip"
================================

~cdriga
Comment 12 cdriga 2005-11-24 10:48:25 UTC
I bet that disabling email forwarding to addresses like username@openoffice.org
and keeping this service only for mail lists and IZ would suddenly make things
work. 

The forwarding is a usefull service but also it is unfortunately a method for
sabotaging the mail server. And it is a easy method available for anybody who
has the power to send mass emails loaded with attachments. 

Guess that under the circumstances, it worth trying to disable the forwarding
for a while. 

BTW: I received one of the messages I sent yesterday to the lists. The previous
one did not manged through. I am curious if it's lost.

~cdriga
Comment 13 ooo 2005-11-24 14:55:42 UTC
Why don't Collabnet staff doesn't write status here in this issue?
Comment 14 merschmann 2005-11-25 08:35:38 UTC
Another day with a very very bad mailsystem.
The time to get a mail on the list is about 24 hours. And I got this:
-------------------------------------------------------
Delivery to the following recipient has been delayed:

    users@de.openoffice.org

Message will be retried for 2 more day(s)

Technical details of temporary failure:
TEMP_FAILURE: Could not initiate SMTP conversation with any hosts:
[asmx1.sfo.collab.net. (5): Connection timed out]
-------------------------------------------------------

Support: Please tell us here in clear words, what problem the mailsystem has and
how long it will take to fix it.
Comment 15 grsingleton 2005-11-25 18:35:59 UTC
You might want to set the ConnectionRateThrottle parameter in Sendmail
(confCONNECTION_RATE_THROTTLE in sendmail.mc) quite low, like to around 3.
That delays connections if more than 3/second come in.  While it
still doesn't really prevent the DoS, it can smooth the load on the machine.
Or you can use Sendmail 8.13's more fine-grained rate_control features so
that any one IP address can't open too many connections too quickly.

But the better solution of blocking offending IPs in access.db is probably
a good one for now.
Comment 16 stx123 2005-11-25 19:12:47 UTC
My understanding is that messages generated at the site (IZ, CVS notifications)
are sent with a reasonable delay.
It seems that the messages handled and sent from the site are bounces or
webmaster@, hostmaster@, ... messages.
I leave it to "support" to give an update on the actions taken and the expected
timeframe needed to resolve the issue. Please whether messages sent in the last
days and accepted by the OOo mail exchanger will be send at some point of time.
Comment 17 stx123 2005-11-25 19:17:33 UTC
My understanding is that messages generated at the site (IZ, CVS notifications)
are sent within a reasonable delay.
It seems that the messages handled and then sent from the site are to a large
extend bounces or webmaster@, hostmaster@, ... messages.
I leave it to "support" to give an update on the actions taken and the expected
timeframe needed to resolve the issue. Please let us know whether messages sent
in the last days and accepted by the OOo mail exchanger will be send at some
point of time.
Comment 18 Unknown 2005-11-25 20:54:09 UTC
We had over 150000 mails queued on the mailers yesterday. The status of the 
mails queue as of now is:
messages in queue: 43738
messages in queue but not yet preprocessed: 0
As of now the server is doing over 350mails/sec.
The indexers are fine as well.Mails are flowing and queue size have reduced by 
over 60%

Regards
Karthik-Helpdesk
Comment 19 stx123 2005-11-25 21:11:54 UTC
You will have noticed that asmx1.sfo.collab.net is not available most of the time.
Messages bounce because they couldn't be deliverd for 3 days.
I'm sure you take the appropriate action instead of letting the machine work on
the useless webmaster mails.
Could you please answer the questions about
the expected timeframe needed to resolve the issue and 
whether messages sent in the last days will be send?

Comment 20 pavel 2005-11-25 21:32:21 UTC
pavel@paveljanik:~> date -u
Fri Nov 25 21:30:25 UTC 2005
pavel@paveljanik:~> telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
telnet: connect to address 64.125.133.81: Connection refused
pavel@paveljanik:~> mailq
-Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient-------
7D9466AFF8     1906 Thu Nov 24 20:18:10  Pavel@Janik.cz
          (connect to asmx1.sfo.collab.net[64.125.133.81]: Connection refused)
                                         dev@l10n.openoffice.org

469E86AFF5      949 Fri Nov 25 06:56:43  Pavel@Janik.cz
          (connect to asmx1.sfo.collab.net[64.125.133.81]: Connection refused)
                                         thing@openoffice.org

97E616AFFB     1094 Thu Nov 24 19:37:04  Pavel@Janik.cz
          (connect to asmx1.sfo.collab.net[64.125.133.81]: Connection refused)
                                         dev@native-lang.openoffice.org

-- 4 Kbytes in 3 Requests.
pavel@paveljanik:~> 
Comment 21 Unknown 2005-11-26 12:20:51 UTC
St , 
We have put forth your queries to the engineers . we would be updating this 
issue when the engineers do provide us with their best guess estimate for 
resolving this issue.

Thanks
Jobin.

Comment 22 grsingleton 2005-11-27 14:23:43 UTC
Things are back to square one again. I find the following on my mailserver:
Running /var/spool/mqueue/jARDWVY3001364 (sequence 1 of 7)
<users@openoffice.org>... Connecting to asmx1.sfo.collab.net. via esmtp...
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.

Running /var/spool/mqueue/jARCUslf001052 (sequence 2 of 7)
<grsingleton@openoffice.org>... Deferred: Connection refused by
asmx1.sfo.collab.net.

Running /var/spool/mqueue/jARDUKBk001355 (sequence 3 of 7)
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.

What is starange is that messages posted via gmane are getting through. Please
fix asap.
Comment 23 grsingleton 2005-11-29 13:47:37 UTC
Please explain why port 25 is consistently blocked. This has gone on too long
and there are solutions.

e.g.

sendmail -v -q

Running /var/spool/mqueue/jATCpH5r016147 (sequence 1 of 3)
<users@openoffice.org>... Connecting to asmx1.sfo.collab.net. via esmtp...
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.

Running /var/spool/mqueue/jATCkHjm016111 (sequence 2 of 3)
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.

Running /var/spool/mqueue/jATCKGpq016003 (sequence 3 of 3)
<dev@documentation.openoffice.org>,<hashir0905@openoffice.org>,<maryjane47@openoffice.org>,<mitren@openoffice.org>,<roger_martinez@openoffice.org>...
Deferred: Connection refused by asmx1.sfo.collab.net.
Comment 24 lsuarezpotts 2005-11-30 00:43:54 UTC
support, would you be willing to have a look at this?

thanks
louis
Comment 25 Unknown 2005-11-30 05:16:16 UTC
Hi grsingleton,

We've sent an email to an account on a test project in openoffice.org and I was
able to receive it. Operations are currently seeing spike of spam/virus and have
updated that it all depends on the configuration of your mail server, on how
often it tries to deliver the email.This is saturating the smtp connection on
asmx1.sfo server.  Even to identify if an email is spam or not the server needs
to make a smtp connection, which uses up a smtp connection.  Once the customer
sents an email,it gets to our smtp server, it shouldn't take very long to get
delivered. Hence please verify and contact us if you have any questions.

Thanks,
Kavitha-Helpdesk
Comment 26 grsingleton 2005-11-30 12:19:18 UTC
Yes. I have questions. You claim that one message got through. I have had that
experience too. I see a problem here, the server is blocking port 25 and
refusing connections vis a vis the following that have been sitting waiting for
asmx1.sfo.collab.net to accept connections:

[root@dsl root]# date
Wed Nov 30 07:11:57 EST 2005
[root@dsl root]# mailq
                /var/spool/mqueue (8 requests)
-----Q-ID----- --Size-- -Priority- ---Q-Time---
--------Sender/Recipient--------jAU71u82021655     4630     484301 Nov 30 02:01
MAILER-DAEMON
                 (Deferred: 451 4.7.1 Please try again later)
                                                <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jAU31ugW020439     2629     842369 Nov 29 22:01 MAILER-DAEMON
                 (Deferred: 451 4.7.1 Please try again later)
                                                <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jAU31ugX020439     2781     842423 Nov 29 22:01 MAILER-DAEMON
                 (Deferred: 451 4.7.1 Please try again later)
                                                <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jAU31ugY020439     2871     842611 Nov 29 22:01 MAILER-DAEMON
                 (Deferred: 451 4.7.1 Please try again later)
                                                <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jAU2VQ9C020284     2542    1053111+Nov 29 21:31 <grsingleton@openoffice.org>
      8BITMIME   (Deferred: 451 4.7.1 Please try again later)
                                                <dev@documentation.openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jATMk3sS018936      573    1591179+Nov 29 17:46 <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
                                                <users@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
jATMhCRF018920      680    1591234+Nov 29 17:43 <grsingleton@openoffice.org>
                 (Deferred: 450 Requested mail action not taken-Try
later:sv5pub.verizon.net)
                                                <jnobrien@verizon.net>
                 (Deferred: 450 Requested mail action not taken-Try
later:sv5pub.verizon.net)
jATMvrag018994      917    1591422+Nov 29 17:58 <grsingleton@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
                                                <users@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
                Total requests: 8
/var/spool/clientmqueue is empty
                Total requests: 0
[root@dsl root]# date
Wed Nov 30 07:12:04 EST 2005
[root@dsl root]#


I suggested on Fri Nov 25 10:35:59 -0800 2005 that

You might want to set the ConnectionRateThrottle parameter in Sendmail
(confCONNECTION_RATE_THROTTLE in sendmail.mc) quite low, like to around 3.
That delays connections if more than 3/second come in.  While it
still doesn't really prevent the DoS, it can smooth the load on the machine.
Or you can use Sendmail 8.13's more fine-grained rate_control features so
that any one IP address can't open too many connections too quickly.

But the better solution of blocking offending IPs in access.db is probably
a good one for now.

It seems that neither has been implemented; hence we have an on-going problem.
As colead of the documentation project I have a responsibility to respond in a
timely fashion to my group and it is frustrating to *NOT* be able to do so. I do
understand about a virus storm and I also understand about trying to accept all
but when most of the viruses carry payload there are ways to handle this and the
few legitimate messages that might be affected would be stripped anyway so ...


Please explain why this cannot be resolved.
Comment 27 grsingleton 2005-11-30 12:22:15 UTC
added louis to cc list
Comment 28 lsuarezpotts 2005-11-30 14:39:57 UTC
support, would you be able to investigate to see if grsingleton's suggestions have been implemented? And 
if they have not been, to indicate what has been done to resolve the current situation of delays and to 
prevent future outages?

thanks!

Louis
Comment 29 Unknown 2005-11-30 15:34:04 UTC
Louis,

I have put across your query to Ops regarding port 25 and if grsingleton's
suggestions have been implemented. Awaiting their response on this.

Thanks,
Karishma-Helpdesk
Comment 30 lsuarezpotts 2005-11-30 16:14:33 UTC
thanks

louis
Comment 31 Unknown 2005-11-30 23:57:37 UTC
To alleviate the current situation, here is what the operations team has done:

The problem is that the # of smtp connection to our mail server was limited
to 100, and most of these connections were used (mostly) by e-mails of nature 
spam/virus.  This is why external mail servers were not able to deliver the 
messages and were getting connection refused.  

As of now, they've increased the # of smtp connection to our mail server
(asmx1.sfo) to 200.  The spam filter on the server seems to be holding with 
this setting, but they will keep an eye on things to make sure it doesn't 
cause problem on that server(the brightmail one).  A test message from a 
separate domain came through within 5 minutes.  The increased number of smtp 
connections seems to be helping now.  

Please let us know if you are seeing better results on your end after this 
change was done to-day. We can understand that delays in mail messages cause a 
huge inconvenience for the Openoffice user community.
Comment 32 stx123 2005-12-01 16:03:27 UTC
There is some slight improvement. But from the provided graphs and logs you will
see that asmx1 still suffer from longer periods of unavailability.

Please find the most recent bounce below.

The original message was received at Mon, 28 Nov 2005 05:04:01 -0700 (MST)
from [129.157.128.5]

   ----- The following addresses had permanent fatal errors -----
<stx001@openoffice.org>

   ----- Transcript of session follows -----
<stx001@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.
Message could not be delivered for 3 days
Message will be deleted from queue



Reporting-MTA: dns; brmea-mail-4.sun.com
Arrival-Date: Mon, 28 Nov 2005 05:04:01 -0700 (MST)

Final-Recipient: RFC822; stx001@openoffice.org
Action: failed
Status: 4.4.7
Last-Attempt-Date: Thu, 1 Dec 2005 09:00:19 -0700 (MST)
Comment 33 grsingleton 2005-12-02 12:31:14 UTC
Well is is 07h30EST and we still have a problem. I have the following in my mail
spool:

[root@dsl mqueue]# !mai
mailq
                /var/spool/mqueue (1 request)
-----Q-ID----- --Size-- -Priority- ---Q-Time---
--------Sender/Recipient--------jB2CKYD9007103     2390     242955 Dec  2 07:20
<grsingleton@openoffice.org>
                 (Deferred: Connection refused by asmx1.sfo.collab.net.)
                                                <users@openoffice.org>
                 (Deferred: Connection refused by asmx1.sfo.collab.net.)
                Total requests: 1
/var/spool/clientmqueue is empty
                Total requests: 0
[root@dsl mqueue]#

Is there anything I can do to help?
Comment 34 Unknown 2005-12-03 01:54:04 UTC
*** Issue 58656 has been marked as a duplicate of this issue. ***
Comment 35 Unknown 2005-12-03 02:02:45 UTC
Am able to telnet to port 25 with no problems. Can you please verify if this 
is still happening?
Comment 36 grsingleton 2005-12-03 02:16:25 UTC
Telneting in is not what sendmail does so this test has limited value. I have
tried this whilst getting refusals and had no success at these times. Tried a
message to both of us and the queue is clearing as expected. Whether or not it
is delivered in a timely manner is something else than what this issue addresses.
Comment 37 grsingleton 2005-12-04 13:51:00 UTC
Well soemthing is still *VERY* wrong here.  the mailserver was working and then
suddenly started to refuse connections, again.

# sendmail -v -q

Running /var/spool/mqueue/jB4DVdNl026896 (sequence 1 of 1)
<users@openoffice.org>... Connecting to asmx1.sfo.collab.net. via esmtp...
<users@openoffice.org>... Deferred: Connection refused by asmx1.sfo.collab.net.
# 

Please tell me what I can do to help resolve this problem.
Comment 38 lsuarezpotts 2005-12-04 17:41:51 UTC
gerry, are you still experiencing the problem?

reassign to support if yes.

Louis
Comment 39 grsingleton 2005-12-04 19:55:48 UTC
Outages are fewer but still exist. See my comment from this morning.
Comment 40 grsingleton 2005-12-04 20:02:18 UTC
As proof, here is my latest attempt to respond to the mailing lists:

# mailq
                /var/spool/mqueue (1 request)
-----Q-ID----- --Size-- -Priority- ---Q-Time---
--------Sender/Recipient--------jB4K05TU028661      333     150878 Dec  4 15:00
<grsingleton@openoffice.org>
                 (Deferred: Connection refused by asmx1.sfo.collab.net.)
                                                <users@openoffice.org>
                 (Deferred: Connection refused by asmx1.sfo.collab.net.)
                Total requests: 1
/var/spool/clientmqueue is empty
                Total requests: 0
# 
Comment 41 pavel 2005-12-04 20:28:44 UTC
Evidence:

pavel@paveljanik:~> echo quit | telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
Connected to asmx1.sfo.collab.net.
Escape character is '^]'.
Connection closed by foreign host.
pavel@paveljanik:~> echo quit | telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
telnet: connect to address 64.125.133.81: Connection refused
pavel@paveljanik:~> echo quit | telnet asmx1.sfo.collab.net 25
Trying 64.125.133.81...
telnet: connect to address 64.125.133.81: Connection refused
pavel@paveljanik:~> date -u
Sun Dec  4 20:27:32 UTC 2005
pavel@paveljanik:~> 

Hmm, maybe the setup is so dumb that it limits connections per IP also for
regular writers like grsingleton or me are?
Comment 42 lsuarezpotts 2005-12-04 22:09:29 UTC
Mail is having problems again, which is disappointing.  Let's look at http://stats.services.openoffice.org/
stats/lists/delaylog.txt for confirmation.

I've reopened the Extranet issue #43. BTW, this doesn't seem really to relate to PCN 41922.

louis

Comment 43 Frank Schönheit 2005-12-05 14:59:18 UTC
Still experiencing problems with delayed delivery of mail.
As moderator of several mailing lists in the DBA project, I have to approve
messages from non-subscribers. Those messages rarely appear in the mailing list.
My moderation/acceptance mails seem to be silently dropped.

The last three mails I sent (one at 2005-12-01, 2 about 8 hours ago) suffered
from this problem. While 8 hours are already at the limit, though can perhaps be
explained with high server load, 4 days is simply inacceptable.
Comment 44 Unknown 2005-12-05 15:29:17 UTC
We understand your concern,in order to resolve this issue, it has been escalated
to our II level support to give much more higher importance to resolve this
immediately.

Thanks,
Kavitha-helpdesk
Comment 45 Unknown 2005-12-06 00:53:36 UTC
The mail server appears to be delivering messages quickly right now. There was 
a spike in the incoming mails earlier in the day, which has since then reduced.

Also, the upgraded Brightmail server is currently being setup and should be 
operational in the next few days.

http://stats.services.openoffice.org/stats/lists/delaylog.txt shows 
improvement too.
Comment 46 Unknown 2005-12-06 01:03:23 UTC
My post was around 5-01 PM Pacific.

Noticed these on the URL: 
http://stats.services.openoffice.org/stats/lists/delaylog.txt

2005-12-06-01-57: 262 secs mail delay (users) mins: 4 
2005-12-06-01-57: 259 secs mail delay (allbugs) mins: 4 
2005-12-06-01-58: 258 secs mail delay (allbugs) mins: 4 

FYI: I got fairly quick response when I post these in IZ.
Comment 47 stx123 2005-12-06 13:22:00 UTC
As I said in my comment on Fri Nov 25 11:17:33 -0800 2005" outbound notification
messages are delivered nost of the time with a reasonable delay of some minutes.
The problem persists for inbound messages with the unavailability (connection
refused, error message "451 4.7.1 Please try again later") of asmx1.sfo.collab.net.

   Mail Queue (16 requests)
--Q-ID-- --Size-- -----Q-Time----- ------------Sender/Recipient------------
OAA29562       77 Tue Dec  6 14:00 root
                 (Deferred: 451 4.7.1 Please try again later)
                                   stx002@openoffice.org
OAA29649       77 Tue Dec  6 14:02 root
                 (Deferred: 451 4.7.1 Please try again later)
                                   stx001@openoffice.org
NAA28824       77 Tue Dec  6 13:45 root
                 (Deferred: 451 4.7.1 Please try again later)
                                   stx002@openoffice.org
NAA28868       77 Tue Dec  6 13:47 root
                 (Deferred: 451 4.7.1 Please try again later)
                                   stx001@openoffice.org
NAA28098       77 Tue Dec  6 13:30 root
                 (Deferred: 451 4.7.1 Please try again later)
                                   stx002@openoffice.org

and so on...
Comment 48 Unknown 2005-12-07 20:08:54 UTC
Some of the other SUN sites are now behind the new brightmail spam-protection 
cluster. This has taken the load off the mail server (asmx1). Coupled with 
that, operations made some slight changes to the mail server configurations. 
We verified that the overall mail performance had now improved significantly. 
CN operations will monitor the behaviour of the new Brightmail cluster and 
schedule to place the openoffice.org server behind that setup early next week. 
In the interim I believe the mail delays should be already reduced drastically.
Comment 49 grsingleton 2005-12-08 12:34:40 UTC
I see no change. Message are being queued up on my system because of refusals.
e.g.

# mailq
                /var/spool/mqueue (2 requests)
-----Q-ID----- --Size-- -Priority- ---Q-Time---
--------Sender/Recipient--------jB8CRBRG023817      899     151455 Dec  8 07:27
<grsingleton@openoffice.org>
      8BITMIME   (Deferred: Connection refused by asmx1.sfo.collab.net.)
                                                <users@openoffice.org>
                 (Deferred: Connection refused by asmx1.sfo.collab.net.)
jB8CVCvW023841     1382     151971 Dec  8 07:31 <grsingleton@openoffice.org>
      8BITMIME   (Deferred: 451 4.7.1 Please try again later)
                                                <users@openoffice.org>
                 (Deferred: 451 4.7.1 Please try again later)
                Total requests: 2
/var/spool/clientmqueue is empty
                Total requests: 0
# 
Comment 50 lsuarezpotts 2005-12-08 13:48:42 UTC
Hi
Hm. I'm not seeing delays, Gerry. Would you want to check anew?

Louis
Comment 51 Unknown 2005-12-08 22:24:53 UTC
Due to the anticipated Virus/Worm attack, the OO.o server was moved behind the 
new Brightmail Spam-protection cluster to-day. CN operations team is 
monitoring the site closely after this move. The initial analysis shows that a 
huge volume of Spams/Worms are already caught by the new spam filter.
Comment 52 stx123 2005-12-09 00:04:38 UTC
Our empty mail queue and the measured delays tell me that the switch to the
Spam-protection cluster was very helpful.
Comment 53 Unknown 2005-12-09 00:20:05 UTC
CN support will continue to monitor this site.
Comment 54 grsingleton 2005-12-10 00:53:17 UTC
Louis asked if the situation was better. From the little I posted today, I would
say yes it is better. I will monitor for the next few days.
Comment 55 Unknown 2005-12-29 14:21:58 UTC
Hi,

We have been monitoring the site for the past few days and found that it is
working much better than before. Can you please confirm us whether we can close
this case or we can keep it open to track it further.

Thanks,
Kavitha-helpdesk
Comment 56 grsingleton 2005-12-29 23:55:35 UTC
Speaking only for myself, I do believe the problem is solved.
Comment 57 khirano 2005-12-30 00:38:50 UTC
Yes, it is better now.
But are we sure that the new spam filter is working well?

Can Aniruddha Sarkar and/or Kavitha Jayakumar check out what we are receiving
now at openoffice.org lists including:
feedback@website.openoffice.org
cvs@cs.openoffice.org
cvs@marketing.openoffice.org
cvs@specs.openoffice.org
cvs@ru.openoffice.org
cvs@specs.openoffice.org
issues@scripting.openoffice.org
issues@tr.openoffice.org
issues@cs.openoffice.org
issues@br-pt.openoffice.org
issues@da.openoffice.org
issues@api.openoffice.org
.
Comment 58 Unknown 2005-12-30 04:14:25 UTC
Hi Khirano
              We will verify the mailing lists as mentioned in your previous 
description and will get back to you as soon as possible.

Regards,
Karthik-Helpdesk
Comment 59 Unknown 2006-01-06 12:12:36 UTC
Khirano,

Can you please let us know if you are still receiving spam mails in the mailing
lists.

Regards,
Karishma - Helpdesk
Comment 60 stx123 2006-01-08 10:52:05 UTC
A short look in the archive of one of the CVS list will show that there are more
SPAM than notification messages
http://ui.openoffice.org/servlets/BrowseList?listName=cvs&from=2006-01-01&to=2006-01-31
Comment 61 khirano 2006-01-10 06:51:28 UTC
Hi Karishma,
Yes, spam mails are hitting our several cvs-lists, issues-lists and other
mailing lists very well these days in the beginning of the new year.
For example, please take a look at:
feedback@website.openoffice.org
http://website.openoffice.org/servlets/BrowseList?listName=feedback&from=2006-01-01&to=2006-01-31&count=232&by=date&paged=false
Comment 62 khirano 2006-01-10 08:03:11 UTC
FYI:
I tried googling "feedback@website.openoffice.org" and found the following
interesting pages:
1. http://website.openoffice.org/
2. http://www.mail-archive.com/lists.html
3.
http://www.objectssearch.com/mailarchive/reader.jsp?list=feedback@website.openoffice.org

If you take a look at:
http://www.mail-archive.com/cvs%40ui.openoffice.org/maillist.html
You will see what Stefan is talking about cvs@ui.openoffice.org far easier than
taking a look at:
http://ui.openoffice.org/servlets/BrowseList?listName=cvs&from=2006-01-01&to=2006-01-31
:)
Are they useful for spammers?
;)
Comment 63 stx123 2006-01-12 10:04:39 UTC
I would recommend to close this issue as fixed wrt to problems with mail delivery.
We could follow-up on SPAM problems in a separate issue.
Comment 64 davide 2006-01-12 22:15:04 UTC
I have big problems with italian ML.

localizzazione@it.openoffice.org 

is very slow. I sent an email yesterday and I couldn't see it delivered yet.

Moreover now I  get error sending email to

plio@it.openoffice.org


- These recipients of your message have been processed by the mail server:
plio@it.openoffice.org; Failed; 5.1.2 (bad destination system address)

    Remote MTA cylon1.sjc.collab.net: network error


 - SMTP protocol diagnostic: 554 cylon1.sjc.collab.net

Reporting-MTA: dns; aa005msg.fastwebnet.it
Received-from-MTA: dns; ms002msg.fastwebnet.it (10.31.41.33)
Arrival-Date: Thu, 12 Jan 2006 22:58:40 +0100

Final-Recipient: rfc822; plio@it.openoffice.org
Action: Failed
Status: 5.1.2 (bad destination system address)
Remote-MTA: dns; cylon1.sjc.collab.net
Comment 65 davide 2006-01-12 22:17:27 UTC
I have big problems with italian ML.

localizzazione@it.openoffice.org 

is very slow. I sent an email yesterday and I couldn't see it delivered yet.

Moreover now I  get error sending email to

plio@it.openoffice.org


- These recipients of your message have been processed by the mail server:
plio@it.openoffice.org; Failed; 5.1.2 (bad destination system address)

    Remote MTA cylon1.sjc.collab.net: network error


 - SMTP protocol diagnostic: 554 cylon1.sjc.collab.net

Reporting-MTA: dns; aa005msg.fastwebnet.it
Received-from-MTA: dns; ms002msg.fastwebnet.it (10.31.41.33)
Arrival-Date: Thu, 12 Jan 2006 22:58:40 +0100

Final-Recipient: rfc822; plio@it.openoffice.org
Action: Failed
Status: 5.1.2 (bad destination system address)
Remote-MTA: dns; cylon1.sjc.collab.net
Comment 66 Unknown 2006-01-13 00:03:09 UTC
I have asked my engineers to check the mail server and would provide an update 
as soon as possible.

Regards,
Karthik
Support Operations
Comment 67 Unknown 2006-01-13 00:42:09 UTC
I tried to send an email to plio@it.openoffice.org and I recieved the mail 
immediately and also it has been archived.The Mail server seems to work 
fine,could you please verify again and get back to us.

Regards,
Karthik
Support Operations
Comment 68 pavel 2006-01-13 07:22:45 UTC
karthiksp: hmm.

ddoza reported that in the past, it was not working for some unknown reason for
him. You answered that it works for you now, which leaves a question why the
service you provide is so volatile. To answer such question, please do not use
the logic "it works now" -> "it worked before", but have a look in the logs
*why* it failed *before*. This way, we can see *the solution*. Right now, we
only see "it works now, so it worked before".
Comment 69 Unknown 2006-01-13 08:40:27 UTC
Another internal request is now opened to look into the errors reported by 
ddozza.
Comment 70 Unknown 2006-01-13 08:57:09 UTC
Ddozza, Can you please confirm if the e-mail that you sent to the 
plio@it.openoffice.org mailing list contain any attachment(s)? I am doing some 
research into the 554 error code, and there are instances when this is 
reported when a transaction is cancelled due to the presence of a virus. 
Although it may not be the case for this one, it would be worth verifying if 
any attachments were present.
Comment 71 Unknown 2006-01-13 09:25:13 UTC
Another interesting observation. It seems that fastwebnet.it could be in a few 
blacklisted list(s). Checking to see the error returned from the Spam/Virus 
filter could be because of this too.
Comment 72 Unknown 2006-01-16 10:34:39 UTC
The last observation appears to be the roo cause!
Here are the details from the spam/virus filter's maillog:
<snip>
Thu Jan 12 13:58:42 2006 Info: New SMTP ICID 8416856 interface Data 1 
(204.16.10
4.10) address 213.140.2.72 reverse dns host 213-140-2-72.ip.fastwebnet.it 
verifi ed yes Thu Jan 12 13:58:42 2006 Info: ICID 8416856 REJECT SG BLACKLIST 
match sbrs[-10.0 :-2.0] SBRS -2.1 Thu Jan 12 13:58:42 2006 Info: ICID 8416856 
close ====
<snip>
---------
Analysis:

The user's email/connection was rejected b'coz they were on the blacklist. Is 
this from a dial-up connection? It looks like fastwebnet.it sends a lot of 
virus/spam messages and all of their messages have been dropped because they 
are being perceived bad. 

Ddozza, 
If you use a static ip we can add it to the whitelist, but if you are using a 
dynamic ip then not sure how we can help you.

----------------
BTW, as Stefan mentioned earlier, it's better to open another issues for 
spam/virus related and closing this one as the original mailserver issue is 
resolved. Hence I am marking this resolved. Please re-open this if there still 
is any issue around the overall mail system.

Thanks
Comment 73 davide 2006-01-16 11:28:31 UTC
Very strange, because I use *always* smtp.fastwebnet.it as relay server which is 

smtp.fastwebnet.it.     163     IN      A       213.140.2.32

I don't know if fastweb does an IP rotation. 

Anyway lots of people use Fastweb because is a very popular internet provider in
Italy.
This clarifies because other italian people has the same problem.

 
Comment 74 Unknown 2006-01-18 18:13:39 UTC
Per SUN/Stefan's request, Operations have added .fastwebnet.it domain to the 
whitelist of OO.O mail filtering.  This means we will accept all mail from 
them and will not reject any mail. Please verify if this fixes the problem.
Comment 75 Unknown 2006-01-18 18:14:59 UTC
Ddozza, Can you please confirm with other community folks in Italy if they 
still experience the problems?
Comment 76 lsuarezpotts 2006-01-20 02:22:21 UTC
davide, we would like to confirm the nature of the problem and for that we need for you to try to see if the 
problem persists...

thanks
louis
Comment 77 paolomantovani 2006-01-20 10:00:39 UTC
Created attachment 33405 [details]
refused mail
Comment 78 lsuarezpotts 2006-01-20 16:34:35 UTC
support, it seems that mail is still being refused from fastweb. please see the attached file.
louis
Comment 79 Unknown 2006-01-20 17:59:37 UTC
Changing the summary; should have opened a new ticket as mentioned by Stefan, 
earlier. This ticket already has details on this current mail issue; hence 
will continue to work on this.
Comment 80 lsuarezpotts 2006-01-20 18:14:58 UTC
my error; asarkar pointed out that fastweb does not seem to be involved in the latest problem.  

Davide: it seems as if libero.it may be blocked, too. Can you help us confirm that? 

louis
Comment 81 davide 2006-01-20 21:53:12 UTC
Another person reported the same problem. I asked him which relay he is using.
Comment 82 davide 2006-01-20 21:53:39 UTC
---------- Forwarded message ----------
From: postmaster@it.openoffice.org <postmaster@it.openoffice.org>
Date: 16-gen-2006 15.29
Subject: failure delivery
To: fabio.fiorentini@gmail.com


Unable to deliver message to the following address(es) utenti@it.openoffice.org.

Remote host said: 554 delivery error: This user doesn't have an
account
Comment 83 davide 2006-01-21 21:16:46 UTC
Today lot of messages passed in mailing list but I received the error reported
above as mail under "MODERATION". Very strange. I attached one of this but all
are the same.

And this happens only for ML utenti@it.openoffice.org and not for
discussioni@it.openoffice.org



Comment 84 davide 2006-01-21 21:18:26 UTC
Created attachment 33440 [details]
Mail received under moderation even if it passed on ML.
Comment 85 davide 2006-01-23 07:29:54 UTC
This user is correctly a subscriber of the ML utenti@it.openoffice.org.

He posts from gmail but nothing is published on ML and neighter I receive any
notification of moderation.

Davide


---------------------------------------------------------------------------


From: postmaster@it.openoffice.org <postmaster@it.openoffice.org>
Date: 20-gen-2006 20.51
Subject: failure delivery
To: fabio.fiorentini@gmail.com


Unable to deliver message to the following address(es) utenti@it.openoffice.org.

Remote host said: 554 delivery error: This user doesn't have an
account

--- Original message follows.
2006/1/20, Paolo M. Grossholz:
> >
> > Cari amici,
> > è normale che cliccando su Informazioni su OpenOffice.org all'interno
> > del menù ? di Writer legga:
> > OpenOffice.org 2.0 ???
> > Non dovrebbe essere 2.0.1.???


intanto 2.0 non è 2.0.0  :-) 
comunque è già stato segnalato varie volte in lista negli scorsi giorni
prova a dare un'occhiata agli archivi della lista.
per vedere la versione devi tenere premuto ctrl e poi in sequenza S, D, T

Ciao

Fabio
Comment 86 davide 2006-01-23 18:26:17 UTC
Another mail problem.

----------------------------------


Oggetto:
Delivery Status Notification
Da:
Mail Delivery Service <postmaster@aliceposta.it>
Data:
Sat, 21 Jan 2006 08:20:40 +0100
A:
madmachine@alice.it

 - These recipients of your message have been processed by the mail server:
utenti@it.openoffice.org; Failed; 5.1.2 (bad destination system address)

    Remote MTA cylon1.sjc.collab.net: network error


 - SMTP protocol diagnostic: 554 cylon1.sjc.collab.net




Reporting-MTA: dns; vsmtp21alice.tin.it
Received-from-MTA: dns; [87.6.76.234] (87.6.76.234)
Arrival-Date: Sat, 21 Jan 2006 08:20:39 +0100

Final-Recipient: rfc822; utenti@it.openoffice.org
Action: Failed
Status: 5.1.2 (bad destination system address)
Remote-MTA: dns; cylon1.sjc.collab.net



Return-Path: <madmachine@alice.it>
Received: from [87.6.76.234] (87.6.76.234) by vsmtp21alice.tin.it (7.2.060.1)
        id 43C3E98B002004D5 for utenti@it.openoffice.org; Sat, 21 Jan 2006
08:20:39 +0100
Message-ID: <43D1E19C.6000102@alice.it>
Date: Sat, 21 Jan 2006 08:24:12 +0100
From: madmachine <madmachine@alice.it>
User-Agent: Mozilla Thunderbird 1.5 (X11/20051201)
MIME-Version: 1.0
To:  utenti@it.openoffice.org
Subject: Re: [utenti] Titoli dei paragrafi su colonna laterale
References: <43CF47F8.4090204@ingegnericonsulenti.com> <43D0F5A8.5050706@alice.it>
In-Reply-To: <43D0F5A8.5050706@alice.it>
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 8bit

Comment 87 lsuarezpotts 2006-01-23 19:27:52 UTC
reassigning to support
Comment 88 Unknown 2006-01-23 20:09:13 UTC
I tried in google "aliceposta.it blacklist" and found references of this site 
in blacklist related forums. However, I or CN does not go by google's results.
But most likely this domain *is* in the blacklist of our spam/virus filter. 
Can we have a list of all the domains that you are experiencing problems with? 
That way we can verify and try to add them to the white-list in one go, 
instead of  multiple times. Also, please note that adding some of these 
domains could allow visrues/spams to get through to the OO.o sites. So, please 
choose this list with caution.
Comment 89 Unknown 2006-01-24 17:44:38 UTC
I am taking the priority down a little bit here. We discussed this issue with 
Stefan and we agreed to collect and put a list together of all the domain 
sites that need whitelisting. Obviously as more sites need to be whitelisted 
in the future, we can add them as required.

I would recommend that we close this issue and then open separate tickets for 
adding to whitelist(s).

Any thoughts?
Comment 90 Unknown 2006-01-30 02:41:39 UTC
Hi,
      Any thoughts or updates on this issue?

Regards,
Karthik
Support Operations
Comment 91 kami911 2006-02-07 21:29:17 UTC
Hi!

I didn't get my IZ notification mails and I didn't get the subscribed maillists
mails. Could you help me? My mailaddress is kami_@openoffice.org that is
forwarded to kamihir@freemail.hu...
Thank you in advance,
KAMI
Comment 92 grsingleton 2006-02-25 13:45:33 UTC
This issue is obviously active and is in Start state. Changing to reflect efforts
Comment 93 davide 2006-02-28 10:27:44 UTC
Another error by sending email to ML management@it.openoffice.org

--------------------------------------------------------------

- These recipients of your message have been processed by the mail server:
management-accept-1141122028.10521.odegdifekgdomdibegap@it.openoffice.org;
Failed; 5.1.2 (bad destination system address)

    Remote MTA cylon2.sjc.collab.net: network error


 - SMTP protocol diagnostic: 554 cylon2.sjc.collab.net

Reporting-MTA: dns; aa002msg.fastwebnet.it
Received-from-MTA: dns; ms005msg.fastwebnet.it (10.31.41.25)
Arrival-Date: Tue, 28 Feb 2006 11:22:29 +0100

Final-Recipient: rfc822;
management-accept-1141122028.10521.odegdifekgdomdibegap@it.openoffice.org
Action: Failed
Status: 5.1.2 (bad destination system address)
Remote-MTA: dns; cylon2.sjc.collab.net
Oggetto: Re: MODERATE for management@it.openoffice.orgDa: Davide Dozza
<davide@flossconsulting.it>Data: Tue, 28 Feb 2006 11:22:19 +0100A:
management-accept-1141122028.10521.odegdifekgdomdibegap@it.openoffice.org
Comment 94 kami911 2006-02-28 11:51:11 UTC
I am not sure if some of UI text are localizable:
officecfg/registry/data/org/openoffice/Office/UI/CalcCommands.xcu
officecfg/registry/data/org/openoffice/Office/UI/WriterCommands.xcu
officecfg/registry/data/org/openoffice/Office/UI/DrawImpressCommands.xcu	
because it misses the de text version...
Comment 95 kami911 2006-02-28 12:09:58 UTC
Sorry!
Comment 96 davide 2006-03-22 08:07:30 UTC
Some people reported new problems on utenti@it.openoffice.org ML. In particular
it seems that mails sent with OE are posted correctly while mails delivered via
Thunderbird 1.0.7 are discarded because I don't receive any notification of
moderation.
I attached the two emails sent via thunderbird that have been discarded.

Davide

--------------------------------------------------------------------------

>From - Tue Mar 21 08:44:17 2006
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00800000
Message-ID: <441FAED0.1010601@virgilio.it>
Date: Tue, 21 Mar 2006 08:44:16 +0100
From: "italdesign.tin" <italdesign1@virgilio.it>
User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923)
X-Accept-Language: it, it-it, en-us, en
MIME-Version: 1.0
To: Utenti_OOo - Mail_List <utenti@it.openoffice.org>
Subject: Grafici o diagrammi su Calc
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 8bit

-------------------------------------------------------------

>From - Tue Mar 21 17:19:25 2006
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00800000
Message-ID: <4420278C.60509@virgilio.it>
Date: Tue, 21 Mar 2006 17:19:24 +0100
From: "italdesign.tin" <italdesign1@virgilio.it>
User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923)
X-Accept-Language: it, it-it, en-us, en
MIME-Version: 1.0
To:  utenti@it.openoffice.org
Subject: grafici e diagrammi su Calc
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 8bit
Comment 97 stx123 2006-03-29 20:44:25 UTC
This issue started with the title "mailserver down". This problem has been
solved with the installation of improved SPAM and virus protection.
There seem to be some conditions under which messages are rejected.
One was that the domain fastweb.it was blacklisted. This domain is now in a
whitelist and messages will no longer be rejected from that domain.
Nevertheless the problem resulting in similar error messages persist as issue
63493 shows.
Please let's continue to work on different problems in new / different issues.
Thanks, Stefan
Comment 98 Unknown 2007-02-20 04:33:56 UTC
Based on Stefan's last comments closing this issue .