Apache OpenOffice (AOO) Bugzilla – Issue 65228
stats for total mail list subscribers
Last modified: 2017-05-20 10:20:30 UTC
stats for total number of subscribers stopped 3 March 2006. An internal collabnet issue was filed shortly after. This issue is intended to track work on the issue/problem.
added statscenter iz number and url to whiteboard/url. louis
The solution is a very useful set of java scripts (see attached) that can output desired results in csv format for OOo inspection. 1. Run the script directly from your terminal. 2. For project lists, use module=mlm, then [projectname.domainname], or e.g., api.openoffice.org 3. enter your username/password (thus, this only will work with project leads/domain admins.) example: louis$ java -jar lib/ceetools.jar --module=mlm Enter mailing list [mailinglist@project.domain]: api.openoffice.org Enter action [add|count|list|remove|set|totals]: count Enter username: [name] Enter password: [password] cvs:9 issues:16 features:60 users:124 dev:308 You can also output as csv file: $ java -jar lib/ceetools.jar --module=mlm --http --format=csv [filename.csv] See also for more info, http://rafb.net/paste/results/LzLqsi83.html Let me know how this works.... Louis
Created attachment 36578 [details] ceetools-1.zip
with https I get: $ java -jar lib/ceetools.jar --module=mlm --user=mh@openoffice.org --password=XXX --list=dev@openoffice.org --action=count --https java.net.SocketException: Connection reset by peer: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketImpl.<init>(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketFactoryImpl.createSocket(Unknown Source) at org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory.createSocket(Unknown Source) at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) at net.collab.ceetools.http.HttpUtil.login(HttpUtil.java:58) at net.collab.ceetools.mailinglists.MailingListManager.run(MailingListManager.java:116) at net.collab.ceetools.mailinglists.MailingListManager.main(MailingListManager.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at net.collab.ceetools.Main.runModule(Main.java:94) at net.collab.ceetools.Main.main(Main.java:38) Failed to download file. java.net.ConnectException: Connection refused: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketImpl.<init>(Unknown Source) at com.sun.net.ssl.internal.ssl.SSLSocketFactoryImpl.createSocket(Unknown Source) at org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory.createSocket(Unknown Source) at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) at net.collab.ceetools.http.HttpUtil.getPageAsString(HttpUtil.java:133) withoout https I get: $ java -jar lib/ceetools.jar --module=mlm --user=mh@openoffice.org --password=XXX --list=dev@openoffice.org --action=count Method failed: HTTP/1.1 404 Not Found java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at net.collab.ceetools.Main.runModule(Main.java:94) at net.collab.ceetools.Main.main(Main.java:38) Caused by: java.lang.NullPointerException at net.collab.ceetools.mailinglists.MailingListManager.listAsList(MailingListManager.java:398) at net.collab.ceetools.mailinglists.MailingListManager.count(MailingListManager.java:204) at net.collab.ceetools.mailinglists.MailingListManager.run(MailingListManager.java:174) at net.collab.ceetools.mailinglists.MailingListManager.main(MailingListManager.java:80) ... 6 more I'm sitting behind a NATed firewall....
ok, my fault, the command line help was a little bit misleading, instead of dev@openoffice.org I have to put www.openoffice.org for all mailing list of that project.
I have my own Mac OS X firewall but am fairly exposed. I ran it without http and got the correct output plus some error comments. See: Pangyra:~/Desktop/ceetools-1 louis$ java -jar lib/ceetools.jar --module=mlm Enter mailing list [mailinglist@project.domain]: dev@www.openoffice.org Enter action [add|count|list|remove|set|totals]: count Enter username: username Enter password: password Failed to download file. java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:168) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read(BufferedInputStream.java:235) at java.io.FilterInputStream.read(FilterInputStream.java:66) at org.apache.commons.httpclient.AutoCloseInputStream.read(Unknown Source) at net.collab.ceetools.http.HttpUtil.getPageAsString(HttpUtil.java:142) at net.collab.ceetools.mailinglists.MailingListManager.listAsList(MailingListManager.java:394) at net.collab.ceetools.mailinglists.MailingListManager.count(MailingListManager.java:204) at net.collab.ceetools.mailinglists.MailingListManager.run(MailingListManager.java:174) at net.collab.ceetools.mailinglists.MailingListManager.main(MailingListManager.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at net.collab.ceetools.Main.runModule(Main.java:94) at net.collab.ceetools.Main.main(Main.java:38) dev:621 Pangyra:~/Desktop/ceetools-1 louis$ I then tried with all www lists--too a way long time and aborted it (users has over 10K, I think) and re- tried with xml. See below: Pangyra:~/Desktop/ceetools-1 louis$ java -jar lib/ceetools.jar --module=mlm Enter mailing list [mailinglist@project.domain]: xml.openoffice.org Enter action [add|count|list|remove|set|totals]: count Enter username: username Enter password: password cvs:9 issues:14 features:63 dev:265 -louis
right. We can change that string. But that's why I included my example... best Louis
I think I can close this, yes? Louis
*** Issue 65227 has been marked as a duplicate of this issue. ***
the tools seem functional to me but not usable. while running the tool, the whole site slows down and I also get connection time out errors: java.net.ConnectException: Connection timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:507) at java.net.Socket.connect(Socket.java:457) at java.net.Socket.<init>(Socket.java:365) at java.net.Socket.<init>(Socket.java:238) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.c reateSocket(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.c reateSocket(Unknown Source) at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unk nown Source) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknow n Source) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source ) at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source ) at net.collab.ceetools.http.HttpUtil.login(HttpUtil.java:58) at net.collab.ceetools.mailinglists.MailingListManager.run(MailingListMa nager.java:116) at net.collab.ceetools.mailinglists.MailingListManager.main(MailingListM anager.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:39) ....
I give up now with this tool, I can offer new messages: Method failed: HTTP/1.1 404 Not Found Method failed: HTTP/1.1 404 Not Found org.jdom.IllegalTargetException: The target "null" is not legal for JDOM/XML Processing Instructions: XML names cannot be null or empty. at org.jdom.ProcessingInstruction.setTarget(ProcessingInstruction.java:132) at org.jdom.ProcessingInstruction.<init>(ProcessingInstruction.java:118) at org.jdom.DefaultJDOMFactory.processingInstruction(DefaultJDOMFactory.java:156) at org.jdom.input.DOMBuilder.buildTree(DOMBuilder.java:300) at org.jdom.input.DOMBuilder.buildTree(DOMBuilder.java:170) at org.jdom.input.DOMBuilder.build(DOMBuilder.java:135) at net.collab.ceetools.xml.XMLUtil.getDocumentFromString(XMLUtil.java:57) at net.collab.ceetools.mailinglists.MailingListManager.listAsList(MailingListManager.java:394) at net.collab.ceetools.mailinglists.MailingListManager.count(MailingListManager.java:204) at net.collab.ceetools.mailinglists.MailingListManager.iterateOverLists(MailingListManager.java:227) at net.collab.ceetools.mailinglists.MailingListManager.run(MailingListManager.java:176)
this tool must do something stupid, when determing the number of subscriber run time seems either to depend on numbers of subscribes or number of posts. get the numbers for e.g. the fr.openoffice.org does last about 5 minutes vs. reading the html page of http://fr.openoffice.org/servlets/MailingListMembers?list=dev&group=Subscribers only needs a few seconds. run time for small projects like ucb.openoffice.org is about a minute, running this for www.openoffice.org about 10 minutes, I never got the data for de.openoffice.org because of getting errors. please provide something more useful.
Thanks for trying. I'll let the engineer know of your wishes and see what we can do. louis
I filed several weeks ago PCN 47716. Being worked on. Adding support.
From the engineer, this is how the tool might look: A single frame broken down into three panes: 1. Configured Domains (Top left) 2. Configured Reports (Bottom left) 3. Results (Right) You will configure a domain and then configure a set of reports you would like to run. To run a report for a domain, you right-click the report and select the domain to run the report for. Once there is data to represent, the Results table is populated. Features -------- Import/Export of configured domains and reports Save results in CSV, TSV, TXT and XML Run all CEE Tools reports from the gui -- As to when: we have to arrange that.
Do you have any updates regarding the "when"? In addition, would it be possible to get the current total number of subscribers once again independent of the availability of the stats tool? Thanks, Erwin
No idea about when. CN is discussing implementing similar functionality in future CEE versions. I suggest you raise this during a Tuesday call and insist upon it. As to the other data. See above. I have not been able to get data since early March. Issues have been filed and CN is looking at them. I suggest you raise this also during a Tuesday call. louis
We don't have to run the tool. CN is going to provide the data according to a discussion we had with Helen. reassigning to support...
Not sure with the status of this issue might be louis -:) would be able to give a shot on this issue . Louis ...-:)
thanks! See the PCN on this and work with Jeremy. It's so far pending. OMC doesn't give us this info. Louis
Have pinged Jeremy for an update in the internal issue .
Still awaiting a response from the engineer on the status of this issue .
No further improvements in the status of this issue . Pushing this issue internally for more traction .
To CRM .
.
From the next release of CEE pulling these information for reports e.g total number of subscribers etc would be very easy and less painful via normal SQl commands due to the new implementation of Discussion Forum . Hence moving this issue to the resolved later queue .
Updating milestone
CollabNet Support is currently reviewing the issues under Resolved-Later. If the issues are fixed currently in any of the present CEE releases, then it will be marked as Resolved-Fixed. There might be a few issues which might not be in our future roadmaps which might be closed as Wontfix unless it does not lie under any custom request.
Since markmail.org is in place for handling this request & also the new DS Has a tab that denotes the subscribers along with the messages sent. I am marking the ticket as resolved fixed.