Bug 61139 - Commandline summary ignores Transaction Controller results when "Generate Parent Sampler" option is checked
Summary: Commandline summary ignores Transaction Controller results when "Generate Par...
Status: RESOLVED DUPLICATE of bug 60109
Alias: None
Product: JMeter - Now in Github
Classification: Unclassified
Component: Main (show other bugs)
Version: 3.1
Hardware: All All
: P2 regression (vote)
Target Milestone: ---
Assignee: JMeter issues mailing list
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-05-31 07:46 UTC by Vincent HERILIER
Modified: 2017-05-31 08:05 UTC (History)
1 user (show)



Attachments
testcase with 2 different TCs (3.1 and above) (13.87 KB, application/xml)
2017-05-31 07:46 UTC, Vincent HERILIER
Details
testcase with 1 TC with unchecked option (3.1 and above) (9.21 KB, application/xml)
2017-05-31 07:47 UTC, Vincent HERILIER
Details
testcase with 1 TC with checked option (3.1 and above) (9.45 KB, application/xml)
2017-05-31 07:48 UTC, Vincent HERILIER
Details
testcase with 2 different TCs (2.13) (13.80 KB, application/xml)
2017-05-31 07:49 UTC, Vincent HERILIER
Details
testcase with 1 TC with unchecked option (2.13) (9.21 KB, application/xml)
2017-05-31 07:52 UTC, Vincent HERILIER
Details
testcase with 1 TC with checked option (2.13) (9.21 KB, application/xml)
2017-05-31 07:53 UTC, Vincent HERILIER
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Vincent HERILIER 2017-05-31 07:46:59 UTC
Created attachment 35015 [details]
testcase with 2 different TCs (3.1 and above)

Since JMeter 3.1, in commandline, the summary does not take in account results of Transaction Controllers that have "Generate Parent Sampler" option checked.
Same in JMeter 3.2.

It sounds like a small regression.

Here's the results of 3 test cases that contains Transaction Controllers:

TC.jmx [2 TC with 3 HTTP samplers each, first has the option unchecked, for the second it is checked]
--------------------------
summary =      3 in 00:00:00 =    9.0/s Avg:     0 Min:     0 Max:     0 Err:     3 (100.00%)
Tidying up ...    @ Wed May 31 09:15:15 CEST 2017 (1496214915506)
... end of run
==========================
It has to be 4
--------------------------

TC-A.jmx [1 TC with 3 HTTP samplers each, option is unchecked]
--------------------------
summary +      1 in 00:00:00 =    2.9/s Avg:     0 Min:     0 Max:     0 Err:     1 (100.00%) Active: 1 Started: 1 Finished: 0
summary +      2 in 00:00:00 =  111.1/s Avg:     0 Min:     0 Max:     0 Err:     2 (100.00%) Active: 0 Started: 1 Finished: 1
summary =      3 in 00:00:00 =    8.3/s Avg:     0 Min:     0 Max:     0 Err:     3 (100.00%)
Tidying up ...    @ Wed May 31 09:19:05 CEST 2017 (1496215145785)
... end of run
--------------------------

TC-B.jmx [1 TC with 3 HTTP samplers each, option is checked]
--------------------------
summary =      0 in 00:00:00 = ******/s Avg:     0 Min: 9223372036854775807 Max: -9223372036854775808 Err:     0 (0.00%)
Tidying up ...    @ Wed May 31 09:20:10 CEST 2017 (1496215210259)
... end of run
==========================
It has to be 1
--------------------------

To make a comparison, here's the results coming from 2.13 version of the same tests:

OldTC.jmx
--------------------------
summary =      5 in     2s =    3.1/s Avg:   250 Min:    69 Max:   507 Err:     0 (0.00%)
Tidying up ...    @ Wed May 31 09:28:50 CEST 2017 (1496215730672)
... end of run
--------------------------

OldTC-A.jmx
--------------------------
summary +      1 in   1.2s =    0.8/s Avg:   331 Min:   331 Max:   331 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
summary +      3 in   0.2s =   17.9/s Avg:   217 Min:    70 Max:   492 Err:     0 (0.00%) Active: 0 Started: 1 Finished: 1
summary =      4 in   1.4s =    2.9/s Avg:   246 Min:    70 Max:   492 Err:     0 (0.00%)
Tidying up ...    @ Wed May 31 09:28:02 CEST 2017 (1496215682966)
... end of run
--------------------------

OldTC-B.jmx
--------------------------
summary =      1 in   1.3s =    0.8/s Avg:   459 Min:   459 Max:   459 Err:     0 (0.00%)
Tidying up ...    @ Wed May 31 09:27:33 CEST 2017 (1496215653433)
... end of run
--------------------------
Comment 1 Vincent HERILIER 2017-05-31 07:47:55 UTC
Created attachment 35016 [details]
testcase with 1 TC with unchecked option (3.1 and above)
Comment 2 Vincent HERILIER 2017-05-31 07:48:29 UTC
Created attachment 35017 [details]
testcase with 1 TC with checked option (3.1 and above)
Comment 3 Vincent HERILIER 2017-05-31 07:49:25 UTC
Created attachment 35018 [details]
testcase with 2 different TCs (2.13)
Comment 4 Vincent HERILIER 2017-05-31 07:52:18 UTC
Created attachment 35019 [details]
testcase with 1 TC with unchecked option (2.13)
Comment 5 Vincent HERILIER 2017-05-31 07:53:03 UTC
Created attachment 35020 [details]
testcase with 1 TC with checked option (2.13)
Comment 6 Philippe Mouawad 2017-05-31 07:54:38 UTC
Hi Vincent,
It's not a bug, it is intentional and was clearly announced in Incompatible Changes in release notes (which I would be very happy if users took time to read 
a document we carefully build to announce all changes):

See:
http://jmeter.apache.org/changes_history.html#Incompatible%20changes

------------------------------------------------------------
Since version 3.1, HTML report ignores empty Transaction Controller (possibly generated by If Controller or Throughput Controller) when computing metrics. This provides more accurate metrics
Since version 3.1, Summariser ignores SampleResults generated by Transaction Controller when computing the live statistics, see Bug 60109

------------------------------------------------------------

See Bug 60109
Generate Parent Sample should not be used anymore as it will not work with HTML Report nor with summariser.

I think in a near future we should drop this option.

*** This bug has been marked as a duplicate of bug 60109 ***
Comment 7 Vincent HERILIER 2017-05-31 08:05:43 UTC
Hi Philippe,

All my apologies, I miss this change.
I'll read twice or more next release ;)
Thanks for reminding to be more attentive.
Comment 8 The ASF infrastructure team 2022-09-24 20:38:09 UTC
This issue has been migrated to GitHub: https://github.com/apache/jmeter/issues/4403