Bug 60893

Summary: Getting AH00052: child pid 636 exit signal Aborted (6) error
Product: Apache httpd-2 Reporter: pratap <pratap.sekhar>
Component: AllAssignee: Apache HTTPD Bugs Mailing List <bugs>
Status: NEEDINFO ---    
Severity: critical    
Priority: P2    
Version: 2.4.39   
Target Milestone: ---   
Hardware: PC   
OS: Windows NT   
URL: https://emedicoz.com

Description pratap 2017-03-21 01:15:11 UTC 
Dear Team,

We were using Apache 2.2.23 initially and installed 2.4.23 recently following by configuring various options to support our project. The apache instance 2.4.23 is also integrated with Siteminder Policy servers.


When trying to access the application, we getting below error first time in error_log and stops handling further and also don't see any entry for this transaction in access_log. The user experience for this hit in browser is "500 Internal server error". The strange thing is - page works perfectly when relaunch the application.


===================
terminate called after throwing an instance of 'std::out_of_range'
  what():  basic_string::substr
[Sat Mar 11 16:52:16.313199 2017] [core:notice] [pid 620:tid 140199602513664] AH00052: child pid 636 exit signal Aborted (6)
=====================

Can you please go through this and suggest whether we need to apply any patch to fix this?

Thanks
Pratap Raja Sekhar
Comment 1 Eric Covener 2017-03-21 01:16:27 UTC 
What third-party modules are loaded? This is an uncaught C++ exception, and httpd from the ASF has no c++ modules.
Comment 2 pratap 2017-03-21 01:19:15 UTC 
Hi Eric,
Thanks for the response. Only Weblogic module is loaded.
FYI - We reverted to 2.2.23 but this error disappear but the same issue is there only in 2.4.23 version.

(In reply to Eric Covener from comment #1)
> What third-party modules are loaded? This is an uncaught C++ exception, and
> httpd from the ASF has no c++ modules.
Comment 3 pratap 2017-03-21 01:21:22 UTC 
Also the httpd is running in Oracle Enterprise Linux version 6.8 of Kernel UEK4.

(In reply to Eric Covener from comment #1)
> What third-party modules are loaded? This is an uncaught C++ exception, and
> httpd from the ASF has no c++ modules.
Comment 4 Eric Covener 2017-03-21 01:26:33 UTC 
You'd need to capture a corefile and analyze it with gdb to be certain, but it's almost certainly a problem in the [c++] weblogic module.
Comment 5 pratap 2017-03-21 01:43:31 UTC 
if the problem is with weblogic plug-in c++ code then why its not failing everytime but failing only during first time?

(In reply to Eric Covener from comment #4)
> You'd need to capture a corefile and analyze it with gdb to be certain, but
> it's almost certainly a problem in the [c++] weblogic module.
Comment 6 Eric Covener 2017-03-21 01:47:19 UTC 
(In reply to pratap from comment #5)
> if the problem is with weblogic plug-in c++ code then why its not failing
> everytime but failing only during first time?

You'll need to analyze the core to figure out the faulting C++ module. httpd doesn't come with ANY c++ modules.
Comment 7 pratap 2017-03-21 01:51:20 UTC 

(In reply to Eric Covener from comment #6)
> (In reply to pratap from comment #5)
> > if the problem is with weblogic plug-in c++ code then why its not failing
> > everytime but failing only during first time?
> 
> You'll need to analyze the core to figure out the faulting C++ module. httpd
> doesn't come with ANY c++ modules.

Will that be possible for you to share some info on how to generate to core and analyze. Please share the URL that talks about generating core dump and analyzing using gdb.
Comment 8 Eric Covener 2017-03-21 01:52:07 UTC 
http://httpd.apache.org/dev/debugging.html
Comment 9 Nitan 2020-07-16 04:17:20 UTC 
Please see the logs.
Php version 7.0.3

OS:- Amazon linux.
I have already enough memory.


ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
*** Error in `/usr/sbin/httpd': corrupted size vs. prev_size: 0x000055b6850f683f ***
======= Backtrace: =========
/lib64/libc.so.6(+0x80be4)[0x7f4c62c38be4]
/lib64/libc.so.6(+0x815ce)[0x7f4c62c395ce]
/etc/httpd/modules/libphp-zts-7.0.so(+0x254374)[0x7f4c556be374]
/etc/httpd/modules/libphp-zts-7.0.so(php_module_shutdown+0x33)[0x7f4c55650a53]
/etc/httpd/modules/libphp-zts-7.0.so(php_module_shutdown_wrapper+0x9)[0x7f4c55650aa9]
/etc/httpd/modules/libphp-zts-7.0.so(+0x2e8481)[0x7f4c55752481]
/usr/lib64/libapr-1.so.0(apr_pool_destroy+0x7e)[0x7f4c633c272e]
/etc/httpd/modules/mod_mpm_worker.so(+0x4f55)[0x7f4c5820df55]
/etc/httpd/modules/mod_mpm_worker.so(+0x5e20)[0x7f4c5820ee20]
/etc/httpd/modules/mod_mpm_worker.so(+0x61e9)[0x7f4c5820f1e9]
/etc/httpd/modules/mod_mpm_worker.so(+0x6c18)[0x7f4c5820fc18]
/usr/sbin/httpd(ap_run_mpm+0x4e)[0x55b6848a32de]
/usr/sbin/httpd(main+0xa89)[0x55b68489bdf9]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f4c62bda575]
/usr/sbin/httpd(+0x21f80)[0x55b68489bf80]
======= Memory map: ========
55b68487a000-55b6848fe000 r-xp 00000000 ca:01 16274                      /usr/sbin/httpd
55b684afe000-55b684b01000 r--p 00084000 ca:01 16274                      /usr/sbin/httpd
55b684b01000-55b684b03000 rw-p 00087000 ca:01 16274                      /usr/sbin/httpd
55b684b03000-55b684b06000 rw-p 00000000 00:00 0
55b684d5d000-55b684e9e000 rw-p 00000000 00:00 0                          [heap]
55b684e9e000-55b68510b000 rw-p 00000000 00:00 0                          [heap]
55b68510b000-55b685170000 rw-p 00000000 00:00 0                          [heap]
7f4ba8000000-7f4ba8021000 rw-p 00000000 00:00 0
7f4ba8021000-7f4bac000000 ---p 00000000 00:00 0
7f4bb4000000-7f4bb4c2e000 rw-p 00000000 00:00 0
7f4bb4c2e000-7f4bb8000000 ---p 00000000 00:00 0
7f4bb8000000-7f4bb8021000 rw-p 00000000 00:00 0
7f4bb8021000-7f4bbc000000 ---p 00000000 00:00 0
7f4bbc000000-7f4bbccbc000 rw-p 00000000 00:00 0
7f4bbc000000-7f4bbccbc000 rw-p 00000000 00:00 0
7f4bbccbc000-7f4bc0000000 ---p 00000000 00:00 0
7f4bc0000000-7f4bc0ca5000 rw-p 00000000 00:00 0
7f4bc0ca5000-7f4bc4000000 ---p 00000000 00:00 0
7f4bc4000000-7f4bc4c78000 rw-p 00000000 00:00 0
7f4bc4c78000-7f4bc8000000 ---p 00000000 00:00 0
7f4bc8000000-7f4bc8d79000 rw-p 00000000 00:00 0
7f4bc8d79000-7f4bcc000000 ---p 00000000 00:00 0
7f4bcc000000-7f4bccce1000 rw-p 00000000 00:00 0
7f4bccce1000-7f4bd0000000 ---p 00000000 00:00 0
7f4bd0000000-7f4bd0c49000 rw-p 00000000 00:00 0
7f4bd0c49000-7f4bd4000000 ---p 00000000 00:00 0
7f4bd4000000-7f4bd4e3d000 rw-p 00000000 00:00 0
7f4bd4e3d000-7f4bd8000000 ---p 00000000 00:00 0
7f4bdc000000-7f4bdcc8f000 rw-p 00000000 00:00 0
7f4bdcc8f000-7f4be0000000 ---p 00000000 00:00 0
7f4be0000000-7f4be0cfd000 rw-p 00000000 00:00 0
7f4be0cfd000-7f4be4000000 ---p 00000000 00:00 0
7f4be4000000-7f4be4e92000 rw-p 00000000 00:00 0
7f4be4e92000-7f4be8000000 ---p 00000000 00:00 0
7f4be8000000-7f4be8c96000 rw-p 00000000 00:00 0
7f4be8c96000-7f4bec000000 ---p 00000000 00:00 0
7f4bec000000-7f4becea7000 rw-p 00000000 00:00 0
7f4becea7000-7f4bf0000000 ---p 00000000 00:00 0
7f4bf0000000-7f4bf0cb1000 rw-p 00000000 00:00 0
7f4bf0cb1000-7f4bf4000000 ---p 00000000 00:00 0
7f4bf4000000-7f4bf4db7000 rw-p 00000000 00:00 0
7f4bf4db7000-7f4bf8000000 ---p 00000000 00:00 0
7f4bf8000000-7f4bf8d09000 rw-p 00000000 00:00 0
7f4bf8d09000-7f4bfc000000 ---p 00000000 00:00 0
7f4bfc000000-7f4bfccbc000 rw-p 00000000 00:00 0
7f4c55260000-7f4c55262000 rw-p 00000000 00:00 0
7f4c55262000-7f4c55269000 r-xp 00000000 ca:01 267854                     /lib64/librt-2.17.so
7f4c55269000-7f4c55468000 ---p 00007000 ca:01 267854                     /lib64/librt-2.17.so
7f4c55468000-7f4c55469000 r--p 00006000 ca:01 267854                     /lib64/librt-2.17.so
7f4c55469000-7f4c5546a000 rw-p 00007000 ca:01 267854                     /lib64/librt-2.17.so
7f4c5546a000-7f4c558a8000 r-xp 00000000 ca:01 528331                     /usr/lib64/httpd/modules/libphp-zts-7.0.so
7f4c558a8000-7f4c55aa8000 ---p 0043e000 ca:01 528331                     /usr/lib64/httpd/modules/libphp-zts-7.0.so
7f4c55aa8000-7f4c55b2e000 rw-p 0043e000 ca:01 528331                     /usr/lib64/httpd/modules/libphp-zts-7.0.so
7f4c55b2e000-7f4c55b43000 rw-p 00000000 00:00 0
7f4c55b43000-7f4c55b4b000 r-xp 00000000 ca:01 540522                     /usr/lib64/httpd/modules/mod_cgid.so
7f4c55b4b000-7f4c55d4b000 ---p 00008000 ca:01 540522                     /usr/lib64/httpd/modules/mod_cgid.so
7f4c55d4b000-7f4c55d4c000 r--p 00008000 ca:01 540522                     /usr/lib64/httpd/modules/mod_cgid.so
7f4c55d4c000-7f4c55d4d000 rw-p 00009000 ca:01 540522                     /usr/lib64/httpd/modules/mod_cgid.so
7f4c55d4d000-7f4c55d82000 r-xp 00000000 ca:01 540601                     /usr/lib64/httpd/modules/mod_ssl.so
7f4c55d82000-7f4c55f81000 ---p 00035000 ca:01 540601                     /usr/lib64/httpd/modules/mod_ssl.so
7f4c55f81000-7f4c55f84000 r--p 00034000 ca:01 540601                     /usr/lib64/httpd/modules/mod_ssl.so
7f4c55f84000-7f4c55f85000 rw-p 00037000 ca:01 540601                     /usr/lib64/httpd/modules/mod_ssl.so
7f4c55f85000-7f4c55f87000 rw-p 00000000 00:00 0
7f4c55f87000-7f4c55f8a000 r-xp 00000000 ca:01 540563                     /usr/lib64/httpd/modules/mod_proxy_wstunnel.so
7f4c55f8a000-7f4c5618a000 ---p 00003000 ca:01 540563                     /usr/lib64/httpd/modules/mod_proxy_wstunnel.so
7f4c5618a000-7f4c5618b000 r--p 00003000 ca:01 540563                     /usr/lib64/httpd/modules/mod_proxy_wstunnel.so
7f4c5618b000-7f4c5618c000 rw-p 00004000 ca:01 540563                     /usr/lib64/httpd/modules/mod_proxy_wstunnel.so
7f4c5618c000-7f4c5618f000 r-xp 00000000 ca:01 540562                     /usr/lib64/httpd/modules/mod_proxy_uwsgi.so
7f4c5618f000-7f4c5638e000 ---p 00003000 ca:01 540562                     /usr/lib64/httpd/modules/mod_proxy_uwsgi.so
7f4c5638e000-7f4c5638f000 r--p 00002000 ca:01 540562                     /usr/lib64/httpd/modules/mod_proxy_uwsgi.so
7f4c5638f000-7f4c56390000 rw-p 00003000 ca:01 540562                     /usr/lib64/httpd/modules/mod_proxy_uwsgi.so
7f4c56390000-7f4c56394000 r-xp 00000000 ca:01 540561
7f4c64448000-7f4c64449000 rw-p 00057000 ca:01 262273                     /lib64/libpcre.so.0.0.1
7f4c64449000-7f4c6446b000 r-xp 00000000 ca:01 302116                     /lib64/ld-2.17.so
7f4c64537000-7f4c6458c000 rw-s 00000000 00:05 202818918                  /dev/zero (deleted)
7f4c645da000-7f4c645db000 rw-p 00000000 00:00 0
7f4c645db000-7f4c64659000 rw-s 00000000 00:05 273975885                  /dev/zero (deleted)
7f4c64659000-7f4c64660000 rw-p 00000000 00:00 0
7f4c64660000-7f4c64667000 r--s 00000000 ca:01 3249                       /usr/lib64/gconv/gconv-modules.cache
7f4c64667000-7f4c64668000 rw-s 00000000 00:05 273975886                  /dev/zero (deleted)
7f4c64668000-7f4c64669000 rw-s 00000000 00:05 273975884                  /dev/zero (deleted)
7f4c64669000-7f4c6466a000 rw-p 00000000 00:00 0
7f4c6466a000-7f4c6466b000 r--p 00021000 ca:01 302116                     /lib64/ld-2.17.so
7f4c6466b000-7f4c6466c000 rw-p 00022000 ca:01 302116                     /lib64/ld-2.17.so
7f4c6466c000-7f4c6466d000 rw-p 00000000 00:00 0
7fff1f16c000-7fff1f18d000 rw-p 00000000 00:00 0                          [stack]
7fff1f1f1000-7fff1f1f4000 r--p 00000000 00:00 0                          [vvar]
7fff1f1f4000-7fff1f1f6000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
[Wed Jul 15 20:37:32.416760 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 46503 exit signal Bus error (7)
[Wed Jul 15 20:37:32.417521 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 29301 exit signal Aborted (6)
[Wed Jul 15 20:37:32.417556 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 108344 exit signal Aborted (6)





7f4c63fce000-7f4c63fd0000 rw-p 00026000 ca:01 16199                      /usr/lib64/libaprutil-1.so.0.5.4
7f4c63fd0000-7f4c63fee000 r-xp 00000000 ca:01 3344                       /usr/lib64/libselinux.so.1
7f4c63fee000-7f4c641ed000 ---p 0001e000 ca:01 3344                       /usr/lib64/libselinux.so.1
7f4c641ed000-7f4c641ee000 r--p 0001d000 ca:01 3344                       /usr/lib64/libselinux.so.1
7f4c641ee000-7f4c641ef000 rw-p 0001e000 ca:01 3344                       /usr/lib64/libselinux.so.1
7f4c641ef000-7f4c641f1000 rw-p 00000000 00:00 0
7f4c641f1000-7f4c64248000 r-xp 00000000 ca:01 262273                     /lib64/libpcre.so.0.0.1
7f4c64248000-7f4c64448000 ---p 00057000 ca:01 262273                     /lib64/libpcre.so.0.0.1
7f4c64448000-7f4c64449000 rw-p 00057000 ca:01 262273                     /lib64/libpcre.so.0.0.1
7f4c64449000-7f4c6446b000 r-xp 00000000 ca:01 302116                     /lib64/ld-2.17.so
7f4c64537000-7f4c6458c000 rw-s 00000000 00:05 202818918                  /dev/zero (deleted)
7f4c645da000-7f4c645db000 rw-p 00000000 00:00 0
7f4c645db000-7f4c64659000 rw-s 00000000 00:05 273975885                  /dev/zero (deleted)
7f4c64659000-7f4c64660000 rw-p 00000000 00:00 0
7f4c64660000-7f4c64667000 r--s 00000000 ca:01 3249                       /usr/lib64/gconv/gconv-modules.cache
7f4c64667000-7f4c64668000 rw-s 00000000 00:05 273975886                  /dev/zero (deleted)
7f4c64668000-7f4c64669000 rw-s 00000000 00:05 273975884                  /dev/zero (deleted)
7f4c64669000-7f4c6466a000 rw-p 00000000 00:00 0
7f4c6466a000-7f4c6466b000 r--p 00021000 ca:01 302116                     /lib64/ld-2.17.so
7f4c6466b000-7f4c6466c000 rw-p 00022000 ca:01 302116                     /lib64/ld-2.17.so
7f4c6466c000-7f4c6466d000 rw-p 00000000 00:00 0
7fff1f16c000-7fff1f18d000 rw-p 00000000 00:00 0                          [stack]
7fff1f1f1000-7fff1f1f4000 r--p 00000000 00:00 0                          [vvar]
7fff1f1f4000-7fff1f1f6000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
[Wed Jul 15 20:37:32.416760 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 46503 exit signal Bus error (7)
[Wed Jul 15 20:37:32.417521 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 29301 exit signal Aborted (6)
[Wed Jul 15 20:37:32.417556 2020] [core:notice] [pid 101029:tid 139966078621760] AH00052: child pid 108344 exit signal Aborted (6)