Hello, We're running the following version of 389 DS: 389-adminutil-1.1.15-2.2.el5 389-admin-1.1.29-1.4.el5 389-ds-base-1.2.10.14-3.2.el5 389-ds-base-libs-1.2.10.14-3.2.el5 Recently, ns-slapd crashed on an LDAP search host: ns-slapd[5907]: segfault at 0000000000000018 rip 00002b5b390c3361 rsp 00002b5cac9ed560 error 4 I was curious if the following crash is a known bug in this version and/or what can be done to help find the root cause. Per http://port389.org/wiki/FAQ#Debugging_Hangs $ gdb -ex 'set confirm off' -ex 'set pagination off' -ex 'thread apply all bt full' -ex 'quit' /usr/sbin/ns-slapd /var/log/dirsrv/slapd-INSTANCENAME/core.PID > stacktrace.`date +%s`.txt 2>&1 Provides the following, I realize it is probably not helpful without all of the debugging symbols; however, I was curious if from what is shown, this is a known issue and fixed already in a newer version or if this is a new issue, thanks! GNU gdb Fedora (6.8-27.el5) Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu"... (no debugging symbols found) Reading symbols from /usr/lib64/dirsrv/libslapd.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/libslapd.so.0 Reading symbols from /usr/lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libkrb5.so.3 Reading symbols from /usr/lib64/libk5crypto.so.3... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libk5crypto.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libpcre.so.0... (no debugging symbols found)...done. Loaded symbols for /lib64/libpcre.so.0 Reading symbols from /usr/lib64/libssldap60.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssldap60.so Reading symbols from /usr/lib64/libprldap60.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libprldap60.so Reading symbols from /usr/lib64/libldap60.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libldap60.so Reading symbols from /usr/lib64/libldif60.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libldif60.so Reading symbols from /usr/lib64/libssl3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl3.so Reading symbols from /usr/lib64/libnss3.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnss3.so Reading symbols from /usr/lib64/libplc4.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libplc4.so Reading symbols from /usr/lib64/libplds4.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libplds4.so Reading symbols from /usr/lib64/libnspr4.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnspr4.so Reading symbols from /usr/lib64/libsasl2.so.2... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsasl2.so.2 Reading symbols from /usr/lib64/libsvrcore.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsvrcore.so.0 Reading symbols from /lib64/libpthread.so.0... (no debugging symbols found)...done. Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /usr/lib64/libkrb5support.so.0... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libresolv.so.2... (no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /usr/lib64/libsmime3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsmime3.so Reading symbols from /usr/lib64/libsoftokn3.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsoftokn3.so Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /usr/lib64/libnssutil3.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnssutil3.so Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libcrypt.so.1... (no debugging symbols found)...done. Loaded symbols for /lib64/libcrypt.so.1 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libselinux.so.1... (no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 Reading symbols from /lib64/libsepol.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libsepol.so.1 Reading symbols from /lib64/libnss_files.so.2... (no debugging symbols found)...done. Loaded symbols for /lib64/libnss_files.so.2 Reading symbols from /usr/lib64/dirsrv/plugins/libsyntax-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libsyntax-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libbitwise-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libbitwise-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libcollation-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libcollation-plugin.so Reading symbols from /usr/lib64/libicui18n.so.36... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libicui18n.so.36 Reading symbols from /usr/lib64/libicuuc.so.36...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libicuuc.so.36 Reading symbols from /usr/lib64/libicudata.so.36... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libicudata.so.36 Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libstdc++.so.6 Reading symbols from /lib64/libm.so.6... (no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Reading symbols from /usr/lib64/dirsrv/plugins/libpwdstorage-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libpwdstorage-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libdes-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libdes-plugin.so Reading symbols from /usr/lib64/sasl2/libanonymous.so.2... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libanonymous.so.2 Reading symbols from /usr/lib64/sasl2/libgssapiv2.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libgssapiv2.so.2 Reading symbols from /usr/lib64/libgssapi_krb5.so.2... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/libgssapi_krb5.so.2 Reading symbols from /usr/lib64/sasl2/libcrammd5.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libcrammd5.so.2 Reading symbols from /usr/lib64/sasl2/libplain.so.2... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libplain.so.2 Reading symbols from /usr/lib64/sasl2/libdigestmd5.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libdigestmd5.so.2 Reading symbols from /lib64/libcrypto.so.6... (no debugging symbols found)...done. Loaded symbols for /lib64/libcrypto.so.6 Reading symbols from /usr/lib64/sasl2/libsasldb.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/libsasldb.so.2 Reading symbols from /usr/lib64/sasl2/liblogin.so.2... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/sasl2/liblogin.so.2 Reading symbols from /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libacctpolicy-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libacctpolicy-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libacctusability-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libacctusability-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libacl-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libacl-plugin.so Reading symbols from /usr/lib64/dirsrv/libns-dshttpd.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/libns-dshttpd.so.0 Reading symbols from /usr/lib64/dirsrv/plugins/libautomember-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libautomember-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libchainingdb-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libchainingdb-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libcos-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libcos-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libderef-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libderef-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libdna-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libdna-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libhttp-client-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libhttp-client-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libback-ldbm.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libback-ldbm.so Reading symbols from /lib64/libdb-4.3.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libdb-4.3.so Reading symbols from /usr/lib64/dirsrv/plugins/libreplication-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libreplication-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/liblinkedattrs-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/liblinkedattrs-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libmanagedentries-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libmanagedentries-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libmemberof-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libmemberof-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libpam-passthru-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libpam-passthru-plugin.so Reading symbols from /lib64/libpam.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libpam.so.0 Reading symbols from /lib64/libaudit.so.0... (no debugging symbols found)...done. Loaded symbols for /lib64/libaudit.so.0 Reading symbols from /usr/lib64/dirsrv/plugins/libpassthru-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libpassthru-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libreferint-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libreferint-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libretrocl-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libretrocl-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libroles-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libroles-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libschemareload-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libschemareload-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libstatechange-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libstatechange-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libusn-plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libusn-plugin.so Reading symbols from /usr/lib64/dirsrv/plugins/libviews-plugin.so... (no debugging symbols found)...done. Loaded symbols for /usr/lib64/dirsrv/plugins/libviews-plugin.so Reading symbols from /usr/lib64/libfreebl3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libfreebl3.so Core was generated by `/usr/sbin/ns-slapd -D /etc/dirsrv/slapd -i /var/run/dirsrv/slapd.'. Program terminated with signal 11, Segmentation fault. [New process 5907] [New process 1650] [New process 1580] [New process 1579] [New process 1578] [New process 1577] [New process 1551] #0 0x00002b5b390c3361 in ?? () from /usr/lib64/dirsrv/plugins/libcos-plugin.so Thread 7 (process 1551): #0 0x0000003b9060b280 in pthread_cond_timedwait@(a)GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. Cannot access memory at address 0x7fffac9ce5a8 Thread 6 (process 1577): #0 0x0000003b8face122 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00002b5b35368099 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #2 0x00002b5b39902828 in ?? () from /usr/lib64/dirsrv/plugins/libback-ldbm.so No symbol table info available. #3 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #4 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 5 (process 1578): #0 0x0000003b8face122 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00002b5b35368099 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #2 0x00002b5b39902a59 in ?? () from /usr/lib64/dirsrv/plugins/libback-ldbm.so No symbol table info available. #3 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #4 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (process 1579): #0 0x0000003b8face122 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00002b5b35368099 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #2 0x00002b5b399025a5 in ?? () from /usr/lib64/dirsrv/plugins/libback-ldbm.so No symbol table info available. #3 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #4 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (process 1580): #0 0x0000003b8face122 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00002b5b35368099 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #2 0x00002b5b39902e87 in ?? () from /usr/lib64/dirsrv/plugins/libback-ldbm.so No symbol table info available. #3 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #4 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (process 1650): #0 0x0000003b8face122 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00002b5b35368099 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #2 0x000000000041711c in sasl_map_config_add () No symbol table info available. #3 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #4 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (process 5907): #0 0x00002b5b390c3361 in ?? () from /usr/lib64/dirsrv/plugins/libcos-plugin.so No symbol table info available. #1 0x0000003b8fa31f8e in bsearch () from /lib64/libc.so.6 No symbol table info available. #2 0x00002b5b390c632a in cos_cache_change_notify () from /usr/lib64/dirsrv/plugins/libcos-plugin.so No symbol table info available. #3 0x00002b5b390c2956 in cos_post_op () from /usr/lib64/dirsrv/plugins/libcos-plugin.so No symbol table info available. #4 0x00002b5b3534023f in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #5 0x00002b5b3534042c in plugin_call_plugins () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #6 0x00002b5b352ffc30 in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #7 0x00002b5b352ffd13 in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #8 0x00002b5b39eaf262 in ?? () from /usr/lib64/dirsrv/plugins/libreplication-plugin.so No symbol table info available. #9 0x00002b5b39eaf4e2 in ?? () from /usr/lib64/dirsrv/plugins/libreplication-plugin.so No symbol table info available. #10 0x00002b5b35352a81 in send_ldap_search_entry_ext () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #11 0x00002b5b3535314c in send_ldap_search_entry () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #12 0x00002b5b35336fd3 in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #13 0x00002b5b353374a2 in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #14 0x00002b5b35338275 in op_shared_search () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #15 0x00002b5b35343452 in ?? () from /usr/lib64/dirsrv/libslapd.so.0 No symbol table info available. #16 0x00002b5b39eb15f2 in ?? () from /usr/lib64/dirsrv/plugins/libreplication-plugin.so No symbol table info available. #17 0x0000003b936288cd in ?? () from /usr/lib64/libnspr4.so No symbol table info available. #18 0x0000003b9060683d in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #19 0x0000003b8fad4f8d in clone () from /lib64/libc.so.6 No symbol table info available. Justin.