#8121 named-pkcs11 SIGABRT
Opened by brianjmurrell. Modified

Issue

Twice now named-pkcs11 has died due to SIGABRT while reloading after a logrotate.

Steps to Reproduce

Not really sure other than install EL7 with IdM and wait for a weekly logrotate. But it's not 100% reproducible.

Actual behavior

named-pkcs11 crashes with SIGABRT

Expected behavior

Not crash

Version/Release/Distribution

ipa-server-4.6.5-11.el7.centos.3.x86_64
ipa-client-4.6.5-11.el7.centos.3.x86_64
ipa-server-4.6.5-11.el7.centos.3.x86_64
ipa-client-4.6.5-11.el7.centos.3.x86_64
389-ds-base-1.3.9.1-10.el7.x86_64
pki-ca-10.5.16-5.el7_7.noarch
krb5-server-1.15.1-37.el7_7.2.x86_64
bind-pkcs11-9.11.4-9.P2.el7.x86_64

Additional info:

Two abrt produced bug reports can be found at:
https://bugs.centos.org/view.php?id=16489
https://bugs.centos.org/view.php?id=16741

Stack traces of each of those above (respectively):

[New LWP 5604]
[New LWP 5605]
[New LWP 5606]
[New LWP 5603]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
warning: File "/var/cache/abrt-di/usr/lib/debug/usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so.debug" has a different build-id, file skipped
warning: the debug information found in "/var/cache/abrt-di/usr/lib/debug//usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so.debug" does not match "/usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so" (CRC mismatch).
warning: the debug information found in "/var/cache/abrt-di/usr/lib/debug/usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so.debug" does not match "/usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so" (CRC mismatch).
Core was generated by `/usr/sbin/named-pkcs11 -u named -c /etc/named.conf'.
Program terminated with signal 6, Aborted.
#0  0x00007fd3d5ff12c7 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
55    return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig);
Thread 4 (Thread 0x7fd3d9901840 (LWP 5603)):
#0  0x00007fd3d7046f47 in pthread_join (threadid=140547774547712, thread_return=thread_return@entry=0x0) at pthread_join.c:90
        _tid = 5604
        _buffer = {__routine = 0x7fd3d7046e80 <cleanup>, __arg = 0x7fd3d42d0d28, __canceltype = -972040968, __prev = 0x0}
        oldtype = 0
        pd = 0x7fd3d42d0700
        self = 0x7fd3d9901840
        result = 0
#1  0x00007fd3d8ee3134 in isc__taskmgr_destroy (managerp=managerp@entry=0x5557c60fd520 <ns_g_taskmgr>) at task.c:1543
        manager = 0x7fd3d98c5010
        task = <optimized out>
        i = 0
#2  0x00005557c5e909d1 in destroy_managers () at ./main.c:680
No locals.
#3  cleanup () at ./main.c:937
No locals.
#4  main (argc=<optimized out>, argv=<optimized out>) at ./main.c:1149
        result = 0
Thread 3 (Thread 0x7fd3d32ce700 (LWP 5606)):
#0  0x00007fd3d60b9603 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81
No locals.
#1  0x00007fd3d8ef2de6 in watcher (uap=0x7fd3d98c8010) at socket.c:3981
        manager = 0x7fd3d98c8010
        done = isc_boolean_false
        cc = <optimized out>
        fnname = 0x7fd3d8f05232 "epoll_wait()"
        strbuf = '\000' <repeats 127 times>
#2  0x00007fd3d7045dd5 in start_thread (arg=0x7fd3d32ce700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd3d32ce700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140547757762304, -1543284727309730295, 0, 8392704, 0, 140547757762304, 1527424983946165769, 1527433578127883785}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#3  0x00007fd3d60b902d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
Thread 2 (Thread 0x7fd3d3acf700 (LWP 5605)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
No locals.
#1  0x00007fd3d8efb358 in isc_condition_waituntil (c=c@entry=0x7fd3d98c6078, m=m@entry=0x7fd3d98c6028, t=t@entry=0x7fd3d98c606c) at condition.c:66
        presult = <optimized out>
        result = <optimized out>
        ts = {tv_sec = 1564776512, tv_nsec = 804913000}
        strbuf = "\334\250\257\321\323\177\000\000\201\247\357\330\323\177\000\000@\230D]\000\000\000\000\003\r\002", '\000' <repeats 13 times>, "*", '\000' <repeats 31 times>, "`\000\000\000\000\000\000\000P\342\345\307WU\000\000\253Q\356\330\323\177\000\000\300\272\257\321\323\177\000\000aZ\354\330\323\177\000\000\020\000\000\000\000\000\000\000\002\000\000\000\003\000\000"
#2  0x00007fd3d8ee6253 in run (uap=0x7fd3d98c6010) at timer.c:825
        manager = 0x7fd3d98c6010
        now = {seconds = 1564776512, nanoseconds = 134403000}
        result = <optimized out>
#3  0x00007fd3d7045dd5 in start_thread (arg=0x7fd3d3acf700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd3d3acf700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140547766155008, -1543284727309730295, 0, 8392704, 0, 140547766155008, 1527426083994664457, 1527433578127883785}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#4  0x00007fd3d60b902d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
Thread 1 (Thread 0x7fd3d42d0700 (LWP 5604)):
#0  0x00007fd3d5ff12c7 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
        resultvar = 0
        pid = 5603
        selftid = 5604
#1  0x00007fd3d5ff29b8 in __GI_abort () at abort.c:90
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0, 140547733493096, 140547396880256, 0, 140547854442188, 616, 140547854439280, 140547774543888, 140547805999254, 140547774544016, 140547805454325, 549755813898, 140547774544016, 140547774544016, 140547774543996, 8}}, sa_flags = -655616224, sa_restorer = 0x7}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00005557c5ea174e in assertion_failed (file=<optimized out>, line=<optimized out>, type=<optimized out>, cond=<optimized out>) at ./main.c:222
        tracebuf = {0x5557c5ea1580 <assertion_failed+96>, 0x7fd3d8ec140a <isc_assertion_failed+10>, 0x7fd3d8ee398b <isc__task_sendanddetach+811>, 0x7fd3d9154909 <dns_adb_cancelfind+553>, 0x7fd3d9269aae <zone_shutdown+494>, 0x7fd3d8ee1a06 <run+678>, 0x7fd3d7045dd5 <start_thread+197>, 0x7fd3d60b902d <clone+109>, 0x7fd3d60b902d <clone+109>, 0x0, 0x500000000, 0x1000002ba, 0x2b151536, 0x7fd3d42cfa78, 0x7fd3d42cfa50, 0x1, 0x0, 0x7fd3d990f378, 0x7fd3d990f020, 0x7fd3d970ffcf <_dl_lookup_symbol_x+287>, 0x0, 0x0, 0x5, 0x0, 0x7fd300000001, 0x7fd3d990f020, 0x7fd3d9120d98, 0x7fd3d911fad8, 0x500000000, 0x7fd3d8ece7c9 <isc_log_doit+201>, 0x0, 0x7fd3d990f378, 0x7fd3d42cf9c0, 0x7fd3d42cf9b0, 0xbbcef15f, 0x7fd3d8eb49af, 0xffffffff, 0x7fd3d970ffcf <_dl_lookup_symbol_x+287>, 0x7fd3d8eb3878, 0x7fd3d990f020, 0x7fd3d9299d40, 0x0, 0x7fd300000001, 0x7fd3d9926b28, 0x7fd300000005, 0x7fd3d42cfc50, 0x20b, 0x7fd3d911c040, 0x0, 0x7fd3d9926e80, 0x7fd3d42cfa50, 0x7fd3d9112710, 0x7fd3d42cfd40, 0x7fd3d98c5028, 0x7fd3d98d9550, 0x7fd3cc15a8c8, 0x7fd3d1a99010, 0x7fd3d9714d1e <_dl_fixup+206>, 0x5, 0x0, 0x7fd3cd816a40, 0x7fd3d8eb3878, 0x7fd3d42cfcd0, 0x7fd3d971c853 <_dl_runtime_resolve_fxsave+67>, 0x0, 0x7fd3d8f01370, 0x0, 0x268, 0x7fd3d8f01ecc, 0x0, 0x0, 0x7fd3d98c5028, 0x37f, 0x7fd3cc15a8c8, 0x7fd3cc15a050, 0xffff00001f80, 0x0 <repeats 17 times>, 0xff000000000000, 0x585858582d706d74, 0x7700585858585858, 0x0, 0x0, 0x0, 0xffff000000000000, 0x80, 0x35, 0x4040404040404040, 0x4040404040404040, 0x5b5b5b5b5b5b5b5b, 0x5b5b5b5b5b5b5b5b, 0x2020202020202020, 0x2020202020202020, 0xdededededededede, 0xdededededededede, 0xffff00ff00000000, 0xffff00ffffffff00, 0x0, 0x0, 0xff00000000, 0xff0000000000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x2020202020202020, 0x2020202020202020, 0x7fd3d1ab3368, 0x7fd3d1ab32e0}
        i = <optimized out>
        nframes = 8
        result = <optimized out>
        logsuffix = <optimized out>
        fname = 0x0
#3  0x00007fd3d8ec140a in isc_assertion_failed (file=file@entry=0x7fd3d8f01ecc "task.c", line=line@entry=616, type=type@entry=isc_assertiontype_require, cond=cond@entry=0x7fd3d8f01370 "(((task) != ((void *)0)) && (((const isc__magic_t *)(task))->magic == ((('T') << 24 | ('A') << 16 | ('S') << 8 | ('K')))))") at assertions.c:57
No locals.
#4  0x00007fd3d8ee398b in isc__task_sendanddetach (taskp=taskp@entry=0x7fd3d42cfd40, eventp=eventp@entry=0x7fd3d42cfd38) at task.c:616
        idle1 = (unknown: 3649851432)
        task = 0x7fd3d1ab32e0
#5  0x00007fd3d9154909 in dns_adb_cancelfind (find=0x7fd3d1ab32e0) at adb.c:3257
        ev = 0x7fd3d1ab3368
        task = 0x7fd3d1ab32e0
        adb = 0x7fd3d1a99010
        bucket = <optimized out>
        unlock_bucket = <optimized out>
#6  0x00007fd3d9269aae in notify_cancel (zone=0x7fd3cc15a050, zone=0x7fd3cc15a050) at zone.c:9379
        notify = 0x7fd3cf61f8d0
#7  zone_shutdown (task=<optimized out>, event=<optimized out>) at zone.c:11405
        zone = 0x7fd3cc15a050
        free_needed = <optimized out>
        linked = <optimized out>
        raw = 0x0
        secure = 0x0
#8  0x00007fd3d8ee1a06 in dispatch (manager=0x7fd3d98c5010) at task.c:1116
        dispatch_count = 1
        done = isc_boolean_false
        finished = isc_boolean_false
        requeue = isc_boolean_false
        event = 0x7fd3cc15a8c8
        task = 0x7fd3d98d9550
#9  run (uap=0x7fd3d98c5010) at task.c:1286
        manager = 0x7fd3d98c5010
#10 0x00007fd3d7045dd5 in start_thread (arg=0x7fd3d42d0700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd3d42d0700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140547774547712, -1543284727309730295, 0, 8392704, 0, 140547774547712, 1527440378182696457, 1527433578127883785}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#11 0x00007fd3d60b902d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
From                To                  Syms Read   Shared Object Library
0x00007fd3d94f6250  0x00007fd3d9501368  Yes         /lib64/liblwres.so.90
0x00007fd3d913bf80  0x00007fd3d929810d  Yes         /lib64/libdns-pkcs11.so.100
0x00007fd3d8ebe360  0x00007fd3d8efb582  Yes         /lib64/libisc-pkcs11.so.95
0x00007fd3d8ca2c50  0x00007fd3d8ca9799  Yes         /lib64/libbind9.so.90
0x00007fd3d8a895f0  0x00007fd3d8a91ddd  Yes         /lib64/libisccfg.so.90
0x00007fd3d86ca730  0x00007fd3d881f26d  Yes         /lib64/libdns.so.100
0x00007fd3d8499a40  0x00007fd3d849daaa  Yes         /lib64/libisccc.so.90
0x00007fd3d8256060  0x00007fd3d828850a  Yes         /lib64/libgssapi_krb5.so.2
0x00007fd3d7f86b00  0x00007fd3d7fee9ba  Yes         /lib64/libkrb5.so.3
0x00007fd3d7d32890  0x00007fd3d7d50b7f  Yes         /lib64/libk5crypto.so.3
0x00007fd3d7b2b500  0x00007fd3d7b2c0d3  Yes         /lib64/libcom_err.so.2
0x00007fd3d7735000  0x00007fd3d786d5c7  Yes         /lib64/libcrypto.so.10
0x00007fd3d746f410  0x00007fd3d74aeec2  Yes         /lib64/libisc.so.95
0x00007fd3d725b620  0x00007fd3d725ce56  Yes         /lib64/libcap.so.2
0x00007fd3d70438b0  0x00007fd3d704ed51  Yes         /lib64/libpthread.so.0
0x00007fd3d6e14e40  0x00007fd3d6e28eba  Yes         /lib64/libGeoIP.so.1
0x00007fd3d6ad2920  0x00007fd3d6bbb810  Yes         /lib64/libxml2.so.2
0x00007fd3d6890110  0x00007fd3d689c698  Yes         /lib64/libz.so.1
0x00007fd3d6591310  0x00007fd3d65fc2d6  Yes         /lib64/libm.so.6
0x00007fd3d6388d90  0x00007fd3d638988e  Yes         /lib64/libdl.so.2
0x00007fd3d5fda930  0x00007fd3d6129d2f  Yes         /lib64/libc.so.6
0x00007fd3d5daeaa0  0x00007fd3d5db621b  Yes         /lib64/libkrb5support.so.0
0x00007fd3d5ba85b0  0x00007fd3d5ba91cc  Yes         /lib64/libkeyutils.so.1
0x00007fd3d59918f0  0x00007fd3d599fe52  Yes         /lib64/libresolv.so.2
0x00007fd3d9706ad0  0x00007fd3d9721f80  Yes         /lib64/ld-linux-x86-64.so.2
0x00007fd3d578a3d0  0x00007fd3d578c40a  Yes         /lib64/libattr.so.1
0x00007fd3d5566080  0x00007fd3d557c860  Yes         /lib64/liblzma.so.5
0x00007fd3d53429d0  0x00007fd3d53587d6  Yes         /lib64/libselinux.so.1
0x00007fd3d50db5f0  0x00007fd3d51215b0  Yes         /lib64/libpcre.so.1
0x00007fd3d4ec9130  0x00007fd3d4ed0481  Yes         /lib64/libnss_files.so.2
0x00007fd3d4cbf540  0x00007fd3d4cc41dc  Yes         /lib64/libnss_sss.so.2
0x00007fd3d2830240  0x00007fd3d28a4178  Yes         /usr/lib64/pkcs11/libsofthsm2.so
0x00007fd3d2571a00  0x00007fd3d25f9860  Yes         /lib64/libsqlite3.so.0
0x00007fd3d22bb220  0x00007fd3d23222da  Yes         /lib64/libstdc++.so.6
0x00007fd3d204ca90  0x00007fd3d205c245  Yes         /lib64/libgcc_s.so.1
0x00007fd3d1868050  0x00007fd3d18887d4  Yes         /usr/lib64/bind/ldap.so
0x00007fd3d165a4a0  0x00007fd3d165baf2  Yes         /lib64/libuuid.so.1
0x00007fd3d1413ee0  0x00007fd3d1445304  Yes         /lib64/libldap-2.4.so.2
0x00007fd3d11f8680  0x00007fd3d11ff9d2  Yes         /lib64/liblber-2.4.so.2
0x00007fd3d0fdcbb0  0x00007fd3d0fee013  Yes         /lib64/libsasl2.so.3
0x00007fd3d0d80b00  0x00007fd3d0dbc5ad  Yes         /lib64/libssl.so.10
0x00007fd3d0b202e0  0x00007fd3d0b4f2ef  Yes         /lib64/libssl3.so
0x00007fd3d08f62c0  0x00007fd3d090ad97  Yes         /lib64/libsmime3.so
0x00007fd3d05d9df0  0x00007fd3d06aefd4  Yes         /lib64/libnss3.so
0x00007fd3d039c990  0x00007fd3d03ac698  Yes         /lib64/libnssutil3.so
0x00007fd3d018cec0  0x00007fd3d018dc28  Yes         /lib64/libplds4.so
0x00007fd3cbdfc4b0  0x00007fd3cbdfdb16  Yes         /lib64/libplc4.so
0x00007fd3cbbc9c30  0x00007fd3cbbe9eaf  Yes         /lib64/libnspr4.so
0x00007fd3cb986db0  0x00007fd3cb98bc6c  Yes         /lib64/libcrypt.so.1
0x00007fd3cb7801e0  0x00007fd3cb78316c  Yes         /lib64/librt.so.1
0x00007fd3cb57bb40  0x00007fd3cb57c1bb  Yes         /lib64/libfreebl3.so
0x00007fd3cb362b30  0x00007fd3cb37459f  Yes         /usr/lib64/krb5/plugins/preauth/pkinit.so
0x00007fd3cb158ef0  0x00007fd3cb15a0bc  Yes (*)     /usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so
(*): Shared library is missing debugging information.
$1 = 0x0
No symbol "__glib_assert_msg" in current context.
rax            0x0  0
rbx            0x8  8
rcx            0xffffffffffffffff   -1
rdx            0x6  6
rsi            0x15e4   5604
rdi            0x15e3   5603
rbp            0x5557c60fd4d0   0x5557c60fd4d0 <ns_g_lctx>
rsp            0x7fd3d42cf708   0x7fd3d42cf708
r8             0x0  0
r9             0x7fd3bdaa4780   140547396880256
r10            0x8  8
r11            0x202    514
r12            0x5557c60fd4c0   93835473441984
r13            0x7fd3d42cf8d0   140547774544080
r14            0x7fd3d42cf880   140547774544000
r15            0x7fd3d42cf888   140547774544008
rip            0x7fd3d5ff12c7   0x7fd3d5ff12c7 <__GI_raise+55>
eflags         0x202    [ IF ]
cs             0x33 51
ss             0x2b 43
ds             0x0  0
es             0x0  0
fs             0x0  0
gs             0x0  0
st0            *value not available*
st1            *value not available*
st2            *value not available*
st3            *value not available*
st4            *value not available*
st5            *value not available*
st6            *value not available*
st7            *value not available*
fctrl          *value not available*
fstat          *value not available*
ftag           *value not available*
fiseg          *value not available*
fioff          *value not available*
foseg          *value not available*
fooff          *value not available*
fop            *value not available*
xmm0           *value not available*
xmm1           *value not available*
xmm2           *value not available*
xmm3           *value not available*
xmm4           *value not available*
xmm5           *value not available*
xmm6           *value not available*
xmm7           *value not available*
xmm8           *value not available*
xmm9           *value not available*
xmm10          *value not available*
xmm11          *value not available*
xmm12          *value not available*
xmm13          *value not available*
xmm14          *value not available*
xmm15          *value not available*
mxcsr          *value not available*
Dump of assembler code for function __GI_raise:
   0x00007fd3d5ff1290 <+0>: mov    %fs:0x2d4,%ecx
   0x00007fd3d5ff1298 <+8>: mov    %fs:0x2d0,%esi
   0x00007fd3d5ff12a0 <+16>:    test   %esi,%esi
   0x00007fd3d5ff12a2 <+18>:    jne    0x7fd3d5ff12d8 <__GI_raise+72>
   0x00007fd3d5ff12a4 <+20>:    mov    $0xba,%eax
   0x00007fd3d5ff12a9 <+25>:    syscall 
   0x00007fd3d5ff12ab <+27>:    mov    %eax,%ecx
   0x00007fd3d5ff12ad <+29>:    mov    %eax,%fs:0x2d0
   0x00007fd3d5ff12b5 <+37>:    mov    %eax,%esi
   0x00007fd3d5ff12b7 <+39>:    movslq %edi,%rdx
   0x00007fd3d5ff12ba <+42>:    movslq %esi,%rsi
   0x00007fd3d5ff12bd <+45>:    movslq %ecx,%rdi
   0x00007fd3d5ff12c0 <+48>:    mov    $0xea,%eax
   0x00007fd3d5ff12c5 <+53>:    syscall 
=> 0x00007fd3d5ff12c7 <+55>:    cmp    $0xfffffffffffff000,%rax
   0x00007fd3d5ff12cd <+61>:    ja     0x7fd3d5ff12ed <__GI_raise+93>
   0x00007fd3d5ff12cf <+63>:    repz retq 
   0x00007fd3d5ff12d1 <+65>:    nopl   0x0(%rax)
   0x00007fd3d5ff12d8 <+72>:    test   %ecx,%ecx
   0x00007fd3d5ff12da <+74>:    jg     0x7fd3d5ff12b7 <__GI_raise+39>
   0x00007fd3d5ff12dc <+76>:    mov    %ecx,%eax
   0x00007fd3d5ff12de <+78>:    neg    %eax
   0x00007fd3d5ff12e0 <+80>:    and    $0x7fffffff,%ecx
   0x00007fd3d5ff12e6 <+86>:    cmove  %esi,%eax
   0x00007fd3d5ff12e9 <+89>:    mov    %eax,%ecx
   0x00007fd3d5ff12eb <+91>:    jmp    0x7fd3d5ff12b7 <__GI_raise+39>
   0x00007fd3d5ff12ed <+93>:    mov    0x38fb5c(%rip),%rdx        # 0x7fd3d6380e50
   0x00007fd3d5ff12f4 <+100>:   neg    %eax
   0x00007fd3d5ff12f6 <+102>:   mov    %eax,%fs:(%rdx)
   0x00007fd3d5ff12f9 <+105>:   or     $0xffffffffffffffff,%rax
   0x00007fd3d5ff12fd <+109>:   retq   
End of assembler dump.
[New LWP 18988]
[New LWP 18989]
[New LWP 18990]
[New LWP 26195]
[New LWP 18987]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/sbin/named-pkcs11 -u named -c /etc/named.conf'.
Program terminated with signal 6, Aborted.
#0  0x00007fd65d3e8337 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
55    return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig);
Thread 5 (Thread 0x7fd660dec840 (LWP 18987)):
#0  0x00007fd65d3e86b2 in do_sigsuspend (set=0x7fffafccf6a0) at ../sysdeps/unix/sysv/linux/sigsuspend.c:31
        resultvar = 18446744073709551102
#1  __GI___sigsuspend (set=set@entry=0x7fffafccf6a0) at ../sysdeps/unix/sysv/linux/sigsuspend.c:44
        oldtype = 0
#2  0x00007fd66036a972 in isc__app_ctxrun (ctx0=ctx0@entry=0x7fd6605a0a80 <isc_g_appctx>) at ../../../../lib/isc-pkcs11/unix/app.c:721
        ctx = 0x7fd6605a0a80 <isc_g_appctx>
        result = <optimized out>
        event = 0x0
        next_event = <optimized out>
        task = 0x0
        sset = {__val = {0 <repeats 16 times>}}
        strbuf = '\000' <repeats 64 times>, "\020\200\333`\326\177\000\000\200\202\333`\326\177\000\000\060\256\311\f\323U\000\000\020\256\311\f\323U\000\000\060\256\311\f\323U\000\000@]\241\f\323U\000\000h\256\311\f\323U\000\000X\256\311\f\323U\000"
#3  0x00007fd66036abcc in isc__app_run () at ../../../../lib/isc-pkcs11/unix/app.c:754
No locals.
#4  0x00007fd66036b42b in isc_app_run () at ../../../../lib/isc-pkcs11/app_api.c:200
        result = 4294966782
#5  0x000055d30ca05746 in main (argc=<optimized out>, argv=<optimized out>) at ../../../bin/named-pkcs11/main.c:1478
        result = <optimized out>
Thread 4 (Thread 0x7fd650f44700 (LWP 26195)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
No locals.
#1  0x00007fd66037fc98 in isc_condition_waituntil (c=c@entry=0x7fd660d21be8, m=m@entry=0x7fd660d21bc0, t=t@entry=0x7fd650f43390) at ../../../../lib/isc-pkcs11/pthreads/condition.c:59
        presult = <optimized out>
        result = <optimized out>
        ts = {tv_sec = 1573979590, tv_nsec = 830615000}
        strbuf = "\303\005\321]\000\000\000\000\227\254\f\000\000\000\000\000\300<\310X\326\177\000\000\000\063\364P\326\177\000\000$fa486b0\254_\307X\326\177\000\000\020\000\000\000\060\000\000\000\340\063\364P\326\177\000\000 3\364P\326\177\000\000\000\226\362n<B#\351\000\000\000\000\000\000\000\000\002\000\000\000\326\177\000\000\001\000\000\000\000\000\000\000\251\061\065`\326\177", '\000' <repeats 17 times>
#2  0x00007fd658c7cee9 in sync_event_send (sctx=0x7fd660d21b50, task=<optimized out>, ev=ev@entry=0x7fd650f433e0, synchronous=synchronous@entry=isc_boolean_true) at syncrepl.c:614
        result = <optimized out>
        abs_timeout = {seconds = 1573979590, nanoseconds = 830615000}
        seqid = 1
        locked = isc_boolean_true
#3  0x00007fd658c6bb2a in syncrepl_update (inst=inst@entry=0x7fd658edd280, entryp=entryp@entry=0x7fd650f43468, chgtype=chgtype@entry=1) at ldap_helper.c:4182
        result = <optimized out>
        pevent = 0x0
        entry = 0x7fd657e0eca0
        zone_name = <optimized out>
        zone_ptr = 0x0
        action = <optimized out>
        task = 0x7fd660dc6010
        synchronous = isc_boolean_true
        __func__ = "syncrepl_update"
#4  0x00007fd658c6c356 in ldap_sync_search_entry (ls=<optimized out>, msg=<optimized out>, entryUUID=<optimized out>, phase=LDAP_SYNC_CAPI_ADD) at ldap_helper.c:4360
        inst = 0x7fd658edd280
        old_entry = 0x0
        new_entry = 0x7fd657e0eca0
        result = 0
        node = 0x0
        mldap_open = isc_boolean_false
        modrdn = <optimized out>
        __func__ = "ldap_sync_search_entry"
#5  0x00007fd658838d60 in ldap_sync_search_entry (ls=ls@entry=0x7fd64c002ed0, res=0x7fd64d064510) at ldap_sync.c:226
        ctrls = 0x7fd64c002e90
        rc = 80
        i = <optimized out>
        ber = 0x7fd64d064550
        entryUUID = {bv_len = 16, bv_val = 0x7fd64d0645b7 "\372Hk\n=\365\021\345\260\320\216!\304\351&\033"}
        cookie = {bv_len = 0, bv_val = 0x0}
        state = 1
        len = 0
        phase = <optimized out>
        __PRETTY_FUNCTION__ = "ldap_sync_search_entry"
#6  0x00007fd658839aba in ldap_sync_init (ls=ls@entry=0x7fd64c002ed0, mode=mode@entry=1) at ldap_sync.c:790
        refreshDone = 0
        msg = 0x7fd64d064510
        ctrl = {ldctl_oid = 0x7fd658843bf0 "1.3.6.1.4.1.4203.1.9.1.1", ldctl_value = {bv_len = 8, bv_val = 0x7fd64c0008c0 "0\006\n\001\001\001\001"}, ldctl_iscritical = 1 '\001'}
        ctrls = {0x7fd650f435a0, 0x0}
        ber = 0x7fd64c002b40
        rc = 100
        tv = {tv_sec = 0, tv_usec = 100000}
        tvp = <optimized out>
        res = 0x7fd64d064510
        __PRETTY_FUNCTION__ = "ldap_sync_init"
#7  0x00007fd658c6e426 in ldap_sync_doit (inst=inst@entry=0x7fd658edd280, conn=<optimized out>, filter_objcs=filter_objcs@entry=0x7fd658c825ba "", mode=mode@entry=1) at ldap_helper.c:4635
        result = <optimized out>
        ret = <optimized out>
        ldap_sync = 0x7fd64c002ed0
        err_hint = 0x7fd658c825ba ""
        filter = "(|  (objectClass=idnsConfigObject)    (&(objectClass=idnsServerConfigObject)    (idnsServerId=server.interlinx.bc.ca)))\000\313\305\064`\326\177\000\000lass=idnsZone)  (objectC\313\305\064`\326\177\000\000sForward\320~\235`\326\177\000\000\060\177\235`\326\177\000\000\350\205\310X\326\177\000\000\060\177\235`\326\177\000\000"...
        config_template = "(|  (objectClass=idnsConfigObject)  %s%s%s%s)"
        server_id = 0x7fd660dae198 "server.interlinx.bc.ca"
        __func__ = "ldap_sync_doit"
#8  0x00007fd658c6e899 in ldap_syncrepl_watcher (arg=0x7fd658edd280) at ldap_helper.c:4707
        inst = 0x7fd658edd280
        conn = 0x7fd660dab400
        ret = <optimized out>
        result = <optimized out>
        sigset = {__val = {512, 0 <repeats 15 times>}}
        reconnect_interval = 0
        state = sync_configinit
        __func__ = "ldap_syncrepl_watcher"
#9  0x00007fd65e43de65 in start_thread (arg=0x7fd650f44700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd650f44700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140558457915136, -4712420527063104025, 0, 8392704, 3, 140558457915136, 4699153920636028391, 4699122448191129063}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#10 0x00007fd65d4b088d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
Thread 3 (Thread 0x7fd65a6c5700 (LWP 18990)):
#0  0x00007fd65d4b0e63 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81
No locals.
#1  0x00007fd660376af6 in watcher (uap=0x7fd660db3010) at ../../../../lib/isc-pkcs11/unix/socket.c:4258
        manager = 0x7fd660db3010
        done = isc_boolean_false
        cc = <optimized out>
        fnname = 0x7fd66038e248 "epoll_wait()"
        strbuf = '\000' <repeats 127 times>
#2  0x00007fd65e43de65 in start_thread (arg=0x7fd65a6c5700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd65a6c5700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140558616778496, -4712420527063104025, 0, 8392704, 0, 140558616778496, 4699130895853225447, 4699122448191129063}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#3  0x00007fd65d4b088d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
Thread 2 (Thread 0x7fd65aec6700 (LWP 18989)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
No locals.
#1  0x00007fd66037fc98 in isc_condition_waituntil (c=c@entry=0x7fd660db1078, m=m@entry=0x7fd660db1028, t=t@entry=0x7fd660db106c) at ../../../../lib/isc-pkcs11/pthreads/condition.c:59
        presult = <optimized out>
        result = <optimized out>
        ts = {tv_sec = 1573979630, tv_nsec = 159739000}
        strbuf = "\\f\002>\326\177\000\000Q\355\067`\326\177\000\000\264\005\321]\000\000\000\000\251\061\065`\326\177", '\000' <repeats 26 times>, ";i6`\326\177\000\000\000\000\000\000\000\000\000\000p\000\000\000\000\000\000\000\320\203\260\r\323U\000\000;i6`\326\177\000\000\340e\002>\326\177\000\000\362\070\064`\326\177\000\000\060\000\000\000\000\000\000\000\003\000\000\000\a\000\000"
#2  0x00007fd660367c73 in run (uap=0x7fd660db1010) at ../../../lib/isc-pkcs11/timer.c:804
        manager = 0x7fd660db1010
        now = {seconds = 1573979572, nanoseconds = 814038000}
        result = <optimized out>
#3  0x00007fd65e43de65 in start_thread (arg=0x7fd65aec6700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd65aec6700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140558625171200, -4712420527063104025, 0, 8392704, 0, 140558625171200, 4699131995901724135, 4699122448191129063}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#4  0x00007fd65d4b088d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
Thread 1 (Thread 0x7fd65b6c7700 (LWP 18988)):
#0  0x00007fd65d3e8337 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
        resultvar = 0
        pid = 18987
        selftid = 18988
#1  0x00007fd65d3e9a28 in __GI_abort () at abort.c:90
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0, 140558681255552, 140558664200829, 2, 140558589253730, 3719, 140558589254321, 140558633560112, 140558665017942, 140558633560240, 140558664472661, 549755813896, 140558633560240, 140558633560240, 140558633560220, 6}}, sa_flags = 1614009840, sa_restorer = 0x5}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x000055d30ca1a1ae in assertion_failed (file=<optimized out>, line=<optimized out>, type=<optimized out>, cond=<optimized out>) at ../../../bin/named-pkcs11/main.c:232
        tracebuf = {0x55d30ca19fe0 <assertion_failed+96>, 0x7fd66033d2da <isc_assertion_failed+10>, 0x7fd658c738b1 <update_zone+705>, 0x7fd660361ddb <run+699>, 0x7fd65e43de65 <start_thread+197>, 0x7fd65d4b088d <clone+109>, 0x7fd65d4b088d <clone+109>, 0x0, 0x0, 0x0, 0x7fd65b6c6930, 0x1, 0x0, 0x0, 0x0, 0xffffffffffffffff, 0x7fd6430b7e90, 0xe5, 0x7fd65b6c69a8, 0xe923423c6ef29600, 0x7fd65b6c69a0, 0x7fd6430b7ead, 0x7fd65b6c6ae0, 0x7fd65ef3a0c1 <sign+881>, 0x0, 0x7fd65b6c6c70, 0x7fd65b6c6ae0, 0x7fd65b6c6ae0, 0x7fd65b6c6b28, 0x7fd65b6c6b6c, 0x0, 0x0, 0x0, 0x7fd6468d7280, 0x7fd65b6c6a20, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd647ff0d70, 0x7fd65b6c6a50, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd6468d7240, 0x7fd65b6c6a80, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd6468d7260, 0x7fd65b6c6ab0, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd647ff0d50, 0x7fd65b6c6ae0, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd63e4e3e20, 0x7fd65b6c6b10, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd6557cd6d0, 0x7fd65b6c6b40, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd643f85a60, 0x7fd65b6c6b70, 0x9d, 0x7fd65b6c6c58, 0x0, 0x7fd6557cd6d0, 0x7fd643f85a80, 0x7fd65b6c6ba0, 0x9d, 0x7fd65b6c6c58, 0x55d30db083d0, 0x7fd643f85ac0, 0x1000, 0x1000, 0x7fd660381128, 0x7fd6557cd6d0, 0x7fd660354581 <isc___mem_put+1137>, 0x7fd6557cd6d0, 0x7fd6440cead0, 0x7fd65b6c6c60, 0x7fd660354581 <isc___mem_put+1137>, 0x7fd657df7c60, 0x55d30db083d0, 0x9d, 0x2845b6c6c58, 0x7fd643f55c00, 0x7fd6580ac010, 0x9d, 0x7fd65b6c6c58, 0x0, 0x55d30ca1522b <control_recvmessage+2091>, 0x7fd600000000, 0x7fd65b6c6c70, 0x7fd65b6c6c70, 0x7fd65b6c6c80, 0x7fd660dc6010, 0x7fd65b6c6c60, 0x7fd65b6c6c68, 0x7fd6603437a6 <float_up+198>, 0x20, 0x5dd105b35dd105b4, 0x7f73a4335dd105ef, 0x0, 0x0, 0x0, 0x0, 0x7fd660dd5220, 0x7fd6430b7e90, 0x7fd6000000e5, 0x4300000029, 0x0, 0x0, 0x0}
        i = <optimized out>
        nframes = 6
        result = <optimized out>
        logsuffix = <optimized out>
        fname = 0x0
#3  0x00007fd66033d2da in isc_assertion_failed (file=file@entry=0x7fd658c85862 "ldap_helper.c", line=line@entry=3719, type=type@entry=isc_assertiontype_insist, cond=cond@entry=0x7fd658c85ab1 "task == inst->task") at ../../../lib/isc-pkcs11/assertions.c:51
No locals.
#4  0x00007fd658c738b1 in update_zone (task=0x7fd660dc6010, event=0x7fd643f35ef0) at ldap_helper.c:3719
        pevent = 0x7fd643f35ef0
        result = <optimized out>
        inst = 0x7fd646463120
        mctx = 0x55d30db083d0
        prevname = {magic = 1145983854, ndata = 0x0, length = 0, labels = 0, attributes = 0, offsets = 0x0, buffer = 0x0, link = {prev = 0xffffffffffffffff, next = 0xffffffffffffffff}, list = {head = 0x0, tail = 0x0}}
        entry = 0x7fd657e0eca0
        __func__ = "update_zone"
#5  0x00007fd660361ddb in dispatch (manager=0x7fd660db0010) at ../../../lib/isc-pkcs11/task.c:1141
        dispatch_count = 1
        done = isc_boolean_false
        finished = isc_boolean_false
        requeue = isc_boolean_false
        event = 0x7fd643f35ef0
        task = 0x7fd660dc6010
#6  run (uap=0x7fd660db0010) at ../../../lib/isc-pkcs11/task.c:1313
        manager = 0x7fd660db0010
#7  0x00007fd65e43de65 in start_thread (arg=0x7fd65b6c7700) at pthread_create.c:307
        __res = <optimized out>
        pd = 0x7fd65b6c7700
        now = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140558633563904, -4712420527063104025, 0, 8392704, 0, 140558633563904, 4699128697903711719, 4699122448191129063}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
#8  0x00007fd65d4b088d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
From                To                  Syms Read   Shared Object Library
0x00007fd6609e13a0  0x00007fd6609ec78c  Yes         /lib64/liblwres.so.160
0x00007fd6605d0b70  0x00007fd66076bead  Yes         /lib64/libdns-pkcs11.so.1102
0x00007fd660339770  0x00007fd66037ff85  Yes         /lib64/libisc-pkcs11.so.169
0x00007fd660116c20  0x00007fd66011f979  Yes         /lib64/libbind9.so.160
0x00007fd65fef84b0  0x00007fd65ff03e31  Yes         /lib64/libisccfg.so.160
0x00007fd65fadf430  0x00007fd65fc73a2d  Yes         /lib64/libdns.so.1102
0x00007fd65f86d720  0x00007fd65f89fbca  Yes         /lib64/libgssapi_krb5.so.2
0x00007fd65f59dc20  0x00007fd65f605a4a  Yes         /lib64/libkrb5.so.3
0x00007fd65f3498d0  0x00007fd65f367bbf  Yes         /lib64/libk5crypto.so.3
0x00007fd65f142500  0x00007fd65f1430d3  Yes         /lib64/libcom_err.so.2
0x00007fd65ef38af0  0x00007fd65ef3d1ea  Yes         /lib64/libisccc.so.160
0x00007fd65eccf760  0x00007fd65ed15df5  Yes         /lib64/libisc.so.169
0x00007fd65e8c4100  0x00007fd65e9fd5a7  Yes         /lib64/libcrypto.so.10
0x00007fd65e653610  0x00007fd65e654e46  Yes         /lib64/libcap.so.2
0x00007fd65e43b8b0  0x00007fd65e446d71  Yes         /lib64/libpthread.so.0
0x00007fd65e20ce80  0x00007fd65e220efa  Yes         /lib64/libGeoIP.so.1
0x00007fd65deca920  0x00007fd65dfb3810  Yes         /lib64/libxml2.so.2
0x00007fd65dc88110  0x00007fd65dc94698  Yes         /lib64/libz.so.1
0x00007fd65d989310  0x00007fd65d9f42d6  Yes         /lib64/libm.so.6
0x00007fd65d780d90  0x00007fd65d78188e  Yes         /lib64/libdl.so.2
0x00007fd65d3d19a0  0x00007fd65d5218ef  Yes         /lib64/libc.so.6
0x00007fd65d1a5bf0  0x00007fd65d1ad36b  Yes         /lib64/libkrb5support.so.0
0x00007fd65cf9f5b0  0x00007fd65cfa01cc  Yes         /lib64/libkeyutils.so.1
0x00007fd65cd888f0  0x00007fd65cd97072  Yes         /lib64/libresolv.so.2
0x00007fd660bf1ad0  0x00007fd660c0d010  Yes         /lib64/ld-linux-x86-64.so.2
0x00007fd65cb813d0  0x00007fd65cb8340a  Yes         /lib64/libattr.so.1
0x00007fd65c95d080  0x00007fd65c973860  Yes         /lib64/liblzma.so.5
0x00007fd65c7399d0  0x00007fd65c74f7d6  Yes         /lib64/libselinux.so.1
0x00007fd65c4d25f0  0x00007fd65c5185b0  Yes         /lib64/libpcre.so.1
0x00007fd65c2c0130  0x00007fd65c2c7481  Yes         /lib64/libnss_files.so.2
0x00007fd65c0b6580  0x00007fd65c0bb21c  Yes         /lib64/libnss_sss.so.2
0x00007fd659c27240  0x00007fd659c9b178  Yes         /usr/lib64/pkcs11/libsofthsm2.so
0x00007fd659968a00  0x00007fd6599f0860  Yes         /lib64/libsqlite3.so.0
0x00007fd6596b2220  0x00007fd6597192da  Yes         /lib64/libstdc++.so.6
0x00007fd659443a90  0x00007fd659453245  Yes         /lib64/libgcc_s.so.1
0x00007fd658c5f2b0  0x00007fd658c7f844  Yes         /usr/lib64/bind/ldap.so
0x00007fd658a514e0  0x00007fd658a52b32  Yes         /lib64/libuuid.so.1
0x00007fd65880aee0  0x00007fd65883c304  Yes         /lib64/libldap-2.4.so.2
0x00007fd6585ef680  0x00007fd6585f69d2  Yes         /lib64/liblber-2.4.so.2
0x00007fd6583d3bb0  0x00007fd6583e5013  Yes         /lib64/libsasl2.so.3
0x00007fd658177b90  0x00007fd6581b364d  Yes         /lib64/libssl.so.10
0x00007fd653db3960  0x00007fd653de72af  Yes         /lib64/libssl3.so
0x00007fd653b88360  0x00007fd653b9d067  Yes         /lib64/libsmime3.so
0x00007fd65386a240  0x00007fd653940274  Yes         /lib64/libnss3.so
0x00007fd65362cc30  0x00007fd65363cb18  Yes         /lib64/libnssutil3.so
0x00007fd65341cf00  0x00007fd65341dc68  Yes         /lib64/libplds4.so
0x00007fd6532184f0  0x00007fd653219b56  Yes         /lib64/libplc4.so
0x00007fd652fe5cd0  0x00007fd653005f5f  Yes         /lib64/libnspr4.so
0x00007fd652da2db0  0x00007fd652da7c6c  Yes         /lib64/libcrypt.so.1
0x00007fd652b9c1e0  0x00007fd652b9f16c  Yes         /lib64/librt.so.1
0x00007fd652997b80  0x00007fd6529981fb  Yes         /lib64/libfreebl3.so
0x00007fd65277ebc0  0x00007fd65279062f  Yes         /usr/lib64/krb5/plugins/preauth/pkinit.so
0x00007fd652574f30  0x00007fd6525761bc  Yes         /usr/lib64/krb5/plugins/libkrb5/sssd_krb5_locator_plugin.so
0x00007fd65236ccf0  0x00007fd652371663  Yes         /usr/lib64/sasl2/libgssapiv2.so
0x00007fd6521662b0  0x00007fd652168543  Yes         /usr/lib64/sasl2/libcrammd5.so
0x00007fd651f61200  0x00007fd651f63003  Yes         /usr/lib64/sasl2/libplain.so
0x00007fd651d5c1b0  0x00007fd651d5dc93  Yes         /usr/lib64/sasl2/libanonymous.so
0x00007fd651b571a0  0x00007fd651b58e93  Yes         /usr/lib64/sasl2/liblogin.so
0x00007fd651949bc0  0x00007fd6519522a3  Yes         /usr/lib64/sasl2/libdigestmd5.so
0x00007fd651742550  0x00007fd651745197  Yes         /usr/lib64/sasl2/libsasldb.so
0x00007fd6513b1480  0x00007fd6514f40fb  Yes         /lib64/libdb-5.3.so
0x00007fd65116cdc0  0x00007fd65117c1e1  Yes         /usr/lib64/gssproxy/proxymech.so
0x00007fd650f4aad0  0x00007fd650f5bfa6  Yes         /lib64/libgssrpc.so.4
0x00007fd64bdfc950  0x00007fd64bdfe3b7  Yes         /usr/lib64/krb5/plugins/authdata/sssd_pac_plugin.so
$1 = 0x0
No symbol "__glib_assert_msg" in current context.
rax            0x0  0
rbx            0x6  6
rcx            0xffffffffffffffff   -1
rdx            0x6  6
rsi            0x4a2c   18988
rdi            0x4a2b   18987
rbp            0x55d30cc9ae00   0x55d30cc9ae00 <ns_g_lctx>
rsp            0x7fd65b6c6728   0x7fd65b6c6728
r8             0x0  0
r9             0x7fd65d3ff27d   140558664200829
r10            0x8  8
r11            0x206    518
r12            0x55d30cc9adf0   94364941004272
r13            0x7fd65b6c68e0   140558633560288
r14            0x7fd65b6c68a0   140558633560224
r15            0x7fd65b6c68a8   140558633560232
rip            0x7fd65d3e8337   0x7fd65d3e8337 <__GI_raise+55>
eflags         0x206    [ PF IF ]
cs             0x33 51
ss             0x2b 43
ds             0x0  0
es             0x0  0
fs             0x0  0
gs             0x0  0
st0            *value not available*
st1            *value not available*
st2            *value not available*
st3            *value not available*
st4            *value not available*
st5            *value not available*
st6            *value not available*
st7            *value not available*
fctrl          *value not available*
fstat          *value not available*
ftag           *value not available*
fiseg          *value not available*
fioff          *value not available*
foseg          *value not available*
fooff          *value not available*
fop            *value not available*
xmm0           *value not available*
xmm1           *value not available*
xmm2           *value not available*
xmm3           *value not available*
xmm4           *value not available*
xmm5           *value not available*
xmm6           *value not available*
xmm7           *value not available*
xmm8           *value not available*
xmm9           *value not available*
xmm10          *value not available*
xmm11          *value not available*
xmm12          *value not available*
xmm13          *value not available*
xmm14          *value not available*
xmm15          *value not available*
mxcsr          *value not available*
Dump of assembler code for function __GI_raise:
   0x00007fd65d3e8300 <+0>: mov    %fs:0x2d4,%ecx
   0x00007fd65d3e8308 <+8>: mov    %fs:0x2d0,%esi
   0x00007fd65d3e8310 <+16>:    test   %esi,%esi
   0x00007fd65d3e8312 <+18>:    jne    0x7fd65d3e8348 <__GI_raise+72>
   0x00007fd65d3e8314 <+20>:    mov    $0xba,%eax
   0x00007fd65d3e8319 <+25>:    syscall 
   0x00007fd65d3e831b <+27>:    mov    %eax,%ecx
   0x00007fd65d3e831d <+29>:    mov    %eax,%fs:0x2d0
   0x00007fd65d3e8325 <+37>:    mov    %eax,%esi
   0x00007fd65d3e8327 <+39>:    movslq %edi,%rdx
   0x00007fd65d3e832a <+42>:    movslq %esi,%rsi
   0x00007fd65d3e832d <+45>:    movslq %ecx,%rdi
   0x00007fd65d3e8330 <+48>:    mov    $0xea,%eax
   0x00007fd65d3e8335 <+53>:    syscall 
=> 0x00007fd65d3e8337 <+55>:    cmp    $0xfffffffffffff000,%rax
   0x00007fd65d3e833d <+61>:    ja     0x7fd65d3e835d <__GI_raise+93>
   0x00007fd65d3e833f <+63>:    repz retq 
   0x00007fd65d3e8341 <+65>:    nopl   0x0(%rax)
   0x00007fd65d3e8348 <+72>:    test   %ecx,%ecx
   0x00007fd65d3e834a <+74>:    jg     0x7fd65d3e8327 <__GI_raise+39>
   0x00007fd65d3e834c <+76>:    mov    %ecx,%eax
   0x00007fd65d3e834e <+78>:    neg    %eax
   0x00007fd65d3e8350 <+80>:    and    $0x7fffffff,%ecx
   0x00007fd65d3e8356 <+86>:    cmove  %esi,%eax
   0x00007fd65d3e8359 <+89>:    mov    %eax,%ecx
   0x00007fd65d3e835b <+91>:    jmp    0x7fd65d3e8327 <__GI_raise+39>
   0x00007fd65d3e835d <+93>:    mov    0x390aec(%rip),%rdx        # 0x7fd65d778e50
   0x00007fd65d3e8364 <+100>:   neg    %eax
   0x00007fd65d3e8366 <+102>:   mov    %eax,%fs:(%rdx)
   0x00007fd65d3e8369 <+105>:   or     $0xffffffffffffffff,%rax
   0x00007fd65d3e836d <+109>:   retq   
End of assembler dump.

For the most recent abort, this morning at 3:30AM, the following was in the named-pkcs11 output:

03:33:08 ldap_helper.c:3719: INSIST(task == inst->task) failed, back trace
03:33:08 #0 0x55d30ca19fe0 in ??
03:33:08 #1 0x7fd66033d2da in ??
03:33:08 #2 0x7fd658c738b1 in ??
03:33:08 #3 0x7fd660361ddb in ??
03:33:08 #4 0x7fd65e43de65 in ??
03:33:08 #5 0x7fd65d4b088d in ??
03:33:08 exiting (due to assertion failure)

There is a bug about it for bind-dyndb-ldap already. @rjeffman tried to reproduce to no avail.
I think it would be good if you could add your information to https://pagure.io/bind-dyndb-ldap/issue/114

That's more useful info. I'm looking into it. Thank you.

Just wondering, any progress?

Sorry, I was not able to look at that yet, there were (and still are) other tasks that preempted it.

@brianjmurrell sorry, but started looking at it just now.

Any progress? This took out my primary name-server here again at 3AM, down until somebody woke to fix it.

Is there anything I can do to help with this? Further info I can provide, etc.

Would it be safe/appropriate/useful to add:

Restart=on-failure

to the named-pkcs11.service unit file until this is resolved?

It seems to be a race condition when logrotate acts on named logs, I'm still looking into it.

For now, restarting named-pkcs11.service on failure should help.

So this continues to happen. Is there any progress in getting to the bottom of it?

Same issue was seen in Ubuntu 18.04 LTS -

Nov 10 16:23:50 x named[27697]: reloading zones succeeded
Nov 10 16:23:50 x named[27697]: ../../src/zone_register.c:516: REQUIRE(zr != ((void *)0)) failed, back trace
Nov 10 16:23:50 x named[27697]: #0 0x562bbb2e8470 in ??
Nov 10 16:23:51 x named[27697]: #1 0x7f3885ac77ba in ??
Nov 10 16:23:51 x named[27697]: #2 0x7f387905cea5 in ??
Nov 10 16:23:51 x named[27697]: #3 0x7f387904efc4 in ??
Nov 10 16:23:51 x named[27697]: #4 0x7f3885aefce9 in ??
Nov 10 16:23:51 x named[27697]: #5 0x7f3884daf6db in ??
Nov 10 16:23:51 x named[27697]: #6 0x7f38844e388f in ??
Nov 10 16:23:51 x named[27697]: exiting (due to assertion failure)

Metadata