from Journal, maybe it's kerberos issues

Jul 14 12:11:28 server02.ipa.example.com named-pkcs11[1041]: Failed to get initial credentials (TGT) using principal 'DNS/server02.ipa.example.com' and keytab 'FILE:/etc/named.keytab' (Cannot contact any KDC for realm 'IPA.EXAMPLE.COM')


Jul 14 12:11:05 server02.ipa.example.com systemd[1]: Starting 389 Directory Server IPA-EXAMPLE-COM....
-- Subject: Unit dirsrv@IPA-EXAMPLE-COM.service has begun start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit dirsrv@IPA-EXAMPLE-COM.service has begun starting up.
Jul 14 12:11:05 server02.ipa.example.com ds_systemd_ask_password_acl[3669]: grep: /etc/dirsrv/slapd-IPA-EXAMPLE-COM/dse.ldif: No such file or directory
Jul 14 12:11:05 server02.ipa.example.com ns-slapd[3674]: [14/Jul/2017:12:11:05.824429897 -0400] dse - The configuration file /etc/dirsrv/slapd-IPA-EXAMPLE-COM/dse.ldif was not restored from backup /etc/dirsrv/slapd-IPA-EXAMPLE-COM/dse.ldif.tmp, error -1
Jul 14 12:11:05 server02.ipa.example.com ns-slapd[3674]: [14/Jul/2017:12:11:05.824786923 -0400] dse - The configuration file /etc/dirsrv/slapd-IPA-EXAMPLE-COM/dse.ldif was restored from backup /etc/dirsrv/slapd-IPA-EXAMPLE-COM/dse.ldif.bak
Jul 14 12:11:06 server02.ipa.example.com ns-slapd[3674]: [14/Jul/2017:12:11:06.614887908 -0400] 389-Directory/1.3.5.10 B2017.145.2037 starting up
Jul 14 12:11:06 server02.ipa.example.com ns-slapd[3674]: [14/Jul/2017:12:11:06.634027487 -0400] Db home directory is not set. Possibly nsslapd-directory (optionally nsslapd-db-home-directory) is missing in the config file.
Jul 14 12:11:06 server02.ipa.example.com ns-slapd[3674]: [14/Jul/2017:12:11:06.636333131 -0400] Detected Disorderly Shutdown last time Directory Server was running, recovering database.
Jul 14 12:11:06 server02.ipa.example.com kernel: traps: ns-slapd[3674] general protection ip:7f05f3c17270 sp:7ffc09641898 error:0 in libdb-5.3.so[7f05f3af2000+1b4000]
Jul 14 12:11:06 server02.ipa.example.com systemd[1]: dirsrv@IPA-EXAMPLE-COM.service: main process exited, code=killed, status=11/SEGV
Jul 14 12:11:06 server02.ipa.example.com systemd[1]: Failed to start 389 Directory Server IPA-EXAMPLE-COM..
-- Subject: Unit dirsrv@IPA-EXAMPLE-COM.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit dirsrv@IPA-EXAMPLE-COM.service has failed.
--
-- The result is failed.
Jul 14 12:11:06 server02.ipa.example.com systemd[1]: Unit dirsrv@IPA-EXAMPLE-COM.service entered failed state.
Jul 14 12:11:06 server02.ipa.example.com systemd[1]: dirsrv@IPA-EXAMPLE-COM.service failed.
Jul 14 12:11:06 server02.ipa.example.com polkitd[659]: Unregistered Authentication Agent for unix-process:3652:239175 (system bus name :1.226, object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8) (disconnected from bus)
Jul 14 12:11:28 server02.ipa.example.com named-pkcs11[1041]: Failed to get initial credentials (TGT) using principal 'DNS/server02.ipa.example.com' and keytab 'FILE:/etc/named.keytab' (Cannot contact any KDC for realm 'IPA.EXAMPLE.COM')
Jul 14 12:11:28 server02.ipa.example.com named-pkcs11[1041]: ldap_syncrepl will reconnect in 60 seconds
Jul 14 12:12:01 server02.ipa.example.com polkitd[659]: Registered Authentication Agent for unix-process:3702:244769 (system bus name :1.231 [/usr/bin/pkttyagent --notify-fd 5 --fallback], object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8)
Jul 14 12:12:01 server02.ipa.example.com systemd[1]: Starting 389 Directory Server IPA-EXAMPLE-COM....
-- Subject: Unit dirsrv@IPA-EXAMPLE-COM.service has begun start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit dirsrv@IPA-EXAMPLE-COM.service has begun starting up.
Jul 14 12:12:02 server02.ipa.example.com ns-slapd[3724]: [14/Jul/2017:12:12:02.625503302 -0400] 389-Directory/1.3.5.10 B2017.145.2037 starting up
Jul 14 12:12:02 server02.ipa.example.com ns-slapd[3724]: [14/Jul/2017:12:12:02.645784373 -0400] Db home directory is not set. Possibly nsslapd-directory (optionally nsslapd-db-home-directory) is missing in the config file.
Jul 14 12:12:02 server02.ipa.example.com ns-slapd[3724]: [14/Jul/2017:12:12:02.648203339 -0400] Detected Disorderly Shutdown last time Directory Server was running, recovering database.
Jul 14 12:12:02 server02.ipa.example.com kernel: traps: ns-slapd[3724] general protection ip:7fd4b627e270 sp:7ffd50c2f528 error:0 in libdb-5.3.so[7fd4b6159000+1b4000]
Jul 14 12:12:02 server02.ipa.example.com systemd[1]: dirsrv@IPA-EXAMPLE-COM.service: main process exited, code=killed, status=11/SEGV
Jul 14 12:12:02 server02.ipa.example.com systemd[1]: Failed to start 389 Directory Server IPA-EXAMPLE-COM..
-- Subject: Unit dirsrv@IPA-EXAMPLE-COM.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit dirsrv@IPA-EXAMPLE-COM.service has failed.
--
-- The result is failed.
Jul 14 12:12:02 server02.ipa.example.com systemd[1]: Unit dirsrv@IPA-EXAMPLE-COM.service entered failed state.
Jul 14 12:12:02 server02.ipa.example.com systemd[1]: dirsrv@IPA-EXAMPLE-COM.service failed.
Jul 14 12:12:02 server02.ipa.example.com polkitd[659]: Unregistered Authentication Agent for unix-process:3702:244769 (system bus name :1.231, object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8) (disconnected from bus)




From: "freeipa-users" <freeipa-users@lists.fedorahosted.org>
To: "freeipa-users" <freeipa-users@lists.fedorahosted.org>
Cc: "Jake" <email@ml.jacobdevans.com>
Sent: Friday, July 14, 2017 12:07:45 PM
Subject: [Freeipa-users]dirsrv will not start, tried cp dse.ldif.startOK to  dse.ldif but issue remains.

IPA Users,
I'm not sure when the last time this service was running/working, any ideas are appreciated.

IPA Version: ipa-server-4.4.0-14.el7.centos.7.x86_64

ipa-server-upgrade
Upgrading IPA:
  [1/8]: saving configuration
  [2/8]: disabling listeners
  [3/8]: enabling DS global lock
  [4/8]: starting directory server
  [error] CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1
  [cleanup]: stopping directory server
  [cleanup]: restoring configuration
IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
Unexpected error - see /var/log/ipaupgrade.log for details:
CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1
The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information



#tail -n 100 /var/log/ipaupgrade.log

2017-07-14T16:03:53Z DEBUG stderr=Job for dirsrv@IPA-EXAMPLE-COM.service failed because a fatal signal was delivered to the control process. See "systemctl status dirsrv@IPA-EXAMPLE-COM.service" and "journalctl -xe" for details.

2017-07-14T16:03:53Z DEBUG Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 449, in start_creation
    run_step(full_msg, method)
  File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 439, in run_step
    method()
  File "/usr/lib/python2.7/site-packages/ipaserver/install/upgradeinstance.py", line 94, in __start
    services.service(self.service_name).start(self.serverid, ldapi=True)
  File "/usr/lib/python2.7/site-packages/ipaplatform/redhat/services.py", line 157, in start
    instance_name, capture_output=capture_output, wait=wait)
  File "/usr/lib/python2.7/site-packages/ipaplatform/base/services.py", line 285, in start
    skip_output=not capture_output)
  File "/usr/lib/python2.7/site-packages/ipapython/ipautil.py", line 494, in run
    raise CalledProcessError(p.returncode, arg_string, str(output))
CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1

2017-07-14T16:03:53Z DEBUG   [error] CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1
2017-07-14T16:03:53Z DEBUG   [cleanup]: stopping directory server
2017-07-14T16:03:53Z DEBUG Starting external process
2017-07-14T16:03:53Z DEBUG args=/bin/systemctl stop dirsrv@IPA-EXAMPLE-COM.service
2017-07-14T16:03:53Z DEBUG Process finished, return code=0
2017-07-14T16:03:53Z DEBUG stdout=
2017-07-14T16:03:53Z DEBUG stderr=
2017-07-14T16:03:53Z DEBUG   duration: 0 seconds
2017-07-14T16:03:53Z DEBUG   [cleanup]: restoring configuration
2017-07-14T16:03:53Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Saving StateFile to '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Saving StateFile to '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-07-14T16:03:53Z DEBUG   duration: 0 seconds
2017-07-14T16:03:53Z ERROR IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
2017-07-14T16:03:53Z DEBUG   File "/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 171, in execute
    return_value = self.run()
  File "/usr/lib/python2.7/site-packages/ipaserver/install/ipa_server_upgrade.py", line 46, in run
    server.upgrade()
  File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1846, in upgrade
    data_upgrade.create_instance()
  File "/usr/lib/python2.7/site-packages/ipaserver/install/upgradeinstance.py", line 119, in create_instance
    show_service_name=False)
  File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 449, in start_creation
    run_step(full_msg, method)
  File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 439, in run_step
    method()
  File "/usr/lib/python2.7/site-packages/ipaserver/install/upgradeinstance.py", line 94, in __start
    services.service(self.service_name).start(self.serverid, ldapi=True)
  File "/usr/lib/python2.7/site-packages/ipaplatform/redhat/services.py", line 157, in start
    instance_name, capture_output=capture_output, wait=wait)
  File "/usr/lib/python2.7/site-packages/ipaplatform/base/services.py", line 285, in start
    skip_output=not capture_output)
  File "/usr/lib/python2.7/site-packages/ipapython/ipautil.py", line 494, in run
    raise CalledProcessError(p.returncode, arg_string, str(output))

2017-07-14T16:03:53Z DEBUG The ipa-server-upgrade command failed, exception: CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1
2017-07-14T16:03:53Z ERROR Unexpected error - see /var/log/ipaupgrade.log for details:
CalledProcessError: Command '/bin/systemctl start dirsrv@IPA-EXAMPLE-COM.service' returned non-zero exit status 1
2017-07-14T16:03:53Z ERROR The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information


Thank You,
-Jake

_______________________________________________
FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org