Project

General

Profile

Bug #698

replication wasn't working on db-ldap-2

Added by Pierre-Louis Bonicoli about 1 month ago. Updated about 1 month ago.

Status:
Resolved
Priority:
Normal
Category:
-
Start date:
2020-05-28
Due date:
% Done:

100%

Estimated time:
Patch Available:
Confirmed:
No
Branch:
Entity:
DuckCorp
Security:
Help Needed:

Description

db-ldap-2.duckcorp.org and db-ldap-1.duckcorp.org were desynchronized: pierre-louis account wasn't available on db-ldap-2.duckcorp.org.

In order to fix this issue, I restarted slapd service on toushirou (systemctl restart slapd).

Here are the logs of slapd.service:

-- Logs begin at Mon 2020-05-18 03:15:02 CEST, end at Thu 2020-05-28 04:24:00 CEST. --
May 18 14:58:04 Toushirou slapd[3394]: slap_global_control: unrecognized control: 1.3.6.1.4.1.42.2.27.8.5.1
May 18 16:58:30 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 18 20:44:05 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 18 20:44:25 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 18 22:04:35 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 19 00:44:33 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 19 03:43:39 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 19 15:09:35 Toushirou slapd[3394]: connection_read(26): no connection!
May 19 16:31:36 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 19 16:31:53 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 19 19:10:07 Toushirou slapd[3394]: connection_read(35): no connection!
May 19 19:10:07 Toushirou slapd[3394]: connection_read(24): no connection!
May 19 22:13:59 Toushirou slapd[3394]: connection_read(37): no connection!
May 19 22:14:07 Toushirou slapd[3394]: connection_read(41): no connection!
May 19 22:41:01 Toushirou slapd[3394]: connection_read(40): no connection!
May 20 01:06:14 Toushirou slapd[3394]: conn=61577 op=0 do_bind: ber_scanf failed
May 20 03:04:59 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 05:03:11 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 10:16:29 Toushirou slapd[3394]: do_syncrep2: rid=004 (-1) Can't contact LDAP server
May 20 10:16:29 Toushirou slapd[3394]: do_syncrep2: rid=002 (-1) Can't contact LDAP server
May 20 10:16:29 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 retrying (2 retries left)
May 20 10:16:29 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying (2 retries left)
May 20 10:16:41 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:16:41 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 retrying (1 retries left)
May 20 10:16:51 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:16:51 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying (1 retries left)
May 20 10:17:01 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:17:01 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 retrying
May 20 10:17:05 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:17:05 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying
May 20 10:17:24 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:17:24 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:17:24 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 retrying (2 retries left)
May 20 10:17:24 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying (2 retries left)
May 20 10:17:56 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:17:56 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 retrying (1 retries left)
May 20 10:18:05 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:18:05 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying (1 retries left)
May 20 10:18:36 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:18:40 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:18:40 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 retrying
May 20 10:19:17 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:19:17 Toushirou slapd[3394]: slap_client_connect: URI=ldap://db-ldap-1.duckcorp.org Error, ldap_start_tls failed (-1)
May 20 10:19:17 Toushirou slapd[3394]: do_syncrepl: rid=004 rc -1 quitting
May 20 10:19:17 Toushirou slapd[3394]: do_syncrepl: rid=002 rc -1 quitting
May 20 14:37:58 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 15:40:15 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 16:25:01 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 16:44:58 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 17:49:45 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 17:50:06 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 19:15:34 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 19:15:57 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 21:26:32 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 20 21:52:44 Toushirou slapd[3394]: connection_read(43): no connection!
May 20 21:52:52 Toushirou slapd[3394]: connection_read(37): no connection!
May 20 22:08:55 Toushirou slapd[3394]: connection_read(15): no connection!
May 20 23:27:19 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 01:07:08 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 04:24:50 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 06:01:22 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 12:21:33 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 16:43:53 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 16:44:10 Toushirou slapd[3394]: connection_input: conn=1016 deferring operation: too many executing
May 21 23:36:27 Toushirou slapd[3394]: connection_read(35): no connection!
May 22 00:56:11 Toushirou slapd[3394]: connection_read(43): no connection!
May 22 01:11:53 Toushirou slapd[3394]: connection_read(40): no connection!
May 22 01:12:03 Toushirou slapd[3394]: connection_read(26): no connection!
May 22 02:47:32 Toushirou slapd[3394]: connection_read(42): no connection!
May 22 03:19:33 Toushirou slapd[3394]: connection_read(36): no connection!
May 22 16:36:11 Toushirou slapd[3394]: connection_read(35): no connection!
May 22 23:20:19 Toushirou slapd[3394]: connection_read(15): no connection!
May 23 00:35:39 Toushirou slapd[3394]: connection_read(28): no connection!
May 23 01:26:12 Toushirou slapd[3394]: connection_read(34): no connection!
May 23 02:46:12 Toushirou slapd[3394]: connection_read(35): no connection!
May 23 21:24:26 Toushirou slapd[3394]: connection_read(38): no connection!
May 23 21:40:25 Toushirou slapd[3394]: connection_read(37): no connection!
May 24 00:21:30 Toushirou slapd[3394]: connection_read(35): no connection!
May 24 00:53:33 Toushirou slapd[3394]: connection_read(23): no connection!
May 24 15:44:52 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:44:52 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:44:52 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:44:53 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:44:53 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:44:59 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:02 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:02 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:45:03 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 15:55:30 Toushirou slapd[3394]: connection_read(37): no connection!
May 24 16:11:22 Toushirou slapd[3394]: connection_read(22): no connection!
May 24 16:34:58 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 16:35:08 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 16:35:09 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 16:35:09 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 16:35:10 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 16:35:10 Toushirou slapd[3394]: <= mdb_substring_candidates: (uid) not indexed
May 24 17:06:40 Toushirou slapd[3394]: connection_read(35): no connection!
May 24 22:28:20 Toushirou slapd[3394]: connection_read(35): no connection!
May 24 22:28:23 Toushirou slapd[3394]: connection_read(39): no connection!
May 24 22:44:24 Toushirou slapd[3394]: connection_read(36): no connection!
May 24 23:16:44 Toushirou slapd[3394]: connection_read(34): no connection!
May 25 00:05:58 Toushirou slapd[3394]: connection_read(41): no connection!
May 25 00:06:05 Toushirou slapd[3394]: connection_read(30): no connection!
May 25 00:22:03 Toushirou slapd[3394]: connection_read(26): no connection!
May 25 00:38:08 Toushirou slapd[3394]: connection_read(40): no connection!
May 25 00:38:22 Toushirou slapd[3394]: connection_read(15): no connection!
May 25 00:54:28 Toushirou slapd[3394]: connection_read(34): no connection!
May 25 10:19:11 Toushirou slapd[3394]: connection_input: conn=77688 deferring operation: too many executing
May 25 12:39:50 Toushirou slapd[3394]: connection_input: conn=77688 deferring operation: too many executing
May 26 00:01:56 Toushirou slapd[3394]: connection_read(39): no connection!
May 26 00:17:57 Toushirou slapd[3394]: connection_read(34): no connection!
May 26 00:33:51 Toushirou slapd[3394]: connection_read(39): no connection!
May 26 00:34:18 Toushirou slapd[3394]: connection_read(27): no connection!
May 26 00:50:57 Toushirou slapd[3394]: connection_read(27): no connection!
May 26 00:50:58 Toushirou slapd[3394]: connection_read(33): no connection!
May 26 01:23:07 Toushirou slapd[3394]: connection_read(38): no connection!
May 26 09:28:09 Toushirou slapd[3394]: connection_input: conn=77688 deferring operation: too many executing
May 26 11:21:01 Toushirou slapd[3394]: connection_input: conn=77688 deferring operation: too many executing
May 26 12:37:12 Toushirou slapd[3394]: connection_read(35): no connection!
May 26 16:16:54 Toushirou slapd[3394]: connection_input: conn=77688 deferring operation: too many executing
May 26 20:11:28 Toushirou slapd[3394]: connection_read(34): no connection!
May 26 21:15:23 Toushirou slapd[3394]: connection_read(28): no connection!
May 27 00:38:19 Toushirou slapd[3394]: connection_read(41): no connection!
May 27 18:52:09 Toushirou slapd[3394]: connection_read(47): no connection!
May 27 18:52:15 Toushirou slapd[3394]: connection_read(28): no connection!
May 27 18:52:26 Toushirou slapd[3394]: connection_read(43): no connection!
May 27 19:56:32 Toushirou slapd[3394]: connection_read(40): no connection!
May 27 19:56:39 Toushirou slapd[3394]: connection_read(40): no connection!
May 27 21:51:12 Toushirou slapd[3394]: connection_read(38): no connection!
May 27 21:51:18 Toushirou slapd[3394]: connection_read(26): no connection!
May 27 22:07:00 Toushirou slapd[3394]: connection_read(15): no connection!
May 27 22:07:19 Toushirou slapd[3394]: connection_read(22): no connection!
May 27 22:39:01 Toushirou slapd[3394]: connection_read(26): no connection!
May 27 23:01:56 Toushirou slapd[3394]: connection_read(33): no connection!
May 27 23:18:10 Toushirou slapd[3394]: connection_read(49): no connection!
May 28 01:10:25 Toushirou slapd[3394]: connection_read(37): no connection!
May 28 01:10:33 Toushirou slapd[3394]: connection_read(39): no connection!
May 28 01:42:20 Toushirou slapd[3394]: connection_read(38): no connection!
May 28 04:18:56 Toushirou systemd[1]: Stopping LSB: OpenLDAP standalone server (Lightweight Directory Access Protocol)...
May 28 04:18:56 Toushirou slapd[3394]: daemon: shutdown requested and initiated.
May 28 04:18:56 Toushirou slapd[3394]: slapd shutdown: waiting for 0 operations/tasks to finish
May 28 04:18:57 Toushirou slapd[3394]: DIGEST-MD5 common mech free
May 28 04:18:57 Toushirou slapd[3394]: DIGEST-MD5 common mech free
May 28 04:18:57 Toushirou slapd[3394]: slapd stopped.
May 28 04:18:57 Toushirou slapd[6990]: Stopping OpenLDAP: slapd.
May 28 04:18:57 Toushirou systemd[1]: slapd.service: Succeeded.
May 28 04:18:57 Toushirou systemd[1]: Stopped LSB: OpenLDAP standalone server (Lightweight Directory Access Protocol).
May 28 04:18:57 Toushirou systemd[1]: slapd.service: Consumed 4h 4min 55.502s CPU time.
May 28 04:18:57 Toushirou systemd[1]: Starting LSB: OpenLDAP standalone server (Lightweight Directory Access Protocol)...
May 28 04:18:57 Toushirou slapd[7001]: @(#) $OpenLDAP: slapd  (Apr 20 2020 18:19:54) $
May 28 04:18:57 Toushirou slapd[7003]: slapd starting
May 28 04:18:57 Toushirou slapd[6995]: Starting OpenLDAP: slapd.
May 28 04:18:57 Toushirou systemd[1]: Started LSB: OpenLDAP standalone server (Lightweight Directory Access Protocol).
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_message_to_entry: rid=002 DN: dc=milkypond,dc=org, UUID: 5e25ffb0-34d0-103a-826b-1b8e95bf3725
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 LDAP_RES_SEARCH_ENTRY(LDAP_SYNC_ADD) tid 1effd700
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 inserted UUID 5e25ffb0-34d0-103a-826b-1b8e95bf3725
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_search (0)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 dc=milkypond,dc=org
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_add dc=milkypond,dc=org (68)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_modify dc=milkypond,dc=org (0)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_message_to_entry: rid=002 DN: cn=admin,dc=milkypond,dc=org, UUID: 5e299e0e-34d0-103a-826c-1b8e95bf3725
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 LDAP_RES_SEARCH_ENTRY(LDAP_SYNC_ADD) tid 1effd700
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 inserted UUID 5e299e0e-34d0-103a-826c-1b8e95bf3725
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_search (0)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 cn=admin,dc=milkypond,dc=org
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_add cn=admin,dc=milkypond,dc=org (68)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_entry: rid=002 be_modify cn=admin,dc=milkypond,dc=org (0)
May 28 04:18:57 Toushirou slapd[7003]: syncrepl_message_to_entry: rid=002 DN: ou=People,dc=milkypond,dc=org, UUID: 5e2e345a-34d0-103a-826d-1b8e95bf3725
[...]

History

#1

Updated by Pierre-Louis Bonicoli about 1 month ago

I should have run ldapsearch -QY EXTERNAL -H ldapi:/// -s base contextcsn on Toushirou before restarting slapd service in order to check when the date of the last replication.

#2

Updated by Pierre-Louis Bonicoli about 1 month ago

On toushirou/db-ldap-2, the previous restart of slapd.service occurred May 10 17:47:20:

/var/log/daemon.log.2.gz:May 10 17:47:20 Toushirou systemd[1]: slapd.service: Succeeded.

#3

Updated by Pierre-Louis Bonicoli about 1 month ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Also available in: Atom PDF