AssertionError: Backup failed{"Error":"get backup metadata: get: context deadline exceeded"} 2024-12-09T16:01:38Z I [rs1/rs102:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:38Z I [rs1/rs102:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:38Z I [rs1/rs102:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:38Z I [rs1/rs102:27017] starting PITR routine 2024-12-09T16:01:38Z I [rs1/rs102:27017] node: rs1/rs102:27017 2024-12-09T16:01:38Z I [rs1/rs101:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:38Z I [rs1/rs102:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:38Z I [rs1/rs103:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:38Z E [rs1/rs102:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:38Z I [rs2/rs201:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:38Z I [rs1/rs101:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:38Z I [rs1/rs102:27017] listening for the commands 2024-12-09T16:01:38Z I [rs1/rs101:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:38Z I [rs1/rs101:27017] starting PITR routine 2024-12-09T16:01:38Z I [rs2/rs201:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:38Z I [rs1/rs103:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:38Z I [rs1/rs101:27017] node: rs1/rs101:27017 2024-12-09T16:01:38Z I [rs2/rs201:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:38Z I [rs2/rs201:27017] starting PITR routine 2024-12-09T16:01:38Z E [rs1/rs101:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:38Z I [rs2/rs201:27017] node: rs2/rs201:27017 2024-12-09T16:01:38Z I [rs1/rs103:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:38Z I [rs1/rs103:27017] starting PITR routine 2024-12-09T16:01:38Z E [rs2/rs201:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:38Z I [rs2/rs201:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:38Z I [rs1/rs101:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:38Z I [rs1/rs103:27017] node: rs1/rs103:27017 2024-12-09T16:01:38Z I [rs2/rs201:27017] listening for the commands 2024-12-09T16:01:38Z I [rs1/rs101:27017] listening for the commands 2024-12-09T16:01:38Z E [rs1/rs103:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:38Z I [rs1/rs103:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:38Z I [rs1/rs103:27017] listening for the commands 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] starting PITR routine 2024-12-09T16:01:40Z I [rs2/rs202:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:40Z I [rs2/rs203:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:40Z I [rs2/rs202:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] node: rscfg/rscfg01:27017 2024-12-09T16:01:40Z E [rscfg/rscfg01:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:40Z I [rs2/rs203:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:40Z I [rs2/rs202:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:40Z I [rs2/rs202:27017] starting PITR routine 2024-12-09T16:01:40Z I [rscfg/rscfg01:27017] listening for the commands 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] starting PITR routine 2024-12-09T16:01:40Z I [rs2/rs203:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:40Z I [rs2/rs203:27017] starting PITR routine 2024-12-09T16:01:40Z I [rs2/rs202:27017] node: rs2/rs202:27017 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] node: rscfg/rscfg02:27017 2024-12-09T16:01:40Z I [rs2/rs203:27017] node: rs2/rs203:27017 2024-12-09T16:01:40Z E [rs2/rs202:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:40Z E [rscfg/rscfg02:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:40Z E [rs2/rs203:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:40Z I [rs2/rs202:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:40Z I [rs2/rs203:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:40Z I [rscfg/rscfg02:27017] listening for the commands 2024-12-09T16:01:40Z I [rs2/rs203:27017] listening for the commands 2024-12-09T16:01:40Z I [rs2/rs202:27017] listening for the commands 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] log options: log-path=/dev/stderr, log-level:D, log-json:false 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] pbm-agent: Version: 2.8.0 Platform: linux/amd64 GitCommit: 294173f2b5dd0496811ec07c9646789b841b7b9c GitBranch: CURRENT_PR BuildTime: 2024-12-09_15:44_UTC GoVersion: go1.22.10 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] starting PITR routine 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] node: rscfg/rscfg03:27017 2024-12-09T16:01:41Z E [rscfg/rscfg03:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] conn level ReadConcern: majority; WriteConcern: majority 2024-12-09T16:01:41Z I [rscfg/rscfg03:27017] listening for the commands 2024-12-09T16:01:43Z E [rs1/rs102:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:43Z E [rs1/rs101:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:43Z E [rs2/rs201:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:43Z E [rs1/rs103:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:45Z E [rscfg/rscfg01:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:45Z E [rs2/rs202:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:45Z E [rs2/rs203:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:45Z E [rscfg/rscfg02:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:46Z E [rscfg/rscfg03:27017] [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result 2024-12-09T16:01:48Z I [rscfg/rscfg01:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rscfg/rscfg01:27017] got epoch {1733760106 3} 2024-12-09T16:01:48Z I [rscfg/rscfg01:27017] [resync] started 2024-12-09T16:01:48Z I [rscfg/rscfg02:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rscfg/rscfg02:27017] got epoch {1733760106 3} 2024-12-09T16:01:48Z I [rs2/rs202:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs2/rs203:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs2/rs202:27017] got epoch {1733760106 3} 2024-12-09T16:01:48Z D [rscfg/rscfg01:27017] [resync] uploading ".pbm.init" [size hint: 5 (5.00B); part size: 10485760 (10.00MB)] 2024-12-09T16:01:48Z I [rs2/rs203:27017] got epoch {1733760106 3} 2024-12-09T16:01:48Z D [rscfg/rscfg02:27017] [resync] lock not acquired 2024-12-09T16:01:48Z I [rs2/rs202:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z I [rs2/rs203:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z D [rscfg/rscfg01:27017] [resync] got backups list: 0 2024-12-09T16:01:48Z D [rscfg/rscfg01:27017] [resync] got physical restores list: 0 2024-12-09T16:01:48Z D [rscfg/rscfg01:27017] [resync] epoch set to {1733760108 20} 2024-12-09T16:01:48Z I [rscfg/rscfg01:27017] [resync] succeed 2024-12-09T16:01:48Z I [rs1/rs102:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs1/rs102:27017] got epoch {1733760108 20} 2024-12-09T16:01:48Z I [rs1/rs102:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z I [rs2/rs201:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs2/rs201:27017] got epoch {1733760108 20} 2024-12-09T16:01:48Z I [rs2/rs201:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z I [rs1/rs101:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs1/rs101:27017] got epoch {1733760108 20} 2024-12-09T16:01:48Z I [rs1/rs103:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rs1/rs101:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z I [rs1/rs103:27017] got epoch {1733760108 20} 2024-12-09T16:01:48Z I [rs1/rs103:27017] [resync] not a member of the leader rs 2024-12-09T16:01:48Z I [rscfg/rscfg03:27017] got command resync <ts: 1733760108>, opid: 6757146c4ff0e0a155d538ea 2024-12-09T16:01:48Z I [rscfg/rscfg03:27017] got epoch {1733760108 20} 2024-12-09T16:01:48Z D [rscfg/rscfg03:27017] [resync] get lock: duplicate operation: 6757146c4ff0e0a155d538ea [Resync storage] 2024-12-09T16:01:48Z D [rscfg/rscfg03:27017] [resync] lock not acquired 2024-12-09T16:01:53Z W [rs1/rs102:27017] [agentCheckup] storage is not initialized 2024-12-09T16:01:53Z I [rs1/rs102:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:53Z I [rs1/rs102:27017] got epoch {1733760108 20} 2024-12-09T16:01:53Z I [rs1/rs102:27017] [resync] not a member of the leader rs 2024-12-09T16:01:53Z W [rs1/rs101:27017] [agentCheckup] storage is not initialized 2024-12-09T16:01:53Z W [rs2/rs201:27017] [agentCheckup] storage is not initialized 2024-12-09T16:01:53Z I [rs2/rs201:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:53Z W [rs1/rs103:27017] [agentCheckup] storage is not initialized 2024-12-09T16:01:53Z I [rs2/rs201:27017] got epoch {1733760108 20} 2024-12-09T16:01:53Z I [rs1/rs101:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:53Z I [rs1/rs103:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:53Z I [rs2/rs201:27017] [resync] not a member of the leader rs 2024-12-09T16:01:53Z I [rs1/rs101:27017] got epoch {1733760108 20} 2024-12-09T16:01:53Z I [rs1/rs103:27017] got epoch {1733760108 20} 2024-12-09T16:01:53Z I [rs1/rs101:27017] [resync] not a member of the leader rs 2024-12-09T16:01:53Z I [rs1/rs103:27017] [resync] not a member of the leader rs 2024-12-09T16:01:53Z I [rscfg/rscfg03:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:53Z I [rscfg/rscfg03:27017] got epoch {1733760108 20} 2024-12-09T16:01:53Z I [rscfg/rscfg03:27017] [resync] started 2024-12-09T16:01:53Z D [rscfg/rscfg03:27017] [resync] got backups list: 0 2024-12-09T16:01:53Z D [rscfg/rscfg03:27017] [resync] got physical restores list: 0 2024-12-09T16:01:53Z D [rscfg/rscfg03:27017] [resync] epoch set to {1733760113 160} 2024-12-09T16:01:53Z I [rscfg/rscfg03:27017] [resync] succeed 2024-12-09T16:01:54Z I [rscfg/rscfg01:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:54Z I [rscfg/rscfg01:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z D [rscfg/rscfg01:27017] [resync] get lock: duplicate operation: 6757147167226afd16aa7d61 [Resync storage] 2024-12-09T16:01:54Z D [rscfg/rscfg01:27017] [resync] lock not acquired 2024-12-09T16:01:54Z I [rscfg/rscfg02:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:54Z I [rscfg/rscfg01:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rscfg/rscfg02:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rscfg/rscfg01:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs2/rs203:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:54Z I [rs2/rs202:27017] got command resync <ts: 1733760113>, opid: 6757147167226afd16aa7d61 2024-12-09T16:01:54Z E [rscfg/rscfg01:27017] [backup/2024-12-09T16:01:54Z] unable to proceed with the backup, active lock is present 2024-12-09T16:01:54Z I [rs2/rs203:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs2/rs202:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z D [rscfg/rscfg02:27017] [resync] get lock: duplicate operation: 6757147167226afd16aa7d61 [Resync storage] 2024-12-09T16:01:54Z D [rscfg/rscfg02:27017] [resync] lock not acquired 2024-12-09T16:01:54Z I [rs2/rs203:27017] [resync] not a member of the leader rs 2024-12-09T16:01:54Z I [rs2/rs202:27017] [resync] not a member of the leader rs 2024-12-09T16:01:54Z I [rs2/rs203:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rscfg/rscfg02:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs2/rs202:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs2/rs203:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs2/rs202:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rscfg/rscfg02:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs1/rs102:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs1/rs102:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs2/rs201:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs2/rs201:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs1/rs101:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs1/rs101:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rs1/rs103:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rs1/rs103:27017] got epoch {1733760113 160} 2024-12-09T16:01:54Z I [rscfg/rscfg03:27017] got command backup [name: 2024-12-09T16:01:54Z, compression: none (level: default)] <ts: 1733760114>, opid: 6757147225e409902e4c578b 2024-12-09T16:01:54Z I [rscfg/rscfg03:27017] got epoch {1733760113 160} 2024-12-09T16:02:09Z D [rs2/rs203:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs2/rs202:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs2/rs203:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rscfg/rscfg02:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs2/rs202:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rscfg/rscfg02:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rs1/rs102:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs1/rs102:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rs2/rs201:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs2/rs201:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rs1/rs101:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs1/rs101:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rs1/rs103:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rs1/rs103:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node 2024-12-09T16:02:09Z D [rscfg/rscfg03:27017] [backup/2024-12-09T16:01:54Z] nomination timeout 2024-12-09T16:02:09Z D [rscfg/rscfg03:27017] [backup/2024-12-09T16:01:54Z] skip after nomination, probably started by another node