INFO logs

Log path is: /opt/yuga/data/yb-data/master/logs/yb-master.INFO
Showing last 1048576 bytes of log

Log file created at: 2026/04/25 03:04:17
Current UTC time: 2026/04/25 03:04:17
Running on machine: ubuntu-caremanager-1
Application fingerprint: version 2025.2.1.0 build 141 revision be088b533e1800380f620374f8c9b513f9b9d571 build_type RELEASE built at 05 Feb 2026 01:28:11 UTC
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0425 03:04:17.949435 3309259 server_main_util.cc:276] NumCPUs determined to be: 4
I0425 03:04:17.949719 3309259 server_main_util.cc:111] Total available RAM is 7.569546 GiB
I0425 03:04:17.949738 3309259 server_main_util.cc:100] Setting flag db_block_cache_size_percentage to recommended value -3
I0425 03:04:17.949760 3309259 server_main_util.cc:102] Setting flag default_memory_limit_to_ram_ratio to recommended value 0.1
I0425 03:04:17.949783 3309259 server_main_util.cc:104] Setting flag tablet_overhead_size_percentage to recommended value 0
I0425 03:04:17.949798 3309259 mem_tracker.cc:200] Creating root MemTracker with garbage collection threshold 8127737 bytes
I0425 03:04:17.949806 3309259 mem_tracker.cc:205] Root memory limit is 812773785
I0425 03:04:17.949826 3309259 tcmalloc_util.cc:233] Setting tcmalloc max thread cache bytes to: 33554432
I0425 03:04:17.949844 3309259 tcmalloc_util.cc:266] Setting TCMalloc profiler sampling period to 1048576 bytes
I0425 03:04:17.949851 3309259 mem_tracker.cc:245] TCMalloc per cpu caches active: 0
I0425 03:04:17.949857 3309259 mem_tracker.cc:247] TCMalloc max per cpu cache size: 1572864
I0425 03:04:17.949863 3309259 mem_tracker.cc:249] TCMalloc max total thread cache bytes: 33554432
I0425 03:04:17.949932 3309259 server_base_options.cc:166] Updating master addrs to {10.0.0.2:7100},{10.0.0.3:7100},{10.0.0.4:7100}
I0425 03:04:17.949963 3309259 server_base_options.cc:166] Updating master addrs to {10.0.0.2:7100},{10.0.0.3:7100},{10.0.0.4:7100}
I0425 03:04:17.949982 3309259 thread_pool.cc:288] Starting thread pool { name: metric cleanup max_workers: 1 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950001 3309259 server_base_options.cc:166] Updating master addrs to {10.0.0.2:7100},{10.0.0.3:7100},{10.0.0.4:7100}
I0425 03:04:17.950299 3309259 mem_tracker.cc:840] MemTracker: hard memory limit is 0.756955 GB
I0425 03:04:17.950310 3309259 mem_tracker.cc:842] MemTracker: soft memory limit is 0.643411 GB
I0425 03:04:17.950390 3309259 thread_pool.cc:288] Starting thread pool { name: object_lock_info_manager max_workers: 4 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950407 3309259 thread_pool.cc:288] Starting thread pool { name: leader-initialization max_workers: 1 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950412 3309259 thread_pool.cc:288] Starting thread pool { name: CatalogManagerBGTasks max_workers: 4 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950417 3309259 thread_pool.cc:288] Starting thread pool { name: async-tasks max_workers: 18446744073709551615 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950421 3309259 thread_pool.cc:288] Starting thread pool { name: inform_removed_master max_workers: 4 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950426 3309259 thread_pool.cc:288] Starting thread pool { name: raft max_workers: 4 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.950430 3309259 thread_pool.cc:288] Starting thread pool { name: raft_notifications max_workers: 18446744073709551615 min_workers: 0 idle_timeout: 15.000s }
I0425 03:04:17.950436 3309259 thread_pool.cc:288] Starting thread pool { name: prepare max_workers: 4 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.950685 3309259 thread_pool.cc:288] Starting thread pool { name: append max_workers: 4 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.950911 3309259 thread_pool.cc:288] Starting thread pool { name: log-sync max_workers: 4 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.951056 3309259 thread_pool.cc:288] Starting thread pool { name: log-alloc max_workers: 4 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.951211 3309259 server_base_options.cc:166] Updating master addrs to {10.0.0.2:7100},{10.0.0.3:7100},{10.0.0.4:7100}
I0425 03:04:17.951231 3309259 thread_pool.cc:288] Starting thread pool { name: MaintenanceMgr max_workers: 1 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.951395 3309259 rpc_server.cc:84] yb::server::RpcServer created at 0x32a43ff92280
I0425 03:04:17.951402 3309259 master.cc:193] yb::master::Master created at 0x7ffcc0f83500
I0425 03:04:17.951406 3309259 master.cc:194] yb::master::TSManager created at 0x32a43ff93a40
I0425 03:04:17.951408 3309259 master.cc:195] yb::master::CatalogManager created at 0x32a43fc09f80
I0425 03:04:17.951437 3309259 master_main.cc:137] Initializing master server...
I0425 03:04:17.951442 3309259 thread_pool.cc:288] Starting thread pool { name: init max_workers: 1 min_workers: 0 idle_timeout: 0.500s }
I0425 03:04:17.953722 3309259 fs_manager.cc:416] Opened local filesystem: /opt/yuga/data
uuid: "55d29a1415af4e44ac228b2c8a82f866"
format_stamp: "Formatted at 2026-02-23 14:21:00 on ubuntu-caremanager-1"
initdb_done_set_after_sys_catalog_restore: true
I0425 03:04:17.954248 3309259 server_base.cc:288] Auto setting FLAGS_num_reactor_threads to 4
I0425 03:04:17.954269 3309259 secure.cc:138] SetupSecureContext: kInternal, 1
I0425 03:04:17.955814 3309259 secure.cc:192] Certs directory: /opt/yuga/certs, node name: 10.0.0.2
I0425 03:04:17.957369 3309259 thread_pool.cc:288] Starting thread pool { name: Master max_workers: 1024 min_workers: 0 idle_timeout: 15.000s }
I0425 03:04:17.958906 3309259 auto_flags_manager_base.cc:350] AutoFlags promoted: ysql_yb_upgrade_to_pg15_completed,ysql_yb_pushdown_is_not_null,ysql_yb_enable_sequence_pushdown,ysql_yb_enable_saop_pushdown,ysql_yb_enable_replication_slot_consumption,ysql_yb_enable_replica_identity,ysql_yb_enable_pg_locks,ysql_yb_enable_index_aggregate_pushdown,ysql_yb_enable_hash_batch_in,ysql_yb_enable_docdb_vector_type,ysql_yb_enable_ddl_atomicity_infra,ysql_yb_enable_alter_table_rewrite,ysql_yb_enable_advisory_locks,cdc_enable_postgres_replica_identity,ysql_yb_enable_add_column_missing_default,ysql_yb_allow_block_based_sampling_algorithm,ysql_skip_row_lock_for_update,ysql_enable_packed_row,yb_enable_cdc_consistent_snapshot_streams,xcluster_store_older_schema_versions,ysql_yb_allow_replication_slot_lsn_types,ysql_enable_auto_analyze_infra,xcluster_enable_subtxn_abort_propagation,xcluster_use_encoded_key_filter,xcluster_enable_ddl_replication,ysql_yb_enable_expression_pushdown,xcluster_automatic_mode_schema_handling_v2,cdcsdk_enable_identification_of_non_eligible_tables,ysql_auto_add_new_index_to_bidirectional_xcluster_infra,ycql_allow_cassandra_drop,store_min_start_ht_running_txns,ysql_yb_enable_ddl_savepoint_infra,store_last_wal_op_log_ht,skip_prefix_locks_for_upgrade,enable_xcluster_api_v2,ysql_yb_bypass_cond_recheck,ysql_enable_object_locking_infra,master_enable_universe_uuid_heartbeat_check,enable_export_snapshot_using_relfilenode,TEST_auto_flags_initialized,ysql_yb_update_optimization_infra,remote_bootstrap_from_leader_only,ysql_yb_enable_replication_commands,enable_tablet_split_of_xcluster_replicated_tables,replicate_transaction_promotion,ycql_suppress_group_by_error,enable_object_retention_due_to_snapshots,persist_tserver_registry,regular_tablets_data_block_key_value_encoding,ysql_yb_allow_separate_requests_for_sampling_stages,enable_tablespace_based_transaction_placement,ysql_yb_allow_dockey_bounds,enable_flush_retryable_requests,ysql_yb_pushdown_strict_inequality,ysql_yb_pg_locks_integrate_advisory_locks,cdcsdk_enable_cleanup_of_expired_table_entries,save_index_into_wal_segments,enable_automatic_tablet_splitting,remote_bootstrap_idle_timeout_ms,cdcsdk_enable_dynamic_tables_disable_option,use_parent_table_id_field,cdcsdk_enable_dynamic_table_addition_with_table_cleanup,enable_xcluster_auto_flag_validation,allow_three_shared_parts_data_block_key_value_encoding,cdc_write_post_apply_metadata,TEST_auto_flags_new_install
I0425 03:04:17.977154 3309259 shared_mem_allocator.cc:323] Preparing shared memory allocator (prefix: VdKaFBWvTkSsIossioL4Zg)
I0425 03:04:17.977231 3309259 server_base.cc:606] Using private rpc address 10.0.0.2
I0425 03:04:17.977598 3309259 fs_manager.cc:827] Found tablet 00000000000000000000000000000000 metadata at /opt/yuga/data/yb-data/master
I0425 03:04:17.977738 3309274 async_client_initializer.cc:91] Starting to init ybclient
I0425 03:04:17.977762 3309259 master_main.cc:140] Starting Master server...
I0425 03:04:17.977773 3309259 ulimit_util.cc:212] Configured soft limit for cpu time is already larger than specified min value (unlimited vs. unlimited). Skipping.
I0425 03:04:17.977777 3309259 ulimit_util.cc:212] Configured soft limit for file size is already larger than specified min value (unlimited vs. unlimited). Skipping.
I0425 03:04:17.977779 3309259 ulimit_util.cc:212] Configured soft limit for data seg size is already larger than specified min value (unlimited vs. unlimited). Skipping.
I0425 03:04:17.977782 3309259 ulimit_util.cc:212] Configured soft limit for stack size is already larger than specified min value (8388608 vs. 8388608). Skipping.
I0425 03:04:17.977784 3309259 ulimit_util.cc:212] Configured soft limit for max user processes is already larger than specified min value (30852 vs. 12000). Skipping.
I0425 03:04:17.977787 3309259 env_posix.cc:1583] Modifying limit for open files from 1024 to 1048576
I0425 03:04:17.977792 3309259 ulimit_util.cc:212] Configured soft limit for max locked memory is already larger than specified min value (1015963648 vs. 65536). Skipping.
I0425 03:04:17.977795 3309259 ulimit_util.cc:212] Configured soft limit for max memory size is already larger than specified min value (unlimited vs. unlimited). Skipping.
I0425 03:04:17.977797 3309259 master_main.cc:142] ulimit cur(max)...
ulimit: core file size 0(unlimited) blks
ulimit: data seg size unlimited(unlimited) kb
ulimit: open files 1048576(1048576)
ulimit: file size unlimited(unlimited) blks
ulimit: pending signals 30852(30852)
ulimit: file locks unlimited(unlimited)
ulimit: max locked memory 992152(992152) kb
ulimit: max memory size unlimited(unlimited) kb
ulimit: stack size 8192(unlimited) kb
ulimit: cpu time unlimited(unlimited) secs
ulimit: max user processes 30852(30852)
I0425 03:04:17.978076 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff87b80
I0425 03:04:17.978119 3309274 thread_pool.cc:288] Starting thread pool { name: cdc_state_clientcb max_workers: 1 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.978204 3309259 service_pool.cc:146] yb.master.MasterBackup: yb::rpc::ServicePoolImpl created at 0x32a43fe1f8c0
I0425 03:04:17.978289 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff874a0
I0425 03:04:17.978295 3309276 client-internal.cc:2923] Reinitialize master addresses from file: ./master.conf
W0425 03:04:17.978369 3309276 catalog_manager.cc:1768] Failed to get current config: Illegal state (yb/master/catalog_manager.cc:12450): Node 55d29a1415af4e44ac228b2c8a82f866 peer not initialized.
I0425 03:04:17.978519 3309276 client-internal.cc:2952] New master addresses: [10.0.0.2:7100,10.0.0.3:7100,10.0.0.4:7100]
I0425 03:04:17.978633 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff86b00
I0425 03:04:17.978698 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff869a0
I0425 03:04:17.979082 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff86420
I0425 03:04:17.979143 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff86580
I0425 03:04:17.979157 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ff86840
I0425 03:04:17.979842 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ffae000
I0425 03:04:17.979866 3309259 service_pool.cc:146] yb.master.MasterService: yb::rpc::ServicePoolImpl created at 0x32a43ffae160
I0425 03:04:17.980262 3309259 service_pool.cc:146] yb.tserver.TabletServerService: yb::rpc::ServicePoolImpl created at 0x32a43ffae2c0
I0425 03:04:17.980372 3309259 thread_pool.cc:288] Starting thread pool { name: Master-high-pri max_workers: 1024 min_workers: 0 idle_timeout: 15.000s }
I0425 03:04:17.980381 3309259 service_pool.cc:146] yb.consensus.ConsensusService: yb::rpc::ServicePoolImpl created at 0x32a43ffae580
I0425 03:04:17.980695 3309259 service_pool.cc:146] yb.tserver.RemoteBootstrapService: yb::rpc::ServicePoolImpl created at 0x32a43ff87e40
I0425 03:04:17.981367 3309259 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators
I0425 03:04:17.981395 3309259 service_pool.cc:146] yb.tserver.PgClientService: yb::rpc::ServicePoolImpl created at 0x32a43ffaf760
I0425 03:04:17.981465 3309259 webserver.cc:359] Starting webserver on 10.0.0.2:7000
I0425 03:04:17.981469 3309259 webserver.cc:368] Document root: /root/yugabyte/www
I0425 03:04:17.981505 3309259 webserver.cc:354] Webserver listen spec is 10.0.0.2:7000
I0425 03:04:17.981640 3309259 webserver.cc:484] Webserver started. Bound to: http://10.0.0.2:7000/
I0425 03:04:17.981752 3309259 service_pool.cc:146] yb.server.GenericService: yb::rpc::ServicePoolImpl created at 0x32a43fff0580
I0425 03:04:17.981985 3309259 rpc_server.cc:167] RPC server started. Bound to: 10.0.0.2:7100
I0425 03:04:17.982173 3309280 async_client_initializer.cc:91] Starting to init ybclient
I0425 03:04:17.982450 3309280 thread_pool.cc:288] Starting thread pool { name: server_clientcb max_workers: 1 min_workers: 1 idle_timeout: 0.500s }
I0425 03:04:17.982535 3309259 db_server_base.cc:80] Node information: { hostname: 'ubuntu-caremanager-1', rpc_ip: '10.0.0.2', webserver_ip: '10.0.0.2', uuid: '55d29a1415af4e44ac228b2c8a82f866' }
I0425 03:04:17.982543 3309259 server_base.cc:606] Using private rpc address 10.0.0.2
I0425 03:04:17.982547 3309259 server_base.cc:628] Using http address 10.0.0.2
I0425 03:04:17.982745 3309282 sys_catalog.cc:289] Trying to load previous SysCatalogTable data from disk
I0425 03:04:17.982833 3309281 client-internal.cc:2923] Reinitialize master addresses from file: ./master.conf
W0425 03:04:17.982878 3309281 catalog_manager.cc:1768] Failed to get current config: Illegal state (yb/master/catalog_manager.cc:12450): Node 55d29a1415af4e44ac228b2c8a82f866 peer not initialized.
I0425 03:04:17.982892 3309281 client-internal.cc:2952] New master addresses: [10.0.0.2:7100,10.0.0.3:7100,10.0.0.4:7100]
I0425 03:04:17.984076 3309274 async_client_initializer.cc:95] Successfully built ybclient
I0425 03:04:17.984133 3309280 async_client_initializer.cc:95] Successfully built ybclient
I0425 03:04:17.990108 3309282 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from UNKNOWN_ROLE to FOLLOWER. Consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:17.990293 3309282 sys_catalog.cc:333] Configuring consensus for distributed operation...
I0425 03:04:17.990298 3309282 server_base_options.cc:166] Updating master addrs to {10.0.0.2:7100},{10.0.0.3:7100},{10.0.0.4:7100}
I0425 03:04:17.990302 3309282 server_base.cc:606] Using private rpc address 10.0.0.2
I0425 03:04:17.991210 3309282 tablet_bootstrap_state_manager.cc:62] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Initialized TabletBootstrapStateManager, found a file ? no, wal dir=/opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000
I0425 03:04:17.991248 3309282 tablet_peer.cc:1701] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [state=BOOTSTRAPPING]: Changed state from NOT_STARTED to BOOTSTRAPPING
I0425 03:04:17.991375 3309282 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from UNKNOWN_ROLE to FOLLOWER. Consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:17.991402 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap starting.
I0425 03:04:17.991641 3309282 tablet.cc:731] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Schema version for sys.catalog is 0
I0425 03:04:17.991847 3309282 transaction_participant.cc:264] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Create
I0425 03:04:17.991885 3309282 docdb_rocksdb_util.cc:383] FLAGS_rocksdb_max_background_flushes was not set, automatically configuring 1 max background flushes
I0425 03:04:17.991889 3309282 docdb_rocksdb_util.cc:418] FLAGS_rocksdb_max_background_compactions was not set, automatically configuring 1 background compactions.
I0425 03:04:17.991892 3309282 docdb_rocksdb_util.cc:431] FLAGS_rocksdb_base_background_compactions was not set, automatically configuring 1 base background compactions.
I0425 03:04:17.991895 3309282 docdb_rocksdb_util.cc:669] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Write buffer size: 134217728
I0425 03:04:17.991899 3309282 docdb_rocksdb_util.cc:637] FLAGS_priority_thread_pool_size was not set, automatically configuring to 2.
I0425 03:04:17.991943 3309282 tablet.cc:864] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Creating RocksDB database in dir /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000
I0425 03:04:17.992715 3309282 tablet.cc:1224] Opening RocksDB at: /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000
I0425 03:04:17.994109 3309282 version_set.cc:3026] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: Recovered from manifest file:/opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/MANIFEST-000033 succeeded,manifest_file_number is 33, next_file_number is 35, last_sequence is 1125899907058324, log_number is 0,prev_log_number is 0,max_column_family is 0, flushed_values is 0x000032a43fad0300 -> { op_id: 1.5 hybrid_time: { physical: 1771858801319766 } }
I0425 03:04:17.994119 3309282 version_set.cc:3034] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: Column family [default] (ID 0), log number is 32
I0425 03:04:17.994446 3309282 event_logger.cc:66] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: EVENT_LOG_v1 {"time_micros": 1777086257994443, "job": 1, "event": "recovery_started", "log_files": [34]}
I0425 03:04:17.994459 3309282 db_impl.cc:1781] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: Recovering log #34 mode 0 skip-recovery 0
I0425 03:04:17.994472 3309282 version_set.cc:2467] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: Creating manifest 36
I0425 03:04:17.996876 3309282 event_logger.cc:66] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: EVENT_LOG_v1 {"time_micros": 1777086257996874, "job": 1, "event": "recovery_finished"}
I0425 03:04:17.996992 3309282 db_impl.cc:1436] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: [JOB 2] Delete /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000//MANIFEST-000033 type=4 #33 -- OK
I0425 03:04:17.997008 3309282 db_impl.cc:1436] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: [JOB 2] Delete /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000//000034.log type=0 #34 -- OK
I0425 03:04:17.998937 3309282 tablet.cc:1250] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Opening intents DB at: /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents
I0425 03:04:17.999617 3309282 version_set.cc:3026] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: Recovered from manifest file:/opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 1125899906842624, log_number is 0,prev_log_number is 0,max_column_family is 0, flushed_values is 0x000032a43fad1b00 -> { op_id: 1.5 hybrid_time: { physical: 1771858801319766 } }
I0425 03:04:17.999625 3309282 version_set.cc:3034] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: Column family [default] (ID 0), log number is 20
I0425 03:04:17.999820 3309282 event_logger.cc:66] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: EVENT_LOG_v1 {"time_micros": 1777086257999818, "job": 1, "event": "recovery_started", "log_files": [22]}
I0425 03:04:17.999832 3309282 db_impl.cc:1781] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: Recovering log #22 mode 0 skip-recovery 0
I0425 03:04:17.999842 3309282 version_set.cc:2467] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: Creating manifest 24
I0425 03:04:18.001732 3309282 event_logger.cc:66] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: EVENT_LOG_v1 {"time_micros": 1777086258001731, "job": 1, "event": "recovery_finished"}
I0425 03:04:18.001991 3309282 db_impl.cc:1436] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: [JOB 2] Delete /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents//MANIFEST-000021 type=4 #21 -- OK
I0425 03:04:18.002009 3309282 db_impl.cc:1436] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: [JOB 2] Delete /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents//000022.log type=0 #22 -- OK
I0425 03:04:18.004194 3309286 transaction_loader.cc:113] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Load transactions start
I0425 03:04:18.004340 3309286 transaction_loader.cc:187] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: LoadTransactions done: loaded 0 transactions
I0425 03:04:18.004395 3309282 tablet.cc:1123] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Successfully opened a RocksDB database at /opt/yuga/data/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000
I0425 03:04:18.004406 3309282 tablet_bootstrap.cc:652] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Time spent opening tablet: real 0.013s	user 0.003s	sys 0.000s
I0425 03:04:18.004747 3309282 tablet_bootstrap.cc:748] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Will attempt to recover log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000001
I0425 03:04:18.004756 3309282 tablet_bootstrap.cc:748] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Will attempt to recover log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000002
I0425 03:04:18.004765 3309282 tablet_bootstrap.cc:748] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Will attempt to recover log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000003
I0425 03:04:18.004766 3309282 tablet_bootstrap.cc:748] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Will attempt to recover log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004
I0425 03:04:18.004773 3309282 tablet_bootstrap.cc:1251] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Flushed DocDB OpIds: { regular: 1.5 intents: 1.5 vector_indexes: [] }
I0425 03:04:18.004918 3309282 tablet_bootstrap.cc:1526] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Max persistent index in RocksDB's SSTables before bootstrap: regular RocksDB: 1.5; intents RocksDB: 1.5
I0425 03:04:18.005175 3309282 log.cc:1527] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Setting log wal retention time to 0 seconds
W0425 03:04:18.005309 3309282 log_util.cc:245] Could not read footer for segment: /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004: Not found (yb/consensus/log_util.cc:591): Footer not found. Footer magic doesn't match
W0425 03:04:18.005645 3309282 log_reader.cc:213] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 was likely left in-progressafter a previous crash. Will try to reuse this segment as writable active segment
I0425 03:04:18.005672 3309282 log.cc:751] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Opened existing logs. Last segment is /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004
I0425 03:04:18.005676 3309282 log.cc:767] durable_wal_write is turned on.
I0425 03:04:18.005684 3309282 tablet_bootstrap.cc:394] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap optimizer (skip_flushed_entries): op_id_replay_lowest=1.5 (regular_op_id=1.5, intents_op_id=1.5, has_intents_db=1)
I0425 03:04:18.007099 3309282 tablet_bootstrap.cc:1473] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 cannot be used as the first segment to start replay with according to our OpId and retention criteria. Continuing to earlier segments.op_id=2.688, op_id_replay_lowest=1.5, last_op_id_in_retryable_requests=0.0, first_op_time=112216.640s, retryable_requests_retain_interval=600.000s, *retryable_requests_replay_from_this_or_earlier_time=111616.640s, is_first_op_id_low_enough_for_retryable_requests=0, is_first_op_time_early_enough_for_retryable_requests=0, is_first_op_id_low_enough=0
I0425 03:04:18.009670 3309282 tablet_bootstrap.cc:1473] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000003 cannot be used as the first segment to start replay with according to our OpId and retention criteria. Continuing to earlier segments.op_id=2.684, op_id_replay_lowest=1.5, last_op_id_in_retryable_requests=0.0, first_op_time=112216.424s, retryable_requests_retain_interval=600.000s, *retryable_requests_replay_from_this_or_earlier_time=111616.640s, is_first_op_id_low_enough_for_retryable_requests=0, is_first_op_time_early_enough_for_retryable_requests=0, is_first_op_id_low_enough=0
I0425 03:04:18.010728 3309282 tablet_bootstrap.cc:1473] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000002 cannot be used as the first segment to start replay with according to our OpId and retention criteria. Continuing to earlier segments.op_id=2.679, op_id_replay_lowest=1.5, last_op_id_in_retryable_requests=0.0, first_op_time=112216.173s, retryable_requests_retain_interval=600.000s, *retryable_requests_replay_from_this_or_earlier_time=111616.640s, is_first_op_id_low_enough_for_retryable_requests=0, is_first_op_time_early_enough_for_retryable_requests=0, is_first_op_id_low_enough=0
I0425 03:04:18.010758 3309282 tablet_bootstrap.cc:1460] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Retryable requests file is too old, ignore the expired retryable requests. is_first_op_id_low_enough_for_retryable_requests=0, is_first_op_time_early_enough_for_retryable_requests=1
I0425 03:04:18.010762 3309282 tablet_bootstrap.cc:1465] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap optimizer (skip_flushed_entries): found first mandatory segment op id: 1.1, op_id_replay_lowest=1.5, last_op_id_in_retryable_requests=0.0, first_op_time=18079.226s, retryable_requests_retain_interval=600.000s, *retryable_requests_replay_from_this_or_earlier_time=111616.640s, number of segments to be skipped: 0
I0425 03:04:18.019953 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap replayed 1/4 log segments. Read operations: 678, overwritten operations: 0. Pending: 1 replicates. Last read committed op id: 2.677, last entry metadata: { entry_time: 112216.120s offset: 807996 active_segment_sequence_number: 1 }, last read entry op id: 2.678
I0425 03:04:18.027267 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap replayed 2/4 log segments. Read operations: 683, overwritten operations: 0. Pending: 1 replicates. Last read committed op id: 2.682, last entry metadata: { entry_time: 112216.372s offset: 1760954 active_segment_sequence_number: 2 }, last read entry op id: 2.683
I0425 03:04:18.037025 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap replayed 3/4 log segments. Read operations: 687, overwritten operations: 0. Pending: 1 replicates. Last read committed op id: 2.686, last entry metadata: { entry_time: 112216.571s offset: 3772856 active_segment_sequence_number: 3 }, last read entry op id: 2.687
I0425 03:04:18.054437 3309282 log_util.cc:807] Scanning /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 for valid entry headers following offset 3867985...
I0425 03:04:18.056309 3309282 log_util.cc:851] Found no log entry headers
I0425 03:04:18.056324 3309282 log_util.cc:712] Ignoring partially flushed segment in write ahead log /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 because there are no log entries following this one. The server probably crashed in the middle of writing an entry to the write-ahead log or downloaded an active log via remote bootstrap. Error detail: Corruption (yb/consensus/log_util.cc:922): Invalid checksum in log entry head header: found=0, computed=2351477386: Failed trying to read batch #5470 at offset 3867985 for log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004: Prior batch offsets: 3867570 3867598 3867957 3867985; Last log entries read: [REPLICATE (3.3568)] [REPLICATE (3.3569)] [REPLICATE (3.3570)] [REPLICATE (3.3571)]
I0425 03:04:18.111632 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap replayed 4/4 log segments. Read operations: 3571, overwritten operations: 0. Pending: 1 replicates. Last read committed op id: 3.3571, last entry metadata: { entry_time: 5189447.078s offset: 3867598 active_segment_sequence_number: 4 }, last read entry op id: 3.3571
I0425 03:04:18.111673 3309282 tablet_bootstrap.cc:1668] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Dumping replay state to log at the end of PlaySegments
I0425 03:04:18.111680 3309282 tablet_bootstrap.cc:1225] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: ReplayState: Previous OpId: 3.3571, Committed OpId: 3.3571, Pending Replicates: 0, Flushed Regular: 1.5, Flushed Intents: 1.5
I0425 03:04:18.111683 3309282 tablet_bootstrap.cc:1225] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Log entries applied to RocksDB: 3571
I0425 03:04:18.111685 3309282 tablet_bootstrap.cc:1680] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Number of orphaned replicates: 0, last id: 3.3571, committed id: 3.3571
I0425 03:04:18.114004 3309282 tablet_vector_indexes.cc:411] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: LaunchBackfillsIfNecessary: list: <NULL>
I0425 03:04:18.114019 3309282 tablet_bootstrap_if.cc:95] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Bootstrap complete.
I0425 03:04:18.128047 3309282 log_util.cc:807] Scanning /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 for valid entry headers following offset 3867985...
I0425 03:04:18.129391 3309282 log_util.cc:851] Found no log entry headers
I0425 03:04:18.129403 3309282 log_util.cc:712] Ignoring partially flushed segment in write ahead log /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004 because there are no log entries following this one. The server probably crashed in the middle of writing an entry to the write-ahead log or downloaded an active log via remote bootstrap. Error detail: Corruption (yb/consensus/log_util.cc:922): Invalid checksum in log entry head header: found=0, computed=2351477386: Failed trying to read batch #5470 at offset 3867985 for log segment /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004: Prior batch offsets: 3867570 3867598 3867957 3867985; Last log entries read: [REPLICATE (3.3568)] [REPLICATE (3.3569)] [REPLICATE (3.3570)] [REPLICATE (3.3571)]
I0425 03:04:18.130724 3309282 log.cc:1163] Successfully restored footer_builder_ and log_index_ for segment: /opt/yuga/data/yb-data/master/wals/table-sys.catalog.uuid/tablet-00000000000000000000000000000000/wal-000000004. Reopen the file for write with starting offset: 3867985
I0425 03:04:18.131613 3309282 log.cc:1527] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Setting log wal retention time to 0 seconds
I0425 03:04:18.131839 3309282 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from UNKNOWN_ROLE to FOLLOWER. Consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:18.139698 3309282 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from FOLLOWER to FOLLOWER. Consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:18.139734 3309282 raft_consensus.cc:514] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending operations. Active config: opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } }
I0425 03:04:18.139753 3309282 raft_consensus.cc:1158] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55d29a1415af4e44ac228b2c8a82f866, State: 1, Role: FOLLOWER, Watermarks: {Received: 3.3571 Committed: 3.3571} Leader: 0.0, new leader: , initial_fd_wait: <uninitialized>
I0425 03:04:18.139761 3309282 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from FOLLOWER to FOLLOWER. Consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:18.139781 3309282 consensus_queue.cc:271] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last applied: 0.0, Last appended: 3.3571, Current term: 0, Majority size: -1, State: QUEUE_OPEN, Mode: NON_LEADER
I0425 03:04:18.139791 3309282 raft_consensus.cc:3580] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 3 FOLLOWER]: Calling mark dirty synchronously for reason code CONSENSUS_STARTED
I0425 03:04:18.139798 3309282 sys_catalog.cc:447] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: SysCatalogTable state changed. Locked=0. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }
I0425 03:04:18.139811 3309282 sys_catalog.cc:451] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: This master's current role is: FOLLOWER
I0425 03:04:18.139818 3309282 tablet_peer.cc:1701] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [state=RUNNING]: Changed state from BOOTSTRAPPING to RUNNING
I0425 03:04:18.139822 3309282 transaction_participant.cc:378] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Start
I0425 03:04:18.139832 3309282 sys_catalog.cc:447] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: SysCatalogTable state changed. Locked=0. Reason: Started TabletPeer. Latest consensus state: current_term: 3 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }
I0425 03:04:18.139840 3309282 sys_catalog.cc:451] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: This master's current role is: FOLLOWER
I0425 03:04:18.139845 3309282 tablet.cc:5843] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Rate limiter (regular db): set bytes_per_second to 1073741824
I0425 03:04:18.139849 3309282 tablet.cc:5843] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Rate limiter (intents db): set bytes_per_second to 1073741824
I0425 03:04:18.139860 3309286 transaction_participant.cc:1812] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: LoadFinished: starting transaction status resolution
I0425 03:04:18.141647 3309282 db_impl.cc:2769] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: SetOptions() on column family [default], inputs: [{level0_stop_writes_trigger, 2147483647}, {level0_slowdown_writes_trigger, 2147483647}]
I0425 03:04:18.141656 3309282 db_impl.cc:2773] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: [default] SetOptions succeeded
I0425 03:04:18.143086 3309282 db_impl.cc:2769] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: SetOptions() on column family [default], inputs: [{disable_auto_compactions, false}]
I0425 03:04:18.143093 3309282 db_impl.cc:2773] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [R]: [default] SetOptions succeeded
I0425 03:04:18.144405 3309282 db_impl.cc:2769] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: SetOptions() on column family [default], inputs: [{level0_stop_writes_trigger, 2147483647}, {level0_slowdown_writes_trigger, 2147483647}]
I0425 03:04:18.144413 3309282 db_impl.cc:2773] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: [default] SetOptions succeeded
I0425 03:04:18.145924 3309282 db_impl.cc:2769] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: SetOptions() on column family [default], inputs: [{disable_auto_compactions, false}]
I0425 03:04:18.145931 3309282 db_impl.cc:2773] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [I]: [default] SetOptions succeeded
I0425 03:04:18.145942 3309282 tablet_peer.cc:1564] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [state=RUNNING]: Registered log gc
I0425 03:04:18.146211 3309282 sys_catalog.cc:713] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: configured and running, proceeding with master startup.
W0425 03:04:18.146380 3309289 catalog_manager_bg_tasks.cc:396] Catalog manager background task thread going to sleep: Service unavailable (yb/master/scoped_leader_shared_lock.cc:94): Catalog manager is not initialized. State: 1
I0425 03:04:18.146530 3309282 server_base.cc:606] Using private rpc address 10.0.0.2
I0425 03:04:18.146600 3309259 master_main.cc:145] Master server successfully started.
I0425 03:04:18.146893 3309292 total_mem_watcher.cc:78] Root memtracker limit: 812773785 (775 MiB); this server will stop if memory usage exceeds 200% of that: 1625547570 bytes (1550 MiB).
I0425 03:04:18.147043 3309284 universe_key_client.cc:81] Received universe keys from master: 10.0.0.3:7100
I0425 03:04:18.147126 3309284 universe_key_client.cc:81] Received universe keys from master: 10.0.0.4:7100
I0425 03:04:18.219765 3309284 encryption_manager.cc:60] Responding to GetUniverseKeyRegistry request with key ids: 
I0425 03:04:18.397709 3309293 raft_consensus.cc:3695] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 3 FOLLOWER]: Advancing to term 4
I0425 03:04:18.397761 3309293 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from FOLLOWER to FOLLOWER. Consensus state: current_term: 4 leader_uuid: "" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:18.400677 3309293 raft_consensus.cc:1780] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 4 FOLLOWER]: Refusing update from remote peer 64fedbe39ec148ab8f9e982b6d19f6d2: Log matching property violated. Preceding OpId in replica: 3.3571. Preceding OpId from leader: 4.3574. (index mismatch)
I0425 03:04:18.400696 3309293 raft_consensus.cc:1996] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 4 FOLLOWER]: Returning from UpdateConsensus because of error: error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: 3.3571. Preceding OpId from leader: 4.3574. (index mismatch)" source_file: "../../src/yb/consensus/raft_consensus.cc" source_line: 1778 errors: "00" } }
I0425 03:04:18.405751 3309293 consensus_meta.cc:361] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Updating active role from FOLLOWER to FOLLOWER. Consensus state: current_term: 4 leader_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }, has_pending_config = 0
I0425 03:04:18.405787 3309293 raft_consensus.cc:3580] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 4 FOLLOWER]: Calling mark dirty synchronously for reason code NEW_LEADER_ELECTED
I0425 03:04:18.405799 3309293 sys_catalog.cc:447] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: SysCatalogTable state changed. Locked=1. Reason: New leader 64fedbe39ec148ab8f9e982b6d19f6d2 elected. Latest consensus state: current_term: 4 leader_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }
I0425 03:04:18.405812 3309293 sys_catalog.cc:451] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: This master's current role is: FOLLOWER
I0425 03:04:18.405835 3309293 replica_state.cc:1215] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 4 FOLLOWER]: Reset our lease: 5245536.325s
I0425 03:04:18.405874 3309281 client-internal.cc:2923] Reinitialize master addresses from file: ./master.conf
I0425 03:04:18.407199 3309293 raft_consensus.cc:3580] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [term 4 FOLLOWER]: Calling mark dirty synchronously for reason code FOLLOWER_NO_OP_COMPLETE
I0425 03:04:18.407217 3309293 sys_catalog.cc:447] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: SysCatalogTable state changed. Locked=1. Reason: Replicate of NO_OP complete on follower. Latest consensus state: current_term: 4 leader_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" config { opid_index: -1 peers { permanent_uuid: "55d29a1415af4e44ac228b2c8a82f866" member_type: VOTER last_known_private_addr { host: "10.0.0.2" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1" } } peers { permanent_uuid: "a5110a40aa5b46eaa183f0022d8d9063" member_type: VOTER last_known_private_addr { host: "10.0.0.3" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2" } } peers { permanent_uuid: "64fedbe39ec148ab8f9e982b6d19f6d2" member_type: VOTER last_known_private_addr { host: "10.0.0.4" port: 7100 } cloud_info { placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" } } }
I0425 03:04:18.407232 3309293 sys_catalog.cc:451] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: This master's current role is: FOLLOWER
I0425 03:04:18.407318 3309281 client-internal.cc:2952] New master addresses: [10.0.0.2:7100,10.0.0.3:7100,10.0.0.4:7100, 10.0.0.2:7100, 10.0.0.3:7100, 10.0.0.4:7100]
I0425 03:04:18.585147 3309285 encryption_manager.cc:60] Responding to GetUniverseKeyRegistry request with key ids: 
W0425 03:04:23.642925 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "50b6629d01b84c9394d97e0098b13a7c" transaction_id: "\313\377\277\371\310\211E \272\365=-Y\001\010\206" propagated_hybrid_time: 7278945315392249856 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245541.560s (passed 5.001s of 5.000s) } to tablet 50b6629d01b84c9394d97e0098b13a7c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 17) to 10.0.0.4:9100 timed out after 4.995s
W0425 03:04:23.647264 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 18) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:28.653224 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945335917355008 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245546.571s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 20) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:28.653330 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 20) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:33.668467 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945356464287744 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245551.587s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 22) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:33.668540 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 22) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:38.687476 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945377020735488 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245556.606s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 24) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:38.687551 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 24) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:43.707706 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945397584646144 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245561.626s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 26) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:43.707770 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 26) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:48.640844 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945418173472768 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245566.559s (passed 4.906s of 4.906s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 28) to 10.0.0.4:9100 timed out after 4.906s
W0425 03:04:48.640913 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 28) to 10.0.0.4:9100 timed out after 4.906s
W0425 03:04:53.679085 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945438423805952 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245571.597s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 30) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:53.679199 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 30) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:58.715193 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945459052199936 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245576.633s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 32) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:04:58.715266 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 32) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:03.755159 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945479695048704 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245581.673s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 34) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:03.755266 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 34) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:08.798408 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945500352004096 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245586.716s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 36) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:08.798480 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 36) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:13.848323 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945521035915264 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245591.766s (passed 5.000s of 5.000s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 38) to 10.0.0.4:9100 timed out after 5.000s
W0425 03:05:13.848461 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 38) to 10.0.0.4:9100 timed out after 5.000s
I0425 03:05:17.989913 3309285 encryption_manager.cc:49] After AddUniverseKeys, key ids in memory: prime
W0425 03:05:18.649017 3309293 tablet_rpc.cc:520] Timed out (yb/rpc/outbound_call.cc:685): Failed GetTransactionStatus: tablet_id: "6c50e890b8914d8a9a740938d3587d4c" transaction_id: "d\244\'\026\010\271K\346\216H\333\337\371*\310\270" transaction_id: "\376\250;\366\340\240F]\272K\310\267\246\231\237j" transaction_id: "\216\2605\251BfN\305\232\014\033\376s\233\225=" transaction_id: "$6N.\030EJ\234\247\317EI\326\361\336F" transaction_id: "\273rwm\264\217N\231\255\317\212\205\n\0256B" transaction_id: "k\022~>\000\026NH\277\251\230\260\346\236\270a" transaction_id: ";F\3553f#A\321\261\376\335\002\'\323\266\343" transaction_id: "\025n\351E&\250H4\2365`V\031\035\001\007" transaction_id: "\207\254<\254\231\216@\035\212\003\353c\375X\266\200" transaction_id: "\304\326\305\253\332\350M\356\254\242\354\353\245\241r\351" transaction_id: ".\204\366\375\247EM\365\235\341\234\326\353-\353\374" transaction_id: "Uh\'\3152\250G)\213\332/\264\"\0200$" transaction_id: "^^\307\n\233\027J\342\226\236\245\311{\320\006\360" transaction_id: "\367\251S\314\241\032D\310\273\017\375\234g\222\2150" transaction_id: "5\322%\367>JC\230\244\316\236W\240ljB" transaction_id: "0\217\002\027\006\243Nk\216\013\264c\357\217\"U" transaction_id: "^\362\347i\272~@\373\223}c|\332Z\302." transaction_id: "\027L\326\033\347AGD\244en\334~[\334\316" transaction_id: "g\305\242\234Z\205D\375\261\r\027L\367\261\374\367" transaction_id: "\0257\300:\004\344G\231\267\310\205Kyr\221M" transaction_id: "\037.\321\332\306}A\177\227\262\307f\254\217\302\026" transaction_id: "\0357\205)\203\300D\307\27443\325L\"\n\006" transaction_id: "\261\366\002\317\211+B\304\220\215F\\\220\267x\320" transaction_id: "\247\207\245\221\214~L)\231\0266\225\301\232J\226" transaction_id: "Z\215\367{\013UE\232\246:\331\317\013\243}7" transaction_id: "\223\243\006\334[\366C\334\227\222\344\007\234\2038\216" transaction_id: "W)r\365\002h@\347\271\344(\2412\333\3336" transaction_id: "\351v-\266\222\310F\022\224\366:\005\342\323}\360" transaction_id: "C\304\351z\026<MT\255\265\rS\371+D\027" propagated_hybrid_time: 7278945541733847040 raft_config_opid_index: 3, retrier: { task_id: -1 state: kIdle deadline: 5245596.567s (passed 4.748s of 4.748s) } to tablet 6c50e890b8914d8a9a740938d3587d4c on tablet server { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3" after 1 attempt(s): GetTransactionStatus RPC (request call id 40) to 10.0.0.4:9100 timed out after 4.748s
W0425 03:05:18.649065 3309293 transaction_status_resolver.cc:239] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866: Failed to request transaction statuses: Timed out (yb/rpc/outbound_call.cc:685): GetTransactionStatus RPC (request call id 40) to 10.0.0.4:9100 timed out after 4.748s
I0425 03:05:20.330250 3309273 tablet_rpc.cc:172] Unable to pick leader for 6c50e890b8914d8a9a740938d3587d4c, replicas: [], followers: [{0x000032a43fb69ad0 -> { uuid: 9c82b8717cad4642ace41a42feaa6835 private: [host: "10.0.0.3" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2", { status: Illegal state (yb/tserver/service_util.cc:295): Tablet 6c50e890b8914d8a9a740938d3587d4c not RUNNING: NOT_STARTED (tablet server error 12) (raft group state error 5) time: 0.006s }}, {0x000032a43ffa4820 -> { uuid: 429247ef0cef4654b978a50b32d230b5 private: [host: "10.0.0.2" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1", { status: Illegal state (yb/tserver/service_util.cc:295): Tablet 6c50e890b8914d8a9a740938d3587d4c not RUNNING: NOT_STARTED (tablet server error 12) (raft group state error 5) time: 1.041s }}, {0x000032a43ec62000 -> { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3", { status: Illegal state (yb/tserver/service_util.cc:295): Tablet 6c50e890b8914d8a9a740938d3587d4c not RUNNING: NOT_STARTED (tablet server error 12) (raft group state error 5) time: 1.057s }}]
I0425 03:05:21.528439 3309271 tablet_rpc.cc:172] Unable to pick leader for 6c50e890b8914d8a9a740938d3587d4c, replicas: [0x000032a43ffa4820 -> { uuid: 429247ef0cef4654b978a50b32d230b5 private: [host: "10.0.0.2" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1"], followers: [{0x000032a43fb69ad0 -> { uuid: 9c82b8717cad4642ace41a42feaa6835 private: [host: "10.0.0.3" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care2", { status: Illegal state (yb/tserver/service_util.cc:295): Tablet 6c50e890b8914d8a9a740938d3587d4c not RUNNING: NOT_STARTED (tablet server error 12) (raft group state error 5) time: 0.031s }}, {0x000032a43ec62000 -> { uuid: 4b655113a45248e5b5cef75067b9b6a3 private: [host: "10.0.0.4" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care3", { status: Illegal state (yb/tserver/service_util.cc:295): Tablet 6c50e890b8914d8a9a740938d3587d4c not RUNNING: BOOTSTRAPPING (tablet server error 12) (raft group state error 0) time: 0.069s }}, {0x000032a43ffa4820 -> { uuid: 429247ef0cef4654b978a50b32d230b5 private: [host: "10.0.0.2" port: 9100] cloud_info: placement_cloud: "hetzner" placement_region: "fsn" placement_zone: "care1", { status: Illegal state (yb/consensus/consensus.cc:154): Not the leader (tablet server error 15) time: 0.105s }}] [suppressed 6 similar messages]
I0425 03:14:18.323545 3309275 retryable_requests.cc:468] T 00000000000000000000000000000000 P 55d29a1415af4e44ac228b2c8a82f866 [sys.catalog]: Removing client d43c1e13-36fc-4ebe-aff9-89609ed87480
I0425 06:04:17.981447 3309268 pg_client_service.cc:2621] Fetching set of database oids
I0425 06:04:17.982242 3309268 pg_client_service.cc:2628] Successfully fetched 7 database oids
I0425 06:04:17.982261 3309268 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators
I0425 09:04:17.982332 3309269 pg_client_service.cc:2621] Fetching set of database oids
I0425 09:04:17.983196 3309269 pg_client_service.cc:2628] Successfully fetched 7 database oids
I0425 09:04:17.983256 3309269 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators
I0425 12:04:17.983328 3309266 pg_client_service.cc:2621] Fetching set of database oids
I0425 12:04:17.984100 3309266 pg_client_service.cc:2628] Successfully fetched 7 database oids
I0425 12:04:17.984113 3309266 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators
I0425 15:04:17.984174 3309269 pg_client_service.cc:2621] Fetching set of database oids
I0425 15:04:17.984856 3309269 pg_client_service.cc:2628] Successfully fetched 7 database oids
I0425 15:04:17.984881 3309269 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators
I0425 18:04:17.984974 3309269 pg_client_service.cc:2621] Fetching set of database oids
I0425 18:04:17.986044 3309269 pg_client_service.cc:2628] Successfully fetched 7 database oids
I0425 18:04:17.986058 3309269 pg_client_service.cc:2647] ScheduleCheckObjectIdAllocators