mirror/mariadb
1
0
Fork 0
mirror of https://github.com/MariaDB/server.git synced 2025-04-21 14:45:34 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
mariadb/mysql-test/suite/rpl/r/rpl_xa_survive_disconnect.result
Andrei Elkin c8ae357341 MDEV-742 XA PREPAREd transaction survive disconnect/server restart 
Lifted long standing limitation to the XA of rolling it back at the
transaction's
connection close even if the XA is prepared.

Prepared XA-transaction is made to sustain connection close or server
restart.
The patch consists of

    - binary logging extension to write prepared XA part of
      transaction signified with
      its XID in a new XA_prepare_log_event. The concusion part -
      with Commit or Rollback decision - is logged separately as
      Query_log_event.
      That is in the binlog the XA consists of two separate group of
      events.

      That makes the whole XA possibly interweaving in binlog with
      other XA:s or regular transaction but with no harm to
      replication and data consistency.

      Gtid_log_event receives two more flags to identify which of the
      two XA phases of the transaction it represents. With either flag
      set also XID info is added to the event.

      When binlog is ON on the server XID::formatID is
      constrained to 4 bytes.

    - engines are made aware of the server policy to keep up user
      prepared XA:s so they (Innodb, rocksdb) don't roll them back
      anymore at their disconnect methods.

    - slave applier is refined to cope with two phase logged XA:s
      including parallel modes of execution.

This patch does not address crash-safe logging of the new events which
is being addressed by MDEV-21469.

CORNER CASES: read-only, pure myisam, binlog-*, @@skip_log_bin, etc

Are addressed along the following policies.
1. The read-only at reconnect marks XID to fail for future
   completion with ER_XA_RBROLLBACK.

2. binlog-* filtered XA when it changes engine data is regarded as
   loggable even when nothing got cached for binlog.  An empty
   XA-prepare group is recorded. Consequent Commit-or-Rollback
   succeeds in the Engine(s) as well as recorded into binlog.

3. The same applies to the non-transactional engine XA.

4. @@skip_log_bin=OFF does not record anything at XA-prepare
   (obviously), but the completion event is recorded into binlog to
   admit inconsistency with slave.

The following actions are taken by the patch.

At XA-prepare:
   when empty binlog cache - don't do anything to binlog if RO,
   otherwise write empty XA_prepare (assert(binlog-filter case)).

At Disconnect:
   when Prepared && RO (=> no binlogging was done)
     set Xid_cache_element::error := ER_XA_RBROLLBACK
     *keep* XID in the cache, and rollback the transaction.

At XA-"complete":
   Discover the error, if any don't binlog the "complete",
   return the error to the user.

Kudos
-----
Alexey Botchkov took to drive this work initially.
Sergei Golubchik, Sergei Petrunja, Marko Mäkelä provided a number of
good recommendations.
Sergei Voitovich made a magnificent review and improvements to the code.
They all deserve a bunch of thanks for making this work done!
2020-03-14 22:45:48 +02:00

319 lines
12 KiB
Text
Raw Permalink Blame History

include/master-slave.inc
[connection master]
connection master;
call mtr.add_suppression("Found 2 prepared XA transactions");
CREATE VIEW v_processlist as SELECT * FROM performance_schema.threads where type = 'FOREGROUND';
CREATE DATABASE d1;
CREATE DATABASE d2;
CREATE TABLE d1.t (a INT) ENGINE=innodb;
CREATE TABLE d2.t (a INT) ENGINE=innodb;
connect master_conn1, 127.0.0.1,root,,test,$MASTER_MYPORT,;
SET @@session.binlog_format= statement;
XA START '1-stmt';
INSERT INTO d1.t VALUES (1);
XA END '1-stmt';
XA PREPARE '1-stmt';
disconnect master_conn1;
connection master;
connect master_conn2, 127.0.0.1,root,,test,$MASTER_MYPORT,;
SET @@session.binlog_format= row;
XA START '1-row';
INSERT INTO d2.t VALUES (1);
XA END '1-row';
XA PREPARE '1-row';
disconnect master_conn2;
connection master;
XA START '2';
INSERT INTO d1.t VALUES (2);
XA END '2';
XA PREPARE '2';
XA COMMIT '2';
XA COMMIT '1-row';
XA COMMIT '1-stmt';
include/show_binlog_events.inc
Log_name Pos Event_type Server_id End_log_pos Info
master-bin.000001 # Gtid # # BEGIN GTID #-#-#
master-bin.000001 # Query # # use `mtr`; INSERT INTO test_suppressions (pattern) VALUES ( NAME_CONST('pattern',_latin1'Found 2 prepared XA transactions' COLLATE 'latin1_swedish_ci'))
master-bin.000001 # Query # # COMMIT
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # use `test`; CREATE ALGORITHM=UNDEFINED DEFINER=`root`@`localhost` SQL SECURITY DEFINER VIEW `v_processlist` AS SELECT * FROM performance_schema.threads where type = 'FOREGROUND'
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # CREATE DATABASE d1
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # CREATE DATABASE d2
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # use `test`; CREATE TABLE d1.t (a INT) ENGINE=innodb
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # use `test`; CREATE TABLE d2.t (a INT) ENGINE=innodb
master-bin.000001 # Gtid # # XA START X'312d73746d74',X'',1 GTID #-#-#
master-bin.000001 # Query # # use `test`; INSERT INTO d1.t VALUES (1)
master-bin.000001 # Query # # XA END X'312d73746d74',X'',1
master-bin.000001 # XA_prepare # # XA PREPARE X'312d73746d74',X'',1
master-bin.000001 # Gtid # # XA START X'312d726f77',X'',1 GTID #-#-#
master-bin.000001 # Annotate_rows # # INSERT INTO d2.t VALUES (1)
master-bin.000001 # Table_map # # table_id: # (d2.t)
master-bin.000001 # Write_rows_v1 # # table_id: # flags: STMT_END_F
master-bin.000001 # Query # # XA END X'312d726f77',X'',1
master-bin.000001 # XA_prepare # # XA PREPARE X'312d726f77',X'',1
master-bin.000001 # Gtid # # XA START X'32',X'',1 GTID #-#-#
master-bin.000001 # Query # # use `test`; INSERT INTO d1.t VALUES (2)
master-bin.000001 # Query # # XA END X'32',X'',1
master-bin.000001 # XA_prepare # # XA PREPARE X'32',X'',1
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # XA COMMIT X'32',X'',1
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # XA COMMIT X'312d726f77',X'',1
master-bin.000001 # Gtid # # GTID #-#-#
master-bin.000001 # Query # # XA COMMIT X'312d73746d74',X'',1
include/sync_slave_sql_with_master.inc
include/stop_slave.inc
connection master;
connect master2, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master2;
SET @@session.binlog_format= statement;
XA START '3-stmt';
INSERT INTO d1.t VALUES (3);
XA END '3-stmt';
XA PREPARE '3-stmt';
disconnect master2;
connect master2, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master2;
SET @@session.binlog_format= row;
XA START '3-row';
INSERT INTO d2.t VALUES (4);
XA END '3-row';
XA PREPARE '3-row';
disconnect master2;
connection master;
connect master2, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master2;
XA START '4';
SELECT * FROM d1.t;
a
1
2
XA END '4';
XA PREPARE '4';
disconnect master2;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_10';
INSERT INTO d1.t VALUES (10);
INSERT INTO d2.t VALUES (10);
XA END 'bulk_trx_10';
XA PREPARE 'bulk_trx_10';
disconnect master_bulk_conn10;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_9';
INSERT INTO d1.t VALUES (9);
INSERT INTO d2.t VALUES (9);
XA END 'bulk_trx_9';
XA PREPARE 'bulk_trx_9';
disconnect master_bulk_conn9;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_8';
INSERT INTO d1.t VALUES (8);
INSERT INTO d2.t VALUES (8);
XA END 'bulk_trx_8';
XA PREPARE 'bulk_trx_8';
disconnect master_bulk_conn8;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_7';
INSERT INTO d1.t VALUES (7);
INSERT INTO d2.t VALUES (7);
XA END 'bulk_trx_7';
XA PREPARE 'bulk_trx_7';
disconnect master_bulk_conn7;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_6';
INSERT INTO d1.t VALUES (6);
INSERT INTO d2.t VALUES (6);
XA END 'bulk_trx_6';
XA PREPARE 'bulk_trx_6';
disconnect master_bulk_conn6;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_5';
INSERT INTO d1.t VALUES (5);
INSERT INTO d2.t VALUES (5);
XA END 'bulk_trx_5';
XA PREPARE 'bulk_trx_5';
disconnect master_bulk_conn5;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_4';
INSERT INTO d1.t VALUES (4);
INSERT INTO d2.t VALUES (4);
XA END 'bulk_trx_4';
XA PREPARE 'bulk_trx_4';
disconnect master_bulk_conn4;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_3';
INSERT INTO d1.t VALUES (3);
INSERT INTO d2.t VALUES (3);
XA END 'bulk_trx_3';
XA PREPARE 'bulk_trx_3';
disconnect master_bulk_conn3;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_2';
INSERT INTO d1.t VALUES (2);
INSERT INTO d2.t VALUES (2);
XA END 'bulk_trx_2';
XA PREPARE 'bulk_trx_2';
disconnect master_bulk_conn2;
connection master;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START 'bulk_trx_1';
INSERT INTO d1.t VALUES (1);
INSERT INTO d2.t VALUES (1);
XA END 'bulk_trx_1';
XA PREPARE 'bulk_trx_1';
disconnect master_bulk_conn1;
connection master;
connection slave;
include/start_slave.inc
connection master;
include/sync_slave_sql_with_master.inc
include/stop_slave.inc
connection master;
XA COMMIT 'bulk_trx_10';
XA ROLLBACK 'bulk_trx_9';
XA COMMIT 'bulk_trx_8';
XA ROLLBACK 'bulk_trx_7';
XA COMMIT 'bulk_trx_6';
XA ROLLBACK 'bulk_trx_5';
XA COMMIT 'bulk_trx_4';
XA ROLLBACK 'bulk_trx_3';
XA COMMIT 'bulk_trx_2';
XA ROLLBACK 'bulk_trx_1';
include/rpl_restart_server.inc [server_number=1]
connection slave;
include/start_slave.inc
connection master;
*** '3-stmt','3-row' xa-transactions must be in the list ***
XA RECOVER;
formatID gtrid_length bqual_length data
1 6 0 3-stmt
1 5 0 3-row
XA COMMIT '3-stmt';
XA ROLLBACK '3-row';
include/sync_slave_sql_with_master.inc
connection master;
connect master_conn2, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START '0123456789012345678901234567890123456789012345678901234567890124','0123456789012345678901234567890123456789012345678901234567890124',2147483647;
INSERT INTO d1.t VALUES (64);
XA END '0123456789012345678901234567890123456789012345678901234567890124','0123456789012345678901234567890123456789012345678901234567890124',2147483647;
XA PREPARE '0123456789012345678901234567890123456789012345678901234567890124','0123456789012345678901234567890123456789012345678901234567890124',2147483647;
disconnect master_conn2;
connection master;
connect master_conn3, 127.0.0.1,root,,test,$MASTER_MYPORT,;
XA START X'FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF',X'00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000',0;
INSERT INTO d1.t VALUES (0);
XA END X'FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF',X'00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000',0;
XA PREPARE X'FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF',X'00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000',0;
disconnect master_conn3;
connection master;
disconnect master_conn4;
connection master;
XA COMMIT '0123456789012345678901234567890123456789012345678901234567890124','0123456789012345678901234567890123456789012345678901234567890124',2147483647;
XA COMMIT X'FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF',X'00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000',0;
XA COMMIT 'RANDOM XID'
include/sync_slave_sql_with_master.inc
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn10;
XA START 'one_phase_10';
INSERT INTO d1.t VALUES (10);
INSERT INTO d2.t VALUES (10);
XA END 'one_phase_10';
XA COMMIT 'one_phase_10' ONE PHASE;
disconnect master_bulk_conn10;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn9;
XA START 'one_phase_9';
INSERT INTO d1.t VALUES (9);
INSERT INTO d2.t VALUES (9);
XA END 'one_phase_9';
XA COMMIT 'one_phase_9' ONE PHASE;
disconnect master_bulk_conn9;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn8;
XA START 'one_phase_8';
INSERT INTO d1.t VALUES (8);
INSERT INTO d2.t VALUES (8);
XA END 'one_phase_8';
XA COMMIT 'one_phase_8' ONE PHASE;
disconnect master_bulk_conn8;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn7;
XA START 'one_phase_7';
INSERT INTO d1.t VALUES (7);
INSERT INTO d2.t VALUES (7);
XA END 'one_phase_7';
XA COMMIT 'one_phase_7' ONE PHASE;
disconnect master_bulk_conn7;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn6;
XA START 'one_phase_6';
INSERT INTO d1.t VALUES (6);
INSERT INTO d2.t VALUES (6);
XA END 'one_phase_6';
XA COMMIT 'one_phase_6' ONE PHASE;
disconnect master_bulk_conn6;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn5;
XA START 'one_phase_5';
INSERT INTO d1.t VALUES (5);
INSERT INTO d2.t VALUES (5);
XA END 'one_phase_5';
XA COMMIT 'one_phase_5' ONE PHASE;
disconnect master_bulk_conn5;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn4;
XA START 'one_phase_4';
INSERT INTO d1.t VALUES (4);
INSERT INTO d2.t VALUES (4);
XA END 'one_phase_4';
XA COMMIT 'one_phase_4' ONE PHASE;
disconnect master_bulk_conn4;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn3;
XA START 'one_phase_3';
INSERT INTO d1.t VALUES (3);
INSERT INTO d2.t VALUES (3);
XA END 'one_phase_3';
XA COMMIT 'one_phase_3' ONE PHASE;
disconnect master_bulk_conn3;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn2;
XA START 'one_phase_2';
INSERT INTO d1.t VALUES (2);
INSERT INTO d2.t VALUES (2);
XA END 'one_phase_2';
XA COMMIT 'one_phase_2' ONE PHASE;
disconnect master_bulk_conn2;
connect master_bulk_conn$i, 127.0.0.1,root,,test,$MASTER_MYPORT,;
connection master_bulk_conn1;
XA START 'one_phase_1';
INSERT INTO d1.t VALUES (1);
INSERT INTO d2.t VALUES (1);
XA END 'one_phase_1';
XA COMMIT 'one_phase_1' ONE PHASE;
disconnect master_bulk_conn1;
connection master;
include/sync_slave_sql_with_master.inc
include/diff_tables.inc [master:d1.t, slave:d1.t]
include/diff_tables.inc [master:d2.t, slave:d2.t]
connection master;
DELETE FROM d1.t;
DELETE FROM d2.t;
DROP TABLE d1.t, d2.t;
DROP DATABASE d1;
DROP DATABASE d2;
DROP VIEW v_processlist;
include/sync_slave_sql_with_master.inc
include/rpl_end.inc
Reference in a new issue View git blame Copy permalink