mariadb/mysql-test/unstable-tests
Marko Mäkelä 56c60b2fc5 MDEV-16111 encryption.innodb_lotoftables failed in buildbot with wrong result
Remove the test, because it easily fails with a result difference.
Analysis by Thirunarayanan Balathandayuthapani:

By default, innodb_encrypt_tables=0.
1) Test case creates 100 tables in innodb_encrypt_1.
2) creates another 100 unencrypted tables (encryption=off) in innodb_encrypt_2
3) creates another 100 encrypted tables (encryption=on) in innodb_encrypt_3
4) enabling innodb_encrypt_tables=1 and checking that only
100 encrypted tables exist. (already we have 100 in dictionary)
5) opening all tables again (no idea why)
6) After that, set innodb_encrypt_tables=0 and wait for 100 tables
to be decrypted (already we have 100 unencrypted tables)
7) dropping all databases

Sporadic failure happens because after step 4, it could encrypt the
normal table too, because innodb_encryption_threads=4.

This test was added in MDEV-9931, which was about InnoDB startup being
slow due to all .ibd files being opened. There have been a number of
later fixes to this problem. Currently the latest one is
commit cad56fbaba, in which some tests
(in particular the test innodb.alter_kill) could fail if all InnoDB
.ibd files are read during startup. That could make this test redundant.

Let us remove the test, because it is big, slow, unreliable, and
does not seem to reliably catch the problem that all files are being
read on InnoDB startup.
2019-06-12 19:08:49 +03:00

562 lines
33 KiB
Text

##############################################################################
#
# List the test cases which, unlike tests from disabled.def files,
# can still be run on the current tree meaningfully, but are known
# or suspected to fail sporadically on different reasons.
#
# Most common reasons are either test failures observed in buildbot,
# or recent modifications to the tests which make their stability
# unknown.
#
# Tests included due to recent modifications are later removed from the
# list, if during a certain period they do not fail (and are not
# modified again). Tests included due to intermittent failures are
# removed when corresponding bug reports are closed.
#
# Separate the test case name and the comment with ':'.
#
# <suitename>.<testcasename> : MDEV-xxxxx - <comment>
#
# '*' wildcard in testcase names is supported.
#
# To use the list, run MTR with --skip-test-list=unstable-tests option.
#
##############################################################################
# Based on 10.1 5b035c84567b60c2ca680de96f5179a6dd3d9e61
main.alter_table_trans : MDEV-12084 - timeout
main.analyze_stmt : Modified in 10.1.39
main.analyze_stmt_slow_query_log : MDEV-12237 - Wrong result
main.auth_named_pipe : MDEV-14724 - System error 2
main.auto_increment_ranges_innodb : Modified in 10.1.38
main.bigint : Modified in 10.1.38
main.bootstrap : MDEV-19199 - error: 34304, status: 134, errno: 2
main.connect : Modified in 10.1.38
main.count_distinct2 : MDEV-11768 - timeout
main.create_delayed : MDEV-10605 - failed with timeout
main.create_drop_event : MDEV-16271 - Wrong result
main.create_drop_role : Modified in 10.1.39
main.ctype_big5 : Include file modified in 10.1.39
main.ctype_euckr : Include file modified in 10.1.39
main.ctype_gb2312 : Include file modified in 10.1.39
main.ctype_gbk : Include file modified in 10.1.39
main.ctype_latin1 : Include file modified in 10.1.39
main.ctype_sjis : Include file modified in 10.1.39
main.ctype_tis620 : Include file modified in 10.1.39
main.ctype_uca : Include file modified in 10.1.39
main.ctype_ucs : Include file modified in 10.1.39
main.ctype_ujis : Include file modified in 10.1.39
main.ctype_utf16 : MDEV-10675: timeout or extra warnings; include file modified in 10.1.39
main.ctype_utf16le : Include file modified in 10.1.39
main.ctype_utf16_uca : Include file modified in 10.1.39
main.ctype_utf32 : Include file modified in 10.1.39
main.ctype_utf32_uca : Include file modified in 10.1.39
main.ctype_utf8 : Include file modified in 10.1.39
main.ctype_utf8mb4 : Include file modified in 10.1.39
main.ctype_utf8mb4_heap : Include file modified in 10.1.39
main.ctype_utf8mb4_innodb : Include file modified in 10.1.39
main.ctype_utf8mb4_myisam : Include file modified in 10.1.39
main.ddl_i18n_koi8r : Modified in 10.1.39
main.ddl_i18n_utf8 : Modified in 10.1.39
main.debug_sync : MDEV-10607 - internal error
main.derived_opt : MDEV-11768 - timeout
main.dirty_close : MDEV-19368 - mysqltest failed but provided no output
main.events_1 : Modified in 10.1.39
main.events_2 : MDEV-13277 - Server crash
main.events_bugs : MDEV-12892 - Crash in fill_schema_processlist
main.events_slowlog : MDEV-12821 - Wrong result
main.events_restart : MDEV-12236 - Server shutdown problem
main.flush : Modified in 10.1.38
main.func_gconcat : Modified in 10.1.39
main.func_group_innodb : Modified in 10.1.38
main.func_hybrid_type : Modified in 10.1.39
main.func_math : Modified in 10.1.39
main.func_misc : Modified in 10.1.38
main.func_str : Modified in 10.1.39
main.func_time : Modified in 10.1.39
main.gis : MDEV-13411 - wrong result on P8; modified in 10.1.39
main.gis-precise : Modified in 10.1.39
main.gis_notembedded : Added in 10.1.39
main.grant4 : Modified in 10.1.39
main.grant5 : Modified in 10.1.38
main.host_cache_size_functionality : MDEV-10606 - sporadic failure on shutdown
main.huge_frm-6224 : Modified in 10.1.38
main.index_intersect_innodb : MDEV-10643 - failed with timeout
main.index_merge_innodb : MDEV-7142 - Wrong execution plan, timeout with valgrind; modified in 10.1.39
main.index_merge_myisam : Include files modified in 10.1.39
main.information_schema_prepare : Added in 10.1.39
main.innodb_mysql_lock : MDEV-7861 - sporadic lock detection failure
main.kill_processlist-6619 : MDEV-10793 - wrong result in processlist; modified in 10.1.39
main.loaddata : MDEV-19368 - mysqltest failed but provided no output; modified in 10.1.39
main.lock : Modified in 10.1.38
main.lock_multi : Modified in 10.1.38
main.lock_sync : Modified in 10.1.38
main.log_slow : MDEV-13263 - Wrong result; modified in 10.1.39
main.log_slow_debug : Added in 10.1.39
main.log_tables-big : MDEV-13408 - wrong result
main.mdev-504 : MDEV-10607 - sporadic "can't connect"
main.mdev375 : MDEV-10607 - sporadic "can't connect"
main.mdev_19276 : Added in 10.1.39
main.merge : MDEV-10607 - sporadic "can't connect"
main.multi_update : Modified in 10.1.39
main.multi_update_big : Added in 10.1.39
main.mysql : Modified in 10.1.39
main.mysql_client_test : MDEV-19369 - error: 5888, status: 23, errno: 2
main.mysql_client_test_comp : MDEV-19369 - error: 5888, status: 23, errno: 2
main.mysql_client_test_nonblock : MDEV-15096 - exec failed
main.mysql_upgrade_noengine : MDEV-14355 - Plugin is busy
main.mysqlbinlog_row_minimal : Modified in 10.1.38
main.mysqld--help : Modified in 10.1.39
main.mysqldump : Modified in 10.1.38
main.mysqldump-compat : Modified in 10.1.39
main.mysqlhotcopy_myisam : MDEV-10995 - test hangs on debug build
main.mysqlslap : MDEV-11801 - timeout
main.mysqltest : MDEV-9269 - fails on Alpha
main.olap : Modified in 10.1.39
main.old-mode : MDEV-19373 - Wrong result
main.order_by_optimizer_innodb : MDEV-10683 - wrong execution plan
main.partition : Modified in 10.1.39
main.partition_debug_sync : MDEV-15669 - Deadlock found when trying to get lock
main.partition_innodb : Modified in 10.1.39
main.partition_innodb_plugin : MDEV-12901 - Valgrind warnings
main.ps : MDEV-11017 - sporadic wrong Prepared_stmt_count; modified in 10.1.39
main.query_cache : MDEV-12895 - Wrong result
main.query_cache_debug : MDEV-15281 - Resize or similar command in progress
main.range_innodb : Modified in 10.1.38
main.range_vs_index_merge_innodb : MDEV-15283 - Server has gone away
main.read_only : Modified in 10.1.38
main.row-checksum : Modified in 10.1.38
main.set_statement : MDEV-13183 - Wrong result
main.show_explain : MDEV-10674 - sporadic failure
main.sp : Modified in 10.1.39
main.sp_notembedded : MDEV-10607 - internal error; modified in 10.1.39
main.sp-security : MDEV-10607 - sporadic "can't connect"
main.sp_trans : Modified in 10.1.39
main.sp-ucs2 : Modified in 10.1.39
main.ssl_verify_ip : Added in 10.1.39
main.statistics : Modified in 10.1.39
main.stat_tables : Modified in 10.1.39
main.stat_tables_par_innodb : MDEV-14155 - wrong rounding
main.status : MDEV-8510 - sporadic wrong result
main.status2 : Modified in 10.1.39
main.subselect_innodb : MDEV-10614 - sporadic wrong results
main.subselect_mat : Modified in 10.1.38
main.subselect_sj : Modified in 10.1.39
main.subselect2 : Modified in 10.1.38
main.tc_heuristic_recover : MDEV-15200 - wrong error on mysqld_stub_cmd
main.timezone2 : Modified in 10.1.39
main.type_bit : Modified in 10.1.39
main.type_blob : MDEV-15195 - Wrong result
main.type_date : Modified in 10.1.39
main.type_datetime_hires : MDEV-10687 - timeout
main.type_decimal : Modified in 10.1.39
main.type_year : Modified in 10.1.39
main.union : Modified in 10.1.38
main.update_innodb : Modified in 10.1.39
main.userstat : Modified in 10.1.39
main.view : Modified in 10.1.39
main.view_grant : Modified in 10.1.39
main.wait_timeout : Lost connection to MySQL server during query
main.xa : MDEV-11769 - lock wait timeout
#----------------------------------------------------------------
archive.archive_bitfield : MDEV-11771 - Extra warning
archive.archive_eits : Added in 10.1.39
archive.archive_symlink : MDEV-12170 - unexpected error on rmdir
archive.discover : MDEV-10510 - Table is marked as crashed
archive.mysqlhotcopy_archive : MDEV-14726 - Table is marked as crashed
archive-test_sql_discovery.discover : MDEV-16817 - Table marked as crashed
#----------------------------------------------------------------
binlog.binlog_base64_flag : Modified in 10.1.38
binlog.binlog_commit_wait : MDEV-10150 - Error: too much time elapsed
binlog.binlog_innodb_stm : Added in 10.1.39
binlog.binlog_killed : MDEV-12925 - Wrong result
binlog.binlog_mysqlbinlog2 : Modified in 10.1.39
binlog.binlog_mysqlbinlog_row_frag : Added in 10.1.38
binlog.binlog_xa_recover : MDEV-8517 - Extra checkpoint
#----------------------------------------------------------------
binlog_encryption.binlog_xa_recover : MDEV-12908 - Extra checkpoint
binlog_encryption.encrypted_master : MDEV-12906 - Failed to sync
binlog_encryption.rpl_parallel : MDEV-10653 - Timeout
binlog_encryption.rpl_relayrotate : MDEV-15194 - Timeout
binlog_encryption.rpl_semi_sync : MDEV-11220 - Wrong result, MDEV-11673 - Valgrind warning
binlog_encryption.rpl_ssl : MDEV-14507 - Timeout on SLES 11.4
binlog_encryption.rpl_stm_relay_ign_space : MDEV-19375 - Test assertion failed in assertion.inc
binlog_encryption.rpl_typeconv : MDEV-14362 - Lost connection to MySQL server during query
binlog.load_data_stm_view : MDEV-16948 - Wrong result
#----------------------------------------------------------------
connect.part_table : Modified in 10.1.38
connect.pivot : MDEV-14803 - failed to discover table
connect.zip : MDEV-13884 - Wrong result
#----------------------------------------------------------------
encryption.create_or_replace : MDEV-16115 - Trying to access tablespace
encryption.debug_key_management : MDEV-13841 - Timeout on wait condition
encryption.encrypt_and_grep : MDEV-13765 - Wrong result
encryption.innodb-bad-key-change2 : MDEV-19118 - Can't connect through socket
encryption.innodb-checksum-algorithm : Modified in 10.1.38
encryption.innodb-compressed-blob : MDEV-14728 - Unable to get certificate
encryption.innodb-encryption-alter : Modified in 10.1.39
encryption.innodb_encryption_discard_import : MDEV-16116 - Wrong result
encryption.innodb_encryption-page-compression : MDEV-12630 - crash or assertion failure
encryption.innodb_encryption_row_compressed : MDEV-16113 - Crash
encryption.innodb_first_page : MDEV-10689 - Crash
encryption.innodb-first-page-read : MDEV-14356 - Timeout on wait condition
encryption.innodb-force-corrupt : Modified in 10.1.38
encryption.innodb-page_encryption : MDEV-10641 - mutex problem
encryption.innodb-read-only : MDEV-14728 - Unable to get certificate; MDEV-16563 - Crash on startup
encryption.innodb-redo-badkey : MDEV-12898 - Server hang on startup
encryption.innodb-remove-encryption : MDEV-16493 - Timeout in wait condition
encryption.innodb_scrub : MDEV-8139 - scrubbing tests need fixing
encryption.innodb_scrub_background : MDEV-8139 - scrubbing tests need fixing
encryption.innodb_scrub_compressed : MDEV-8139 - scrubbing tests need fixing
#----------------------------------------------------------------
engines/iuds.* : Not maintained in timely manner
engines/funcs.* : Not maintained in timely manner
engines/rr_trx.* : MDEV-10998 - tests not maintained
#----------------------------------------------------------------
federated.federated_bug_35333 : MDEV-13410 - Wrong result
federated.federated_bug_585688 : MDEV-12907 - Valgrind, MDEV-14805 - server crash
federated.federated_innodb : MDEV-10617, MDEV-10417 - Wrong checksum, timeouts, fails on Mips
federated.federated_partition : MDEV-10417 - Fails on Mips
federated.federated_transactions : MDEV-10617, MDEV-10417 - Wrong checksum, timeouts, fails on Mips
federated.federatedx : MDEV-10617 - Wrong checksum, timeouts
#----------------------------------------------------------------
funcs_1.memory_views : MDEV-11773 - timeout
funcs_1.processlist_priv_no_prot : Include file modified in 10.1.39
funcs_1.processlist_priv_ps : Include file modified in 10.1.39
funcs_1.processlist_val_no_prot : MDEV-11223 - Wrong result; include file modified in 10.1.39
funcs_1.processlist_val_ps : MDEV-12175 - Wrong plan; include file modified in 10.1.39
funcs_2.memory_charset : MDEV-10290 - Timeout
funcs_2.myisam_charset : MDEV-11535 - Timeout
funcs_2/charset.* : MDEV-10999 - test not maintained
#----------------------------------------------------------------
galera.* : The suite was enabled in 10.1.27 and is still unstable
galera_3nodes.* : The suite has not been stabilized yet
#----------------------------------------------------------------
innodb.alter_candidate_key : Added in 10.1.38
innodb.alter_crash : Added in 10.1.39
innodb.binlog_consistent : MDEV-10618 - Server fails to start
innodb.doublewrite : MDEV-12905 - Lost connection to MySQL server
innodb.foreign-keys : Modified in 10.1.39
innodb.foreign_key : Modified in 10.1.39
innodb.group_commit_crash : MDEV-11770 - checksum mismatch
innodb.group_commit_crash_no_optimize_thread : MDEV-11770 - checksum mismatch
innodb.innodb_28867993 : Added in 10.1.38
innodb.innodb-64k-crash : MDEV-13872 - Failure and crash on startup
innodb.innodb-alter : Modified in 10.1.38
innodb.innodb-alter-debug : MDEV-13182 - InnoDB: adjusting FSP_SPACE_FLAGS; modified in 10.1.38
innodb.innodb-alter-nullable : Modified in 10.1.39
innodb.innodb-alter-table : MDEV-10619 - Testcase timeout
innodb.innodb-blob : MDEV-12053 - Client crash
innodb.innodb_bug14147491 : MDEV-11808 - wrong error codes
innodb.innodb_bug30423 : MDEV-7311 - Wrong number of rows in the plan
innodb.innodb_bug48024 : MDEV-14352 - Assertion failure
innodb.innodb-corrupted-table : Modified in 10.1.39
innodb.innodb-fk : MDEV-13832 - Assertion failure on shutdown
innodb.innodb-index : Modified in 10.1.39
innodb.innodb_max_recordsize_64k : MDEV-15203 - wrong result
innodb.innodb_monitor : MDEV-10939 - Testcase timeout
innodb.innodb-page_compression_default : MDEV-14121 - Assertion failure
innodb.innodb-page_compression_lzma : MDEV-14353 - wrong result on Fedora 25
innodb.innodb-page_compression_zip : MDEV-10641 - mutex problem
innodb.innodb_simulate_comp_failures : MDEV-18417 - ASAN failures
innodb.innodb_stats : MDEV-10682 - wrong result
innodb.innodb_sys_semaphore_waits : MDEV-10331 - wrong result
innodb.innodb-table-online : Modified in 10.1.38
innodb.innodb-truncate : Modified in 10.1.39
innodb.innodb-virtual-columns : Modified in 10.1.38
innodb.innodb_zip_innochecksum : Modified in 10.1.38
innodb.innodb_zip_innochecksum2 : MDEV-13882 - Warning: difficult to find free blocks
innodb.log_file_size : MDEV-15668 - Not found pattern
innodb.recovery_shutdown : MDEV-15671 - Warning: database page corruption
innodb.row_format_redundant : MDEV-15192 - Trying to access missing tablespace
innodb.table_definition_cache_debug : MDEV-14206 - Extra warning
innodb.table_flags : MDEV-19374 - Server failed to restart
innodb.xa_debug : Added in 10.1.39
innodb.xa_recovery : MDEV-15279 - mysqld got exception
#----------------------------------------------------------------
innodb_fts.innodb-fts-fic : MDEV-14154 - Assertion failure
innodb_fts.innodb_fts_misc_debug : MDEV-14156 - Unexpected warning
#----------------------------------------------------------------
maria.insert_select : MDEV-12757 - Timeout
maria.insert_select-7314 : MDEV-16492 - Timeout
maria.maria : MDEV-14430 - Wrong result
#----------------------------------------------------------------
mariabackup.absolute_ibdata_paths : Modified in 10.1.39
mariabackup.encrypted_page_compressed : Added in 10.1.38
mariabackup.encrypted_page_corruption : Added in 10.1.38
mariabackup.huge_lsn : Opt file modified in 10.1.38
mariabackup.incremental_encrypted : MDEV-15667 - Timeout
mariabackup.mdev-14447 : MDEV-15201 - Timeout
mariabackup.page_compression_level : Added in 10.1.39
mariabackup.unencrypted_page_compressed : Added in 10.1.38
mariabackup.xb_compressed_encrypted : MDEV-14812 - Segfault
mariabackup.xb_partition : MDEV-17584 - Crash on shutdown
#----------------------------------------------------------------
mroonga/storage.column_datetime_32bit_2038 : Wrong result on Alpha
mroonga/storage.column_datetime_32bit_before_unix_epoch : Wrong result on Alpha
mroonga/storage.column_datetime_32bit_max : Wrong result on Alpha
mroonga/storage.column_datetime_32bit_out_of_range : Wrong result on Alpha
mroonga/storage.index_multiple_column_unique_date_32bit_equal : Wrong result on Alpha
mroonga/storage.index_multiple_column_unique_date_order_32bit_desc : Wrong result on Alpha
mroonga/storage.index_multiple_column_unique_datetime_index_read : MDEV-8643 - valgrind warnings
mroonga/storage.repair_table_no_index_file : MDEV-9364 - wrong result, MDEV-14807 - wrong error message
mroonga/wrapper.repair_table_no_index_file : MDEV-14807 - Wrong error message
#----------------------------------------------------------------
multi_source.gtid : MDEV-10417 - Fails on Mips
multi_source.info_logs : MDEV-10042 - Wrong result, MDEV-12629 - Valgrind warnings
multi_source.multisource : MDEV-10417 - Fails on Mips
multi_source.reset_slave : MDEV-10690 - wrong result
multi_source.simple : MDEV-4633 - Wrong slave status output
multi_source.status_vars : MDEV-4632 - failed while waiting for Slave_received_heartbeats
#----------------------------------------------------------------
parts.partition_alter2_2_maria : MDEV-14364 - Lost connection to MySQL server during query
parts.partition_auto_increment_archive : MDEV-16491 - Table marked as crashed
parts.partition_auto_increment_maria : MDEV-14430 - Wrong result
parts.partition_auto_increment_max : Added in 10.1.39
parts.partition_exch_qa_10 : MDEV-11765 - wrong result
parts.partition_innodb_status_file : MDEV-12901 - Valgrind
#----------------------------------------------------------------
perfschema.connect_attrs : MDEV-17283 - Wrong result
perfschema.dml_setup_instruments : Modified in 10.1.38
perfschema.func_file_io : MDEV-5708 - fails for s390x
perfschema.func_mutex : MDEV-5708 - fails for s390x
perfschema.hostcache_ipv6_ssl : MDEV-10696 - crash on shutdown
perfschema.privilege_table_io : MDEV-13184 - Extra lines
perfschema.rpl_gtid_func : MDEV-16897 - Wrong result
perfschema.socket_connect : Modified in 10.1.38
perfschema.socket_summary_by_event_name_func : MDEV-10622 - Socket summary tables do not match
perfschema.stage_mdl_global : MDEV-11803 - wrong result on slow builders
perfschema.stage_mdl_procedure : MDEV-11545 - Wrong result
perfschema.stage_mdl_table : MDEV-12638 - Wrong result
perfschema.threads_mysql : MDEV-10677 - sporadic wrong result
perfschema_stress.* : MDEV-10996 - tests not maintained
#----------------------------------------------------------------
plugins.feedback_plugin_send : MDEV-7932 - ssl failed for url
plugins.pam : Modified in 10.1.39
plugins.server_audit : MDEV-9562 - crashes on sol10-sparc
plugins.thread_pool_server_audit : MDEV-9562 - crashes on sol10-sparc
#----------------------------------------------------------------
roles.create_and_grant_role : MDEV-11772 - wrong result
roles.flush_roles-17898 : Modified in 10.1.39
#----------------------------------------------------------------
rpl.circular_serverid0 : MDEV-19372 - ASAN heap-use-after-free
rpl.kill_race_condition : MDEV-19370 - Wrong value for slave parameter; added in 10.1.39
rpl.last_insert_id : MDEV-10625 - warnings in error log
rpl.rpl_auto_increment : MDEV-10417 - Fails on Mips
rpl.rpl_auto_increment_bug45679 : MDEV-10417 - Fails on Mips
rpl.rpl_auto_increment_update_failure : MDEV-10625 - warnings in error log
rpl.rpl_binlog_index : MDEV-9501 - Warning: failed registering on master
rpl.rpl_colSize : MDEV-16112 - Server crash
rpl.rpl_ddl : MDEV-10417 - Fails on Mips
rpl.rpl_domain_id_filter_io_crash : MDEV-14357 - Wrong result
rpl.rpl_domain_id_filter_master_crash : MDEV-19043 - Warnings/errors
rpl.rpl_domain_id_filter_restart : MDEV-10684 - Wrong result; MDEV-19043 - Warnings/errors
rpl.rpl_drop_db_fail : MDEV-16898 - Slave fails to start
rpl.rpl_get_lock : MDEV-19368 - mysqltest failed but provided no output
rpl.rpl_gtid_basic : MDEV-10681 - server startup problem
rpl.rpl_gtid_crash : MDEV-9501 - Warning: failed registering on master
rpl.rpl_gtid_delete_domain : MDEV-14463 - Timeout in include
rpl.rpl_gtid_mdev9033 : MDEV-10680 - warnings
rpl.rpl_gtid_reconnect : MDEV-14497 - Timeout
rpl.rpl_gtid_stop_start : MDEV-10629 - Crash on shutdown, MDEV-12629 - Valgrind warnings
rpl.rpl_gtid_until : MDEV-10625 - warnings in error log
rpl.rpl_idempotency : Modified in 10.1.38
rpl.rpl_innodb_bug30888 : MDEV-10417 - Fails on Mips
rpl.rpl_insert : MDEV-9329 - Fails on Ubuntu/s390x
rpl.rpl_insert_delayed : MDEV-9329 - Fails on Ubuntu/s390x
rpl.rpl_insert_id : MDEV-15197 - Wrong result
rpl.rpl_insert_id_pk : MDEV-16567 - Assertion failure
rpl.rpl_insert_ignore : MDEV-14365 - Lost connection to MySQL server during query
rpl.rpl_invoked_features : MDEV-10417 - Fails on Mips
rpl.rpl_mariadb_slave_capability : MDEV-11018 - sporadic wrong events in binlog
rpl.rpl_mdev12179 : MDEV-19043 - Warnings/errors
rpl.rpl_mdev6020 : MDEV-10417 - Fails on Mips
rpl.rpl_mixed_mixing_engines : MDEV-14489 - Sync slave with master failed
rpl.rpl_non_direct_mixed_mixing_engines : MDEV-14489 - Sync slave with master failed
rpl.rpl_non_direct_row_mixing_engines : MDEV-16561 - Timeout in master pos wait
rpl.rpl_non_direct_stm_mixing_engines : MDEV-14489 - Sync slave with master failed
rpl.rpl_parallel : MDEV-10653 - Timeouts
rpl.rpl_parallel_mdev6589 : MDEV-12979 - Assertion failure
rpl.rpl_parallel_multilevel2 : MDEV-14723 - Timeout
rpl.rpl_parallel_optimistic : MDEV-10511 - Timeout
rpl.rpl_parallel_retry : MDEV-11119 - Server crash
rpl.rpl_parallel_temptable : MDEV-10356 - Crash in close_thread_tables
rpl.rpl_partition_innodb : MDEV-10417 - Fails on Mips
rpl.rpl_password_boundaries : MDEV-11534 - Slave IO warnings
rpl.rpl_rewrt_db : Modified in 10.1.39
rpl.rpl_row_basic_11bugs : MDEV-12171 - Server failed to start
rpl.rpl_row_basic_2myisam : MDEV-13875 - command "diff_files" failed
rpl.rpl_row_big_table_id : Added in 10.1.38
rpl.rpl_row_drop_create_temp_table : MDEV-14487 - Wrong result
rpl.rpl_row_img_blobs : MDEV-13875 - command "diff_files" failed
rpl.rpl_row_img_eng_min : MDEV-13875 - command "diff_files" failed
rpl.rpl_row_img_eng_noblob : MDEV-13875 - command "diff_files" failed
rpl.rpl_row_index_choice : MDEV-15196 - Slave crash
rpl.rpl_row_sp001 : MDEV-9329 - Fails on Ubuntu/s390x
rpl.rpl_semi_sync : MDEV-11220 - Wrong result
rpl.rpl_semi_sync_after_sync : MDEV-14366 - Wrong result
rpl.rpl_semi_sync_after_sync_row : MDEV-14366 - Wrong result
rpl.rpl_semi_sync_event_after_sync : MDEV-11806 - warnings
rpl.rpl_semi_sync_uninstall_plugin : MDEV-7140 - Wrong plugin status
rpl.rpl_semi_sync_wait_point : MDEV-11807 - timeout in wait condition
rpl.rpl_show_slave_hosts : MDEV-10681 - server startup problem
rpl.rpl_skip_replication : MDEV-9268 - Fails with timeout in sync_slave_with_master on Alpha
rpl.rpl_slave_grp_exec : MDEV-10514 - Unexpected deadlock
rpl.rpl_slave_invalid_external_user : Added in 10.1.39
rpl.rpl_start_stop_slave : MDEV-13567 - Replication failure
rpl.rpl_stm_mixing_engines : MDEV-14489 - Sync slave with master failed
rpl.rpl_stm_relay_ign_space : MDEV-14360 - Test assertion
rpl.rpl_sync : MDEV-10633 - Database page corruption
rpl.rpl_temporary_error2 : MDEV-10634 - Wrong number of retries
rpl.rpl_test_framework : MDEV-19368 - mysqltest failed but provided no output
rpl.rpl_trigger : MDEV-18055 - Wrong result
rpl.sec_behind_master-5114 : MDEV-13878 - Wrong result
rpl/extra/rpl_tests.* : MDEV-10994 - tests not maintained
#----------------------------------------------------------------
spider.* : MDEV-9329 - tests are too memory-consuming
spider/bg.direct_aggregate : MDEV-7098 - Trying to unlock mutex that wasn't locked
spider/bg.direct_aggregate_part : MDEV-7098 - Trying to unlock mutex that wasn't locked
spider/bg.ha : MDEV-9329 - failures on s390x
spider/bg.ha_part : MDEV-9329 - Fails on Ubuntu/s390x
spider/bg.spider_fixes : MDEV-7098 -Mutex problem, MDEV-9329 - failures on s390x
spider/bg.spider_fixes_part : MDEV-7098 - Trying to unlock mutex that wasn't locked
spider/bg.spider3_fixes : MDEV-12639 - Packets out of order
spider/bg.vp_fixes : MDEV-9329 - Fails on Ubuntu/s390x
spider/handler.* : MDEV-10987, MDEV-10990 - Tests have not been maintained
#----------------------------------------------------------------
sphinx.* : MDEV-10986 - Tests have not been maintained
#----------------------------------------------------------------
storage_engine* : Tests are not always timely maintained
#----------------------------------------------------------------
stress.ddl_innodb : MDEV-10635 - Testcase timeout
#----------------------------------------------------------------
sys_vars.autocommit_func2 : MDEV-9329 - Fails on Ubuntu/s390x
sys_vars.delayed_insert_limit_func : MDEV-17683 - Wrong result; modified in 10.1.38
sys_vars.keep_files_on_create_basic : MDEV-10676 - timeout
sys_vars.log_slow_admin_statements_func : MDEV-12235 - Server crash
sys_vars.rpl_init_slave_func : MDEV-10149 - wrong results
sys_vars.sql_low_priority_updates_func : Modified in 10.1.38
sys_vars.table_definition_cache_basic : Modified in 10.1.38
sys_vars.thread_cache_size_func : MDEV-11775 - Wrong result
sys_vars.thread_stack_basic : Modified in 10.1.39
sys_vars.transaction_prealloc_size_bug27322 : Modified in 10.1.39
sys_vars.wait_timeout_func : MDEV-12896 - Wrong result
sys_vars.wsrep_sst_method_basic : Modified in 10.1.38
#----------------------------------------------------------------
tokudb.change_column_all_1000_10 : MDEV-12640 - Crash
tokudb.change_column_bin : MDEV-12640 - Crash
tokudb.change_column_char : MDEV-12822 - Lost connection to MySQL server
tokudb.cluster_filter : MDEV-10678 - Wrong execution plan
tokudb.cluster_filter_hidden : MDEV-10678 - Wrong execution plan
tokudb.cluster_filter_unpack_varchar : MDEV-10636 - Wrong execution plan
tokudb.dir_per_db : MDEV-11537 - Wrong result
tokudb.dir_per_db_rename_to_nonexisting_schema : MDEV-14359 - Directory not empty
tokudb.hotindex-insert-bigchar : MDEV-12640 - Crash
tokudb.hotindex-insert-0 : MDEV-15271 - Timeout
tokudb.hotindex-insert-1 : MDEV-13870 - Lost connection to MySQL server
tokudb.hotindex-update-0 : MDEV-15198 - Timeout
tokudb.hotindex-update-1 : MDEV-12640 - Crash
tokudb.locks-select-update-1 : MDEV-13406 - Lock wait timeout
tokudb.rows-32m-rand-insert : MDEV-12640 - Crash
tokudb.rows-32m-seq-insert : MDEV-12640 - Crash
tokudb.savepoint-5 : MDEV-15280 - Wrong result
tokudb.type_datetime : MDEV-15193 - Wrong result
tokudb_backup.* : MDEV-11001 - tests don't work
tokudb_bugs.PS-4979 : Added in 10.1.38
tokudb_bugs.PS-5158 : Added in 10.1.39
tokudb_bugs.PS-5163 : Added in 10.1.39
tokudb_bugs.checkpoint_lock : MDEV-10637 - Wrong processlist output
tokudb_bugs.checkpoint_lock_3 : MDEV-10637 - Wrong processlist output
tokudb_bugs.frm_store : MDEV-12823 - Valgrind
tokudb_bugs.frm_store2 : MDEV-12823 - Valgrind
tokudb_bugs.frm_store3 : MDEV-12823 - Valgrind
tokudb_bugs.xa : MDEV-11804 - Lock wait timeout
tokudb_rpl.* : MDEV-11001 - tests don't work
tokudb_sys_vars.* : MDEV-11001 - tests don't work
rpl-tokudb.* : MDEV-14354 - Tests fail with tcmalloc
#----------------------------------------------------------------
unit.ma_pagecache_consist_64kRD : MDEV-19367 - AddressSanitizer CHECK failed
unit.ma_pagecache_consist_64kWR : MDEV-19367 - AddressSanitizer CHECK failed
unit.ma_test_loghandler : MDEV-10638 - record read not ok
#----------------------------------------------------------------
vcol.not_supported : MDEV-10639 - Testcase timeout
vcol.vcol_keys_innodb : MDEV-10639 - Testcase timeout
vcol.vcol_misc : MDEV-16651 - Wrong error message
vcol.wrong_arena : Modified in 10.1.39
#----------------------------------------------------------------
wsrep.foreign_key : MDEV-14725 - WSREP has not yet prepared node
wsrep.mdev_6832 : MDEV-14195 - Failure upon check-testcase
wsrep.pool_of_threads : MDEV-17345 - WSREP has not yet prepared node for application use
wsrep.variables : MDEV-17585 - Deadlock
wsrep_info.plugin : MDEV-12909 - Wrong result