mariadb/extra
Marko Mäkelä 6b6fa3cdb1 MDEV-18644: Support full_crc32 for page_compressed
This is a follow-up task to MDEV-12026, which introduced
innodb_checksum_algorithm=full_crc32 and a simpler page format.
MDEV-12026 did not enable full_crc32 for page_compressed tables,
which we will be doing now.

This is joint work with Thirunarayanan Balathandayuthapani.

For innodb_checksum_algorithm=full_crc32 we change the
page_compressed format as follows:

FIL_PAGE_TYPE: The most significant bit will be set to indicate
page_compressed format. The least significant bits will contain
the compressed page size, rounded up to a multiple of 256 bytes.

The checksum will be stored in the last 4 bytes of the page
(whether it is the full page or a page_compressed page whose
size is determined by FIL_PAGE_TYPE), covering all preceding
bytes of the page. If encryption is used, then the page will
be encrypted between compression and computing the checksum.
For page_compressed, FIL_PAGE_LSN will not be repeated at
the end of the page.

FSP_SPACE_FLAGS (already implemented as part of MDEV-12026):
We will store the innodb_compression_algorithm that may be used
to compress pages. Previously, the choice of algorithm was written
to each compressed data page separately, and one would be unable
to know in advance which compression algorithm(s) are used.

fil_space_t::full_crc32_page_compressed_len(): Determine if the
page_compressed algorithm of the tablespace needs to know the
exact length of the compressed data. If yes, we will reserve and
write an extra byte for this right before the checksum.

buf_page_is_compressed(): Determine if a page uses page_compressed
(in any innodb_checksum_algorithm).

fil_page_decompress(): Pass also fil_space_t::flags so that the
format can be determined.

buf_page_is_zeroes(): Check if a page is full of zero bytes.

buf_page_full_crc32_is_corrupted(): Renamed from
buf_encrypted_full_crc32_page_is_corrupted(). For full_crc32,
we always simply validate the checksum to the page contents,
while the physical page size is explicitly specified by an
unencrypted part of the page header.

buf_page_full_crc32_size(): Determine the size of a full_crc32 page.

buf_dblwr_check_page_lsn(): Make this a debug-only function, because
it involves potentially costly lookups of fil_space_t.

create_table_info_t::check_table_options(),
ha_innobase::check_if_supported_inplace_alter(): Do allow the creation
of SPATIAL INDEX with full_crc32 also when page_compressed is used.

commit_cache_norebuild(): Preserve the compression algorithm when
updating the page_compression_level.

dict_tf_to_fsp_flags(): Set the flags for page compression algorithm.
FIXME: Maybe there should be a table option page_compression_algorithm
and a session variable to back it?
2019-03-18 14:08:43 +02:00
..
aws_sdk move aws_sdk to extra/ 2019-02-21 14:48:04 +01:00
crc32-vpmsum Make MariaDB CRC32-lib platform independence (#780) 2018-06-01 14:06:01 +04:00
mariabackup MDEV-18644: Support full_crc32 for page_compressed 2019-03-18 14:08:43 +02:00
readline Merge 10.0.14 into 10.1 2014-10-15 12:59:13 +02:00
yassl Fixed compiler warnings 2018-11-21 16:57:18 +02:00
charset2html.c spelling fixes 2017-03-07 13:38:06 +04:00
CMakeLists.txt Merge 10.2 into 10.3 2018-12-14 14:05:25 +02:00
comp_err.c Changed database, tablename and alias to be LEX_CSTRING 2018-01-30 21:33:55 +02:00
innochecksum.cc MDEV-18644: Support full_crc32 for page_compressed 2019-03-18 14:08:43 +02:00
my_print_defaults.c my_print_defaults: remove --config-file/extra-file 2018-10-31 16:06:15 +01:00
mysql_waitpid.c MDEV-8012: Wrong exit code when asking for help 2016-06-12 22:47:18 +03:00
mysqld_safe_helper.c mysqld_safe_help - remove warning 2017-04-30 15:06:01 +04:00
perror.c Changed some MySQL names in messages to MariaDB 2018-12-09 20:49:05 +02:00
replace.c cleanup: create_temp_file() 2018-05-21 16:34:10 +00:00
resolve_stack_dump.c Changed some MySQL names in messages to MariaDB 2018-12-09 20:49:05 +02:00
resolveip.c Don't give warnings from perror or resolveip with safemalloc 2018-07-29 10:56:11 +03:00