mirror of
https://github.com/MariaDB/server.git
synced 2025-02-01 19:41:47 +01:00
1a96259191
- WL#3240 "log DROP TABLE in Maria" - similarly, log RENAME TABLE, REPAIR/OPTIMIZE TABLE, and DELETE no_WHERE_clause (== the DELETE which just truncates the files) - create_rename_lsn added to MARIA_SHARE's state - all these operations (except DROP TABLE) also update the table's create_rename_lsn, which is needed for the correctness of Recovery (see function comment of _ma_repair_write_log_record() in ma_check.c) - write a COMMIT record when transaction commits. - don't log REDOs/UNDOs if this is an internal temporary table like inside ALTER TABLE (I expect this to be a big win). There was already no logging for user-created "CREATE TEMPORARY" tables. - don't fsync files/directories if the table is not transactional - in translog_write_record(), autogenerate a 2-byte-id for the table and log the "id->name" pair (LOGREC_FILE_ID); log LOGREC_LONG_TRANSACTION_ID; automatically store the table's 2-byte-id in any log record. - preparations for Checkpoint: translog_get_horizon(); pausing Checkpoint when some dirty pages are unknown; capturing trn->rec_lsn, trn->first_undo_lsn for Checkpoint and log's low-water-mark computing. - assertions, comments. storage/maria/Makefile.am: more files to build storage/maria/ha_maria.cc: - logging a REPAIR log record if REPAIR/OPTIMIZE was successful. - ha_maria::data_file_type does not have to be set in every info() call, just do it once in open(). - if caller said that transactionality can be disabled (like if caller is ALTER TABLE) i.e. thd->transaction.on==FALSE, then we temporarily disable transactionality of the table in external_lock(); that will ensure that no REDOs/UNDOs are logged for this possibly massive write operation (they are not needed, as if any write fails, the table will be dropped). We re-enable in external_lock(F_UNLCK), which in ALTER TABLE happens before the tmp table replaces the original one (which is good, as thus the final table will have a REDO RENAME and a correct create_rename_lsn). - when we commit we also have to write a log record, so trnman_commit_trn() calls become ma_commit() calls - at end of engine's initialization, we are potentially entering a multi-threaded dangerous world (clients are going to be accepted) and so some assertions of mutex-owning become enforceable, for that we set maria_multi_threaded=TRUE (see ma_control_file.c) storage/maria/ha_maria.h: new member ha_maria::save_transactional (see also ha_maria.cc) storage/maria/ma_blockrec.c: - fixing comments according to discussion with Monty - if a table is transactional but temporarily non-transactional (like in ALTER TABLE), we need to give a sensible LSN to the pages (and, if we give 0, pagecache asserts). - translog_write_record() now takes care of storing the share's 2-byte-id in the log record storage/maria/ma_blockrec.h: fixing comment according to discussion with Monty storage/maria/ma_check.c: When REPAIR/OPTIMIZE modify the data/index file, if this is a transactional table, they must sync it; if they remove files or rename files, they must sync the directory, so that everything is durable. This is just applying to REPAIR/OPTIMIZE the logic already implemented in CREATE/DROP/RENAME a few months ago. Adding a function to write a LOGREC_REPAIR_TABLE at end of REPAIR/OPTIMIZE (called only by ha_maria, not by maria_chk), and to update the table's create_rename_lsn. storage/maria/ma_close.c: fix for a future bug storage/maria/ma_control_file.c: ensuring that if Maria is running in multi-threaded mode, anybody wanting to write to the control file and update last_checkpoint_lsn/last_logno owns the log's lock. storage/maria/ma_control_file.h: see ma_control_file.c storage/maria/ma_create.c: when creating a table: - sync it and its directory only if this is a transactional table and there is a log (no point in syncing in maria_chk) - decouple the two uses of linkname/linkname_ptr (for index file and for data file) into more variables, as we need to know all links until the moment we write the LOGREC_CREATE_TABLE. - set share.data_file_type early so that _ma_initialize_data_file() knows it (Monty's bugfix so that a table always has at least a bitmap page when it is created; so data-file is not 0 bytes anymore). - log a LOGREC_CREATE_TABLE; it contains the bytes which we have just written to the index file's header. Update table's create_rename_lsn. - syncing of kfile had been bugified in a previous merge, correcting - syncing of dfile is now needed as it's not empty anymore - in _ma_initialize_data_file(), use share's block_size and not the global one. This is a gratuitous change, both variables are equal, just that I find it more future-proof to use share-bound variable rather than global one. storage/maria/ma_delete_all.c: log a LOGREC_DELETE_ALL record when doing ma_delete_all_rows(); update create_rename_lsn then. storage/maria/ma_delete_table.c: - logging LOGREC_DROP_TABLE; knowing if this is needed, requires knowing if the table is transactional, which requires opening the table. - we need to sync directories only if the table is transactional storage/maria/ma_extra.c: questions storage/maria/ma_init.c: when maria_end() is called, engine is not multithreaded storage/maria/ma_loghandler.c: - translog_inited has to be visible to ma_create() (see how it is used in ma_create()) - checkpoint record will be a single record, not three - no REDO for TRUNCATE (TRUNCATE calls ma_create() internally so will log a REDO_CREATE) - adding REDO for DELETE no_WHERE_clause (fast DELETE of all rows by truncating the files), REPAIR. - MY_WAIT_IF_FULL to wait&retry if a log write hits a full disk - in translog_write_record(), if MARIA_SHARE does not yet have a 2-byte-id, generate one for it and log LOGREC_FILE_ID; automatically store this short id into log records. - in translog_write_record(), if transaction has not logged its long trid, log LOGREC_LONG_TRANSACTION_ID. - For Checkpoint, we need to know the current end-of-log: adding translog_get_horizon(). - For Control File, adding an assertion that the thread owns the log's lock (control file is protected by this lock) storage/maria/ma_loghandler.h: Changes in log records (see ma_loghandler.c). new prototypes, new functions. storage/maria/ma_loghandler_lsn.h: adding a type LSN_WITH_FLAGS especially for TRN::first_undo_lsn, where the most significant byte is used for flags. storage/maria/ma_open.c: storing the create_rename_lsn in the index file's header (in the state, precisely) and retrieving it from there. storage/maria/ma_pagecache.c: - my set_if_bigger was wrong, correcting it - if the first_in_switch list is not empty, it means that changed_blocks misses some dirty pages, so Checkpoint cannot run and needs to wait. A variable missing_blocks_in_changed_list is added to tell that (should it be named missing_blocks_in_changed_blocks?) - pagecache_collect_changed_blocks_with_lsn() now also tells the minimum rec_lsn (needed for low-water mark computation). storage/maria/ma_pagecache.h: see ma_pagecache.c storage/maria/ma_panic.c: comment storage/maria/ma_range.c: comment storage/maria/ma_rename.c: - logging LOGREC_RENAME_TABLE; knowing if this is needed, requires knowing if the table is transactional, which requires opening the table. - update create_rename_lsn - we need to sync directories only if the table is transactional storage/maria/ma_static.c: comment storage/maria/ma_test_all.sh: - tip for Valgrind-ing ma_test_all - do "export maria_path=somepath" before calling ma_test_all, if you want to run ma_test_all out of storage/maria (useful to have parallel runs, like one normal and one Valgrind, they must not use the same tables so need to run in different directories) storage/maria/maria_def.h: - state now contains, in memory and on disk, the create_rename_lsn - share now contains a 2-byte-id storage/maria/trnman.c: preparations for Checkpoint: capture trn->rec_lsn, trn->first_undo_lsn; minimum first_undo_lsn needed to know log's low-water-mark storage/maria/trnman.h: using most significant byte of first_undo_lsn to hold miscellaneous flags, for now TRANSACTION_LOGGED_LONG_ID. dummy_transaction_object is already declared in ma_static.c. storage/maria/trnman_public.h: dummy_transaction_object was declared in all files including trnman_public.h, while in fact it's a single object. new prototype storage/maria/unittest/ma_test_loghandler-t.c: update for new prototype storage/maria/unittest/ma_test_loghandler_multigroup-t.c: update for new prototype storage/maria/unittest/ma_test_loghandler_multithread-t.c: update for new prototype storage/maria/unittest/ma_test_loghandler_pagecache-t.c: update for new prototype storage/maria/ma_commit.c: function which wraps: - writing a LOGREC_COMMIT record (==commit on disk) - calling trnman_commit_trn() (=commit in memory) storage/maria/ma_commit.h: new header file .tree-is-private: this file is now needed to keep our tree private (don't push it to public trees). When 5.1 is merged into mysql-maria, we can abandon our maria-specific post-commit trigger; .tree_is_private will take care of keeping commit mails private. Don't push this file to public trees.
643 lines
21 KiB
C
643 lines
21 KiB
C
#include "../maria_def.h"
|
|
#include <stdio.h>
|
|
#include <errno.h>
|
|
#include <tap.h>
|
|
#include "../trnman.h"
|
|
|
|
extern my_bool maria_log_remove();
|
|
|
|
#ifndef DBUG_OFF
|
|
static const char *default_dbug_option;
|
|
#endif
|
|
static TRN *trn= &dummy_transaction_object;
|
|
|
|
#define PCACHE_SIZE (1024*1024*10)
|
|
|
|
#define LONG_BUFFER_SIZE (100 * 1024)
|
|
|
|
#ifdef LONG_LOG_TEST
|
|
#define LOG_FLAGS 0
|
|
#define LOG_FILE_SIZE (1024L*1024L)
|
|
#define ITERATIONS (1600*4)
|
|
#else
|
|
#define LOG_FLAGS TRANSLOG_SECTOR_PROTECTION | TRANSLOG_PAGE_CRC
|
|
#define LOG_FILE_SIZE (1024L*1024L*3L)
|
|
#define ITERATIONS 1600
|
|
#endif
|
|
|
|
/*
|
|
#define LOG_FLAGS 0
|
|
#define LOG_FILE_SIZE 1024L*1024L*1024L
|
|
#define ITERATIONS 181000
|
|
*/
|
|
|
|
/*
|
|
#define LOG_FLAGS 0
|
|
#define LOG_FILE_SIZE 1024L*1024L*3L
|
|
#define ITERATIONS 1600
|
|
*/
|
|
|
|
/*
|
|
#define LOG_FLAGS 0
|
|
#define LOG_FILE_SIZE 1024L*1024L*100L
|
|
#define ITERATIONS 65000
|
|
*/
|
|
|
|
/*
|
|
Check that the buffer filled correctly
|
|
|
|
SYNOPSIS
|
|
check_content()
|
|
ptr Pointer to the buffer
|
|
length length of the buffer
|
|
|
|
RETURN
|
|
0 - OK
|
|
1 - Error
|
|
*/
|
|
|
|
static my_bool check_content(byte *ptr, ulong length)
|
|
{
|
|
ulong i;
|
|
byte buff[2];
|
|
for (i= 0; i < length; i++)
|
|
{
|
|
if (i % 2 == 0)
|
|
int2store(buff, i >> 1);
|
|
if (ptr[i] != buff[i % 2])
|
|
{
|
|
fprintf(stderr, "Byte # %lu is %x instead of %x",
|
|
i, (uint) ptr[i], (uint) buff[i % 2]);
|
|
return 1;
|
|
}
|
|
}
|
|
return 0;
|
|
}
|
|
|
|
|
|
/*
|
|
Report OK for read operation
|
|
|
|
SYNOPSIS
|
|
read_ok()
|
|
rec the record header
|
|
*/
|
|
|
|
void read_ok(TRANSLOG_HEADER_BUFFER *rec)
|
|
{
|
|
char buff[80];
|
|
snprintf(buff, sizeof(buff), "read record type: %u LSN: (%lu,0x%lx)",
|
|
rec->type, (ulong) LSN_FILE_NO(rec->lsn),
|
|
(ulong) LSN_OFFSET(rec->lsn));
|
|
ok(1, buff);
|
|
}
|
|
|
|
/*
|
|
Read whole record content, and check content (put with offset)
|
|
|
|
SYNOPSIS
|
|
read_and_check_content()
|
|
rec The record header buffer
|
|
buffer The buffer to read the record in
|
|
skip Skip this number of bytes ot the record content
|
|
|
|
RETURN
|
|
0 - OK
|
|
1 - Error
|
|
*/
|
|
|
|
static my_bool read_and_check_content(TRANSLOG_HEADER_BUFFER *rec,
|
|
byte *buffer, uint skip)
|
|
{
|
|
DBUG_ASSERT(rec->record_length < LONG_BUFFER_SIZE * 2 + 7 * 2 + 2);
|
|
if (translog_read_record(rec->lsn, 0, rec->record_length, buffer, NULL) !=
|
|
rec->record_length)
|
|
return 1;
|
|
return check_content(buffer + skip, rec->record_length - skip);
|
|
}
|
|
|
|
|
|
int main(int argc __attribute__((unused)), char *argv[])
|
|
{
|
|
uint32 i;
|
|
uint32 rec_len;
|
|
uint pagen;
|
|
byte long_tr_id[6];
|
|
byte lsn_buff[23]=
|
|
{
|
|
0x55, 0xAA, 0x55, 0xAA, 0x55, 0xAA, 0x55, 0xAA,
|
|
0x55, 0xAA, 0x55, 0xAA, 0x55, 0xAA, 0x55, 0xAA,
|
|
0x55, 0xAA, 0x55, 0xAA, 0x55, 0xAA, 0x55
|
|
};
|
|
byte long_buffer[LONG_BUFFER_SIZE * 2 + LSN_STORE_SIZE * 2 + 2];
|
|
PAGECACHE pagecache;
|
|
LSN lsn, lsn_base, first_lsn;
|
|
TRANSLOG_HEADER_BUFFER rec;
|
|
LEX_STRING parts[TRANSLOG_INTERNAL_PARTS + 3];
|
|
struct st_translog_scanner_data scanner;
|
|
int rc;
|
|
|
|
MY_INIT(argv[0]);
|
|
|
|
bzero(&pagecache, sizeof(pagecache));
|
|
maria_data_root= ".";
|
|
if (maria_log_remove())
|
|
exit(1);
|
|
|
|
for (i= 0; i < (LONG_BUFFER_SIZE + LSN_STORE_SIZE * 2 + 2); i+= 2)
|
|
{
|
|
int2store(long_buffer + i, (i >> 1));
|
|
/* long_buffer[i]= (i & 0xFF); */
|
|
}
|
|
|
|
bzero(long_tr_id, 6);
|
|
#ifndef DBUG_OFF
|
|
#if defined(__WIN__)
|
|
default_dbug_option= "d:t:i:O,\\ma_test_loghandler.trace";
|
|
#else
|
|
default_dbug_option= "d:t:i:o,/tmp/ma_test_loghandler.trace";
|
|
#endif
|
|
if (argc > 1)
|
|
{
|
|
DBUG_SET(default_dbug_option);
|
|
DBUG_SET_INITIAL(default_dbug_option);
|
|
}
|
|
#endif
|
|
|
|
if (ma_control_file_create_or_open())
|
|
{
|
|
fprintf(stderr, "Can't init control file (%d)\n", errno);
|
|
exit(1);
|
|
}
|
|
if ((pagen= init_pagecache(&pagecache, PCACHE_SIZE, 0, 0,
|
|
TRANSLOG_PAGE_SIZE)) == 0)
|
|
{
|
|
fprintf(stderr, "Got error: init_pagecache() (errno: %d)\n", errno);
|
|
exit(1);
|
|
}
|
|
if (translog_init(".", LOG_FILE_SIZE, 50112, 0, &pagecache, LOG_FLAGS))
|
|
{
|
|
fprintf(stderr, "Can't init loghandler (%d)\n", errno);
|
|
translog_destroy();
|
|
exit(1);
|
|
}
|
|
example_loghandler_init();
|
|
|
|
plan(((ITERATIONS - 1) * 4 + 1)*2 + ITERATIONS - 1);
|
|
|
|
srandom(122334817L);
|
|
|
|
long_tr_id[5]= 0xff;
|
|
|
|
int4store(long_tr_id, 0);
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)long_tr_id;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= 6;
|
|
trn->short_id= 0;
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_FIXED_RECORD_0LSN_EXAMPLE,
|
|
trn, NULL,
|
|
6, TRANSLOG_INTERNAL_PARTS + 1, parts, NULL))
|
|
{
|
|
fprintf(stderr, "Can't write record #%lu\n", (ulong) 0);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_FIXED_RECORD_0LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_FIXED_RECORD_0LSN_EXAMPLE");
|
|
lsn_base= first_lsn= lsn;
|
|
|
|
for (i= 1; i < ITERATIONS; i++)
|
|
{
|
|
trn->short_id= i % 0xFFFF;
|
|
if (i % 2)
|
|
{
|
|
lsn_store(lsn_buff, lsn_base);
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)lsn_buff;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= LSN_STORE_SIZE;
|
|
/* check auto-count feature */
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].str= NULL;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].length= 0;
|
|
if (translog_write_record(&lsn, LOGREC_FIXED_RECORD_1LSN_EXAMPLE,
|
|
trn, NULL, LSN_STORE_SIZE, 0, parts, NULL))
|
|
{
|
|
fprintf(stderr, "1 Can't write reference defore record #%lu\n",
|
|
(ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_FIXED_RECORD_1LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_FIXED_RECORD_1LSN_EXAMPLE");
|
|
lsn_store(lsn_buff, lsn_base);
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 12)
|
|
rec_len= 12;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)lsn_buff;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= LSN_STORE_SIZE;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].str= (char*)long_buffer;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].length= rec_len;
|
|
/* check record length auto-counting */
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE,
|
|
trn, NULL, 0, TRANSLOG_INTERNAL_PARTS + 2,
|
|
parts, NULL))
|
|
{
|
|
fprintf(stderr, "1 Can't write var reference defore record #%lu\n",
|
|
(ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE");
|
|
}
|
|
else
|
|
{
|
|
lsn_store(lsn_buff, lsn_base);
|
|
lsn_store(lsn_buff + LSN_STORE_SIZE, first_lsn);
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)lsn_buff;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= 23;
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_FIXED_RECORD_2LSN_EXAMPLE,
|
|
trn, NULL,
|
|
23, TRANSLOG_INTERNAL_PARTS + 1, parts, NULL))
|
|
{
|
|
fprintf(stderr, "0 Can't write reference defore record #%lu\n",
|
|
(ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_FIXED_RECORD_2LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_FIXED_RECORD_2LSN_EXAMPLE");
|
|
lsn_store(lsn_buff, lsn_base);
|
|
lsn_store(lsn_buff + LSN_STORE_SIZE, first_lsn);
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 19)
|
|
rec_len= 19;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)lsn_buff;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= 14;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].str= (char*)long_buffer;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 1].length= rec_len;
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE,
|
|
trn, NULL, 14 + rec_len,
|
|
TRANSLOG_INTERNAL_PARTS + 2, parts, NULL))
|
|
{
|
|
fprintf(stderr, "0 Can't write var reference defore record #%lu\n",
|
|
(ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE");
|
|
}
|
|
int4store(long_tr_id, i);
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)long_tr_id;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= 6;
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_FIXED_RECORD_0LSN_EXAMPLE,
|
|
trn, NULL, 6,
|
|
TRANSLOG_INTERNAL_PARTS + 1,
|
|
parts, NULL))
|
|
{
|
|
fprintf(stderr, "Can't write record #%lu\n", (ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_FIXED_RECORD_0LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_FIXED_RECORD_0LSN_EXAMPLE");
|
|
|
|
lsn_base= lsn;
|
|
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 9)
|
|
rec_len= 9;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].str= (char*)long_buffer;
|
|
parts[TRANSLOG_INTERNAL_PARTS + 0].length= rec_len;
|
|
if (translog_write_record(&lsn,
|
|
LOGREC_VARIABLE_RECORD_0LSN_EXAMPLE,
|
|
trn, NULL, rec_len,
|
|
TRANSLOG_INTERNAL_PARTS + 1,
|
|
parts, NULL))
|
|
{
|
|
fprintf(stderr, "Can't write variable record #%lu\n", (ulong) i);
|
|
translog_destroy();
|
|
ok(0, "write LOGREC_VARIABLE_RECORD_0LSN_EXAMPLE");
|
|
exit(1);
|
|
}
|
|
ok(1, "write LOGREC_VARIABLE_RECORD_0LSN_EXAMPLE");
|
|
if (translog_flush(lsn))
|
|
{
|
|
fprintf(stderr, "Can't flush #%lu\n", (ulong) i);
|
|
translog_destroy();
|
|
ok(0, "flush");
|
|
exit(1);
|
|
}
|
|
ok(1, "flush");
|
|
}
|
|
|
|
translog_destroy();
|
|
end_pagecache(&pagecache, 1);
|
|
ma_control_file_end();
|
|
|
|
|
|
if (ma_control_file_create_or_open())
|
|
{
|
|
fprintf(stderr, "pass2: Can't init control file (%d)\n", errno);
|
|
exit(1);
|
|
}
|
|
if ((pagen= init_pagecache(&pagecache, PCACHE_SIZE, 0, 0,
|
|
TRANSLOG_PAGE_SIZE)) == 0)
|
|
{
|
|
fprintf(stderr, "pass2: Got error: init_pagecache() (errno: %d)\n", errno);
|
|
exit(1);
|
|
}
|
|
if (translog_init(".", LOG_FILE_SIZE, 50112, 0, &pagecache, LOG_FLAGS))
|
|
{
|
|
fprintf(stderr, "pass2: Can't init loghandler (%d)\n", errno);
|
|
translog_destroy();
|
|
exit(1);
|
|
}
|
|
example_loghandler_init();
|
|
srandom(122334817L);
|
|
|
|
|
|
rc= 1;
|
|
|
|
{
|
|
translog_size_t len= translog_read_record_header(first_lsn, &rec);
|
|
if (len == 0)
|
|
{
|
|
fprintf(stderr, "translog_read_record_header failed (%d)\n", errno);
|
|
goto err;
|
|
}
|
|
if (rec.type !=LOGREC_FIXED_RECORD_0LSN_EXAMPLE || rec.short_trid != 0 ||
|
|
rec.record_length != 6 || uint4korr(rec.header) != 0 ||
|
|
((uchar)rec.header[4]) != 0 || ((uchar)rec.header[5]) != 0xFF ||
|
|
first_lsn != rec.lsn)
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_FIXED_RECORD_0LSN_EXAMPLE "
|
|
"data read(0)\n"
|
|
"type %u, strid %u, len %u, i: %u, 4: %u 5: %u, "
|
|
"lsn(%lu,0x%lx)\n",
|
|
(uint) rec.type, (uint) rec.short_trid, (uint) rec.record_length,
|
|
(uint) uint4korr(rec.header), (uint) rec.header[4],
|
|
(uint) rec.header[5],
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
read_ok(&rec);
|
|
translog_free_record_header(&rec);
|
|
lsn= first_lsn;
|
|
if (translog_init_scanner(first_lsn, 1, &scanner))
|
|
{
|
|
fprintf(stderr, "scanner init failed\n");
|
|
goto err;
|
|
}
|
|
for (i= 1;; i++)
|
|
{
|
|
len= translog_read_next_record_header(&scanner, &rec);
|
|
if (len == 0)
|
|
{
|
|
fprintf(stderr, "1-%d translog_read_next_record_header failed (%d)\n",
|
|
i, errno);
|
|
goto err;
|
|
}
|
|
if (rec.lsn == CONTROL_FILE_IMPOSSIBLE_LSN)
|
|
{
|
|
if (i != ITERATIONS)
|
|
{
|
|
fprintf(stderr, "EOL met at iteration %u instead of %u\n",
|
|
i, ITERATIONS);
|
|
goto err;
|
|
}
|
|
break;
|
|
}
|
|
if (i % 2)
|
|
{
|
|
LSN ref;
|
|
ref= lsn_korr(rec.header);
|
|
if (rec.type != LOGREC_FIXED_RECORD_1LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != 7 || ref != lsn)
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_FIXED_RECORD_1LSN_EXAMPLE "
|
|
"data read(%d) "
|
|
"type: %u strid: %u len: %u"
|
|
"ref: (%lu,0x%lx) (%lu,0x%lx) "
|
|
"lsn(%lu,0x%lx)\n",
|
|
i, (uint) rec.type, (uint) rec.short_trid,
|
|
(uint) rec.record_length,
|
|
(ulong) LSN_FILE_NO(ref), (ulong) LSN_OFFSET(ref),
|
|
(ulong) LSN_FILE_NO(lsn), (ulong) LSN_OFFSET(lsn),
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
}
|
|
else
|
|
{
|
|
LSN ref1, ref2;
|
|
ref1= lsn_korr(rec.header);
|
|
ref2= lsn_korr(rec.header + LSN_STORE_SIZE);
|
|
if (rec.type != LOGREC_FIXED_RECORD_2LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != 23 ||
|
|
ref1 != lsn ||
|
|
ref2 != first_lsn ||
|
|
((uchar)rec.header[22]) != 0x55 ||
|
|
((uchar)rec.header[21]) != 0xAA ||
|
|
((uchar)rec.header[20]) != 0x55 ||
|
|
((uchar)rec.header[19]) != 0xAA ||
|
|
((uchar)rec.header[18]) != 0x55 ||
|
|
((uchar)rec.header[17]) != 0xAA ||
|
|
((uchar)rec.header[16]) != 0x55 ||
|
|
((uchar)rec.header[15]) != 0xAA ||
|
|
((uchar)rec.header[14]) != 0x55)
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_FIXED_RECORD_2LSN_EXAMPLE "
|
|
"data read(%d) "
|
|
"type %u, strid %u, len %u, ref1(%lu,0x%lx), "
|
|
"ref2(%lu,0x%lx) %x%x%x%x%x%x%x%x%x "
|
|
"lsn(%lu,0x%lx)\n",
|
|
i, (uint) rec.type, (uint) rec.short_trid,
|
|
(uint) rec.record_length,
|
|
(ulong) LSN_FILE_NO(ref1), (ulong) LSN_OFFSET(ref1),
|
|
(ulong) LSN_FILE_NO(ref2), (ulong) LSN_OFFSET(ref2),
|
|
(uint) rec.header[14], (uint) rec.header[15],
|
|
(uint) rec.header[16], (uint) rec.header[17],
|
|
(uint) rec.header[18], (uint) rec.header[19],
|
|
(uint) rec.header[20], (uint) rec.header[21],
|
|
(uint) rec.header[22],
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
}
|
|
read_ok(&rec);
|
|
translog_free_record_header(&rec);
|
|
|
|
len= translog_read_next_record_header(&scanner, &rec);
|
|
if (len == 0)
|
|
{
|
|
fprintf(stderr, "1-%d translog_read_next_record_header (var) "
|
|
"failed (%d)\n", i, errno);
|
|
goto err;
|
|
}
|
|
if (rec.lsn == CONTROL_FILE_IMPOSSIBLE_LSN)
|
|
{
|
|
fprintf(stderr, "EOL met at the middle of iteration (first var) %u "
|
|
"instead of beginning of %u\n", i, ITERATIONS);
|
|
goto err;
|
|
}
|
|
if (i % 2)
|
|
{
|
|
LSN ref;
|
|
ref= lsn_korr(rec.header);
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 12)
|
|
rec_len= 12;
|
|
if (rec.type != LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != rec_len + LSN_STORE_SIZE ||
|
|
len != 12 || ref != lsn ||
|
|
check_content(rec.header + LSN_STORE_SIZE, len - LSN_STORE_SIZE))
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE "
|
|
"data read(%d)"
|
|
"type %u (%d), strid %u (%d), len %lu, %lu + 7 (%d), "
|
|
"hdr len: %u (%d), "
|
|
"ref(%lu,0x%lx), lsn(%lu,0x%lx) (%d), content: %d\n",
|
|
i, (uint) rec.type,
|
|
rec.type != LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE,
|
|
(uint) rec.short_trid,
|
|
rec.short_trid != (i % 0xFFFF),
|
|
(ulong) rec.record_length, (ulong) rec_len,
|
|
rec.record_length != rec_len + LSN_STORE_SIZE,
|
|
(uint) len,
|
|
len != 12,
|
|
(ulong) LSN_FILE_NO(ref), (ulong) LSN_OFFSET(ref),
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn),
|
|
(len != 12 || ref != lsn),
|
|
check_content(rec.header + LSN_STORE_SIZE,
|
|
len - LSN_STORE_SIZE));
|
|
goto err;
|
|
}
|
|
if (read_and_check_content(&rec, long_buffer, LSN_STORE_SIZE))
|
|
{
|
|
fprintf(stderr,
|
|
"Incorrect LOGREC_VARIABLE_RECORD_1LSN_EXAMPLE "
|
|
"in whole rec read lsn(%lu,0x%lx)\n",
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
}
|
|
else
|
|
{
|
|
LSN ref1, ref2;
|
|
ref1= lsn_korr(rec.header);
|
|
ref2= lsn_korr(rec.header + LSN_STORE_SIZE);
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 19)
|
|
rec_len= 19;
|
|
if (rec.type != LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != rec_len + LSN_STORE_SIZE * 2 ||
|
|
len != 19 ||
|
|
ref1 != lsn ||
|
|
ref2 != first_lsn ||
|
|
check_content(rec.header + LSN_STORE_SIZE * 2,
|
|
len - LSN_STORE_SIZE * 2))
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE "
|
|
"data read(%d) "
|
|
"type %u, strid %u, len %lu != %lu + 14, hdr len: %u, "
|
|
"ref1(%lu,0x%lx), ref2(%lu,0x%lx), "
|
|
"lsn(%lu,0x%lx)\n",
|
|
i, (uint) rec.type, (uint) rec.short_trid,
|
|
(ulong) rec.record_length, (ulong) rec_len,
|
|
(uint) len,
|
|
(ulong) LSN_FILE_NO(ref1), (ulong) LSN_OFFSET(ref1),
|
|
(ulong) LSN_FILE_NO(ref2), (ulong) LSN_OFFSET(ref2),
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
if (read_and_check_content(&rec, long_buffer, LSN_STORE_SIZE * 2))
|
|
{
|
|
fprintf(stderr,
|
|
"Incorrect LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE "
|
|
"in whole rec read lsn(%lu,0x%lx)\n",
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
}
|
|
read_ok(&rec);
|
|
translog_free_record_header(&rec);
|
|
|
|
len= translog_read_next_record_header(&scanner, &rec);
|
|
if (len == 0)
|
|
{
|
|
fprintf(stderr, "1-%d translog_read_next_record_header failed (%d)\n",
|
|
i, errno);
|
|
goto err;
|
|
}
|
|
if (rec.lsn == CONTROL_FILE_IMPOSSIBLE_LSN)
|
|
{
|
|
fprintf(stderr, "EOL met at the middle of iteration %u "
|
|
"instead of beginning of %u\n", i, ITERATIONS);
|
|
goto err;
|
|
}
|
|
if (rec.type != LOGREC_FIXED_RECORD_0LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != 6 || uint4korr(rec.header) != i ||
|
|
((uchar)rec.header[4]) != 0 || ((uchar)rec.header[5]) != 0xFF)
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_FIXED_RECORD_0LSN_EXAMPLE "
|
|
"data read(%d)\n"
|
|
"type %u, strid %u, len %u, i: %u, 4: %u 5: %u "
|
|
"lsn(%lu,0x%lx)\n",
|
|
i, (uint) rec.type, (uint) rec.short_trid,
|
|
(uint) rec.record_length,
|
|
(uint) uint4korr(rec.header), (uint) rec.header[4],
|
|
(uint) rec.header[5],
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
lsn= rec.lsn;
|
|
read_ok(&rec);
|
|
translog_free_record_header(&rec);
|
|
|
|
len= translog_read_next_record_header(&scanner, &rec);
|
|
if ((rec_len= random() / (RAND_MAX / (LONG_BUFFER_SIZE + 1))) < 9)
|
|
rec_len= 9;
|
|
if (rec.type != LOGREC_VARIABLE_RECORD_0LSN_EXAMPLE ||
|
|
rec.short_trid != (i % 0xFFFF) ||
|
|
rec.record_length != rec_len ||
|
|
len != 9 || check_content(rec.header, len))
|
|
{
|
|
fprintf(stderr, "Incorrect LOGREC_VARIABLE_RECORD_0LSN_EXAMPLE "
|
|
"data read(%d) "
|
|
"type %u, strid %u, len %lu != %lu, hdr len: %u, "
|
|
"lsn(%lu,0x%lx)\n",
|
|
i, (uint) rec.type, (uint) rec.short_trid,
|
|
(ulong) rec.record_length, (ulong) rec_len,
|
|
(uint) len,
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
if (read_and_check_content(&rec, long_buffer, 0))
|
|
{
|
|
fprintf(stderr,
|
|
"Incorrect LOGREC_VARIABLE_RECORD_2LSN_EXAMPLE "
|
|
"in whole rec read lsn(%lu,0x%lx)\n",
|
|
(ulong) LSN_FILE_NO(rec.lsn), (ulong) LSN_OFFSET(rec.lsn));
|
|
goto err;
|
|
}
|
|
read_ok(&rec);
|
|
translog_free_record_header(&rec);
|
|
}
|
|
}
|
|
|
|
rc= 0;
|
|
err:
|
|
if (rc)
|
|
ok(0, "read record");
|
|
translog_destroy();
|
|
end_pagecache(&pagecache, 1);
|
|
ma_control_file_end();
|
|
|
|
if (maria_log_remove())
|
|
exit(1);
|
|
return(test(exit_status()));
|
|
}
|