mirror of
https://github.com/MariaDB/server.git
synced 2025-09-25 18:39:15 +02:00

1. Access foreign keys via TABLE_SHARE::foreign_keys and TABLE_SHARE::referenced_keys; foreign_keys and referenced_keys are lists in TABLE_SHARE. 2. Remove handler FK interface: - get_foreign_key_list() - get_parent_foreign_key_list() - referenced_by_foreign_key() 3. Invalidate referenced shares on: - RENAME TABLE - DROP TABLE - RENAME COLUMN - ADD FOREIGN KEY When foreign table is created or altered by the above operations all referenced shares are closed. This blocks the operation while any referenced shares are used (when at least one its TABLE instance is locked). 4. Update referenced shares on: - CREATE TABLE On CREATE TABLE add items to referenced_keys of referenced shares. States of referenced shares are restored in case of errors. 5. Invalidate foreign shares on: - RENAME TABLE - RENAME COLUMN The above-mentioned blocking takes effect. 6. Check foreign/referenced shares consistency on: - CHECK TABLE 7. Temporary change until MDEV-21051: InnoDB fill foreign key info at handler open(). FOREIGN_KEY_INFO is refactored to FK_info holding Lex_cstring. On first TABLE open FK_info is loaded from storage engine into TABLE_SHARE. All referenced shares (if any exists) are closed. This leads to blocking of first time foreign table open while referenced tables are used. MDEV-21311 Converge Foreign_key and supplemental generated Key together mysql_prepare_create_table() does data validation and such utilities as automatic name generation. But it does that only for indexes and ignores Foreign_key objects. Now as Foreign_key data needs to be stored in FRM files as well this processing must be done for it like for any other Key objects. Replace Key::FOREIGN_KEY type with Key::foreign flag of type Key::MULTIPLE and Key::generated set to true. Construct one object with Key::foreign == true instead of two objects of type Key::FOREIGN_KEY and Key::MULTIPLE. MDEV-21051 datadict refactorings - Move read_extra2() to datadict.cc - Refactored extra2_fields to Extra2_info - build_frm_image() readability MDEV-21051 build_table_shadow_filename() refactoring mysql_prepare_alter_table() leaks fixes MDEV-21051 amend system tables locking restriction Table mysql.help_relation has foreign key to mysql.help_keyword. On bootstrap when help_relation is opened, it preopens help_keyword for READ and fails in lock_tables_check(). If system table is opened for write then fk references are opened for write. Related to: Bug#25422, WL#3984 Tests: main.lock MDEV-21051 Store and read foreign key info into/from FRM files 1. Introduce Foreign_key_io class which creates/parses binary stream containing foreign key structures. Referenced tables store there only hints about foreign tables (their db and name), they restore full info from the corresponding tables. Foreign_key_io is stored under new EXTRA2_FOREIGN_KEY_INFO field in extra2 section of FRM file. 2. Modify mysql_prepare_create_table() to generate names for foreign keys. Until InnoDB storage of foreign keys is removed, FK names must be unique across the database: the FK name must be based on table name. 3. Keep stored data in sync on DDL changes. Referenced tables update their foreign hints after following operations on foreign tables: - RENAME TABLE - DROP TABLE - CREATE TABLE - ADD FOREIGN KEY - DROP FOREIGN KEY Foreign tables update their foreign info after following operations on referenced tables: - RENAME TABLE - RENAME COLUMN 4. To achieve 3. there must be ability to rewrite extra2 section of FRM file without full reparse. FRM binary is built from primary structures like HA_CREATE_INFO and cannot be built from TABLE_SHARE. Use shadow write and rename like fast_alter_partition_table() does. Shadow FRM is new FRM file that replaces the old one. CREATE TABLE workflow: 1. Foreign_key is constructed in parser, placed into alter_info->key_list; 2. mysql_prepare_create_table() translates them to FK_info, assigns foreign_id if needed; 3. build_frm_image() writes two FK_info lists into FRM's extra2 section, for referenced keys it stores only table names (hints); 4. init_from_binary_frm_image() parses extra2 section and fills foreign_keys and referenced_keys of TABLE_SHARE. It restores referenced_keys by reading hint list of table names, opening corresponding shares and restoring FK_info from their foreign_keys. Hints resolution is done only when initializing non-temporary shares. Usually temporary share has different (temporary) name and it is impossible to resolve foreign keys by that name (as we identify them by both foreign and referenced table names). Another not unimportant reason is performance: this saves spare share acquisitions. ALTER TABLE workflow: 1. Foreign_key is constructed in parser, placed into alter_info->key_list; 2. mysql_prepare_alter_table() prepares action lists and share list of foreigns/references; 3. mysql_prepare_alter_table() locks list of foreigns/references by MDL_INTENTION_EXCLUSIVE, acquires shares; 4. prepare_create_table() converts key_list into FK_list, assigns foreign_id; 5. shadow FRM of altered table is created; 6. data is copied; 7. altered table is locked by MDL_EXCLUSIVE; 8. fk_handle_alter() processes action lists, creates FK backups, modifies shares, writes shadow FRMs; 9. altered table is closed; 10. shadow FRMs are installed; 11. altered table is renamed, FRM backup deleted; 12. (TBD in MDEV-21053) shadow FRMs installation log closed, backups deleted; On FK backup system: In case of failed DDL operation all shares that was modified must be restored into original state. This is done by FK_ddl_backup (CREATE, DROP), FK_rename_backup (RENAME), FK_alter_backup (ALTER). On STL usage: STL is used for utility not performance-critical algorithms, core structures hold native List. A wrapper was made to convert STL exception into bool error status or NULL value. MDEV-20865 fk_check_consistency() in CHECK TABLE Self-refs fix Test table_flags fix: "debug" deviation is now gone. FIXMEs: +16 -1
339 lines
13 KiB
C++
339 lines
13 KiB
C++
#ifndef SQL_PARTITION_INCLUDED
|
|
#define SQL_PARTITION_INCLUDED
|
|
|
|
/* Copyright (c) 2006, 2017, Oracle and/or its affiliates.
|
|
Copyright (c) 2011, 2017, MariaDB
|
|
|
|
This program is free software; you can redistribute it and/or modify
|
|
it under the terms of the GNU General Public License as published by
|
|
the Free Software Foundation; version 2 of the License.
|
|
|
|
This program is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
GNU General Public License for more details.
|
|
|
|
You should have received a copy of the GNU General Public License
|
|
along with this program; if not, write to the Free Software
|
|
Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1335 USA */
|
|
|
|
#include "sql_list.h" /* List */
|
|
#include "table.h" /* TABLE_LIST */
|
|
|
|
class Alter_info;
|
|
class Alter_table_ctx;
|
|
class Field;
|
|
class String;
|
|
class handler;
|
|
class partition_info;
|
|
struct TABLE;
|
|
struct TABLE_LIST;
|
|
typedef struct st_bitmap MY_BITMAP;
|
|
typedef struct st_key KEY;
|
|
typedef struct st_key_range key_range;
|
|
|
|
/* Flags for partition handlers */
|
|
#define HA_CAN_PARTITION (1 << 0) /* Partition support */
|
|
#define HA_CAN_UPDATE_PARTITION_KEY (1 << 1)
|
|
#define HA_CAN_PARTITION_UNIQUE (1 << 2)
|
|
#define HA_USE_AUTO_PARTITION (1 << 3)
|
|
#define HA_ONLY_VERS_PARTITION (1 << 4)
|
|
|
|
#define NORMAL_PART_NAME 0
|
|
#define TEMP_PART_NAME 1
|
|
#define RENAMED_PART_NAME 2
|
|
|
|
typedef struct st_lock_param_type
|
|
{
|
|
TABLE_LIST *table_list;
|
|
ulonglong copied;
|
|
ulonglong deleted;
|
|
THD *thd;
|
|
HA_CREATE_INFO *create_info;
|
|
Alter_info *alter_info;
|
|
Alter_table_ctx *alter_ctx;
|
|
TABLE *table;
|
|
KEY *key_info_buffer;
|
|
LEX_CUSTRING org_tabledef_version;
|
|
uchar *pack_frm_data;
|
|
uint key_count;
|
|
uint db_options;
|
|
size_t pack_frm_len;
|
|
// TODO: remove duplicate data: part_info can be accessed via table->part_info
|
|
partition_info *part_info;
|
|
} ALTER_PARTITION_PARAM_TYPE;
|
|
|
|
typedef struct {
|
|
longlong list_value;
|
|
uint32 partition_id;
|
|
} LIST_PART_ENTRY;
|
|
|
|
typedef struct {
|
|
uint32 start_part;
|
|
uint32 end_part;
|
|
} part_id_range;
|
|
|
|
class String_list;
|
|
struct st_partition_iter;
|
|
#define NOT_A_PARTITION_ID UINT_MAX32
|
|
|
|
bool is_partition_in_list(char *part_name, List<char> list_part_names);
|
|
char *are_partitions_in_table(partition_info *new_part_info,
|
|
partition_info *old_part_info);
|
|
bool check_reorganise_list(partition_info *new_part_info,
|
|
partition_info *old_part_info,
|
|
List<char> list_part_names);
|
|
handler *get_ha_partition(partition_info *part_info);
|
|
int get_part_for_buf(const uchar *buf, const uchar *rec0,
|
|
partition_info *part_info, uint32 *part_id);
|
|
void prune_partition_set(const TABLE *table, part_id_range *part_spec);
|
|
bool check_partition_info(partition_info *part_info,handlerton **eng_type,
|
|
TABLE *table, handler *file, HA_CREATE_INFO *info);
|
|
void set_linear_hash_mask(partition_info *part_info, uint num_parts);
|
|
bool fix_partition_func(THD *thd, TABLE *table, bool create_table_ind);
|
|
void get_partition_set(const TABLE *table, uchar *buf, const uint index,
|
|
const key_range *key_spec,
|
|
part_id_range *part_spec);
|
|
uint get_partition_field_store_length(Field *field);
|
|
void get_full_part_id_from_key(const TABLE *table, uchar *buf,
|
|
KEY *key_info,
|
|
const key_range *key_spec,
|
|
part_id_range *part_spec);
|
|
bool mysql_unpack_partition(THD *thd, char *part_buf,
|
|
uint part_info_len,
|
|
TABLE *table, bool is_create_table_ind,
|
|
handlerton *default_db_type,
|
|
bool *work_part_info_used);
|
|
void make_used_partitions_str(MEM_ROOT *mem_root,
|
|
partition_info *part_info, String *parts_str,
|
|
String_list &used_partitions_list);
|
|
uint32 get_list_array_idx_for_endpoint(partition_info *part_info,
|
|
bool left_endpoint,
|
|
bool include_endpoint);
|
|
uint32 get_partition_id_range_for_endpoint(partition_info *part_info,
|
|
bool left_endpoint,
|
|
bool include_endpoint);
|
|
bool check_part_func_fields(Field **ptr, bool ok_with_charsets);
|
|
bool field_is_partition_charset(Field *field);
|
|
Item* convert_charset_partition_constant(Item *item, CHARSET_INFO *cs);
|
|
/**
|
|
Append all fields in read_set to string
|
|
|
|
@param[in,out] str String to append to.
|
|
@param[in] row Row to append.
|
|
@param[in] table Table containing read_set and fields for the row.
|
|
*/
|
|
void append_row_to_str(String &str, const uchar *row, TABLE *table);
|
|
void truncate_partition_filename(char *path);
|
|
|
|
/*
|
|
A "Get next" function for partition iterator.
|
|
|
|
SYNOPSIS
|
|
partition_iter_func()
|
|
part_iter Partition iterator, you call only "iter.get_next(&iter)"
|
|
|
|
DESCRIPTION
|
|
Depending on whether partitions or sub-partitions are iterated, the
|
|
function returns next subpartition id/partition number. The sequence of
|
|
returned numbers is not ordered and may contain duplicates.
|
|
|
|
When the end of sequence is reached, NOT_A_PARTITION_ID is returned, and
|
|
the iterator resets itself (so next get_next() call will start to
|
|
enumerate the set all over again).
|
|
|
|
RETURN
|
|
NOT_A_PARTITION_ID if there are no more partitions.
|
|
[sub]partition_id of the next partition
|
|
*/
|
|
|
|
typedef uint32 (*partition_iter_func)(st_partition_iter* part_iter);
|
|
|
|
|
|
/*
|
|
Partition set iterator. Used to enumerate a set of [sub]partitions
|
|
obtained in partition interval analysis (see get_partitions_in_range_iter).
|
|
|
|
For the user, the only meaningful field is get_next, which may be used as
|
|
follows:
|
|
part_iterator.get_next(&part_iterator);
|
|
|
|
Initialization is done by any of the following calls:
|
|
- get_partitions_in_range_iter-type function call
|
|
- init_single_partition_iterator()
|
|
- init_all_partitions_iterator()
|
|
Cleanup is not needed.
|
|
*/
|
|
|
|
typedef struct st_partition_iter
|
|
{
|
|
partition_iter_func get_next;
|
|
/*
|
|
Valid for "Interval mapping" in LIST partitioning: if true, let the
|
|
iterator also produce id of the partition that contains NULL value.
|
|
*/
|
|
bool ret_null_part, ret_null_part_orig;
|
|
/*
|
|
We should return DEFAULT partition.
|
|
*/
|
|
bool ret_default_part, ret_default_part_orig;
|
|
struct st_part_num_range
|
|
{
|
|
uint32 start;
|
|
uint32 cur;
|
|
uint32 end;
|
|
};
|
|
|
|
struct st_field_value_range
|
|
{
|
|
longlong start;
|
|
longlong cur;
|
|
longlong end;
|
|
};
|
|
|
|
union
|
|
{
|
|
struct st_part_num_range part_nums;
|
|
struct st_field_value_range field_vals;
|
|
};
|
|
partition_info *part_info;
|
|
} PARTITION_ITERATOR;
|
|
|
|
|
|
/*
|
|
Get an iterator for set of partitions that match given field-space interval
|
|
|
|
SYNOPSIS
|
|
get_partitions_in_range_iter()
|
|
part_info Partitioning info
|
|
is_subpart
|
|
store_length_array Length of fields packed in opt_range_key format
|
|
min_val Left edge, field value in opt_range_key format
|
|
max_val Right edge, field value in opt_range_key format
|
|
min_len Length of minimum value
|
|
max_len Length of maximum value
|
|
flags Some combination of NEAR_MIN, NEAR_MAX, NO_MIN_RANGE,
|
|
NO_MAX_RANGE
|
|
part_iter Iterator structure to be initialized
|
|
|
|
DESCRIPTION
|
|
Functions with this signature are used to perform "Partitioning Interval
|
|
Analysis". This analysis is applicable for any type of [sub]partitioning
|
|
by some function of a single fieldX. The idea is as follows:
|
|
Given an interval "const1 <=? fieldX <=? const2", find a set of partitions
|
|
that may contain records with value of fieldX within the given interval.
|
|
|
|
The min_val, max_val and flags parameters specify the interval.
|
|
The set of partitions is returned by initializing an iterator in *part_iter
|
|
|
|
NOTES
|
|
There are currently three functions of this type:
|
|
- get_part_iter_for_interval_via_walking
|
|
- get_part_iter_for_interval_cols_via_map
|
|
- get_part_iter_for_interval_via_mapping
|
|
|
|
RETURN
|
|
0 - No matching partitions, iterator not initialized
|
|
1 - Some partitions would match, iterator intialized for traversing them
|
|
-1 - All partitions would match, iterator not initialized
|
|
*/
|
|
|
|
typedef int (*get_partitions_in_range_iter)(partition_info *part_info,
|
|
bool is_subpart,
|
|
uint32 *store_length_array,
|
|
uchar *min_val, uchar *max_val,
|
|
uint min_len, uint max_len,
|
|
uint flags,
|
|
PARTITION_ITERATOR *part_iter);
|
|
|
|
#include "partition_info.h"
|
|
|
|
#ifdef WITH_PARTITION_STORAGE_ENGINE
|
|
uint fast_alter_partition_table(THD *thd, TABLE *table,
|
|
Alter_info *alter_info,
|
|
Alter_table_ctx *alter_ctx,
|
|
HA_CREATE_INFO *create_info,
|
|
TABLE_LIST *table_list);
|
|
bool set_part_state(Alter_info *alter_info, partition_info *tab_part_info,
|
|
enum partition_state part_state);
|
|
uint prep_alter_part_table(THD *thd, TABLE *table, Alter_info *alter_info,
|
|
HA_CREATE_INFO *create_info,
|
|
bool *partition_changed,
|
|
bool *fast_alter_table);
|
|
char *generate_partition_syntax(THD *thd, partition_info *part_info,
|
|
uint *buf_length,
|
|
bool show_partition_options,
|
|
HA_CREATE_INFO *create_info,
|
|
Alter_info *alter_info);
|
|
char *generate_partition_syntax_for_frm(THD *thd, partition_info *part_info,
|
|
uint *buf_length,
|
|
HA_CREATE_INFO *create_info,
|
|
Alter_info *alter_info);
|
|
bool verify_data_with_partition(TABLE *table, TABLE *part_table,
|
|
uint32 part_id);
|
|
bool compare_partition_options(HA_CREATE_INFO *table_create_info,
|
|
partition_element *part_elem);
|
|
bool compare_table_with_partition(THD *thd, TABLE *table,
|
|
TABLE *part_table,
|
|
partition_element *part_elem,
|
|
uint part_id);
|
|
bool partition_key_modified(TABLE *table, const MY_BITMAP *fields);
|
|
bool write_log_replace_frm(ALTER_PARTITION_PARAM_TYPE *lpt,
|
|
uint next_entry,
|
|
const char *from_path,
|
|
const char *to_path);
|
|
|
|
#else
|
|
#define partition_key_modified(X,Y) 0
|
|
#endif
|
|
|
|
int __attribute__((warn_unused_result))
|
|
create_partition_name(char *out, size_t outlen, const char *in1,
|
|
const char *in2,
|
|
uint name_variant, bool translate);
|
|
|
|
static inline
|
|
int __attribute__((warn_unused_result))
|
|
create_partition_name(char *out, size_t outlen, const char *in1,
|
|
const Lex_ident_partition &in2,
|
|
uint name_variant, bool translate)
|
|
{
|
|
return create_partition_name(out, outlen, in1, in2.str,
|
|
name_variant, translate);
|
|
}
|
|
|
|
|
|
int __attribute__((warn_unused_result))
|
|
create_subpartition_name(char *out, size_t outlen, const char *in1,
|
|
const Lex_ident_partition &in2,
|
|
const Lex_ident_partition &in3, uint name_variant);
|
|
|
|
void set_key_field_ptr(KEY *key_info, const uchar *new_buf,
|
|
const uchar *old_buf);
|
|
|
|
/** Set up table for creating a partition.
|
|
Copy info from partition to the table share so the created partition
|
|
has the correct info.
|
|
@param thd THD object
|
|
@param share Table share to be updated.
|
|
@param info Create info to be updated.
|
|
@param part_elem partition_element containing the info.
|
|
|
|
@return status
|
|
@retval TRUE Error
|
|
@retval FALSE Success
|
|
|
|
@details
|
|
Set up
|
|
1) Comment on partition
|
|
2) MAX_ROWS, MIN_ROWS on partition
|
|
3) Index file name on partition
|
|
4) Data file name on partition
|
|
*/
|
|
bool set_up_table_before_create(THD *thd,
|
|
TABLE_SHARE *share,
|
|
const char *partition_name_with_path,
|
|
HA_CREATE_INFO *info,
|
|
partition_element *part_elem);
|
|
#endif /* SQL_PARTITION_INCLUDED */
|
|
|