mirror/mariadb
1
0
Fork 0
mirror of https://github.com/MariaDB/server.git synced 2025-01-15 19:42:28 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
mariadb/include
History
Monty e600f9aebb MDEV-35750 Change MEM_ROOT allocation sizes to reduse calls to malloc() and avoid memory fragmentation 
This commit updates default memory allocations size used with MEM_ROOT
objects to minimize the number of calls to malloc().

Changes:
- Updated MEM_ROOT block sizes in sql_const.h
- Updated MALLOC_OVERHEAD to also take into account the extra memory
  allocated by my_malloc()
- Updated init_alloc_root() to only take MALLOC_OVERHEAD into account as
  buffer size, not MALLOC_OVERHEAD + sizeof(USED_MEM).
- Reset mem_root->first_block_usage if and only if first block was used.
- Increase MEM_ROOT buffers sized used by my_load_defaults, plugin_init,
  Create_tmp_table, allocate_table_share, TABLE and TABLE_SHARE.
  This decreases number of malloc calls during queries.
- Use a small buffer for THD->main_mem_root in THD::THD. This avoids
  multiple malloc() call for new connections.

I tried the above changes on a complex select query with 12 tables.
The following shows the number of extra allocations that where used
to increase the size of the MEM_ROOT buffers.

Original code:
- Connection to MariaDB:   9 allocations
- First query run:       146 allocations
- Second query run:       24 allocations

Max memory allocated for thd when using with heap table:  61,262,408
Max memory allocated for thd when using Aria tmp table:      419,464

After changes:
Connection to MariaDB:     0 allocations
- First run:              25 allocations
- Second run:              7 allocations

Max memory allocated for thd when using with heap table:  61,347,424
Max memory allocated for thd when using Aria table:          529,168

The new code uses slightly more memory, but avoids memory fragmentation
and is slightly faster thanks to much fewer calls to malloc().

Reviewed-by: Sergei Golubchik <serg@mariadb.org>
2025-01-05 16:40:11 +02:00
..
atomic
mysql MDEV-34836: TOI on parent table must BF abort SR in progress on a child 2024-09-24 11:14:01 +02:00
aligned.h Revert aligned_alloc() addition from MDEV-28836 2022-08-22 09:10:40 +03:00
aria_backup.h S3 is pluggable now 2020-06-19 19:43:07 +02:00
assume_aligned.h Remove a misleading copyright message 2020-03-21 10:25:54 +02:00
big_endian.h
byte_order_generic.h Fix all warnings given by UBSAN 2021-04-20 12:30:09 +03:00
byte_order_generic_x86.h Fix all warnings given by UBSAN 2021-04-20 12:30:09 +03:00
byte_order_generic_x86_64.h typo fixed. HAVE_mi_uint8korr 2023-11-02 19:42:39 +11:00
CMakeLists.txt MDEV-34348: Consolidate cmp function declarations 2024-11-23 08:14:22 -07:00
decimal.h Added typedef decimal_digits_t (uint16) for number of digits in most 2021-05-19 22:27:27 +02:00
dur_prop.h
errmsg.h test cases for MySQL bugs 2022-01-21 16:02:34 +01:00
ft_global.h MDEV-23269 SIGSEGV in ft_boolean_check_syntax_string on setting ft_boolean_syntax 2021-10-11 17:43:23 +04:00
handler_ername.h MDEV-24035 Failing assertion: UT_LIST_GET_LEN(lock.trx_locks) == 0 causing disruption and replication failure 2024-12-12 18:02:00 +02:00
handler_state.h
hash.h MDEV-34348: my_hash_get_key fixes 2024-11-23 08:14:22 -07:00
heap.h MDEV-35469 Heap tables are calling mallocs to often 2025-01-05 16:40:11 +02:00
ilist.h Merge 10.5 into 10.6 2023-02-10 13:03:01 +02:00
json_lib.h Merge branch '10.5' into 10.6 2023-08-01 15:08:52 +02:00
keycache.h
lf.h MDEV-23510: arm64 lf_hash alignment of pointers 2021-02-25 10:06:15 +11:00
little_endian.h
m_ctype.h Merge branch '10.5' into 10.6 2023-12-17 11:20:43 +01:00
m_string.h Merge branch '10.5' into 10.6 2024-10-29 14:20:03 +01:00
ma_dyncol.h Merge 10.4 into 10.5 2023-01-03 17:08:42 +02:00
maria.h cleanup: Aria headers 2020-06-19 19:43:07 +02:00
mariadb_capi_rename.h MDEV-27295 Backport SQL service, introduced by MDEV-19275. 2023-11-05 23:35:32 +04:00
my_alarm.h Merge 10.4 into 10.5 2022-11-08 17:01:28 +02:00
my_alloc.h Merge branch '10.5' into 10.6 2023-12-17 11:20:43 +01:00
my_alloca.h Merge branch '10.4' into 10.5 2023-04-24 12:43:47 +02:00
my_atomic.h MDEV-17441 fixup: Remove unused my_atomic long macros 2022-03-24 09:53:52 +02:00
my_atomic_wrapper.h Merge 10.5 into 10.6 2023-02-10 13:03:01 +02:00
my_attribute.h Merge 10.5 -> 10.6 2024-12-05 09:20:36 +01:00
my_base.h MDEV-24035 Failing assertion: UT_LIST_GET_LEN(lock.trx_locks) == 0 causing disruption and replication failure 2024-12-12 18:02:00 +02:00
my_bit.h MDEV-34392 Inplace algorithm violates the foreign key constraint 2024-10-01 09:41:56 +05:30
my_bitmap.h MDEV-33622 Server crashes when the UPDATE statement (which has duplicate key) is run after setting a low thread_stack 2024-03-12 19:00:41 +02:00
my_byteorder.h MDEV-25870 Windows - fix ARM64 cross-compilation 2021-06-07 23:15:36 +02:00
my_check_opt.h
my_cmp.h MDEV-34348: Consolidate cmp function declarations 2024-11-23 08:14:22 -07:00
my_compare.h Merge branch '10.4' into 10.5 2023-11-08 12:59:00 +01:00
my_compiler.h MDEV-29152: Assertion failed ... upon TO_CHAR with wrong argument 2023-07-12 12:05:59 +03:00
my_counter.h Apply clang-tidy to remove empty constructors / destructors 2023-02-09 16:09:08 +02:00
my_cpu.h Merge branch '10.5' into 10.6 2024-09-06 13:52:57 +10:00
my_crypt.h
my_dbug.h Merge 10.5 into 10.6 2022-09-26 14:34:43 +03:00
my_decimal_limits.h header typos 2022-12-20 08:55:48 +11:00
my_default.h MDEV-22214 mariadbd.exe calls function mysqld.exe, and crashes 2020-04-10 19:05:26 +02:00
my_dir.h header typos 2022-12-20 08:55:48 +11:00
my_getopt.h Added 'const' to arguments in get_one_option and find_typeset() 2021-02-08 12:16:29 +02:00
my_global.h MDEV-35750 Change MEM_ROOT allocation sizes to reduse calls to malloc() and avoid memory fragmentation 2025-01-05 16:40:11 +02:00
my_handler_errors.h MDEV-24035 Failing assertion: UT_LIST_GET_LEN(lock.trx_locks) == 0 causing disruption and replication failure 2024-12-12 18:02:00 +02:00
my_libwrap.h
my_list.h
my_md5.h
my_minidump.h MDEV-11499 mysqltest, Windows : improve diagnostics if server fails to shutdown 2021-09-24 11:49:28 +02:00
my_net.h MDEV-25602 get rid of __WIN__ in favor of standard _WIN32 2021-06-06 13:21:03 +02:00
my_nosys.h
my_pthread.h Merge branch '10.5' into 10.6 2024-01-11 12:59:22 +11:00
my_rdtsc.h Merge 10.5 into 10.6 2024-06-07 10:03:51 +03:00
my_rnd.h
my_service_manager.h MDEV-10183 implement service_manager_extend_timeout on Windows 2022-04-11 07:49:43 +02:00
my_stack_alloc.h MDEV-34533 asan error about stack overflow when writing record in Aria 2024-10-16 17:24:46 +03:00
my_stacktrace.h MDEV-25602 get rid of __WIN__ in favor of standard _WIN32 2021-06-06 13:21:03 +02:00
my_sys.h MDEV-35750 Change MEM_ROOT allocation sizes to reduse calls to malloc() and avoid memory fragmentation 2025-01-05 16:40:11 +02:00
my_time.h Merge 10.3 into 10.4 2022-04-06 08:59:09 +03:00
my_tree.h
my_uctype.h
my_user.h
my_valgrind.h Cleanup: Remove IF_VALGRIND 2022-04-25 09:40:40 +03:00
my_xml.h
myisam.h MDEV-34348: Consolidate cmp function declarations 2024-11-23 08:14:22 -07:00
myisamchk.h Merge branch '10.4' into 10.5 2023-12-02 01:02:50 +01:00
myisammrg.h MDEV-31083 ASAN use-after-poison in myrg_attach_children 2023-05-23 09:16:36 +03:00
myisampack.h MDEV-29473 UBSAN: Signed integer overflow: X * Y cannot be represented in type 'int' in strings/dtoa.c 2022-11-17 17:51:01 +04:00
mysql.h Merge branch '10.5' into 10.6 2023-12-17 11:20:43 +01:00
mysql_com.h Merge from 10.4 to 10.5 2024-04-15 17:46:49 +02:00
mysql_com_server.h
mysql_embed.h
mysql_time.h
mysql_version.h.in Merge 10.3 into 10.4 2020-10-29 13:38:38 +02:00
mysqld_default_groups.h
mysys_err.h MDEV-7947 strcmp() takes 0.37% in OLTP RO 2020-07-23 10:54:33 +03:00
no_valgrind_without_big.inc MDEV-31893 Valgrind reports issues in main.join_cache_notasan 2023-08-10 20:57:42 +02:00
pack.h
password.h
pfs_file_provider.h perfschema compilation, test and misc fixes 2020-03-10 19:24:23 +01:00
pfs_idle_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_memory_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_metadata_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_socket_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_stage_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_statement_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_table_provider.h P_S 5.7.28 2020-03-10 19:24:22 +01:00
pfs_thread_provider.h Merge branch 'merge-perfschema-5.7' into 10.5 2022-08-02 09:34:15 +02:00
pfs_transaction_provider.h cleanup: pass trxid by value 2020-03-10 19:24:23 +01:00
probes_mysql.d.base
probes_mysql.h
probes_mysql_nodtrace.h.in
queues.h MDEV-34348: Consolidate cmp function declarations 2024-11-23 08:14:22 -07:00
rijndael.h
scope.h MDEV-18543 IMPORT TABLESPACE fails after instant DROP COLUMN 2021-10-26 22:50:58 +06:00
service_versions.h MDEV-33277 In-place upgrade causes invalid AUTO_INCREMENT values 2024-02-08 10:35:45 +02:00
source_revision.h.in
span.h Apply clang-tidy to remove empty constructors / destructors 2023-02-09 16:09:08 +02:00
sql_common.h Merge branch '10.5' into 10.6 2023-12-17 11:20:43 +01:00
ssl_compat.h Merge commit '10.4' into 10.5 2023-07-20 11:54:52 +02:00
sslopt-case.h MDEV-25511: Command line tools don't support CRL parameters 2021-05-31 08:29:37 +02:00
sslopt-longopts.h cleanup: unused OPT_xxx and client_priv.h 2024-05-06 17:16:10 +02:00
sslopt-vars.h
t_ctype.h
thr_alarm.h MDEV-25602 get rid of __WIN__ in favor of standard _WIN32 2021-06-06 13:21:03 +02:00
thr_lock.h MDEV-13115: Implement SELECT SKIP LOCKED 2021-04-08 16:51:36 +10:00
thr_timer.h
typelib.h Added 'const' to arguments in get_one_option and find_typeset() 2021-02-08 12:16:29 +02:00
violite.h MDEV-33582 Add more warnings to be able to better diagnose network issues 2024-03-05 20:19:49 +02:00
waiting_threads.h header typos 2022-12-20 08:55:48 +11:00
welcome_copyright_notice.h
wqueue.h
wsrep.h Reduce compilation dependencies on wsrep_mysqld.h 2022-08-31 11:05:23 +03:00