Commit graph

61 commits

Author SHA1 Message Date
John Esmet
ad7254879d refs #5773 emergency fix for transactionless environments, which do not need mvcc
git-svn-id: file:///svn/toku/tokudb@51115 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
b43de53fd3 closes #5783, rename txn->recovered_from_checkpoint to txn->for_recovery
git-svn-id: file:///svn/toku/tokudb@51081 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
67eb050b40 closes #5773, merge to main from tokudb.5773, Merging r51027 through r51078 into '.'
git-svn-id: file:///svn/toku/tokudb@51079 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
09ae64c137 refs #5768, fix maintenence of stats numbytes during garbage collection
git-svn-id: file:///svn/toku/tokudb@50867 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
b2c3b99c81 refs #5768, some changes
git-svn-id: file:///svn/toku/tokudb@50866 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
a8ccc301fd closes #5757 merge information_schema.tokudb_fractal_tree_info and information_schema.tokudb_fractal_tree_block_map to main
git-svn-id: file:///svn/toku/tokudb@50863 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
e04dfafca1 refs #5748, fix small engine status bug introduced
git-svn-id: file:///svn/toku/tokudb@50825 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
84c2121905 refs #5748, do gc on leaves before writing them out to disk
git-svn-id: file:///svn/toku/tokudb@50823 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
6d2baa7492 refs #5559, set child->oldest_known_referenced_xid in toku_bnc_flush_to_child, remove oldest_known_referenced_xid as parameter to ft_flush_some_child
git-svn-id: file:///svn/toku/tokudb@50821 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
John Esmet
4233ec1e5f refs #5559 merge 5559 to main
git-svn-id: file:///svn/toku/tokudb@50812 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
756f1ba394 refs #5744, fix do_update
git-svn-id: file:///svn/toku/tokudb@50731 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Leif Walsh
c653563d3e refs #5672 use a valgrind suppression to ignore the race on the clock
git-svn-id: file:///svn/toku/tokudb@50717 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
58c895e17e closes #5717, simplify case for FT_COMMIT_ANY
git-svn-id: file:///svn/toku/tokudb@50673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
4cc64bdbd9 refs #5710 use a sync fetch and add on the tokutime status variables, not a regular increment, since it is accessed by multiple threads
git-svn-id: file:///svn/toku/tokudb@50561 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
efa90364ce refs #5700, check for existence of txn before dereferencing txn->oldest_referenced_xid
git-svn-id: file:///svn/toku/tokudb@50556 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
3c14b7e312 refs #5710 make sure this engine status variable has the closing ')'
git-svn-id: file:///svn/toku/tokudb@50526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
a0eeedd5f5 refs #5700, merge to main
git-svn-id: file:///svn/toku/tokudb@50517 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
ebdf618b76 refs #5710 add accounting for flush count, number of bytes, IO time (stored as tokutime, shown in seconds), uncompressed size, and compressed size. also add these stats for when the logger writes to disk (os_pwrite, not fsync)
git-svn-id: file:///svn/toku/tokudb@50513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
80b8bb9716 refs #5710 add counters for the number of bytes read and time spent doing IO, for the various ways you can do a fetch. improve the name of get_tokutime() and get rid of the now defunct toku_current_time_nanoseconds()
git-svn-id: file:///svn/toku/tokudb@50481 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
7962622c05 refs #5710 add toku_current_time_nanosec, rename current_time_usec to use 'microsec' to be more consistent
git-svn-id: file:///svn/toku/tokudb@50454 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
761e2ba496 refs #5710 not the right solution. needs to ignore secondary indexes and therefore get pushed to the handlerton
git-svn-id: file:///svn/toku/tokudb@50450 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
df708c4e4f refs #5710 add FT_MSG_KEYVAL_BYTES_IN to measure the amount of key/value userdata ingested at the root. this value does not count message/xid overhead so it is a good denominator when calculating write amplification
git-svn-id: file:///svn/toku/tokudb@50404 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
60854dacbc refs #5710 start new instrumentation work by cleaning out some commented out instrumentation in ft-ops
git-svn-id: file:///svn/toku/tokudb@50403 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
0cc7d82904 refs #5418 fix typo, include config.h from toku_assert.h so that we always know whether or not to be paranoid
git-svn-id: file:///svn/toku/tokudb@50147 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Yoni Fogel
3af91c0f51 refs #5467 merge "kill put loader, fix hot indexer freeze issue" onto main
git-svn-id: file:///svn/toku/tokudb@50137 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
4258288eb9 refs #5671 also don't use copyref in ft-ops.cc
git-svn-id: file:///svn/toku/tokudb@50010 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
44a1de0280 refs #5351 fix memory leak on main
git-svn-id: file:///svn/toku/tokudb@49965 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
65cd284834 fixes #5351 fixes #5528 merge the new locktree to main. the locktree, locktree manager, and blocking lock request api are implemented at the toplevel under locktree/ and the ydb layer has been modified to use the new API. some kruft has been deleted from various parts of the source tree and these merge also includes a change where we kill 'includes.h'
git-svn-id: file:///svn/toku/tokudb@49851 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Leif Walsh
bf70bbb898 refs #5418 merge promotion to main
git-svn-id: file:///svn/toku/tokudb@49697 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Zardosht Kasheff
ddfd46fb56 refs #5634, merge bucket mutexes to main
git-svn-id: file:///svn/toku/tokudb@49391 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Leif Walsh
264a8e65ed refs #5592 fix linking of util, again...
git-svn-id: file:///svn/toku/tokudb@48823 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:13 -04:00
Leif Walsh
774afe534d refs #5592 move circular_buffer, omt, threadpool, growable_array, rwlock, frwlock, kibbutz, mempool, partitioned_counter, nb_mutex, sort to util/, and some other cleanup stuff
git-svn-id: file:///svn/toku/tokudb@48763 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:13 -04:00
Leif Walsh
5abdff33ff refs #5464 move partitioned_counters_init/destroy to portability
git-svn-id: file:///svn/toku/tokudb@48690 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:12 -04:00
Leif Walsh
c3a0afeab3 refs #5368 unify race detection tool annotations in <toku_race_tools.h>
git-svn-id: file:///svn/toku/tokudb@48361 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:11 -04:00
John Esmet
3364bd0b0e refs #5490 dup/nodup artifacts
git-svn-id: file:///svn/toku/tokudb@48249 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:10 -04:00
John Esmet
1b8c8ac4b2 refs #5500 close userdata and checkpoint userdata do not fail, so cachefile close and ft evict from memory do not fail
git-svn-id: file:///svn/toku/tokudb@48237 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:09 -04:00
John Esmet
c652e648fc refs #5500 logger fsync does not fail
git-svn-id: file:///svn/toku/tokudb@48233 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:09 -04:00
John Esmet
0bc5013e30 fixes #5423 fixes #5424 fixes #5503 fixes #5225 fsync always succeeds and returns void, no more ft panic or logger panic, no more impossible error paths
git-svn-id: file:///svn/toku/tokudb@48076 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:08 -04:00
Zardosht Kasheff
8f93bfd8d0 refs #5467, undo checkin
git-svn-id: file:///svn/toku/tokudb@47900 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:07 -04:00
Zardosht Kasheff
5dd0e5e897 refs #5467, merge to main
git-svn-id: file:///svn/toku/tokudb@47870 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:06 -04:00
Leif Walsh
5aa3577fed closes #5464 merge partitioned counters as ft-ops.cc status variables to main
git-svn-id: file:///svn/toku/tokudb@47804 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:06 -04:00
Zardosht Kasheff
06df52d6e1 refs #5442, merge to main
git-svn-id: file:///svn/toku/tokudb@47493 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Leif Walsh
b1a499457b closes #5407 don't update msns of dirty nodes to prevent corruption
git-svn-id: file:///svn/toku/tokudb@47347 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Christian Rober
f3fab8cd8d refs #5086 adding function declarations for compilation errors on clang, added macro usage to prevent clang from being too strict about POD.
git-svn-id: file:///svn/toku/tokudb@47173 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Leif Walsh
b53d614cbb refs #4937 set message's msn after splitting the root to avoid a race
git-svn-id: file:///svn/toku/tokudb@47096 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
d59b9e772d refs #4937, merge to main
git-svn-id: file:///svn/toku/tokudb@47083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Leif Walsh
ca7781d92d refs #5378 merge to main
git-svn-id: file:///svn/toku/tokudb@47027 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
b2c3633e70 closes #5388, batch pins for keyrange
git-svn-id: file:///svn/toku/tokudb@47026 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
3a887ea75f refs #5312, merge to main
git-svn-id: file:///svn/toku/tokudb@47022 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
Yoni Fogel
52dd11a5b4 closes #5367 Fix problem where nodes in omt are marked stale, the node is evicted and read again and not marked stale ever again
git-svn-id: file:///svn/toku/tokudb@46947 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00