Commit graph

53 commits

Author SHA1 Message Date
Zardosht Kasheff
6d2baa7492 refs #5559, set child->oldest_known_referenced_xid in toku_bnc_flush_to_child, remove oldest_known_referenced_xid as parameter to ft_flush_some_child
git-svn-id: file:///svn/toku/tokudb@50821 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
John Esmet
4233ec1e5f refs #5559 merge 5559 to main
git-svn-id: file:///svn/toku/tokudb@50812 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
756f1ba394 refs #5744, fix do_update
git-svn-id: file:///svn/toku/tokudb@50731 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Leif Walsh
c653563d3e refs #5672 use a valgrind suppression to ignore the race on the clock
git-svn-id: file:///svn/toku/tokudb@50717 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
58c895e17e closes #5717, simplify case for FT_COMMIT_ANY
git-svn-id: file:///svn/toku/tokudb@50673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
4cc64bdbd9 refs #5710 use a sync fetch and add on the tokutime status variables, not a regular increment, since it is accessed by multiple threads
git-svn-id: file:///svn/toku/tokudb@50561 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
efa90364ce refs #5700, check for existence of txn before dereferencing txn->oldest_referenced_xid
git-svn-id: file:///svn/toku/tokudb@50556 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
3c14b7e312 refs #5710 make sure this engine status variable has the closing ')'
git-svn-id: file:///svn/toku/tokudb@50526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
a0eeedd5f5 refs #5700, merge to main
git-svn-id: file:///svn/toku/tokudb@50517 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
ebdf618b76 refs #5710 add accounting for flush count, number of bytes, IO time (stored as tokutime, shown in seconds), uncompressed size, and compressed size. also add these stats for when the logger writes to disk (os_pwrite, not fsync)
git-svn-id: file:///svn/toku/tokudb@50513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
80b8bb9716 refs #5710 add counters for the number of bytes read and time spent doing IO, for the various ways you can do a fetch. improve the name of get_tokutime() and get rid of the now defunct toku_current_time_nanoseconds()
git-svn-id: file:///svn/toku/tokudb@50481 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
7962622c05 refs #5710 add toku_current_time_nanosec, rename current_time_usec to use 'microsec' to be more consistent
git-svn-id: file:///svn/toku/tokudb@50454 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
761e2ba496 refs #5710 not the right solution. needs to ignore secondary indexes and therefore get pushed to the handlerton
git-svn-id: file:///svn/toku/tokudb@50450 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
df708c4e4f refs #5710 add FT_MSG_KEYVAL_BYTES_IN to measure the amount of key/value userdata ingested at the root. this value does not count message/xid overhead so it is a good denominator when calculating write amplification
git-svn-id: file:///svn/toku/tokudb@50404 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
60854dacbc refs #5710 start new instrumentation work by cleaning out some commented out instrumentation in ft-ops
git-svn-id: file:///svn/toku/tokudb@50403 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
0cc7d82904 refs #5418 fix typo, include config.h from toku_assert.h so that we always know whether or not to be paranoid
git-svn-id: file:///svn/toku/tokudb@50147 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Yoni Fogel
3af91c0f51 refs #5467 merge "kill put loader, fix hot indexer freeze issue" onto main
git-svn-id: file:///svn/toku/tokudb@50137 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
4258288eb9 refs #5671 also don't use copyref in ft-ops.cc
git-svn-id: file:///svn/toku/tokudb@50010 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
44a1de0280 refs #5351 fix memory leak on main
git-svn-id: file:///svn/toku/tokudb@49965 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
65cd284834 fixes #5351 fixes #5528 merge the new locktree to main. the locktree, locktree manager, and blocking lock request api are implemented at the toplevel under locktree/ and the ydb layer has been modified to use the new API. some kruft has been deleted from various parts of the source tree and these merge also includes a change where we kill 'includes.h'
git-svn-id: file:///svn/toku/tokudb@49851 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Leif Walsh
bf70bbb898 refs #5418 merge promotion to main
git-svn-id: file:///svn/toku/tokudb@49697 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Zardosht Kasheff
ddfd46fb56 refs #5634, merge bucket mutexes to main
git-svn-id: file:///svn/toku/tokudb@49391 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Leif Walsh
264a8e65ed refs #5592 fix linking of util, again...
git-svn-id: file:///svn/toku/tokudb@48823 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:13 -04:00
Leif Walsh
774afe534d refs #5592 move circular_buffer, omt, threadpool, growable_array, rwlock, frwlock, kibbutz, mempool, partitioned_counter, nb_mutex, sort to util/, and some other cleanup stuff
git-svn-id: file:///svn/toku/tokudb@48763 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:13 -04:00
Leif Walsh
5abdff33ff refs #5464 move partitioned_counters_init/destroy to portability
git-svn-id: file:///svn/toku/tokudb@48690 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:12 -04:00
Leif Walsh
c3a0afeab3 refs #5368 unify race detection tool annotations in <toku_race_tools.h>
git-svn-id: file:///svn/toku/tokudb@48361 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:11 -04:00
John Esmet
3364bd0b0e refs #5490 dup/nodup artifacts
git-svn-id: file:///svn/toku/tokudb@48249 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:10 -04:00
John Esmet
1b8c8ac4b2 refs #5500 close userdata and checkpoint userdata do not fail, so cachefile close and ft evict from memory do not fail
git-svn-id: file:///svn/toku/tokudb@48237 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:09 -04:00
John Esmet
c652e648fc refs #5500 logger fsync does not fail
git-svn-id: file:///svn/toku/tokudb@48233 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:09 -04:00
John Esmet
0bc5013e30 fixes #5423 fixes #5424 fixes #5503 fixes #5225 fsync always succeeds and returns void, no more ft panic or logger panic, no more impossible error paths
git-svn-id: file:///svn/toku/tokudb@48076 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:08 -04:00
Zardosht Kasheff
8f93bfd8d0 refs #5467, undo checkin
git-svn-id: file:///svn/toku/tokudb@47900 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:07 -04:00
Zardosht Kasheff
5dd0e5e897 refs #5467, merge to main
git-svn-id: file:///svn/toku/tokudb@47870 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:06 -04:00
Leif Walsh
5aa3577fed closes #5464 merge partitioned counters as ft-ops.cc status variables to main
git-svn-id: file:///svn/toku/tokudb@47804 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:06 -04:00
Zardosht Kasheff
06df52d6e1 refs #5442, merge to main
git-svn-id: file:///svn/toku/tokudb@47493 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Leif Walsh
b1a499457b closes #5407 don't update msns of dirty nodes to prevent corruption
git-svn-id: file:///svn/toku/tokudb@47347 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Christian Rober
f3fab8cd8d refs #5086 adding function declarations for compilation errors on clang, added macro usage to prevent clang from being too strict about POD.
git-svn-id: file:///svn/toku/tokudb@47173 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:05 -04:00
Leif Walsh
b53d614cbb refs #4937 set message's msn after splitting the root to avoid a race
git-svn-id: file:///svn/toku/tokudb@47096 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
d59b9e772d refs #4937, merge to main
git-svn-id: file:///svn/toku/tokudb@47083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Leif Walsh
ca7781d92d refs #5378 merge to main
git-svn-id: file:///svn/toku/tokudb@47027 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
b2c3633e70 closes #5388, batch pins for keyrange
git-svn-id: file:///svn/toku/tokudb@47026 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:04 -04:00
Zardosht Kasheff
3a887ea75f refs #5312, merge to main
git-svn-id: file:///svn/toku/tokudb@47022 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
Yoni Fogel
52dd11a5b4 closes #5367 Fix problem where nodes in omt are marked stale, the node is evicted and read again and not marked stale ever again
git-svn-id: file:///svn/toku/tokudb@46947 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
Yoni Fogel
4407c947c6 refs #5367 Revert r46901 (incorrect fix)
git-svn-id: file:///svn/toku/tokudb@46945 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
Leif Walsh
e5a3993c58 closes #5367 fix a race between marking messages as stale in the fifo and in the omt
git-svn-id: file:///svn/toku/tokudb@46901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
Zardosht Kasheff
7ea6dd4171 refs #4606, merge to main
git-svn-id: file:///svn/toku/tokudb@46797 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:03 -04:00
John Esmet
01068d0c1d fixes #4752 support blackhole option in tokudb, add it to the stress test framework as well as an option for prelocked write. we also fix the flags api in the ft layer to return void since they can't fail.
git-svn-id: file:///svn/toku/tokudb@46644 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:02 -04:00
Leif Walsh
8f1ee9c29c refs #5155 merge some work to main:
- better delete marked algorithm
 - use marked omt for fresh message tree
 - little cleanup things


git-svn-id: file:///svn/toku/tokudb@46549 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:02 -04:00
Bradley C. Kuszmaul
7a6b7c9896 Fix #5295, #5292. {{{svn merge -r46285:46297 ../tokudb.5295b}}}
git-svn-id: file:///svn/toku/tokudb@46309 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:02 -04:00
Yoni Fogel
d4cf29525f refs #5081 Replace all usage:
BOOL->bool
FALSE->false
TRUE->true
u_int*_t->uint*_t

Also poisoned all of the variables

git-svn-id: file:///svn/toku/tokudb@46157 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:01 -04:00
John Esmet
f5be016dea fixes #5282 only do txn related operations if a txn exists. note that the ydb layer properly handles change descriptor in a txnless environment.
git-svn-id: file:///svn/toku/tokudb@45958 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:00 -04:00