Commit graph

378 commits

Author SHA1 Message Date
John Esmet
4cc64bdbd9 refs #5710 use a sync fetch and add on the tokutime status variables, not a regular increment, since it is accessed by multiple threads
git-svn-id: file:///svn/toku/tokudb@50561 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
1f00b8ac1d refs #5710 fix typos! oops
git-svn-id: file:///svn/toku/tokudb@50560 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
efa90364ce refs #5700, check for existence of txn before dereferencing txn->oldest_referenced_xid
git-svn-id: file:///svn/toku/tokudb@50556 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Leif Walsh
cfea900e2f refs #5672 add invariant to do_partial_fetch
git-svn-id: file:///svn/toku/tokudb@50536 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
3c14b7e312 refs #5710 make sure this engine status variable has the closing ')'
git-svn-id: file:///svn/toku/tokudb@50526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
a0eeedd5f5 refs #5700, merge to main
git-svn-id: file:///svn/toku/tokudb@50517 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
bb07e09525 closes #5729, when returning TOKUDB_TRY_AGAIN, don't ever set the write lock type to expensive
git-svn-id: file:///svn/toku/tokudb@50514 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
ebdf618b76 refs #5710 add accounting for flush count, number of bytes, IO time (stored as tokutime, shown in seconds), uncompressed size, and compressed size. also add these stats for when the logger writes to disk (os_pwrite, not fsync)
git-svn-id: file:///svn/toku/tokudb@50513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
860c7994b0 refs #5731, make removing a cachefile from the linked list not be recursive
git-svn-id: file:///svn/toku/tokudb@50510 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
6c10bb3b91 refs #5724, remove call to toku_cachefile_of_filenum in do_insertion
git-svn-id: file:///svn/toku/tokudb@50505 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
80b8bb9716 refs #5710 add counters for the number of bytes read and time spent doing IO, for the various ways you can do a fetch. improve the name of get_tokutime() and get rid of the now defunct toku_current_time_nanoseconds()
git-svn-id: file:///svn/toku/tokudb@50481 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
7962622c05 refs #5710 add toku_current_time_nanosec, rename current_time_usec to use 'microsec' to be more consistent
git-svn-id: file:///svn/toku/tokudb@50454 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
761e2ba496 refs #5710 not the right solution. needs to ignore secondary indexes and therefore get pushed to the handlerton
git-svn-id: file:///svn/toku/tokudb@50450 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
df708c4e4f refs #5710 add FT_MSG_KEYVAL_BYTES_IN to measure the amount of key/value userdata ingested at the root. this value does not count message/xid overhead so it is a good denominator when calculating write amplification
git-svn-id: file:///svn/toku/tokudb@50404 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
60854dacbc refs #5710 start new instrumentation work by cleaning out some commented out instrumentation in ft-ops
git-svn-id: file:///svn/toku/tokudb@50403 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
f4096a581d refs #5654, grab parent's txn lock when moving rollback entries from child to parent when the child commits. This prevents a race condition with a hot indexer simultaneously adding something to the parent's entry
git-svn-id: file:///svn/toku/tokudb@50375 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
d55461eb70 closes #5696 remove drd ignoring stuff, we think I fixed the bug in another way
git-svn-id: file:///svn/toku/tokudb@50325 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Zardosht Kasheff
21c863b635 closes #5669, increase the cachetable limit, it needs to be at least twice the size of the single pair that we have, otherwise, the evictor may sneak in when we are calling change_pair_attr, and catch the cachetable to have a size of 16, because we have added the new attr but not removed the old one
git-svn-id: file:///svn/toku/tokudb@50322 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
b007ef017d refs #5696 possible fix for drd issues, and for what seems like a typo condition
git-svn-id: file:///svn/toku/tokudb@50158 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
09ff3e9c8d refs #5671 drd annotations got weird recently
git-svn-id: file:///svn/toku/tokudb@50150 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
0cc7d82904 refs #5418 fix typo, include config.h from toku_assert.h so that we always know whether or not to be paranoid
git-svn-id: file:///svn/toku/tokudb@50147 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Yoni Fogel
3af91c0f51 refs #5467 merge "kill put loader, fix hot indexer freeze issue" onto main
git-svn-id: file:///svn/toku/tokudb@50137 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
83c6154273 refs #5671 another leak
git-svn-id: file:///svn/toku/tokudb@50128 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
ddc8d821c1 refs #5671 fix memory leaks
git-svn-id: file:///svn/toku/tokudb@50126 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
9688214ba7 refs #5671 fix a memory leak in test helpers
git-svn-id: file:///svn/toku/tokudb@50124 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
346a38e001 refs #5671 fix an off-by-one error
git-svn-id: file:///svn/toku/tokudb@50065 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00
Leif Walsh
704131bf4b refs #5684 fix compilation
git-svn-id: file:///svn/toku/tokudb@50064 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
17d9bd691c fixes #5684 do not memset on fake_db. only set the cmp descriptor.
git-svn-id: file:///svn/toku/tokudb@50063 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Leif Walsh
aab744ac1b refs #5671 add toku_memdup_dbt, it's cleaner
git-svn-id: file:///svn/toku/tokudb@50011 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Leif Walsh
4258288eb9 refs #5671 also don't use copyref in ft-ops.cc
git-svn-id: file:///svn/toku/tokudb@50010 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Leif Walsh
44e625c726 closes #5671 don't assert in a weird case with left-heavy uneven splits, beef up ybt usage
git-svn-id: file:///svn/toku/tokudb@50009 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
44a1de0280 refs #5351 fix memory leak on main
git-svn-id: file:///svn/toku/tokudb@49965 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Zardosht Kasheff
f95d0fadfb closes #5685, dirty the rollback log node when we give it to a transaction after rollback_log_node_cache.get_rollback_log_node
git-svn-id: file:///svn/toku/tokudb@49961 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Zardosht Kasheff
632e525cfb closes #5682, set dirty bit to 0 after cloning a rollback log node
git-svn-id: file:///svn/toku/tokudb@49932 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
1fbd9dd387 refs #5676 this should not be on main...
git-svn-id: file:///svn/toku/tokudb@49912 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
Leif Walsh
ffe2a5d87c refs #5351 fix mutexattr stuff for darwin
git-svn-id: file:///svn/toku/tokudb@49885 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
d44504d797 fix an error case that was confusing the optimization, which broke the build
git-svn-id: file:///svn/toku/tokudb@49874 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:16 -04:00
John Esmet
12803248af refs #5351 do not use the static initializer in a dynamic context, because it confuses tools like helgrind which look for create/destroy pairs to validate mutex handling
git-svn-id: file:///svn/toku/tokudb@49865 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
John Esmet
6002ec10c0 refsf #5351 fix a very strange warning from the optimizer
git-svn-id: file:///svn/toku/tokudb@49861 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
John Esmet
65cd284834 fixes #5351 fixes #5528 merge the new locktree to main. the locktree, locktree manager, and blocking lock request api are implemented at the toplevel under locktree/ and the ydb layer has been modified to use the new API. some kruft has been deleted from various parts of the source tree and these merge also includes a change where we kill 'includes.h'
git-svn-id: file:///svn/toku/tokudb@49851 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Leif Walsh
2fb9deb055 refs #5418 shrink benchmark-test a bit so it completes faster
git-svn-id: file:///svn/toku/tokudb@49775 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Leif Walsh
2c45ee3a31 refs #5418 add --verify_period to benchmark-test
git-svn-id: file:///svn/toku/tokudb@49772 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Leif Walsh
df8d7e9f2f refs #5418 don't run such a large benchmark-test under valgrind
git-svn-id: file:///svn/toku/tokudb@49758 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Yoni Fogel
1740c966e2 fix benchmark-test test (1 was misplaced)
git-svn-id: file:///svn/toku/tokudb@49709 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:15 -04:00
Yoni Fogel
b211b37602 Add extra options to benchmark-test
git-svn-id: file:///svn/toku/tokudb@49708 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Leif Walsh
bf70bbb898 refs #5418 merge promotion to main
git-svn-id: file:///svn/toku/tokudb@49697 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Rich Prohaska
609d0dca91 get ftdump interactive mode working
git-svn-id: file:///svn/toku/tokudb@49645 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Zardosht Kasheff
3ec4608bf9 refs #5661, move advancement of cleaner head to outside of if-clause, preventing infinite loop in cleaner
git-svn-id: file:///svn/toku/tokudb@49557 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Zardosht Kasheff
e5faea7b5c closes #5661, fix drd issue
git-svn-id: file:///svn/toku/tokudb@49538 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00
Leif Walsh
9659dc651c increase timeout for benchmark-test_256
git-svn-id: file:///svn/toku/tokudb@49528 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:14 -04:00