Commit graph

5320 commits

Author SHA1 Message Date
Leif Walsh
cfea900e2f refs #5672 add invariant to do_partial_fetch
git-svn-id: file:///svn/toku/tokudb@50536 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Leif Walsh
6da3b56c57 refs #5697 revert r50177 (we actually do want stress tests to quit hot indexes early)
git-svn-id: file:///svn/toku/tokudb@50533 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
John Esmet
3c14b7e312 refs #5710 make sure this engine status variable has the closing ')'
git-svn-id: file:///svn/toku/tokudb@50526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
a0eeedd5f5 refs #5700, merge to main
git-svn-id: file:///svn/toku/tokudb@50517 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
bb07e09525 closes #5729, when returning TOKUDB_TRY_AGAIN, don't ever set the write lock type to expensive
git-svn-id: file:///svn/toku/tokudb@50514 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
ebdf618b76 refs #5710 add accounting for flush count, number of bytes, IO time (stored as tokutime, shown in seconds), uncompressed size, and compressed size. also add these stats for when the logger writes to disk (os_pwrite, not fsync)
git-svn-id: file:///svn/toku/tokudb@50513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
860c7994b0 refs #5731, make removing a cachefile from the linked list not be recursive
git-svn-id: file:///svn/toku/tokudb@50510 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
6c10bb3b91 refs #5724, remove call to toku_cachefile_of_filenum in do_insertion
git-svn-id: file:///svn/toku/tokudb@50505 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
eeaf0912c7 refs #5710 fix mac build
git-svn-id: file:///svn/toku/tokudb@50490 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
80b8bb9716 refs #5710 add counters for the number of bytes read and time spent doing IO, for the various ways you can do a fetch. improve the name of get_tokutime() and get rid of the now defunct toku_current_time_nanoseconds()
git-svn-id: file:///svn/toku/tokudb@50481 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
a879883311 refs #5351 remove kruft
git-svn-id: file:///svn/toku/tokudb@50479 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
0e3dfbabec refs #5710 invariant_zero must not be visible when this header is exported to the handlerton
git-svn-id: file:///svn/toku/tokudb@50464 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
2fd87df7ab change stress test script to save libutil.so and to recreate the paths for the libraries we need (gdb has trouble otherwise)
git-svn-id: file:///svn/toku/tokudb@50462 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
7962622c05 refs #5710 add toku_current_time_nanosec, rename current_time_usec to use 'microsec' to be more consistent
git-svn-id: file:///svn/toku/tokudb@50454 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
b4f91e0727 refs #5654, fix invariants to run only if a txn exists, in some unit tests, a txn does not exist
git-svn-id: file:///svn/toku/tokudb@50453 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
761e2ba496 refs #5710 not the right solution. needs to ignore secondary indexes and therefore get pushed to the handlerton
git-svn-id: file:///svn/toku/tokudb@50450 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
8837da0f14 refs #5713 whoopsies, compile fix for release builds
git-svn-id: file:///svn/toku/tokudb@50428 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
d04f506d6c closes #5713 make mutex initializers macros (as posix requires) and clean up the if statement garbage
git-svn-id: file:///svn/toku/tokudb@50424 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
d50d088ea6 refs #4871 increase test timeout for test3529.tdb, apparently it takes a while in my freebsd vm
git-svn-id: file:///svn/toku/tokudb@50422 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
df708c4e4f refs #5710 add FT_MSG_KEYVAL_BYTES_IN to measure the amount of key/value userdata ingested at the root. this value does not count message/xid overhead so it is a good denominator when calculating write amplification
git-svn-id: file:///svn/toku/tokudb@50404 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
60854dacbc refs #5710 start new instrumentation work by cleaning out some commented out instrumentation in ft-ops
git-svn-id: file:///svn/toku/tokudb@50403 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Zardosht Kasheff
f4096a581d refs #5654, grab parent's txn lock when moving rollback entries from child to parent when the child commits. This prevents a race condition with a hot indexer simultaneously adding something to the parent's entry
git-svn-id: file:///svn/toku/tokudb@50375 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
18243fc976 refs #5351 fix darwin build of examples/
git-svn-id: file:///svn/toku/tokudb@50367 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
Leif Walsh
c85623e58f refs #5667 fix test_error a different way (that doesn't break)
git-svn-id: file:///svn/toku/tokudb@50341 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:19 -04:00
John Esmet
5a40b111e8 refs #5629 correct memory management in the callback
git-svn-id: file:///svn/toku/tokudb@50336 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
cb466ea3a6 refs #5351 fix cmake invocation of test_stress0
git-svn-id: file:///svn/toku/tokudb@50330 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
bcc068d012 refs #5671 increase timeout for upgrade stress tests
git-svn-id: file:///svn/toku/tokudb@50329 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
e459c4b1c5 refs #5629 get rid of some unneeded byte flipping. stick to little endian witha little endian comparison function.
git-svn-id: file:///svn/toku/tokudb@50327 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
7653a8165f closes #5667 add __SRCFILE__ to src/tests, use it in test_error.tdb
git-svn-id: file:///svn/toku/tokudb@50326 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
d55461eb70 closes #5696 remove drd ignoring stuff, we think I fixed the bug in another way
git-svn-id: file:///svn/toku/tokudb@50325 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Zardosht Kasheff
21c863b635 closes #5669, increase the cachetable limit, it needs to be at least twice the size of the single pair that we have, otherwise, the evictor may sneak in when we are calling change_pair_attr, and catch the cachetable to have a size of 16, because we have added the new attr but not removed the old one
git-svn-id: file:///svn/toku/tokudb@50322 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
997977d490 don't know what this refs, but increase timeout for loader-stress-del.comp.loader
git-svn-id: file:///svn/toku/tokudb@50321 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
c69b88af16 refs #5671 increase join_timeout default to 1h
git-svn-id: file:///svn/toku/tokudb@50320 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
a6d4ee723c refs #5629 respect the put flags
git-svn-id: file:///svn/toku/tokudb@50319 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
ea7d0656be refs #5629 make sure we have 64 bit versions and there is a test for it
git-svn-id: file:///svn/toku/tokudb@50318 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
c4a230cb1d refs #5629 add 64 bit host to net ordering
git-svn-id: file:///svn/toku/tokudb@50317 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
67bf34707f refs #5629 ensure the proper byte order
git-svn-id: file:///svn/toku/tokudb@50316 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
84d2b6350f refs #5702 fix generate row callback
git-svn-id: file:///svn/toku/tokudb@50314 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
d341ca5098 refs #5671 increase timeout for drd_mid tests
git-svn-id: file:///svn/toku/tokudb@50312 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
c8f788758c refs #4871 finish removing affinity stuff
git-svn-id: file:///svn/toku/tokudb@50311 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
caafdfa859 don't know what this refs, but perf_iibench shouldn't build against bdb
git-svn-id: file:///svn/toku/tokudb@50310 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
ac8329debe refs #5666 increase timeout for filesize.tdb, it's been timing out during coverage runs
git-svn-id: file:///svn/toku/tokudb@50309 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
15e0df36fb refs #5671 implement join_timeout with a portable 'crash and dump core' function
git-svn-id: file:///svn/toku/tokudb@50308 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
27d87f64c4 refs #5702 remove the old perf_insert_multiple, add the new perf_iibench. it is currently very simple. the first DB is a unique index with an autoincrement key, the rest of the DBs are non-unique and have random keys.
git-svn-id: file:///svn/toku/tokudb@50304 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
689a93f5ff fixes #5701 The assert half correct, half over-active. When the manager's mutex is held it is okay to transition an existing locktree's reference count from 0 to 1. If the lock isn't held, it's a race, since one thread could be destroying the zero-ref count locktree when you're incrementing the count. The failure occurred with the manager's mutx held (so the assert was overactive) and it's a layering-pain to assert that the manager's mutex is held otherwise, so just get rid of it.
git-svn-id: file:///svn/toku/tokudb@50297 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
c44f2c3d78 refs #5671 get cores on alarm failure
git-svn-id: file:///svn/toku/tokudb@50277 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
John Esmet
55894dacb4 this test was not running properly, for some reason...
git-svn-id: file:///svn/toku/tokudb@50207 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Yoni Fogel
576cc5f168 refs #5697 revert r50161 (we don't want stress tests to quit hot indexes early)
git-svn-id: file:///svn/toku/tokudb@50177 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
a60df40880 refs #5662 stagger the long running stress tests
git-svn-id: file:///svn/toku/tokudb@50176 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:18 -04:00
Leif Walsh
42dec70f10 refs #4883 remove affinity code, we weren't using it anyway
git-svn-id: file:///svn/toku/tokudb@50174 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:17 -04:00