Commit graph

5565 commits

Author SHA1 Message Date
John Esmet
05eeb46a18 fixes #5801 perf framework has been improved in a few ways:
- minimum key/val size is up to 8 bytes. now perf tests and stress tests have a consistent mechanism for generating keys and values, reducing headache.
- perf tests use a "main" function that generates tables based on the provided key/val size and compressibility, while stress (correctness) tests use a main function that generates tables with a provided (default in all cases, I think) key/val size and fully zero'd values, so the table is in the "correct" zero-sum state. previously this was causing perf tests to generate zer-valued rows always, no matter what row size you wanted or how much compressibility was requested, which clearly skewed performance results (ie: your 100 byte rows are only 8 bytes)
- renamed legacy NULL pointers to nullptr
- moved some "special" operations to the perf/stress tests that use them instead of the global header, to keep things more tidy.



git-svn-id: file:///svn/toku/tokudb@51258 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
John Esmet
3909900311 fixes #5812
git-svn-id: file:///svn/toku/tokudb@51256 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
John Esmet
3cb519b5e6 refs #5811 fix mac build
git-svn-id: file:///svn/toku/tokudb@51254 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
John Esmet
ce3d75552b fixes #5722 fully removed max_partitioned counter dead code
git-svn-id: file:///svn/toku/tokudb@51251 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
Yoni Fogel
c7124719dc refs #5663 Fix compiler warning
git-svn-id: file:///svn/toku/tokudb@51240 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
Yoni Fogel
12ccf6ae0a refs #5663 Merge #5663 onto main
git-svn-id: file:///svn/toku/tokudb@51238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
Zardosht Kasheff
c4a8d4434c refs #5805, merge fix to main
git-svn-id: file:///svn/toku/tokudb@51216 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
John Esmet
1fd162242d fixes #5797 cilk artifacts removed
git-svn-id: file:///svn/toku/tokudb@51213 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
Yoni Fogel
00ac50e3e9 refs #5802 Fix calculations for probabilistic clock,
take into account things could be negative (so use int64_ts instead of uint_64) and set appropriate max for size_current

git-svn-id: file:///svn/toku/tokudb@51207 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
3ad68549df refs #5802, compile fix
git-svn-id: file:///svn/toku/tokudb@51206 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
985e18813f refs #5802, add some casts
git-svn-id: file:///svn/toku/tokudb@51205 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
d13962d4d6 closes #5807, remove assert until we have #5672 fixed
git-svn-id: file:///svn/toku/tokudb@51201 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
e5151f7eda refs #5802, refine comment
git-svn-id: file:///svn/toku/tokudb@51200 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
bf54341114 refs #5802, fix up math, fix inequality
git-svn-id: file:///svn/toku/tokudb@51198 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
cd8b5d7e2b refs #5802, fix some math
git-svn-id: file:///svn/toku/tokudb@51192 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
97d8311d89 refs #5802, fix some math
git-svn-id: file:///svn/toku/tokudb@51190 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
979ce809bb refs #5802, redo the math to avoid divisions and expensive modular arithmetic, add comments explaining why math makes sense
git-svn-id: file:///svn/toku/tokudb@51189 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
9fbe4863a0 refs #5802, merge probabilistic PAIR clock decrementing from tokudb.fb to main.
git-svn-id: file:///svn/toku/tokudb@51187 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
004cf78b56 closes #5804, merge 51139, work to read in entire internal nodes into memory, compressed, as opposed to using two I/O's, to main.
git-svn-id: file:///svn/toku/tokudb@51185 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
4f21a8ed0c refs #5801 actually, don't do this just yet - needs a little more
git-svn-id: file:///svn/toku/tokudb@51157 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
4302af8796 refs #5801 remove some kruft, make the comparison function consistent, juice up the min key size to 8. now, keys are interpreted as an array of 8 byte little endian ints with 0-3 extra bytes at the end
git-svn-id: file:///svn/toku/tokudb@51156 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
0062aabc73 refs #5779 merge new accounting to main
git-svn-id: file:///svn/toku/tokudb@51141 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
ad7254879d refs #5773 emergency fix for transactionless environments, which do not need mvcc
git-svn-id: file:///svn/toku/tokudb@51115 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
33a99affe4 fixes #5771 merge the single txnid optimization to main. single threaded write performance is up 20-50% in mysql and multithreaded performance is largely unchanged.
git-svn-id: file:///svn/toku/tokudb@51108 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
b43de53fd3 closes #5783, rename txn->recovered_from_checkpoint to txn->for_recovery
git-svn-id: file:///svn/toku/tokudb@51081 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
67eb050b40 closes #5773, merge to main from tokudb.5773, Merging r51027 through r51078 into '.'
git-svn-id: file:///svn/toku/tokudb@51079 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Leif Walsh
789ee2877e increase some test timeouts because they time out during coverage runs
git-svn-id: file:///svn/toku/tokudb@51057 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Leif Walsh
5e982cbc4d refs #5672 fix a compile error that just appeared
git-svn-id: file:///svn/toku/tokudb@51010 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Leif Walsh
c1924af662 refs #5672 switch around flags so we can override -O0 in debug builds (maybe speed up drd?)
git-svn-id: file:///svn/toku/tokudb@51009 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Leif Walsh
0b1b7bd3bd don't build ctags if on a mac and also using etags because of the case insensitive filesystem
git-svn-id: file:///svn/toku/tokudb@50999 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
cb55979913 refs #5775, fix deadlock by moving mo lock acquisition higher up in stack for hot indexing
git-svn-id: file:///svn/toku/tokudb@50990 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
7a174bc306 refs #5778 only build static versions of many utilities
git-svn-id: file:///svn/toku/tokudb@50988 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
c0f791cb4e refs #5779 rebalance on the way down in treenode::insert(), add a test that makes sure the concurrent tree can survive 128k serial key insertions.
git-svn-id: file:///svn/toku/tokudb@50986 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
e64cd1ca4b refs #5666 fix keyrange-merge.tdb, needed more elements to work right
git-svn-id: file:///svn/toku/tokudb@50982 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
2c4f804b84 closes #5665 make recover-flt1 work on a bigger tree so we get inbox flushing
git-svn-id: file:///svn/toku/tokudb@50981 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
2f8f9ff560 refs #5776 merge a fix for 5776 to main. will resolve as closed once 5771 can survive stress tests for 24 hours or so.
git-svn-id: file:///svn/toku/tokudb@50967 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
9ceb4d337e refs #5672 try adding some ways to crash that hopefully print a stacktrace
git-svn-id: file:///svn/toku/tokudb@50946 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
8b299e3e50 refs #5772, make a blind fix to set txn->oldest_referenced_xid to TXNID_NONE during recovery
git-svn-id: file:///svn/toku/tokudb@50939 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
68d1ea5ef4 refs #5120 fix up linking on linux
git-svn-id: file:///svn/toku/tokudb@50926 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
d7801469d6 refs #5120 forgot to add toku_time.cc
git-svn-id: file:///svn/toku/tokudb@50925 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
c1c8699577 closes #5120 remove TOKU_ALLOW_DEPRECATED, reorganize some headers a bit to accomodate
git-svn-id: file:///svn/toku/tokudb@50922 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
491c2460d5 refs #5127 allocate space for getcwd ourselves, to avoid system malloc conflicts with jemalloc frees that showed up on osx
git-svn-id: file:///svn/toku/tokudb@50913 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
526c4e7299 refs #5559 fix more tests broken by 5559
git-svn-id: file:///svn/toku/tokudb@50891 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
1cf17f4e3d refs #5559 fix more failures from 5559 on mainline (hint: we need to use initializing functions in tests, no more manually setting fields)
git-svn-id: file:///svn/toku/tokudb@50889 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
ae0053e8dc refs #5559 fix test broken by 5559
git-svn-id: file:///svn/toku/tokudb@50882 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
d605f812fb refs #5730, make cachefiles list a doubly linked list for more efficient close, helps shutdown
git-svn-id: file:///svn/toku/tokudb@50881 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
5a95388095 refs #5638, make small changes to perf_child_txn.cc
git-svn-id: file:///svn/toku/tokudb@50880 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
John Esmet
5575b5e744 refs #5559 fix a test broken by 5559
git-svn-id: file:///svn/toku/tokudb@50877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
8f20fb7115 refs #5559 fix print format bug in ftdump
git-svn-id: file:///svn/toku/tokudb@50873 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
09ae64c137 refs #5768, fix maintenence of stats numbytes during garbage collection
git-svn-id: file:///svn/toku/tokudb@50867 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00