Commit graph

5837 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
91e2af2b42 Cleanup 2014-02-14 15:16:54 -05:00
Bradley C. Kuszmaul
d71b0003a5 Make the hotbackup library link up 2014-02-14 14:31:14 -05:00
John Esmet
3c0a9bcedd refs #145 capture the node's height before calling finalize(), which is
the last point we may read the node variable safely.
2014-02-13 12:35:19 -05:00
Leif Walsh
3fe7781a19 added tokumx to readme 2014-02-12 11:01:20 -05:00
John Esmet
8efe8d1175 refs #170 Add overall compression ratio. Add all compression ratios to
TOKU_GLOBAL_STATUS
2014-02-11 16:22:56 -05:00
John Esmet
ec1dc2dc22 fixes #170 Add compression ratio engine status values for leaf/nonleaf
disk bytes written. Need to add a 'double' engine status type, which
apparnetly exists in the union, but not as a type tag.
2014-02-11 14:28:08 -05:00
John Esmet
3c2958a4b9 Merge branch 'releases/tokumx-1.4' 2014-02-08 18:02:04 -05:00
John Esmet
f7323d26d9 fixes #168 Run full garbage collection if promotion injects into a leaf
node and notices that it is over 32mb
2014-02-08 17:59:22 -05:00
Leif Walsh
9d3d681d04 Revert "Merge remote-tracking branch 'origin/ft-index/46merge-a'"
This reverts commit b1c1e93dc4, reversing
changes made to 60be90af92.
2014-02-04 11:08:30 -05:00
Leif Walsh
a03b9926d7 Merge remote-tracking branch 'origin/ft-index/46merge-a' 2014-02-04 10:37:07 -05:00
Yoni Fogel
4d9ba2645a fixes Tokutek/ft-index#163 frwlock is properly split into .h and .cc. Users only include .h 2014-01-29 22:09:33 -08:00
Yoni Fogel
198b4d60bd Refs Tokutek/ft-index#46 Updated comments in dmt.h 2014-01-29 20:59:40 -08:00
Yoni Fogel
a5e7b6aca6 Refs Tokutek/ft-index#46 Rename dmt_size->num_klpairs, dmt_iterate*->iterate* 2014-01-29 20:59:36 -08:00
Yoni Fogel
4d3451acd0 Refs Tokutek/ft-index#46 Unify toku_mempool_*_(size|space) to be toku_mempool_*_size 2014-01-29 20:59:34 -08:00
Yoni Fogel
5c9a1a4ca1 Refs Tokutek/ft-index#46 don't (malloc|alloca)+memcpy before le_pack;
Instead just keep mempool around a little longer (like pre-refactoring).  This should
reduce large mallocs and remove a memcpy
2014-01-29 20:59:32 -08:00
Yoni Fogel
7a2e9511a3 Refs Tokutek/ft-index#46 improve test coverage, minor formatting 2014-01-29 20:59:28 -08:00
Yoni Fogel
51d75f315d Refs Tokutek/ft-index#46 cleaned up serialization, upped version to 26 2014-01-29 20:59:26 -08:00
Yoni Fogel
db9ef1a573 Refs Tokutek/ft-index#46 Comments, minor renames, reworked bn_data::move_leafentries s.t. splits do not significantly increase memory usage of basement nodes and to be cleaner 2014-01-29 20:59:24 -08:00
Yoni Fogel
7f2e8e728b Refs Tokutek/ft-index#46 reimplemented bn_data::move_leafentries_to for speed
now uses dmt iterate_on_range and the dmt builder instead of a for loop
2014-01-29 20:59:22 -08:00
Yoni Fogel
3b661a4ba9 Refs Tokutek/ft-index#46 fix overactive inequality assertion in mempool 2014-01-29 20:59:19 -08:00
Yoni Fogel
6b0c108cff Refs Tokutek/ft-index#46 Killed dmt_functor<> template. Added dmtwriter_t template parameter to dmt and some documentation 2014-01-29 20:59:17 -08:00
Yoni Fogel
eef0ab7812 Refs Tokutek/ft-index#46 documentation/comments 2014-01-29 20:59:15 -08:00
Yoni Fogel
12937dc284 Refs Tokutek/ft-index#46 Finish verify (find purpose). Restore old verify_in_mempool functionality 2014-01-29 20:59:10 -08:00
Yoni Fogel
7e32e7c7f8 Refs Tokutek/ft-index#46 Minor optimizations, added some todos for code review. WILL NOT COMPILE 2014-01-29 20:59:08 -08:00
Yoni Fogel
8d45bea397 Refs Tokutek/ft-index#46 Add some comments. Improve dmt::verify() to check for more types of corruption. More static checks 2014-01-29 20:59:05 -08:00
Yoni Fogel
7fb84ea746 Refs Tokutek/ft-index#46 Remove ctree/dtree/mnode/cnode/base node/dnode/marks/etc... That is, removed all items that
were designed to allow us to upgrade the dmt later (e.g. fixed-length nodes for tree form) or merge with old omt (e.g. supporting marks)
2014-01-29 20:58:46 -08:00
Yoni Fogel
8e04352397 Refs Tokutek/ft-index#46 Added some comments, deleted unused/commented out code, renamed variables 2014-01-29 20:58:35 -08:00
Yoni Fogel
b0ccec783a Refs Tokutek/ft-index#46 Add dmt (dynamic OMT)
Use dmt to replace omt in bn_data class for storing leafentries.
Optimization for serial inserts and mempool
2014-01-29 20:53:35 -08:00
Leif Walsh
5a61f34453 added passthrough scoped_malloc impl for osx #160
osx doesn't support __thread well so scoped_malloc breaks it.  Rather than
fix it, we implement a correct but poorly-performing implementation for
now that will be used on osx machines.

fixes #160
2014-01-29 18:40:27 -05:00
Yoni Fogel
00d69605eb fixes Tokutek/ft-index#57 Rewrite test. 2014-01-29 12:28:43 -08:00
Yoni Fogel
168e12c7e9 Refs Tokutek/ft-index#159 Calculate klpair size correctly when message application deletes a leafentry 2014-01-27 21:02:34 -08:00
Yoni Fogel
30bf78b3fc Refs Tokutek/ft-index#159 Calculate klpair size correctly when garbage collection deletes a leafentry 2014-01-27 20:58:43 -08:00
Yoni Fogel
8c3c9ca4f2 refs Tokutek/mongo#886 Fix get_last_key test.
Garbage collection was done on the clones and did not always make it to in-memory.
Also, closing a db and reopening no longer (necessarily) flushes the nodes out of memory; we close the entire environment when we want to ensure we read it.
2014-01-27 20:52:25 -08:00
John Esmet
625d852692 fixes #145 Destroy resources outside of the pair's write lock during
partial eviction
2014-01-23 16:59:49 -05:00
John Esmet
75052cdc11 fixes #127 Add a class for scoped mallocs, which are satisfied from a
thread-local buffer when possible.
2014-01-23 16:57:04 -05:00
John Esmet
8527aa5aeb Fix an off by 1 bug 2014-01-23 11:20:31 -05:00
John Esmet
fbc1f5933e fixes #146 Add context class and track the current writer/context in the
frwlock
2014-01-22 13:18:49 -05:00
John Esmet
8fc37abdcd fixes #156 Add a parameter for the nonleaf partial eviction strategy 2014-01-22 12:56:45 -05:00
Yoni Fogel
3207d145ff refs Tokutek/mongo#886 Clean up test (don't repeat test 3 times), run several more cases 2014-01-21 23:34:53 -08:00
Zardosht Kasheff
991e31ed32 refs Tokutek/mongo#886, change get_last_key to use a callback instead of copying data, so that we don't have
mongo code freeing data that fractal tree allocated.
2014-01-21 23:08:30 -05:00
Yoni Fogel
2a04aefc6f refs Tokutek/mongo#886
Add db->get_last_key() and test.
Add test
2014-01-21 17:08:59 -05:00
John Esmet
e1a82f88ab fixes #142 Always use quicklz when partially evicting an internal node
partition
2014-01-21 13:04:35 -05:00
John Esmet
773bb8c945 fixes #132 Calculate size delta statistics once during the partial
eviction callback
2014-01-21 13:04:35 -05:00
John Esmet
ed9b5fc676 fixes #140 Pre-size the fifo before appending data during nonleaf
serialization. Assume the fifo is about 1kb larger than the read buffer
(in practice, the fifo is 5 bytes smaller than the read buffer).
2014-01-21 13:02:59 -05:00
John Esmet
84fa905d8d fixes #130 Create basement nodes and non-leaf message trees using
create_no_array() so that deserialization does not malloc/free needlessly.
2014-01-21 12:59:58 -05:00
John Esmet
d000732ab4 fixes #151 Do not send commit messages for fractal tree update commands 2014-01-21 12:59:46 -05:00
John Esmet
2e190e0631 fixes #152 Add accounting for long input buffer wait stalls in the
logger
2014-01-21 12:59:34 -05:00
John Esmet
f7c1d3f9ff fixes #154 Remove toku_fair_rwlock 2014-01-20 16:53:17 -05:00
Rich Prohaska
0492446818 #147 dont hold locktree manager mutex when escalating 2014-01-14 19:14:18 -05:00
Rich Prohaska
c8993dec4d #141 identify a big transaction and have it run lock escalation 2014-01-13 11:29:52 -05:00