Commit graph

5857 commits

Author SHA1 Message Date
John Esmet
3b85f796d8 fixes #184 Remove non-production code 2014-03-01 18:56:22 -05:00
Rich Prohaska
eb500b8cb1 #178 destroy ule status partitioned counters 2014-02-25 11:21:13 -05:00
Rich Prohaska
21421e1f36 #168 fix make problem related to tokudb only tests 2014-02-25 09:57:36 -05:00
Leif Walsh
c6a6cd8cf8 Merge remote-tracking branch 'origin/garbage_collection_extended' 2014-02-23 16:09:07 -05:00
John Esmet
dfcffcc714 Allow txn manager state to be created cheaply, with the option to later
initialize it for full gc if we think it is worth it. This allows for
full gc to run when bringing a basement node up to date.
2014-02-21 19:57:19 -05:00
John Esmet
9ee82c3cce Do not use the newest of our ancestor's oldest_referenced_xid values -
there may be an abort message waiting to be applied.
2014-02-21 16:10:51 -05:00
John Esmet
36a525f978 Fix test 2014-02-21 16:09:34 -05:00
John Esmet
be301362d8 Add test to detect a case of bad implicition promotion 2014-02-21 15:57:58 -05:00
Rich Prohaska
054633c65d #173 allow lock tree waits to be killable 2014-02-21 12:27:23 -05:00
John Esmet
0bd9ff9d3f Fix up a race where two threads could update the oldest referenced xid
in a different order than they began, and blow up a bad assert.
2014-02-20 16:15:14 -05:00
John Esmet
fb76250b7a Consolidate garbage collection information into txn_gc_info. Explicitly
separate the difference between the oldest referenced xid we can use for
implicit promotion vs simple garbage collection.
2014-02-20 13:32:25 -05:00
John Esmet
f12bdc758c Pass down txn manager state to message application, which it can use to
run full garbage collection when a leafentry has > 1 committed entry.
2014-02-20 13:30:30 -05:00
John Esmet
d93fe66d5e refs #171 split the includes that are used for OSX vs linux builds 2014-02-15 10:38:20 -05:00
John Esmet
ca7651e522 fixes #171 maintain a global map of registered tl_stack objects that we
can iterate over and clean up, which prevents a memory leak when the
fractal tree shared library unloads before all thread-local destructors run
2014-02-15 10:13:23 -05:00
Bradley C. Kuszmaul
0a06abb42e Revert "Make the hotbackup library link up"
This reverts commit 843f0050cb.

Should have been on a branch.
2014-02-14 17:07:26 -05:00
Bradley C. Kuszmaul
d0223116ac Revert "Cleanup"
This reverts commit 7fa771e0f3.

Should have been on a branch.
2014-02-14 17:07:10 -05:00
Bradley C. Kuszmaul
6154c3d31b Revert "Cleanup"
This reverts commit fbd9685991.

Should have been on a branch.
2014-02-14 17:06:22 -05:00
Bradley C. Kuszmaul
d76887a9c2 Revert "backup stress test runs"
This reverts commit d467d3cf42.

Should have been on a branch.
2014-02-14 17:06:01 -05:00
Bradley C. Kuszmaul
7c6bd00edf backup stress test runs 2014-02-14 16:02:58 -05:00
Bradley C. Kuszmaul
00ef6d8498 Cleanup 2014-02-14 15:27:23 -05:00
Bradley C. Kuszmaul
91e2af2b42 Cleanup 2014-02-14 15:16:54 -05:00
Bradley C. Kuszmaul
d71b0003a5 Make the hotbackup library link up 2014-02-14 14:31:14 -05:00
John Esmet
3c0a9bcedd refs #145 capture the node's height before calling finalize(), which is
the last point we may read the node variable safely.
2014-02-13 12:35:19 -05:00
Leif Walsh
3fe7781a19 added tokumx to readme 2014-02-12 11:01:20 -05:00
John Esmet
8efe8d1175 refs #170 Add overall compression ratio. Add all compression ratios to
TOKU_GLOBAL_STATUS
2014-02-11 16:22:56 -05:00
John Esmet
ec1dc2dc22 fixes #170 Add compression ratio engine status values for leaf/nonleaf
disk bytes written. Need to add a 'double' engine status type, which
apparnetly exists in the union, but not as a type tag.
2014-02-11 14:28:08 -05:00
John Esmet
3c2958a4b9 Merge branch 'releases/tokumx-1.4' 2014-02-08 18:02:04 -05:00
John Esmet
f7323d26d9 fixes #168 Run full garbage collection if promotion injects into a leaf
node and notices that it is over 32mb
2014-02-08 17:59:22 -05:00
Leif Walsh
9d3d681d04 Revert "Merge remote-tracking branch 'origin/ft-index/46merge-a'"
This reverts commit b1c1e93dc4, reversing
changes made to 60be90af92.
2014-02-04 11:08:30 -05:00
Leif Walsh
a03b9926d7 Merge remote-tracking branch 'origin/ft-index/46merge-a' 2014-02-04 10:37:07 -05:00
Yoni Fogel
4d9ba2645a fixes Tokutek/ft-index#163 frwlock is properly split into .h and .cc. Users only include .h 2014-01-29 22:09:33 -08:00
Yoni Fogel
198b4d60bd Refs Tokutek/ft-index#46 Updated comments in dmt.h 2014-01-29 20:59:40 -08:00
Yoni Fogel
a5e7b6aca6 Refs Tokutek/ft-index#46 Rename dmt_size->num_klpairs, dmt_iterate*->iterate* 2014-01-29 20:59:36 -08:00
Yoni Fogel
4d3451acd0 Refs Tokutek/ft-index#46 Unify toku_mempool_*_(size|space) to be toku_mempool_*_size 2014-01-29 20:59:34 -08:00
Yoni Fogel
5c9a1a4ca1 Refs Tokutek/ft-index#46 don't (malloc|alloca)+memcpy before le_pack;
Instead just keep mempool around a little longer (like pre-refactoring).  This should
reduce large mallocs and remove a memcpy
2014-01-29 20:59:32 -08:00
Yoni Fogel
7a2e9511a3 Refs Tokutek/ft-index#46 improve test coverage, minor formatting 2014-01-29 20:59:28 -08:00
Yoni Fogel
51d75f315d Refs Tokutek/ft-index#46 cleaned up serialization, upped version to 26 2014-01-29 20:59:26 -08:00
Yoni Fogel
db9ef1a573 Refs Tokutek/ft-index#46 Comments, minor renames, reworked bn_data::move_leafentries s.t. splits do not significantly increase memory usage of basement nodes and to be cleaner 2014-01-29 20:59:24 -08:00
Yoni Fogel
7f2e8e728b Refs Tokutek/ft-index#46 reimplemented bn_data::move_leafentries_to for speed
now uses dmt iterate_on_range and the dmt builder instead of a for loop
2014-01-29 20:59:22 -08:00
Yoni Fogel
3b661a4ba9 Refs Tokutek/ft-index#46 fix overactive inequality assertion in mempool 2014-01-29 20:59:19 -08:00
Yoni Fogel
6b0c108cff Refs Tokutek/ft-index#46 Killed dmt_functor<> template. Added dmtwriter_t template parameter to dmt and some documentation 2014-01-29 20:59:17 -08:00
Yoni Fogel
eef0ab7812 Refs Tokutek/ft-index#46 documentation/comments 2014-01-29 20:59:15 -08:00
Yoni Fogel
12937dc284 Refs Tokutek/ft-index#46 Finish verify (find purpose). Restore old verify_in_mempool functionality 2014-01-29 20:59:10 -08:00
Yoni Fogel
7e32e7c7f8 Refs Tokutek/ft-index#46 Minor optimizations, added some todos for code review. WILL NOT COMPILE 2014-01-29 20:59:08 -08:00
Yoni Fogel
8d45bea397 Refs Tokutek/ft-index#46 Add some comments. Improve dmt::verify() to check for more types of corruption. More static checks 2014-01-29 20:59:05 -08:00
Yoni Fogel
7fb84ea746 Refs Tokutek/ft-index#46 Remove ctree/dtree/mnode/cnode/base node/dnode/marks/etc... That is, removed all items that
were designed to allow us to upgrade the dmt later (e.g. fixed-length nodes for tree form) or merge with old omt (e.g. supporting marks)
2014-01-29 20:58:46 -08:00
Yoni Fogel
8e04352397 Refs Tokutek/ft-index#46 Added some comments, deleted unused/commented out code, renamed variables 2014-01-29 20:58:35 -08:00
Yoni Fogel
b0ccec783a Refs Tokutek/ft-index#46 Add dmt (dynamic OMT)
Use dmt to replace omt in bn_data class for storing leafentries.
Optimization for serial inserts and mempool
2014-01-29 20:53:35 -08:00
Leif Walsh
5a61f34453 added passthrough scoped_malloc impl for osx #160
osx doesn't support __thread well so scoped_malloc breaks it.  Rather than
fix it, we implement a correct but poorly-performing implementation for
now that will be used on osx machines.

fixes #160
2014-01-29 18:40:27 -05:00
Yoni Fogel
00d69605eb fixes Tokutek/ft-index#57 Rewrite test. 2014-01-29 12:28:43 -08:00