Commit graph

98 commits

Author SHA1 Message Date
Yoni Fogel
6a74f0aacd Refs Tokutek/ft-engine/#40 Add c_restrict_to_range function to force cursor to keep track of prelocked range 2013-07-17 14:55:23 -07:00
Rich Prohaska
57b8de7363 #17 gracefull db open 2013-06-24 10:53:31 -04:00
Yoni Fogel
7f84d4b7a4 refs #25. Fix (test-only) bug where db_env_set_toku_product_name would not get called for some tests because they were lower than ydb layer 2013-06-12 08:31:32 -07:00
Yoni Fogel
a5770c1ce1 refs #25. Makes product name configurable via
db_env_set_toku_product_name
2013-06-11 19:44:52 -07:00
Leif Walsh
c64a51a2be remove overactive assert that in_memory_stats.numbytes is nonnegative #18 2013-05-28 16:31:15 -04:00
Leif Walsh
77c7cdd7fe implement db->get_key_after_bytes closes #18
squashed commits:

create db->get_key_after_bytes() api down to the ft layer, and start a unit test
refs #18

setup/teardown for get_key_after_bytes test
refs #18

rename test because it really is going to be a small unit test
refs #18

implement a few initial checks
refs #18

adding actually_skipped parameter because we will want it in splitVector
refs #18

NULL -> nullptr, I'm rusty from mongo work
refs #18

fix some old apis to fit what get_key_after_bytes needs:

make keyrange_compare_s hold an FT instead of FT_HANDLE to prepare for reuse refs #18

make keyrange_compare_s hold a const dbt refs #18

fix const-correctness of fill_bfe functions refs #18

add unit test for an empty dictionary
refs #18

implement get_key_after_bytes for a single basement node, passes simple tests
refs #18

add test for multiple basement nodes
refs #18

fix usage of ft_search_t, we do need a full one after all
refs #18

check actually_skipped for correctness (even though it's an estimate)
refs #18

restructure test to be faster, and test keys before the beginning of the table
refs #18

don't try to read in the right basement node, just check the bns you have
refs #18

implement get_key_after_bytes for height > 0 trees
refs #18

return the amount skipped even if we hit the end of the table
refs #18

add inexact test for height > 0 trees, adjust constants so it's faster
refs #18

don't do I/O to bring in basement nodes just for get_key_after_bytes
refs #18

don't blindly check the first basement node, it's not guaranteed to be there anymore
refs #18

fix leak in get_key_after_bytes_unit.tdb
refs #18

add get_key_after_bytes to test_stress5
refs #18

switch to a callback API to save mallocs and memcpys
refs #18
2013-05-24 18:02:29 -04:00
Leif Walsh
88def6a5cb fix or suppress errors due to -Wmaybe-uninitialized in GCC 4.8
closes #13
2013-05-06 08:30:03 -04:00
Leif Walsh
9f99932a76 refs #6566 fix typo in license text
git-svn-id: file:///svn/toku/tokudb@55577 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:36 -04:00
Leif Walsh
9fd20e61a4 refs #6566 add license text to all C/C++ files as a comment near the top
git-svn-id: file:///svn/toku/tokudb@55574 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:35 -04:00
Leif Walsh
84fef672e4 refs #6566 update all copyright strings to reflect an end year of 2013
git-svn-id: file:///svn/toku/tokudb@55567 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:35 -04:00
Zardosht Kasheff
73b86e51c4 refs #6300, fix on main
git-svn-id: file:///svn/toku/tokudb@54569 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
798f83412e refs #6286 Reorganized static asserts and status macros so c++11 features stay out of exported headers
git-svn-id: file:///svn/toku/tokudb@54546 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
8c06138f58 refs #6286 Removed TOKDUB_ prefixes from all column names for global status.
Added static asserts that prevent accidentally adding global status variables that start with TOKU

git-svn-id: file:///svn/toku/tokudb@54509 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
22e332838a refs #6286 Add 148 items to information schema.global_status
git-svn-id: file:///svn/toku/tokudb@54507 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
e8226b79b8 refs #6286 Add infrastructure to use column names for info schema
git-svn-id: file:///svn/toku/tokudb@54506 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
5028ac0cb8 refs #6287 Fully remove old debug info
git-svn-id: file:///svn/toku/tokudb@54500 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Rich Prohaska
930aacc602 refs #5820 remove debug printf
git-svn-id: file:///svn/toku/tokudb@54495 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
2ea274c9f5 refs #5820 Merge information schema to mainline
git-svn-id: file:///svn/toku/tokudb@54478 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:31 -04:00
Yoni Fogel
b77c165c15 fixes #6086 Merge 6086 to main. We now read in basement nodes if a full keyrange resides in it so that we can answer more accurately.
git-svn-id: file:///svn/toku/tokudb@54342 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:30 -04:00
Zardosht Kasheff
a85f32968c refs #6058, merge to main!
git-svn-id: file:///svn/toku/tokudb@54234 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:30 -04:00
Zardosht Kasheff
d865cbdeb5 refs #5737, merge to main
git-svn-id: file:///svn/toku/tokudb@53577 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:30 -04:00
Zardosht Kasheff
40c1bc80c5 refs #6057, merge backing out of read txn work to main
git-svn-id: file:///svn/toku/tokudb@53466 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:29 -04:00
Zardosht Kasheff
6ee0cf44ea closes #5978, merge to main
git-svn-id: file:///svn/toku/tokudb@53062 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:29 -04:00
John Esmet
c944625f22 refs #5918 derp
git-svn-id: file:///svn/toku/tokudb@52335 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:27 -04:00
John Esmet
bde258f5dd refs #5918 break down serialize/compress etc times into leaf vs nonleaf
git-svn-id: file:///svn/toku/tokudb@52331 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:27 -04:00
Zardosht Kasheff
f3dc3fdea2 refs #5842, merge Direct I/O to main
git-svn-id: file:///svn/toku/tokudb@52238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:27 -04:00
Zardosht Kasheff
f07a7f1e6a closes #5554, merge to main
git-svn-id: file:///svn/toku/tokudb@51911 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:26 -04:00
Zardosht Kasheff
ebb5315335 refs #5638, merge to main, finally.
git-svn-id: file:///svn/toku/tokudb@51767 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:26 -04:00
John Esmet
49425d163b closes #5864 add compression, decompression, serialization, deserialization statistics to engine status. all interesting code paths should be covered.
git-svn-id: file:///svn/toku/tokudb@51729 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:26 -04:00
John Esmet
0308d99b3f fix stuff
git-svn-id: file:///svn/toku/tokudb@51669 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:26 -04:00
John Esmet
b604b9d6fc fixes #5762 oldest_referenced_xid and oldest_referenced_xid_known now share a prefix, which makes searching for them together a little easier
git-svn-id: file:///svn/toku/tokudb@51667 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:25 -04:00
John Esmet
ea0736aa1c fixes #5723 refs #5801 merge 5723 to main and merge some last-minute 5801 fixes:
- widely adopt the use of ybt abstractions instead of raw dbt management. TODO: the loader and the descriptor are still manually managed.
- remove templates from the perf framework in favor of explicit key size checks that more accurately describe "How Keys/Vals Work", and prevent type related bugs.
- also: removed some dead code, refs #5101



git-svn-id: file:///svn/toku/tokudb@51665 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:25 -04:00
Leif Walsh
69910da437 refs #5861 fix the bug on mainline
git-svn-id: file:///svn/toku/tokudb@51529 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:25 -04:00
Leif Walsh
1517b01985 refs #5672 compile drd/helgrind tests with -O1 so they complete in a reasonable amount of time
git-svn-id: file:///svn/toku/tokudb@51305 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
John Esmet
1fd162242d fixes #5797 cilk artifacts removed
git-svn-id: file:///svn/toku/tokudb@51213 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:24 -04:00
Zardosht Kasheff
004cf78b56 closes #5804, merge 51139, work to read in entire internal nodes into memory, compressed, as opposed to using two I/O's, to main.
git-svn-id: file:///svn/toku/tokudb@51185 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
0062aabc73 refs #5779 merge new accounting to main
git-svn-id: file:///svn/toku/tokudb@51141 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
John Esmet
ad7254879d refs #5773 emergency fix for transactionless environments, which do not need mvcc
git-svn-id: file:///svn/toku/tokudb@51115 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
b43de53fd3 closes #5783, rename txn->recovered_from_checkpoint to txn->for_recovery
git-svn-id: file:///svn/toku/tokudb@51081 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
67eb050b40 closes #5773, merge to main from tokudb.5773, Merging r51027 through r51078 into '.'
git-svn-id: file:///svn/toku/tokudb@51079 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:23 -04:00
Zardosht Kasheff
09ae64c137 refs #5768, fix maintenence of stats numbytes during garbage collection
git-svn-id: file:///svn/toku/tokudb@50867 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Zardosht Kasheff
b2c3b99c81 refs #5768, some changes
git-svn-id: file:///svn/toku/tokudb@50866 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:22 -04:00
Leif Walsh
a8ccc301fd closes #5757 merge information_schema.tokudb_fractal_tree_info and information_schema.tokudb_fractal_tree_block_map to main
git-svn-id: file:///svn/toku/tokudb@50863 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
e04dfafca1 refs #5748, fix small engine status bug introduced
git-svn-id: file:///svn/toku/tokudb@50825 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
84c2121905 refs #5748, do gc on leaves before writing them out to disk
git-svn-id: file:///svn/toku/tokudb@50823 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
6d2baa7492 refs #5559, set child->oldest_known_referenced_xid in toku_bnc_flush_to_child, remove oldest_known_referenced_xid as parameter to ft_flush_some_child
git-svn-id: file:///svn/toku/tokudb@50821 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
John Esmet
4233ec1e5f refs #5559 merge 5559 to main
git-svn-id: file:///svn/toku/tokudb@50812 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Zardosht Kasheff
756f1ba394 refs #5744, fix do_update
git-svn-id: file:///svn/toku/tokudb@50731 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:21 -04:00
Leif Walsh
c653563d3e refs #5672 use a valgrind suppression to ignore the race on the clock
git-svn-id: file:///svn/toku/tokudb@50717 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00
Zardosht Kasheff
58c895e17e closes #5717, simplify case for FT_COMMIT_ANY
git-svn-id: file:///svn/toku/tokudb@50673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-17 00:01:20 -04:00