Commit graph

3245 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
5fcfafc691 Overactive assertion. Refs #2759. [t:2759]
git-svn-id: file:///svn/toku/tokudb@21573 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
c49d7a8c0c The first loader gets 1/2 of cachetable memory.
* That's 2/3 of 3/4, which is calculated as 1/4 is unreservable.  The loader asks for 2/3 of what's reservable, getting one half.
The second loader gets 1/6 of cachetable memory.
 * That's 2/3 of 1/4: The loader asks for 2/3 of what's reservable.  1/2 has been reserved.  1/4 is unreservable.  1/4 is reservable.  2/3 of 1/4 is 1/6.
The third loader gets 1/18 of cachetable memory. 
 * That's 2/3 or 1/12.   (1/4 is unreservable. 1/2 was reserved by the first loader.  1/6 by the second.  That leaves 1/12)
Generally the next one gets 1/3 of what the previous one got.

Refs #2759. [t:2759]


git-svn-id: file:///svn/toku/tokudb@21564 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
f635f4d458 Merge the fix for #2755 and #2759 to main. [t:2755] [t:2759]
{{{
svn merge -r21499:21502 https://svn.tokutek.com/tokudb/toku/tokudb.2755
}}}
.


git-svn-id: file:///svn/toku/tokudb@21503 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
2248b6205c #2740 refs[t:2740] fix the cxx permissions test (which depends on the underlying inames)
git-svn-id: file:///svn/toku/tokudb@21309 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
a61a4869ba Closes [t:2740] Delete rot13 of inames.
git-svn-id: file:///svn/toku/tokudb@21289 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
c37567705f #2738 refs[t:2738] merge dbufio bug fix to main
git-svn-id: file:///svn/toku/tokudb@21260 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
76dcd3fe21 2738 refs[t:2738] test case for the double buffer hang
git-svn-id: file:///svn/toku/tokudb@21217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
1a65ba1d80 #2723 refs[t:2723] fix the slow control-c reaction in the brtloader's write to brt function
git-svn-id: file:///svn/toku/tokudb@21103 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
0498c6e405 Added timestamps to exhastive abort_via_poll test (-k option).
git-svn-id: file:///svn/toku/tokudb@21084 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
12f96cf9d9 Added utilities to format and print current time.
git-svn-id: file:///svn/toku/tokudb@21083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
dfdaee296d Candidate fix for #2730 (the race in the loader and the io-thread where they glare at each other). Refs #2730. [t:2730]
git-svn-id: file:///svn/toku/tokudb@21082 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
59540179fa [t:2721] Add -k option to loader-cleanup-test to test only abort-via-poll, but test it exhaustively for any size database.
git-svn-id: file:///svn/toku/tokudb@21072 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
2464d77583 [t:2721] Improve loader-cleanup-test to return non-zero from polling function for different cases (first time, second time, etc., just like error injection).
git-svn-id: file:///svn/toku/tokudb@21070 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Yoni Fogel
ebea4a70fd closes[t:2720] Fix bug in get_iname test.
dbt.size should be length of string, not size of pointer

git-svn-id: file:///svn/toku/tokudb@21052 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
6b09687c83 #2718 refs[t:2718] free the big buffer attached to the temp files when they are closed
git-svn-id: file:///svn/toku/tokudb@21045 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
3f1175d007 #2717 refs[t:2717] print the tree stats if verbose
git-svn-id: file:///svn/toku/tokudb@21043 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
8a95226d84 #2717 refs[t:2717] fix the brtloader subtree estimates
git-svn-id: file:///svn/toku/tokudb@21040 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
b8a4f4d5a4 Check the dsize also. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21039 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
2c4a0c91cc Need an extra test for {{{loader-stress-test.loader}}} in the {{{Makefile}}} to manifest #2717. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
712b0c9af9 Loader stress test now checks the estimates (at the root) by default. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21037 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
5e99cd713c refs[t:2717] dump the subtree estimates
git-svn-id: file:///svn/toku/tokudb@21032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
20415efcca Quiet the nightly builds even more. Refs #2678. [t:2678]
git-svn-id: file:///svn/toku/tokudb@20991 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
d4aaf04dab Quiet the nightly builds even more. Refs #2678. [t:2678]
git-svn-id: file:///svn/toku/tokudb@20921 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
bfa8303199 closes[t:2704] fix cronjob for windows nightly tests
git-svn-id: file:///svn/toku/tokudb@20903 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
fa229ab979 Fix the cachetable-race so that it doesn't run in BDB and compiles under windows. Fixes #2699, #2698. close[t:2699] close[t:2698].
git-svn-id: file:///svn/toku/tokudb@20902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
1ef3183013 Add SUMMARIZE=1 to the cxx tests. Refs #2678. [t:2678].
git-svn-id: file:///svn/toku/tokudb@20901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
7d2b82be13 [t:2692] Restore "write_log_files" check to fsync log on checkpoints
git-svn-id: file:///svn/toku/tokudb@20884 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
5134631d15 closes[t:2692] Fix two races that helgrind reports.
Technically neither one causes any problems.

git-svn-id: file:///svn/toku/tokudb@20881 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
aca0557856 Tell helgrind not to complain about the toku_checkpointing_user_status. Refs #2684. [t:2684]
git-svn-id: file:///svn/toku/tokudb@20879 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
7b7c374814 Better documentation of the test. [t:2684]
git-svn-id: file:///svn/toku/tokudb@20878 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
e43af77fc6 Create a test to trigger #2684 (the race found in checkpointing in loader-stress-test). [t:2684]
git-svn-id: file:///svn/toku/tokudb@20877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
718654ee1a closes[t:2684] Allow zombie dbs during closing environment (till after first checkpoint)
git-svn-id: file:///svn/toku/tokudb@20875 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
316115d81a Makefile improvement
git-svn-id: file:///svn/toku/tokudb@20874 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
5cd73a5828 [t:2641] Fix build (false positive uninitialized variables warning)
git-svn-id: file:///svn/toku/tokudb@20866 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
e520e8bcf7 closes[t:2687] fix memory leak
git-svn-id: file:///svn/toku/tokudb@20865 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
a9c554b353 [t:2641] Merge DB_READCOMMITTED bugfix (r20839) to main.
git-svn-id: file:///svn/toku/tokudb@20863 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
0566a81ccd Fix #2691. (Silent CXX nightly build plus add PASS/FAIL). close[t:2691]
git-svn-id: file:///svn/toku/tokudb@20862 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
5e86ca2f59 Fix #2690 (silent building man pages). close[t:2690]
git-svn-id: file:///svn/toku/tokudb@20860 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
639b54104f Fix #2689. ({{{LC_ALL=C}}} for texi2dvi calls). close[t:2689]
git-svn-id: file:///svn/toku/tokudb@20859 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
d966cdb045 Delete them. Closes #2688. close[t:2688]
git-svn-id: file:///svn/toku/tokudb@20858 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Rich Prohaska
132926232d refs[t:2683] fix the newbrt/tests/Makefile rule 2b, should be 3a
git-svn-id: file:///svn/toku/tokudb@20857 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Rich Prohaska
b9c39cbca1 fix the linux build broken by the previous checkin
git-svn-id: file:///svn/toku/tokudb@20851 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Rich Prohaska
e017a69683 fix gcc 4.1.2 build on linux
git-svn-id: file:///svn/toku/tokudb@20850 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
53b88b1fb1 Fix #2683. Make the big brtloader-test-extractor tests not use valgrind. close[t:2683]
git-svn-id: file:///svn/toku/tokudb@20849 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
6b16623e8a Fix windows compile.
Poison __sync_fetch_and_add and __sync_add_and_fetch, wrote toku wrappers and windows equivalents
fix bug in toku_sync_fetch_and_(in|de)crement_int32 where it returned result instead of original

git-svn-id: file:///svn/toku/tokudb@20848 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Barry Perlman
fa0666f746 Closes [t:2670]. Direct error output to error log, not stderr, when verbose=0.
git-svn-id: file:///svn/toku/tokudb@20847 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Rich Prohaska
e5ce7dfb2a refs[t:2681] omit the test that crashes cilkscreen
git-svn-id: file:///svn/toku/tokudb@20842 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Yoni Fogel
d4efa2ff45 [t:2561] Renamed cached 3.1 db directory so that it is not removed with 'make clean'
git-svn-id: file:///svn/toku/tokudb@20841 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Yoni Fogel
eb32e0e55f [t:2679] Fix log test failures due to changed log file name
git-svn-id: file:///svn/toku/tokudb@20840 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Rich Prohaska
0594ee1d92 move the tokugrind script to the toku/tokdub directory
git-svn-id: file:///svn/toku/tokudb@20838 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00