Commit graph

3363 commits

Author SHA1 Message Date
Yoni Fogel
5771f5dbb5 [t:2835] merge 22549 from 4.1 to main
git-svn-id: file:///svn/toku/tokudb@22550 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Yoni Fogel
73fd2c4acd [t:2835] merge r22545 into main
git-svn-id: file:///svn/toku/tokudb@22547 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Yoni Fogel
3b607e2f02 [t:2835] Remove some code that could cause later crashes.
Cleaning up of rollback logs in toku_rollback_txn_close is indicative of a problem that should cause a crash right away,
not the next time you start up mysql.

This might be the direct cause of global's problem,
but requires another bug to exist (rollback nodes must not have been cleaned up during a 'successful' abort or commit
first in order for the 'cleanup' to cause a problem)

git-svn-id: file:///svn/toku/tokudb@22526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
fc8da7b577 #2821 refs[t:2821] fixup the loader tests
git-svn-id: file:///svn/toku/tokudb@22418 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
7a3f6089e2 #2821 refs[t:2821] fixup the loader tests
git-svn-id: file:///svn/toku/tokudb@22416 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
6f67fad660 #2821 #2829 refs[t:2821] refs[t:2829] fix the loader's merger vmsize and remove an fsync bubble
git-svn-id: file:///svn/toku/tokudb@22413 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
663acdae84 #2654 refs[t:2654] merge loader persort speedup to main tokudb
git-svn-id: file:///svn/toku/tokudb@22354 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
07f7970808 Merge 2577c onto main line. Refs #2755c. [t:2755c]
{{{
svn merge -r22020:22070 https://svn.tokutek.com/tokudb/toku/tokudb.2755c
}}}
.


git-svn-id: file:///svn/toku/tokudb@22160 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Yoni Fogel
c2162500af [t:2785] Correct comments in block_table to properly describe checkpointing
git-svn-id: file:///svn/toku/tokudb@22014 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Dave Wells
79db8f76cd document loader API, close #2589 [t:2589]
git-svn-id: file:///svn/toku/tokudb@21915 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Barry Perlman
b592f3949d [t:2795] Placate fussy compiler unhappy about test utility print_time_now().
git-svn-id: file:///svn/toku/tokudb@21899 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Barry Perlman
593253739c [t:2781] Close 2781, add test programs to verify fix.
When processing suppress_rollback log entry, associate brt with transaction.

git-svn-id: file:///svn/toku/tokudb@21894 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Barry Perlman
a2d1f3b27d [t:2781] Skip BDB version of recover-test-logsuppress.
git-svn-id: file:///svn/toku/tokudb@21893 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Barry Perlman
5bf8fcfb6f [t:2781] Added test for 2781, not yet complete.
git-svn-id: file:///svn/toku/tokudb@21878 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
6bc4bee1cd #2782 refs[t:2782] free the env's real_tmp_dir when it is closed
git-svn-id: file:///svn/toku/tokudb@21856 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
7448027de9 Cleanup temp files from tmp dir, not log dir. Fix #2783. close[t:2783]
git-svn-id: file:///svn/toku/tokudb@21828 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
a35dbbbbd8 Fixes #2782. The brtloader uses temp dir. Note however that #2783 isn't fixed yet. close[t:2782].
git-svn-id: file:///svn/toku/tokudb@21827 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
b008bdf29d Remove bdb and tdb files in src/tests. Fix #2778. close[t:2778]
git-svn-id: file:///svn/toku/tokudb@21769 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
5fcfafc691 Overactive assertion. Refs #2759. [t:2759]
git-svn-id: file:///svn/toku/tokudb@21573 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
c49d7a8c0c The first loader gets 1/2 of cachetable memory.
* That's 2/3 of 3/4, which is calculated as 1/4 is unreservable.  The loader asks for 2/3 of what's reservable, getting one half.
The second loader gets 1/6 of cachetable memory.
 * That's 2/3 of 1/4: The loader asks for 2/3 of what's reservable.  1/2 has been reserved.  1/4 is unreservable.  1/4 is reservable.  2/3 of 1/4 is 1/6.
The third loader gets 1/18 of cachetable memory. 
 * That's 2/3 or 1/12.   (1/4 is unreservable. 1/2 was reserved by the first loader.  1/6 by the second.  That leaves 1/12)
Generally the next one gets 1/3 of what the previous one got.

Refs #2759. [t:2759]


git-svn-id: file:///svn/toku/tokudb@21564 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
f635f4d458 Merge the fix for #2755 and #2759 to main. [t:2755] [t:2759]
{{{
svn merge -r21499:21502 https://svn.tokutek.com/tokudb/toku/tokudb.2755
}}}
.


git-svn-id: file:///svn/toku/tokudb@21503 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
2248b6205c #2740 refs[t:2740] fix the cxx permissions test (which depends on the underlying inames)
git-svn-id: file:///svn/toku/tokudb@21309 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
a61a4869ba Closes [t:2740] Delete rot13 of inames.
git-svn-id: file:///svn/toku/tokudb@21289 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
c37567705f #2738 refs[t:2738] merge dbufio bug fix to main
git-svn-id: file:///svn/toku/tokudb@21260 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
76dcd3fe21 2738 refs[t:2738] test case for the double buffer hang
git-svn-id: file:///svn/toku/tokudb@21217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
1a65ba1d80 #2723 refs[t:2723] fix the slow control-c reaction in the brtloader's write to brt function
git-svn-id: file:///svn/toku/tokudb@21103 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
0498c6e405 Added timestamps to exhastive abort_via_poll test (-k option).
git-svn-id: file:///svn/toku/tokudb@21084 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
12f96cf9d9 Added utilities to format and print current time.
git-svn-id: file:///svn/toku/tokudb@21083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
dfdaee296d Candidate fix for #2730 (the race in the loader and the io-thread where they glare at each other). Refs #2730. [t:2730]
git-svn-id: file:///svn/toku/tokudb@21082 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
59540179fa [t:2721] Add -k option to loader-cleanup-test to test only abort-via-poll, but test it exhaustively for any size database.
git-svn-id: file:///svn/toku/tokudb@21072 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Barry Perlman
2464d77583 [t:2721] Improve loader-cleanup-test to return non-zero from polling function for different cases (first time, second time, etc., just like error injection).
git-svn-id: file:///svn/toku/tokudb@21070 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Yoni Fogel
ebea4a70fd closes[t:2720] Fix bug in get_iname test.
dbt.size should be length of string, not size of pointer

git-svn-id: file:///svn/toku/tokudb@21052 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
6b09687c83 #2718 refs[t:2718] free the big buffer attached to the temp files when they are closed
git-svn-id: file:///svn/toku/tokudb@21045 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
3f1175d007 #2717 refs[t:2717] print the tree stats if verbose
git-svn-id: file:///svn/toku/tokudb@21043 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
8a95226d84 #2717 refs[t:2717] fix the brtloader subtree estimates
git-svn-id: file:///svn/toku/tokudb@21040 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
b8a4f4d5a4 Check the dsize also. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21039 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
2c4a0c91cc Need an extra test for {{{loader-stress-test.loader}}} in the {{{Makefile}}} to manifest #2717. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
712b0c9af9 Loader stress test now checks the estimates (at the root) by default. Refs #2717. [t:2717]
git-svn-id: file:///svn/toku/tokudb@21037 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
5e99cd713c refs[t:2717] dump the subtree estimates
git-svn-id: file:///svn/toku/tokudb@21032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
20415efcca Quiet the nightly builds even more. Refs #2678. [t:2678]
git-svn-id: file:///svn/toku/tokudb@20991 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
d4aaf04dab Quiet the nightly builds even more. Refs #2678. [t:2678]
git-svn-id: file:///svn/toku/tokudb@20921 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
bfa8303199 closes[t:2704] fix cronjob for windows nightly tests
git-svn-id: file:///svn/toku/tokudb@20903 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
fa229ab979 Fix the cachetable-race so that it doesn't run in BDB and compiles under windows. Fixes #2699, #2698. close[t:2699] close[t:2698].
git-svn-id: file:///svn/toku/tokudb@20902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
1ef3183013 Add SUMMARIZE=1 to the cxx tests. Refs #2678. [t:2678].
git-svn-id: file:///svn/toku/tokudb@20901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
7d2b82be13 [t:2692] Restore "write_log_files" check to fsync log on checkpoints
git-svn-id: file:///svn/toku/tokudb@20884 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
5134631d15 closes[t:2692] Fix two races that helgrind reports.
Technically neither one causes any problems.

git-svn-id: file:///svn/toku/tokudb@20881 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
aca0557856 Tell helgrind not to complain about the toku_checkpointing_user_status. Refs #2684. [t:2684]
git-svn-id: file:///svn/toku/tokudb@20879 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
7b7c374814 Better documentation of the test. [t:2684]
git-svn-id: file:///svn/toku/tokudb@20878 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
e43af77fc6 Create a test to trigger #2684 (the race found in checkpointing in loader-stress-test). [t:2684]
git-svn-id: file:///svn/toku/tokudb@20877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
718654ee1a closes[t:2684] Allow zombie dbs during closing environment (till after first checkpoint)
git-svn-id: file:///svn/toku/tokudb@20875 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00