Commit graph

336 commits

Author SHA1 Message Date
Barry Perlman
ecca7928f3 [t:3175] Put nodesize in fcreate recovery log entry, remove fcreate2 recovery log entry.
git-svn-id: file:///svn/toku/tokudb@27081 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
91daf918a0 #3168 print decompression block information including the raw block to stderr refs[t:3168]
git-svn-id: file:///svn/toku/tokudb@27079 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
42921bb831 #3163 use the nodesize configured in a db in the brtloader refs[t:3163]
git-svn-id: file:///svn/toku/tokudb@26909 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
abd5212bcf Merge r26784 into the main line.
Changes include patches to
 * Handle gcc 4.4.1's foibles.
 * Instrument {{{toku_os_pread}}}
 * Release the lock during I/Os for queries (#3039)
 * Simplification of the ydb lock (no more backoff)
 * Use {{{DB_TXN_NOSYNC}} for several tests (which speeds them up).
 * Set the redzone to zero for several tests  (so they can run on machines with little free space). (#3111)
 * Add  helgrind and valgrind suppressions to some tests.
 * Add dollar-id-dollar to several files.
 * Declare the schedule status values to be volatile.
 * Add a method to the toku {{{RWLOCK}}} to effectively grab the read lock and then release it quickly.  (With only one condition variable acquisition.)
Fixes #3039. close[t:3039]
Refs #3111,   #3112,   #3119,   #3125,   #3126,   #3128,   #3131,   #3133,   #3142,   #3152.
   [t:3111] [t:3112] [t:3119] [t:3125] [t:3126] [t:3128] [t:3131] [t:3133] [t:3142] [t:3152].


git-svn-id: file:///svn/toku/tokudb@26785 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Barry Perlman
c68e4f968a [t:3102] Change brtloader_fi_close() to ignore files that are already closed when called from brtloader_fi_close_all().
git-svn-id: file:///svn/toku/tokudb@26361 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Dave Wells
8de2b2f1a7 fixes from hotindexer recovery code review
git-svn-id: file:///svn/toku/tokudb@26176 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Rich Prohaska
862072b775 #3047 fix le cursor per code review refs[t:3047]
git-svn-id: file:///svn/toku/tokudb@25741 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:31 -04:00
Rich Prohaska
9582103554 #3046 use the brt compare function for le cursor key comparisons refs[t:3046]
git-svn-id: file:///svn/toku/tokudb@25729 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:31 -04:00
Rich Prohaska
43e5039e58 #3011 remove *extra from *multiple functions and callbacks refs[t:3011]
git-svn-id: file:///svn/toku/tokudb@25627 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:30 -04:00
Dave Wells
f31a90e9e9 merge indexer to main refs #2843 [t:2843]
git-svn-id: file:///svn/toku/tokudb@25593 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:29 -04:00
Barry Perlman
548d03d70e [t:2892] Merge upgrade logic to main. Merge command was svn merge --accept=postpone -r25293:HEAD ../tokudb.main+2892 .
git-svn-id: file:///svn/toku/tokudb@25303 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:25 -04:00
Rich Prohaska
58e54d7d3e #3008 fix some compile problems refs[t:3008]
git-svn-id: file:///svn/toku/tokudb@25159 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:24 -04:00
Rich Prohaska
7606a0eb32 #2953 merge update_multiple to main refs[t:2953]
git-svn-id: file:///svn/toku/tokudb@25124 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:24 -04:00
Bradley C. Kuszmaul
70eb6ebabe Close #2945 (get rid of {{{db->set_bt_compare}}} in favor of {{{env->set_default_bt_compare}}}).
Closes #2945.  close[t:2945]
{{{
svn merge -r 24888:24894 https://svn.tokutek.com/tokudb/toku/tokudb.2945
}}}
.


git-svn-id: file:///svn/toku/tokudb@24931 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:24 -04:00
Rich Prohaska
5c0dce7cbb #2513 merge the cached threadpool to main refs[t:2513]
git-svn-id: file:///svn/toku/tokudb@24627 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
26ca989666 #2969 set cpu affinity in the keyrange-unflat test in an attempt to understand its performance refs[t:2969]
git-svn-id: file:///svn/toku/tokudb@24517 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
fb2462e446 #2965 make a common assert in the brtloader extractor test more informative closes[t:2965]
git-svn-id: file:///svn/toku/tokudb@24329 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
bb8666dc80 #2961 dbufio-test and dbufio-test-destroy can not run in parallel. fix them closes[t:2961]
git-svn-id: file:///svn/toku/tokudb@24246 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
b4281f36b4 #2946 merge le-cursor's to main
git-svn-id: file:///svn/toku/tokudb@24142 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
d9436a2dd7 #2948 fix a broken assert
git-svn-id: file:///svn/toku/tokudb@24119 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Bradley C. Kuszmaul
bb5579a145 Merge 2948 changes to main: Start putting upsert into brt layer (Refs #2948). Also add unused attributes (Closes #2950). [t:2948] close[t:2950]
{{{
svn merge -c 24081 https://svn.tokutek.com/tokudb/toku/tokudb.2948
}}}
.


git-svn-id: file:///svn/toku/tokudb@24083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
261715cf6e #2891 refs[t:2891] fix the newbrt cilk build
git-svn-id: file:///svn/toku/tokudb@23926 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
8cf78727aa #2921 refs[t:2921] remove obsolete memory functions
git-svn-id: file:///svn/toku/tokudb@23625 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Zardosht Kasheff
c14837af5b [t:2811], remove unneeded leafentry accessor
git-svn-id: file:///svn/toku/tokudb@23609 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Zardosht Kasheff
cc91ea8ca4 [t:2811], merge to main \!\!\!
git-svn-id: file:///svn/toku/tokudb@23495 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Bradley C. Kuszmaul
1bfd207e32 Merge the fixes for #2862, #2861, and #2269 onto main. Fixes #2269, #2861, #2862. close[t:2269] close[t:2861] close[t:2862]
{{{
svn merge -r 23006:23042 https://svn.tokutek.com/tokudb/toku/tokudb.2862b
}}}
.


git-svn-id: file:///svn/toku/tokudb@23046 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Rich Prohaska
ab1d8172bd #2868 refs[t:2868] fix the presort speedup in the loader
git-svn-id: file:///svn/toku/tokudb@22868 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Bradley C. Kuszmaul
74565b165a Merge changes for #2859 (delete dirs when tests complete). Fixes #2859. close[t:2859]
git-svn-id: file:///svn/toku/tokudb@22773 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Bradley C. Kuszmaul
a0c9d1bdf5 Add -Wl,rpath to the dynlibs. Refs #2848. [t:2848]
git-svn-id: file:///svn/toku/tokudb@22722 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Bradley C. Kuszmaul
52714401a0 Use dynamic libraries for newbrt tests. Fix #2848. close[t:2848]
git-svn-id: file:///svn/toku/tokudb@22718 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Rich Prohaska
855004b623 #2847 refs[t:2847] panic the dbufio when an error occurs in the test
git-svn-id: file:///svn/toku/tokudb@22674 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:21 -04:00
Rich Prohaska
d9985ad0cf #2840 refs[t:2840] add debug prints to the loader to help fix the dbufio read row problem, also remove the assert on this error path
git-svn-id: file:///svn/toku/tokudb@22673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
fc8da7b577 #2821 refs[t:2821] fixup the loader tests
git-svn-id: file:///svn/toku/tokudb@22418 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
7a3f6089e2 #2821 refs[t:2821] fixup the loader tests
git-svn-id: file:///svn/toku/tokudb@22416 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Rich Prohaska
663acdae84 #2654 refs[t:2654] merge loader persort speedup to main tokudb
git-svn-id: file:///svn/toku/tokudb@22354 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
c49d7a8c0c The first loader gets 1/2 of cachetable memory.
* That's 2/3 of 3/4, which is calculated as 1/4 is unreservable.  The loader asks for 2/3 of what's reservable, getting one half.
The second loader gets 1/6 of cachetable memory.
 * That's 2/3 of 1/4: The loader asks for 2/3 of what's reservable.  1/2 has been reserved.  1/4 is unreservable.  1/4 is reservable.  2/3 of 1/4 is 1/6.
The third loader gets 1/18 of cachetable memory. 
 * That's 2/3 or 1/12.   (1/4 is unreservable. 1/2 was reserved by the first loader.  1/6 by the second.  That leaves 1/12)
Generally the next one gets 1/3 of what the previous one got.

Refs #2759. [t:2759]


git-svn-id: file:///svn/toku/tokudb@21564 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
f635f4d458 Merge the fix for #2755 and #2759 to main. [t:2755] [t:2759]
{{{
svn merge -r21499:21502 https://svn.tokutek.com/tokudb/toku/tokudb.2755
}}}
.


git-svn-id: file:///svn/toku/tokudb@21503 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
c37567705f #2738 refs[t:2738] merge dbufio bug fix to main
git-svn-id: file:///svn/toku/tokudb@21260 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
76dcd3fe21 2738 refs[t:2738] test case for the double buffer hang
git-svn-id: file:///svn/toku/tokudb@21217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Rich Prohaska
132926232d refs[t:2683] fix the newbrt/tests/Makefile rule 2b, should be 3a
git-svn-id: file:///svn/toku/tokudb@20857 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
53b88b1fb1 Fix #2683. Make the big brtloader-test-extractor tests not use valgrind. close[t:2683]
git-svn-id: file:///svn/toku/tokudb@20849 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
6b16623e8a Fix windows compile.
Poison __sync_fetch_and_add and __sync_add_and_fetch, wrote toku wrappers and windows equivalents
fix bug in toku_sync_fetch_and_(in|de)crement_int32 where it returned result instead of original

git-svn-id: file:///svn/toku/tokudb@20848 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Rich Prohaska
e5ce7dfb2a refs[t:2681] omit the test that crashes cilkscreen
git-svn-id: file:///svn/toku/tokudb@20842 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Yoni Fogel
c9b2b066dd [t:2561] Merge tokudb.2561b to main. Disabled auto-upgrade and auto-upgrade tests
git-svn-id: file:///svn/toku/tokudb@20778 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Rich Prohaska
c5bad31abf closes[t:2656] run some cilkscreen tests
git-svn-id: file:///svn/toku/tokudb@20753 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
d694dbaf93 closes[t:2665] quiet logcursor-bad-checksum
git-svn-id: file:///svn/toku/tokudb@20722 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
9d695b7990 closes[t:2666] quiet recovery-cend-cbegin
git-svn-id: file:///svn/toku/tokudb@20721 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
85fbe869d1 closes[t:2667] quiet recovery-empty
git-svn-id: file:///svn/toku/tokudb@20719 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Bradley C. Kuszmaul
c74c406581 Fix #2664. (cachetable-scan should be quiet). close[t:2664]
git-svn-id: file:///svn/toku/tokudb@20713 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
4952a05f32 refs[t:2656] run some cilkscreen tests
git-svn-id: file:///svn/toku/tokudb@20693 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00