Commit graph

233 commits

Author SHA1 Message Date
Zardosht Kasheff
add11ba8a3 [t:3816], merge a fix into main that should unblock performance testing
git-svn-id: file:///svn/toku/tokudb@34525 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:49 -04:00
Zardosht Kasheff
9bc2ea130d [t:3932], wakeup workqueue if size_evicting falls to less than 1/8th size_current during partial eviction
git-svn-id: file:///svn/toku/tokudb@34427 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:48 -04:00
Zardosht Kasheff
23a98e0de8 [t:3907], fix compile of gcc optimized
git-svn-id: file:///svn/toku/tokudb@34219 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:48 -04:00
Zardosht Kasheff
21c5808d96 [t:3902], set state of PAIRs before posting them on threads for eviction/fetching
git-svn-id: file:///svn/toku/tokudb@34217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:48 -04:00
Zardosht Kasheff
1a5dbd80e5 [t:3645], merge to main
git-svn-id: file:///svn/toku/tokudb@34156 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:48 -04:00
Leif Walsh
32a778c43f [t:3315] merge indexed buffers work into mainline
git-svn-id: file:///svn/toku/tokudb@33979 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:47 -04:00
Barry Perlman
06843a6451 [t:3825] #3825 Merged changesets 33440, 33527, 33536 from 5.1.4 branch to main.
git-svn-id: file:///svn/toku/tokudb@33975 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:47 -04:00
Zardosht Kasheff
f392523514 [t:3436], [t:3782], merge ydb level bulk fetch to main line
git-svn-id: file:///svn/toku/tokudb@33770 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Rich Prohaska
7df041788c #3836 add cachetable eviction counter to engine status refs[t:3836]
git-svn-id: file:///svn/toku/tokudb@33558 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Leif Walsh
c21077bc26 [t:3635] fixing a merge conflict I thought I already got
git-svn-id: file:///svn/toku/tokudb@33538 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Leif Walsh
b669ec96d6 [t:3635] [t:3764] [t:3757] [t:3749] merging tokudb.3635+prefetch into mainline, pending testing, fixes #3635, #3764, #3757, #3749
git-svn-id: file:///svn/toku/tokudb@33537 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Zardosht Kasheff
90ecff06bc [t:3755], put in assert
git-svn-id: file:///svn/toku/tokudb@33425 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Zardosht Kasheff
370a98bbce [t:3755], merge fix to main where we write a dirty node out on a writer thread if a checkpoint is pending
git-svn-id: file:///svn/toku/tokudb@33424 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Zardosht Kasheff
e686a2ec1f [t:3781], set state to CTPAIRE_READING when doing a partial fetch
git-svn-id: file:///svn/toku/tokudb@33423 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:46 -04:00
Zardosht Kasheff
2e03c2588c [t:3774], add cachetable miss and hit counts to get_and_pin_nonblocking
git-svn-id: file:///svn/toku/tokudb@33153 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:45 -04:00
Leif Walsh
794aaf730c reverting a fat-fingered change to cachetable.c from r33053
git-svn-id: file:///svn/toku/tokudb@33054 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:45 -04:00
Leif Walsh
4a96abc33e [t:3647] [t:3728] merge changes from tokudb.3647, closes #3647 and closes #3728
git-svn-id: file:///svn/toku/tokudb@33053 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:45 -04:00
Rich Prohaska
1dd96b44ab #3584 debug printf cachetable checkpoint info refs[t:3584]
git-svn-id: file:///svn/toku/tokudb@32938 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:44 -04:00
Zardosht Kasheff
46e33438c7 [t:3720], add some comments
git-svn-id: file:///svn/toku/tokudb@32914 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:44 -04:00
Zardosht Kasheff
a0f5141344 [t:3643], some more cachetable comments
git-svn-id: file:///svn/toku/tokudb@32912 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:44 -04:00
Zardosht Kasheff
278f7c2947 [t:3643], make small code simplification, before adding comments
git-svn-id: file:///svn/toku/tokudb@32911 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:44 -04:00
Zardosht Kasheff
8927a3e718 [t:3609], fix race condition by having shortcut cursors grab read locks on PAIRs, range queries will be slower
git-svn-id: file:///svn/toku/tokudb@32713 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:42 -04:00
Zardosht Kasheff
b90f894d14 [t:3651], merge to main
git-svn-id: file:///svn/toku/tokudb@32620 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:41 -04:00
Zardosht Kasheff
219331cc02 [t:3627], merge last of milestone 3 to main
git-svn-id: file:///svn/toku/tokudb@32565 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:41 -04:00
Zardosht Kasheff
4a88cb22b4 [t:3644], merge cachetable changes for #3627 from tokudb.3627 to main
git-svn-id: file:///svn/toku/tokudb@32519 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:41 -04:00
Bradley C. Kuszmaul
885c83300b [t:3604] Merge everything from the tokudb.3312c+3524+msn branch. Refs #3604.
git-svn-id: file:///svn/toku/tokudb@32294 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:40 -04:00
Zardosht Kasheff
44499d3488 [t:3506], remove PAIR->write_me
git-svn-id: file:///svn/toku/tokudb@30929 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:40 -04:00
Rich Prohaska
c8fddf59ce #3344 speedup cachefile_flush_cachefile by maintaining a list of pairs for each cachefile refs[t:3344]
git-svn-id: file:///svn/toku/tokudb@29770 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:38 -04:00
Barry Perlman
78ae34f63f [t:3337] #3337 Fsync log for begin_checkpoint.
git-svn-id: file:///svn/toku/tokudb@29402 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:38 -04:00
Bradley C. Kuszmaul
355c285dff [t:3219] Improve comment. Refs #3219.
git-svn-id: file:///svn/toku/tokudb@28669 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:37 -04:00
Bradley C. Kuszmaul
f69f0a6a5b [t:3219] Merge the 3219 fixes onto the main line. Refs #3219.
{{{
svn merge -r28558:28575 https://svn.tokutek.com/tokudb/toku/tokudb.3219c
}}}
.


git-svn-id: file:///svn/toku/tokudb@28588 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:37 -04:00
Bradley C. Kuszmaul
abd5212bcf Merge r26784 into the main line.
Changes include patches to
 * Handle gcc 4.4.1's foibles.
 * Instrument {{{toku_os_pread}}}
 * Release the lock during I/Os for queries (#3039)
 * Simplification of the ydb lock (no more backoff)
 * Use {{{DB_TXN_NOSYNC}} for several tests (which speeds them up).
 * Set the redzone to zero for several tests  (so they can run on machines with little free space). (#3111)
 * Add  helgrind and valgrind suppressions to some tests.
 * Add dollar-id-dollar to several files.
 * Declare the schedule status values to be volatile.
 * Add a method to the toku {{{RWLOCK}}} to effectively grab the read lock and then release it quickly.  (With only one condition variable acquisition.)
Fixes #3039. close[t:3039]
Refs #3111,   #3112,   #3119,   #3125,   #3126,   #3128,   #3131,   #3133,   #3142,   #3152.
   [t:3111] [t:3112] [t:3119] [t:3125] [t:3126] [t:3128] [t:3131] [t:3133] [t:3142] [t:3152].


git-svn-id: file:///svn/toku/tokudb@26785 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Barry Perlman
deb0d23050 [t:2949] Improve cachetable's get_and_pin_footprint.
git-svn-id: file:///svn/toku/tokudb@25399 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:26 -04:00
Barry Perlman
548d03d70e [t:2892] Merge upgrade logic to main. Merge command was svn merge --accept=postpone -r25293:HEAD ../tokudb.main+2892 .
git-svn-id: file:///svn/toku/tokudb@25303 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:25 -04:00
Rich Prohaska
24d915f259 #2966 use assert_zero in some of the newbrt files refs[t:2966]
git-svn-id: file:///svn/toku/tokudb@24717 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Rich Prohaska
5c0dce7cbb #2513 merge the cached threadpool to main refs[t:2513]
git-svn-id: file:///svn/toku/tokudb@24627 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Barry Perlman
db868fb31d [t:2947] Merge from tokudb.2947. Added errno to error log, don't take minicron lock for engine status. I want to print engine status to error log, but the env isn't available everywhere, so that's not here (yet).
git-svn-id: file:///svn/toku/tokudb@24075 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:23 -04:00
Bradley C. Kuszmaul
06d1c0e1eb Get rid of {{{TAGMALLOC}}}. Fixes #2912. close[t:2912]
git-svn-id: file:///svn/toku/tokudb@23493 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Rich Prohaska
a71c846cb4 #2877 refs[t:2877] remove kruft from the cachetable
git-svn-id: file:///svn/toku/tokudb@23180 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Yoni Fogel
0b0c76392a closes[t:1398] [t:2861] Remove more heaviside code (include straddle hacks) from newbrt
git-svn-id: file:///svn/toku/tokudb@23060 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:22 -04:00
Bradley C. Kuszmaul
5fcfafc691 Overactive assertion. Refs #2759. [t:2759]
git-svn-id: file:///svn/toku/tokudb@21573 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:20 -04:00
Bradley C. Kuszmaul
c49d7a8c0c The first loader gets 1/2 of cachetable memory.
* That's 2/3 of 3/4, which is calculated as 1/4 is unreservable.  The loader asks for 2/3 of what's reservable, getting one half.
The second loader gets 1/6 of cachetable memory.
 * That's 2/3 of 1/4: The loader asks for 2/3 of what's reservable.  1/2 has been reserved.  1/4 is unreservable.  1/4 is reservable.  2/3 of 1/4 is 1/6.
The third loader gets 1/18 of cachetable memory. 
 * That's 2/3 or 1/12.   (1/4 is unreservable. 1/2 was reserved by the first loader.  1/6 by the second.  That leaves 1/12)
Generally the next one gets 1/3 of what the previous one got.

Refs #2759. [t:2759]


git-svn-id: file:///svn/toku/tokudb@21564 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
f635f4d458 Merge the fix for #2755 and #2759 to main. [t:2755] [t:2759]
{{{
svn merge -r21499:21502 https://svn.tokutek.com/tokudb/toku/tokudb.2755
}}}
.


git-svn-id: file:///svn/toku/tokudb@21503 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:19 -04:00
Bradley C. Kuszmaul
fa229ab979 Fix the cachetable-race so that it doesn't run in BDB and compiles under windows. Fixes #2699, #2698. close[t:2699] close[t:2698].
git-svn-id: file:///svn/toku/tokudb@20902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
aca0557856 Tell helgrind not to complain about the toku_checkpointing_user_status. Refs #2684. [t:2684]
git-svn-id: file:///svn/toku/tokudb@20879 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Bradley C. Kuszmaul
e43af77fc6 Create a test to trigger #2684 (the race found in checkpointing in loader-stress-test). [t:2684]
git-svn-id: file:///svn/toku/tokudb@20877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:18 -04:00
Yoni Fogel
c9b2b066dd [t:2561] Merge tokudb.2561b to main. Disabled auto-upgrade and auto-upgrade tests
git-svn-id: file:///svn/toku/tokudb@20778 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:17 -04:00
Bradley C. Kuszmaul
c20a422a93 Reserve memory. Refs #2613. [t:2613].
git-svn-id: file:///svn/toku/tokudb@20241 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:12 -04:00
Barry Perlman
ae050bf956 [t:2504] Improve engine status.
git-svn-id: file:///svn/toku/tokudb@20077 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:11 -04:00
Bradley C. Kuszmaul
28cc5d1ed9 Merge the changes from 2499d onto the main line. Fixes #2499. close[t:2499].
{{{
svn merge -r 19523:19895 https://svn.tokutek.com/tokudb/toku/tokudb.2499d
}}}
.


git-svn-id: file:///svn/toku/tokudb@19902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00