Commit graph

3176 commits

Author SHA1 Message Date
Yoni Fogel
10d5d03fac [t:2662] Fix checkpoint bug where re-ordered writes before fsync can cause
a corrupt dictionary.
Do an extra fsync.

git-svn-id: file:///svn/toku/tokudb@20697 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
4952a05f32 refs[t:2656] run some cilkscreen tests
git-svn-id: file:///svn/toku/tokudb@20693 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
9d292108f8 closes[t:2637] common brtloader error injector source
git-svn-id: file:///svn/toku/tokudb@20687 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Dave Wells
85bfc804f0 remove cilk_spawn that is within cilk_for loop
git-svn-id: file:///svn/toku/tokudb@20684 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Zardosht Kasheff
97c826d5ea [t:2563], remove statement in error log file when rename fails due to lock not granted
git-svn-id: file:///svn/toku/tokudb@20678 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
e6a7af95a3 refs[t:2654] fix a NULL pointer deref found by valgrind brtloader-test-open
git-svn-id: file:///svn/toku/tokudb@20672 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
3f6fe2beac refs[t:2656] fix some data races in the brtloader tests
git-svn-id: file:///svn/toku/tokudb@20660 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
6d894d3f94 refs[t:2656] cilkscreen some brtloader-test-writer-errors
git-svn-id: file:///svn/toku/tokudb@20658 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
d86d1e5361 closes[t:2659] fix the data race in the finish_primary_rows_internal function. found by cilkscreen ./brtloader-test-extractor -s
git-svn-id: file:///svn/toku/tokudb@20657 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
650e2c0079 refs[t:2656] cilkscreen some brtloader tests
git-svn-id: file:///svn/toku/tokudb@20656 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
346c1498e3 closes[t:2645] run the loader-cleanup-test in parallel
git-svn-id: file:///svn/toku/tokudb@20647 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Rich Prohaska
9f1bd3e462 closes[t:2653] xfail the loader-tpch-load test
git-svn-id: file:///svn/toku/tokudb@20645 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Bradley C. Kuszmaul
54490d3c06 Simplify structures to keep track of whether data in an index is sorted. Refs #2654. [t:2654].
git-svn-id: file:///svn/toku/tokudb@20644 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:16 -04:00
Bradley C. Kuszmaul
57fb43c9c5 Add structures to keep track of whether data in an index is sorted. We aren't maintaining it properly yet, but everything should work since we aren't using it. Refs #2654. [t:2654].
git-svn-id: file:///svn/toku/tokudb@20640 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
0303169600 refs[t:2645] add -e option to the loader-cleanup-test
git-svn-id: file:///svn/toku/tokudb@20638 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
9e02290285 closes[t:2642] fix a mem leak in the brtloader found with the cleanup test
git-svn-id: file:///svn/toku/tokudb@20627 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
53a5c307ba refs[t:2645] add -e option to the loader-cleanup-test
git-svn-id: file:///svn/toku/tokudb@20614 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
5518290137 closes[t:2591] fix the brtloader destroy to avoid the mutex when not yet initialized
git-svn-id: file:///svn/toku/tokudb@20608 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Zardosht Kasheff
b4bf6f031c [t:2563], prevent printing of msg to error log in case of DB_LOCK_NOTGRANTED
git-svn-id: file:///svn/toku/tokudb@20573 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
4ee75d917c closes[t:2650] test the brtloader extractor with various input rows
git-svn-id: file:///svn/toku/tokudb@20570 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
c62f8829e1 closes[t:2650] test the brtloader extractor with various input rows
git-svn-id: file:///svn/toku/tokudb@20569 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Yoni Fogel
f1a67d8133 [t:2631] [t:2623] Fix windows build broken by r20413.
Implement "strerror_r" in windows

git-svn-id: file:///svn/toku/tokudb@20565 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
6af1a32e4e refs[t:2650] verify the temp files created by the extractor
git-svn-id: file:///svn/toku/tokudb@20558 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
42fdb90153 refs[t:2591] mutex destroy called on an uninitalized mutex
git-svn-id: file:///svn/toku/tokudb@20557 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Bradley C. Kuszmaul
d14326cc0e brtloader.c is now 96.61% of lines and 87.13% of branches. [t:2647] Refs #2647.
git-svn-id: file:///svn/toku/tokudb@20539 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
543dd95cdb closes[t:2648] improve the brtloader writer coverage
git-svn-id: file:///svn/toku/tokudb@20538 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Bradley C. Kuszmaul
59a8f06e93 The brtloader is now at 95.03% lines covered and 84.64% of branches taken. That's pretty good. We can work to remove a few more, but it's diminishing returns from here. [t:2647] Refs #2647.
git-svn-id: file:///svn/toku/tokudb@20537 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Bradley C. Kuszmaul
c4405b714c Make the ...dbufio tests better. Refs #2633. [t:2633]
git-svn-id: file:///svn/toku/tokudb@20534 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Dave Wells
2ef2752ced cleanup merge_some_files error path [t:2642]
git-svn-id: file:///svn/toku/tokudb@20533 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
4b9a5ce35d closes[t:2646] run fractal tree examples with transactions (default)
git-svn-id: file:///svn/toku/tokudb@20531 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
1bba1e63b2 closes[t:2644] combine the brtloader panic and error callback state
git-svn-id: file:///svn/toku/tokudb@20526 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Yoni Fogel
4d0f2e5773 [t:2624] fix windows compile of r20449 (off_t->toku_off_t)
git-svn-id: file:///svn/toku/tokudb@20522 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Barry Perlman
39670ab94b Allow logger status with no logger.
git-svn-id: file:///svn/toku/tokudb@20495 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Rich Prohaska
418b60fbd7 refs[t:2643] compile the brtloader tests
git-svn-id: file:///svn/toku/tokudb@20489 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Bradley C. Kuszmaul
bfe190f763 #2642 runs with -r 1000 and no valgrind problems. The problem is we must actually call fclose even when injecting errors in bad_fclose. [t:2642] Refs #2642
git-svn-id: file:///svn/toku/tokudb@20487 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:15 -04:00
Dave Wells
b3800e0177 fix loader_open test failures, closes #2591 [t:2591]
git-svn-id: file:///svn/toku/tokudb@20486 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
7b435f245a Fix at least one problem found by the loader-cleanup-test. Make the valgrind version of loader-cleanup-test use {{{-r 1000}}} so it runs faster. Refs #2642. [t:2642]
git-svn-id: file:///svn/toku/tokudb@20482 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Dave Wells
faea32e1ca add asserts, cleanup fta init
git-svn-id: file:///svn/toku/tokudb@20471 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
d567a309ac Fix #2643. (Make progress reporting work right again in the loader). close[t:2643]
git-svn-id: file:///svn/toku/tokudb@20470 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Rich Prohaska
af9d10bcd2 refs[t:2639] execute error return from kv_malloc
git-svn-id: file:///svn/toku/tokudb@20467 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Rich Prohaska
6c54d4ae28 closes[t:2639] recover from translation table realloc failures in the allocate block function of the brtloader. merge -r 20450:head from tokudb.2639
git-svn-id: file:///svn/toku/tokudb@20466 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
227abb8536 Fix #2533. (Avoid runts and don't make maximal fanout in loader). close[t:2533]
git-svn-id: file:///svn/toku/tokudb@20459 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Barry Perlman
bc8ec47a33 [t:2621] [t:2624] Port file system wrappers to Windows.
git-svn-id: file:///svn/toku/tokudb@20449 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
a6e22aadac Merge in the 2623 branch to main. Closes #2623. close[t:2623]
{{{
svn merge -r 20428:20432 https://svn.tokutek.com/tokudb/toku/tokudb.2623
}}}
.


git-svn-id: file:///svn/toku/tokudb@20433 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Rich Prohaska
5e03a29540 refs[t:2603] run some additional extractor tests
git-svn-id: file:///svn/toku/tokudb@20431 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Rich Prohaska
7fd7b5c15f closes[t:2634] fix some file open and close errors paths in the brtloader
git-svn-id: file:///svn/toku/tokudb@20430 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Barry Perlman
8b7ecdf800 [t:2499] loader-cleanup-test: Improve error reporting
git-svn-id: file:///svn/toku/tokudb@20429 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
47c5441a8d Merge the basic dbufio working test in. It doesn't test destination files, and the failure cases aren't running yet. But the ...dbufio() code looks fairly well covered anyway. [t:2623] Refs #2623.
{{{
svn merge -r 20423:20425 https://svn.tokutek.com/tokudb/toku/tokudb.2623
}}}
.


git-svn-id: file:///svn/toku/tokudb@20426 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Rich Prohaska
48b56ff14f refs[t:2603] inject errors from the poll callback into the extractor
git-svn-id: file:///svn/toku/tokudb@20424 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00
Bradley C. Kuszmaul
53cb67c979 Merge some tests of error paths back to main line. Refs #2623. [t:2623]
{{{
svn merge -r 20415:20420 https://svn.tokutek.com/tokudb/toku/tokudb.2623
}}}
.


git-svn-id: file:///svn/toku/tokudb@20421 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:14 -04:00