Commit graph

3707 commits

Author SHA1 Message Date
Barry Perlman
22495551ec [t:3113] Delete extraneous logic.
git-svn-id: file:///svn/toku/tokudb@27359 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Barry Perlman
df9cc9234a [t:3113] Add test recover-3113.
git-svn-id: file:///svn/toku/tokudb@27358 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Barry Perlman
f7f0be31d5 [t:3178] Centralize panic handling, do not run library destructor if env is panicked. Note, logger panic does not disable library destructor, perhaps it should. Note, failed assert causes env panic, disabling library destructor.
git-svn-id: file:///svn/toku/tokudb@27354 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Barry Perlman
83e823e2e6 [t:3113] During recovery, do not use latest version of rollback log file,
but use latest version that was checkpointed at or before the last complete checkpoint.

git-svn-id: file:///svn/toku/tokudb@27338 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Barry Perlman
40b2124deb [t:3196] Fix iname generation: only dictionaries created by brtloader
will have _L_ mark, dictionaries created using USE_PUTS (2440 log suppression, a.k.a. put-loader) will 
have _P_ mark, dictionaries created without loader will have no mark.

git-svn-id: file:///svn/toku/tokudb@27298 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Barry Perlman
60b8508095 [t:3187] Make assert code more robust.
git-svn-id: file:///svn/toku/tokudb@27209 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:35 -04:00
Bradley C. Kuszmaul
16caca9d6c Merge changes from tokudb.3173 onto main. This version causes 4.1.1 to fail (when appropiately ported) and 4.1.3 to succeed. That is, the unit tests now notice that the fractal tree has wrong pivot keys. Fixes #3173. close[t:3173]
{{{
svn merge -c27115:27120 ../tokudb.3173
}}}
.


git-svn-id: file:///svn/toku/tokudb@27133 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
3852c4b304 #3179 clamp the hot indexer progress refs[t:3179]
git-svn-id: file:///svn/toku/tokudb@27130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
55208fc364 Merge r27117 from tokudb.3173. Refs #3173. [t:3173]
git-svn-id: file:///svn/toku/tokudb@27118 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
703dbc4784 Candidate fix for #3173. Refs #3173. [t:3173]
git-svn-id: file:///svn/toku/tokudb@27114 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Barry Perlman
ecca7928f3 [t:3175] Put nodesize in fcreate recovery log entry, remove fcreate2 recovery log entry.
git-svn-id: file:///svn/toku/tokudb@27081 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Zardosht Kasheff
7e2b864b37 [t:3166], use new flag to not grab write lock on directory
git-svn-id: file:///svn/toku/tokudb@27080 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
91daf918a0 #3168 print decompression block information including the raw block to stderr refs[t:3168]
git-svn-id: file:///svn/toku/tokudb@27079 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Zardosht Kasheff
7d83e7a751 [t:3166], add flag for db->open to say you are creating a hot db
git-svn-id: file:///svn/toku/tokudb@27078 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
5297be0f96 #3164 fix changeset 27062 refs[t:3164]
git-svn-id: file:///svn/toku/tokudb@27073 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
ecb82d778e #3164 fix the brtloader pivot key problem refs[t:3164]
git-svn-id: file:///svn/toku/tokudb@27062 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
0472609876 #3164 fix the brtloader pivot key problem refs[t:3164]
git-svn-id: file:///svn/toku/tokudb@27061 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Barry Perlman
5b6920d3c9 [t:3169] Set environment panic on failed assert.
git-svn-id: file:///svn/toku/tokudb@27057 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
42921bb831 #3163 use the nodesize configured in a db in the brtloader refs[t:3163]
git-svn-id: file:///svn/toku/tokudb@26909 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
22455dbb1c Undo r26806. Refs #3161. [t:3161]
git-svn-id: file:///svn/toku/tokudb@26833 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
970417e199 Fix #3160. close[t:3160]
git-svn-id: file:///svn/toku/tokudb@26806 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
abd5212bcf Merge r26784 into the main line.
Changes include patches to
 * Handle gcc 4.4.1's foibles.
 * Instrument {{{toku_os_pread}}}
 * Release the lock during I/Os for queries (#3039)
 * Simplification of the ydb lock (no more backoff)
 * Use {{{DB_TXN_NOSYNC}} for several tests (which speeds them up).
 * Set the redzone to zero for several tests  (so they can run on machines with little free space). (#3111)
 * Add  helgrind and valgrind suppressions to some tests.
 * Add dollar-id-dollar to several files.
 * Declare the schedule status values to be volatile.
 * Add a method to the toku {{{RWLOCK}}} to effectively grab the read lock and then release it quickly.  (With only one condition variable acquisition.)
Fixes #3039. close[t:3039]
Refs #3111,   #3112,   #3119,   #3125,   #3126,   #3128,   #3131,   #3133,   #3142,   #3152.
   [t:3111] [t:3112] [t:3119] [t:3125] [t:3126] [t:3128] [t:3131] [t:3133] [t:3142] [t:3152].


git-svn-id: file:///svn/toku/tokudb@26785 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Rich Prohaska
cf3bbe92df #3147 merge tokudb block size changes to main refs[t:3147]
git-svn-id: file:///svn/toku/tokudb@26780 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
974d5147b5 Fix the volatile declaration. Refs #3142 [t:3142] (merge r26660 into tokudb and tokudb.3039c)
git-svn-id: file:///svn/toku/tokudb@26661 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Bradley C. Kuszmaul
217fed8351 In {{{tokudb.3039}}} and {{{tokudb}}} merge fix for #3142. Fixes #3142. close[t:3142]
{{{
svn merge -r26654:26656 https://svn.tokutek.com/tokudb/toku/tokudb.3039c+3131
}}}


git-svn-id: file:///svn/toku/tokudb@26659 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Dave Wells
91788e1d2a fix issue with test
git-svn-id: file:///svn/toku/tokudb@26608 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:34 -04:00
Barry Perlman
9e3302820c [t:3130] Capture oldest txn starttime at txn begin.
git-svn-id: file:///svn/toku/tokudb@26508 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Rich Prohaska
7c059f7af2 #3129 fix recover of insert multiple and delete multiple with a valid source filenum closes[t:3129]
git-svn-id: file:///svn/toku/tokudb@26506 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
8a810eafd8 [t:3130] Add start time of oldest live txn to engine status.
git-svn-id: file:///svn/toku/tokudb@26502 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Rich Prohaska
e1e8cab62b #3129 fix recover of insert multiple and delete multiple with a valid source filenum closes[t:3129]
git-svn-id: file:///svn/toku/tokudb@26501 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Zardosht Kasheff
b563fcc246 [t:3117], fix bug
git-svn-id: file:///svn/toku/tokudb@26491 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
186a86939d [t:3120] Ignore false test failures caused by varying number of system calls.
git-svn-id: file:///svn/toku/tokudb@26458 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Zardosht Kasheff
702f49e52f [t:3117], merge fractal tree piece to main
git-svn-id: file:///svn/toku/tokudb@26451 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
37f0a697b3 [t:3034] Update engine status for new functionality.
git-svn-id: file:///svn/toku/tokudb@26444 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Bradley C. Kuszmaul
63d1c05f30 Fix #3112 (bash {{{=~}}} operator doesn't like quotes). close[t:3112]
git-svn-id: file:///svn/toku/tokudb@26365 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Bradley C. Kuszmaul
e4a1d77679 Make some of the tests work with smaller redzones. Refs #3111. [t:3111]
git-svn-id: file:///svn/toku/tokudb@26362 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
c68e4f968a [t:3102] Change brtloader_fi_close() to ignore files that are already closed when called from brtloader_fi_close_all().
git-svn-id: file:///svn/toku/tokudb@26361 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
2f4f4976be [t:3102] Restore brtloader_fi_close_all() to brtloader-internal.h (needed by test programs). Also clarify use of return values in brtloader_fi_close().
git-svn-id: file:///svn/toku/tokudb@26360 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
62eb359ca0 [t:2892] Fix error in toku_get_version_of_logs_on_disk() so version_found is always set correctly.
git-svn-id: file:///svn/toku/tokudb@26350 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
870a7f7934 [t:2892] Delete obsolete function.
git-svn-id: file:///svn/toku/tokudb@26349 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Zardosht Kasheff
0a62f29cf2 [t:3067], add another case brought up in test plan review
git-svn-id: file:///svn/toku/tokudb@26328 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
093337c84b [t:3103] Fix minor defects in verbose output from loader-cleanup-test.
git-svn-id: file:///svn/toku/tokudb@26320 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
de61796b6c [t:3102] Propogate error return up call stack when fclose() fails. Make brtloader_fi_close_all() static to brtloader.c and delete its signature from brtloader-internal.h.
git-svn-id: file:///svn/toku/tokudb@26318 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
6a9a386314 [t:2892] Add test of attempt to upgrade environment with multiple log files and dirty shutdown.
git-svn-id: file:///svn/toku/tokudb@26191 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Rich Prohaska
cc750bf881 #3094 set executable property on the tokudb scripts refs[t:3094]
git-svn-id: file:///svn/toku/tokudb@26188 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Rich Prohaska
b897d79c37 fixes from hotindexer recover code review
git-svn-id: file:///svn/toku/tokudb@26185 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Dave Wells
8de2b2f1a7 fixes from hotindexer recovery code review
git-svn-id: file:///svn/toku/tokudb@26176 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
8f05263293 [t:3092] Avoid function call for common case.
git-svn-id: file:///svn/toku/tokudb@26164 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
f56ef74403 [t:3092] Replace raw abort() calls with resource_assert() calls in xmalloc functions. This will provide more information in error logs on crash.
git-svn-id: file:///svn/toku/tokudb@26163 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:33 -04:00
Barry Perlman
3c3d05f421 [t:2892] Add function to check rows, but skipping over first n rows which are expected to have been deleted.
git-svn-id: file:///svn/toku/tokudb@26137 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:32 -04:00