Commit graph

2764 commits

Author SHA1 Message Date
Rich Prohaska
26ba255118 merge the recovery changes found by barry and rich during a code review to main closes[t:2231]
git-svn-id: file:///svn/toku/tokudb@16298 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Rich Prohaska
a58906fe32 add the test recover callback to the db.h files refs[t:2028]
git-svn-id: file:///svn/toku/tokudb@16297 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
04f341a870 modify recovery stress tests to occasionally crash in recovery [t:2028]
git-svn-id: file:///svn/toku/tokudb@16282 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
dec996c12a add ability to execute 2 callbacks during recovery - for [t:2028]
git-svn-id: file:///svn/toku/tokudb@16279 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
84987d501e tests that lone fcreate in log closes file on backwards scan [t:2159]
git-svn-id: file:///svn/toku/tokudb@16259 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
5d0f2314e9 fix memory leak
git-svn-id: file:///svn/toku/tokudb@16258 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
4e56c4b468 add aborted fileops transactions
git-svn-id: file:///svn/toku/tokudb@16253 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Yoni Fogel
d1bd4159a3 Addresses #2227 refs[t:2227] Add test case that reproduces crash reliably
Closes #2225 closes[t:2225] Add fileops unit tests (recovery version).

git-svn-id: file:///svn/toku/tokudb@16251 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Yoni Fogel
3d64b79078 Closes #2227 closes[t:2227] Change the way backwards recovery works for
fcreate/fclose/fassociate/fopen.  Files that potentially do not have a full header written will never be opened

git-svn-id: file:///svn/toku/tokudb@16238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
12bf0be85e Uninitialized variable
git-svn-id: file:///svn/toku/tokudb@16235 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
35e486272e Preliminary powerfail test
git-svn-id: file:///svn/toku/tokudb@16234 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
1e46510c47 Force recovery to use entire log by leaving an oldest living transaction that is older than
any transaction that commits or aborts.  Delete code that truncated the log to force the same
behavior.


git-svn-id: file:///svn/toku/tokudb@16233 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
87fc6bdce2 100 dictionaries
git-svn-id: file:///svn/toku/tokudb@16231 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
1c5ba7650b force recovery down an error path refs[t:2224]
git-svn-id: file:///svn/toku/tokudb@16219 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
688a7ca01e typo not caught with DEBUG=1
git-svn-id: file:///svn/toku/tokudb@16218 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
d569899a6d now randomly aborts before, during, or after the last checkpoint
git-svn-id: file:///svn/toku/tokudb@16217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
79e7c8a397 create a stress test for fileops. still a work in progress, but worth checking in
git-svn-id: file:///svn/toku/tokudb@16181 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
4fdf978767 closes[t:2221] recovery does not call ydb callbacks
git-svn-id: file:///svn/toku/tokudb@16155 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
e37c1ac397 Addresses #2218 refs[t:2218] Merge r1629 to main
git-svn-id: file:///svn/toku/tokudb@16130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
84314a3ade keep track of the ydbtime structs in the big ydb lock so we can free them when the lib unloads closes[t:2198]
git-svn-id: file:///svn/toku/tokudb@16125 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
a23dcae3b7 fix a linux test refs[t:2212]
git-svn-id: file:///svn/toku/tokudb@16116 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
a7acb6d7f3 Tell filesize not to run vgrind
git-svn-id: file:///svn/toku/tokudb@16111 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
54c356e095 Addresses #2217 refs[t:2217] Fix memory leak in test.
git-svn-id: file:///svn/toku/tokudb@16109 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
5bdc180c76 Addresses #2217 refs[t:2217]
Fix r16084, test now correctly shows file size reduces after many inserts and deletes

git-svn-id: file:///svn/toku/tokudb@16108 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
83e417314c fix the src/tests build
git-svn-id: file:///svn/toku/tokudb@16107 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
a3a8d8cce6 Merge from 2212 branch. Fixes #2212. Fixes[t:2212].
git-svn-id: file:///svn/toku/tokudb@16106 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
ea9ff275bb Added test to measure file size after many inserts and deletes.
git-svn-id: file:///svn/toku/tokudb@16084 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
698c0a6c33 Deleted.
git-svn-id: file:///svn/toku/tokudb@16083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
984461741c Added simple example of htonl
git-svn-id: file:///svn/toku/tokudb@16082 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
6222ec9492 fixes[t:2213] Fixes #2213.
git-svn-id: file:///svn/toku/tokudb@16069 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
ee8d5b670e Remove about 15 lines of dead code. Refs [t:2208]
git-svn-id: file:///svn/toku/tokudb@16068 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
dca0d1c566 rearrange the release dir structure refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@16046 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
ab2d691957 Fixes[t:2210] Fixes #2210.
git-svn-id: file:///svn/toku/tokudb@16038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
645ef221d7 Add some carriage returns to dump_translation().
git-svn-id: file:///svn/toku/tokudb@16034 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Bradley C. Kuszmaul
4726801d1a Fixes[t:2209] Fixes #2209.
git-svn-id: file:///svn/toku/tokudb@16032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
cddc1a25f9 don't mix mallocators closes[t:2204]
git-svn-id: file:///svn/toku/tokudb@15999 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
903d51eb35 add a test for a missing tokudb file during recovery refs[t:2199]
git-svn-id: file:///svn/toku/tokudb@15998 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
be78fe5408 fix a valgrind bug refs[t:2199]
git-svn-id: file:///svn/toku/tokudb@15995 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
c3738f4487 Addresses #2197 refs[t:2197] brtdump: Provide cachefile for brt header.
git-svn-id: file:///svn/toku/tokudb@15989 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
2b9bd45bf3 db-insert has no txn by default. db-scan has txn by default. have to make them match. refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15988 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
967e906014 db-insert has no txn by default. db-scan has txn by default. update the docs refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15987 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Yoni Fogel
daa83b2d17 Addresses #2194 refs[t:2194] Windows port work: set default for 'open' to be binary.
Set open of logfiles to be binary

git-svn-id: file:///svn/toku/tokudb@15986 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
96850c261b add setup and check rules. get rid of the private tokudb.h refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15983 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
a738580d53 add setup and check rules. get rid of the private tokudb.h refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15982 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
5da081a536 rearrange the recovery progress refs[t:2191]
git-svn-id: file:///svn/toku/tokudb@15981 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
ebc6a25f03 describe the units of progress time refs[t:2191]
git-svn-id: file:///svn/toku/tokudb@15980 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
e73a7f83c0 test some recovery error paths closes[t:2199]
git-svn-id: file:///svn/toku/tokudb@15979 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
87bbf72c70 Addresses #2121 refs[t:2121] toku_ydb_lock_destroy(): After freeing thread-specific memory for ydbtime struct,
set thread-specific storage to NULL to prevent destructor (toku_free) from being called twice,
just in case the thread that calls toku_ydb_lock_destroy() is not the same thread that called 
toku_ydb_lock_init().


git-svn-id: file:///svn/toku/tokudb@15976 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
c2d7c68f56 Closes #2121 closes[t:2121] Free memory for last remaining ydbtime struct when shutting down.
git-svn-id: file:///svn/toku/tokudb@15975 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
ed3167c978 fix some env leaks refs[t:2198]
git-svn-id: file:///svn/toku/tokudb@15973 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00