Commit graph

2756 commits

Author SHA1 Message Date
Yoni Fogel
3d64b79078 Closes #2227 closes[t:2227] Change the way backwards recovery works for
fcreate/fclose/fassociate/fopen.  Files that potentially do not have a full header written will never be opened

git-svn-id: file:///svn/toku/tokudb@16238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
12bf0be85e Uninitialized variable
git-svn-id: file:///svn/toku/tokudb@16235 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
35e486272e Preliminary powerfail test
git-svn-id: file:///svn/toku/tokudb@16234 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
1e46510c47 Force recovery to use entire log by leaving an oldest living transaction that is older than
any transaction that commits or aborts.  Delete code that truncated the log to force the same
behavior.


git-svn-id: file:///svn/toku/tokudb@16233 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
87fc6bdce2 100 dictionaries
git-svn-id: file:///svn/toku/tokudb@16231 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
1c5ba7650b force recovery down an error path refs[t:2224]
git-svn-id: file:///svn/toku/tokudb@16219 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
688a7ca01e typo not caught with DEBUG=1
git-svn-id: file:///svn/toku/tokudb@16218 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
d569899a6d now randomly aborts before, during, or after the last checkpoint
git-svn-id: file:///svn/toku/tokudb@16217 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Dave Wells
79e7c8a397 create a stress test for fileops. still a work in progress, but worth checking in
git-svn-id: file:///svn/toku/tokudb@16181 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
4fdf978767 closes[t:2221] recovery does not call ydb callbacks
git-svn-id: file:///svn/toku/tokudb@16155 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
e37c1ac397 Addresses #2218 refs[t:2218] Merge r1629 to main
git-svn-id: file:///svn/toku/tokudb@16130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
84314a3ade keep track of the ydbtime structs in the big ydb lock so we can free them when the lib unloads closes[t:2198]
git-svn-id: file:///svn/toku/tokudb@16125 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
a23dcae3b7 fix a linux test refs[t:2212]
git-svn-id: file:///svn/toku/tokudb@16116 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
a7acb6d7f3 Tell filesize not to run vgrind
git-svn-id: file:///svn/toku/tokudb@16111 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
54c356e095 Addresses #2217 refs[t:2217] Fix memory leak in test.
git-svn-id: file:///svn/toku/tokudb@16109 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
5bdc180c76 Addresses #2217 refs[t:2217]
Fix r16084, test now correctly shows file size reduces after many inserts and deletes

git-svn-id: file:///svn/toku/tokudb@16108 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
83e417314c fix the src/tests build
git-svn-id: file:///svn/toku/tokudb@16107 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
a3a8d8cce6 Merge from 2212 branch. Fixes #2212. Fixes[t:2212].
git-svn-id: file:///svn/toku/tokudb@16106 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
ea9ff275bb Added test to measure file size after many inserts and deletes.
git-svn-id: file:///svn/toku/tokudb@16084 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
698c0a6c33 Deleted.
git-svn-id: file:///svn/toku/tokudb@16083 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
984461741c Added simple example of htonl
git-svn-id: file:///svn/toku/tokudb@16082 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
6222ec9492 fixes[t:2213] Fixes #2213.
git-svn-id: file:///svn/toku/tokudb@16069 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
ee8d5b670e Remove about 15 lines of dead code. Refs [t:2208]
git-svn-id: file:///svn/toku/tokudb@16068 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
dca0d1c566 rearrange the release dir structure refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@16046 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
ab2d691957 Fixes[t:2210] Fixes #2210.
git-svn-id: file:///svn/toku/tokudb@16038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
645ef221d7 Add some carriage returns to dump_translation().
git-svn-id: file:///svn/toku/tokudb@16034 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Bradley C. Kuszmaul
4726801d1a Fixes[t:2209] Fixes #2209.
git-svn-id: file:///svn/toku/tokudb@16032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
cddc1a25f9 don't mix mallocators closes[t:2204]
git-svn-id: file:///svn/toku/tokudb@15999 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
903d51eb35 add a test for a missing tokudb file during recovery refs[t:2199]
git-svn-id: file:///svn/toku/tokudb@15998 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
be78fe5408 fix a valgrind bug refs[t:2199]
git-svn-id: file:///svn/toku/tokudb@15995 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
c3738f4487 Addresses #2197 refs[t:2197] brtdump: Provide cachefile for brt header.
git-svn-id: file:///svn/toku/tokudb@15989 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
2b9bd45bf3 db-insert has no txn by default. db-scan has txn by default. have to make them match. refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15988 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
967e906014 db-insert has no txn by default. db-scan has txn by default. update the docs refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15987 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Yoni Fogel
daa83b2d17 Addresses #2194 refs[t:2194] Windows port work: set default for 'open' to be binary.
Set open of logfiles to be binary

git-svn-id: file:///svn/toku/tokudb@15986 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
96850c261b add setup and check rules. get rid of the private tokudb.h refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15983 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
a738580d53 add setup and check rules. get rid of the private tokudb.h refs[t:2202]
git-svn-id: file:///svn/toku/tokudb@15982 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
5da081a536 rearrange the recovery progress refs[t:2191]
git-svn-id: file:///svn/toku/tokudb@15981 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
ebc6a25f03 describe the units of progress time refs[t:2191]
git-svn-id: file:///svn/toku/tokudb@15980 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
e73a7f83c0 test some recovery error paths closes[t:2199]
git-svn-id: file:///svn/toku/tokudb@15979 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
87bbf72c70 Addresses #2121 refs[t:2121] toku_ydb_lock_destroy(): After freeing thread-specific memory for ydbtime struct,
set thread-specific storage to NULL to prevent destructor (toku_free) from being called twice,
just in case the thread that calls toku_ydb_lock_destroy() is not the same thread that called 
toku_ydb_lock_init().


git-svn-id: file:///svn/toku/tokudb@15976 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
c2d7c68f56 Closes #2121 closes[t:2121] Free memory for last remaining ydbtime struct when shutting down.
git-svn-id: file:///svn/toku/tokudb@15975 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
ed3167c978 fix some env leaks refs[t:2198]
git-svn-id: file:///svn/toku/tokudb@15973 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
722f0aea3f remove the fifo peek cmdstruct cruft refs[t:2189]
git-svn-id: file:///svn/toku/tokudb@15965 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
062817affe test delboth during recovery closes[t:2196]
git-svn-id: file:///svn/toku/tokudb@15964 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
887a53259d Addresses #2090 refs[t:2090] Bugfix in cachetable_reserve_filenum(), added test program to exercise filenum reservation/release.
git-svn-id: file:///svn/toku/tokudb@15963 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
6c30f3916d remove the fifo_msg cruft from the newbrt refs[t:2189]
git-svn-id: file:///svn/toku/tokudb@15962 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
25cfe8a64d Addresses #1924 refs[t:1924] Disable automatic upgrade until we decide to actually do it.
We don't want to partially upgrade a database and we don't have the logic to automatically
create the fileops directory.  This is done simply by setting 
  BRT_LAYOUT_MIN_SUPPORTED_VERSION = BRT_LAYOUT_VERSION
and leaving some unused code in place.


git-svn-id: file:///svn/toku/tokudb@15960 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
c0a2cb6fd2 improve recovery progress tracking refs[t:2191]
git-svn-id: file:///svn/toku/tokudb@15959 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Barry Perlman
3704350368 Closes #2195 closes[t:2195] Retry fsync on EINTR
git-svn-id: file:///svn/toku/tokudb@15958 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
6282f73348 remove some more logging cruft refs[t:2189]
git-svn-id: file:///svn/toku/tokudb@15957 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00