Bradley C. Kuszmaul
f27cc8fa09
Fixes #2323 by getting rid of gcc warnings. closes[t:2323]
...
git-svn-id: file:///svn/toku/tokudb@17147 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:59 -04:00
Bradley C. Kuszmaul
639c1d3920
Note what's going on with the redirect of stderr. Refs #2308 . [t:2308]
...
git-svn-id: file:///svn/toku/tokudb@17144 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Rich Prohaska
2cdf2fc582
add tracing for getting a handle on node serialization costs refs[t:2261]
...
git-svn-id: file:///svn/toku/tokudb@17123 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
e944ee50a6
[t:2312] All paths to write/pwrite go through portability layer.
...
full_os_(p)write check for partial reads, and fixable errors.
git-svn-id: file:///svn/toku/tokudb@17078 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
a0d3657e23
closes[t:2309] [t:2308] Deprecate dup2, _dup2 (wrap with toku_dup2), and replace /dev/null with DEV_NULL_FILE
...
Fixes some recovery tests in windows
git-svn-id: file:///svn/toku/tokudb@17020 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
b0ee051f9c
[t:2257] Speed up reading logs backwards in windows by using default FILE* buffering
...
git-svn-id: file:///svn/toku/tokudb@16999 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
f1086d049d
[t:2257] Switch atomic instructions to decrement, increment if they only modify by 1,
...
remove some bookkkeeping in windows that is slow and not completely necessary.
git-svn-id: file:///svn/toku/tokudb@16998 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
836889d0b2
[t:2257] Src tests and newbrt tests now verify init and destroy function succeed
...
git-svn-id: file:///svn/toku/tokudb@16996 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Dave Wells
c7c9c7aa22
merge changes from tokudb.2294.logtrim
...
git-svn-id: file:///svn/toku/tokudb@16947 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Yoni Fogel
9557f27e82
Addresses #2249 [t:2249] Merge DB_ENV->put_multiple branch back onto main.
...
Fixed some makefile issues, ported recovery tests to use toku_hard_crash_on_purpose(), fixed db-benchmark-test to use default name
for 0th db
git-svn-id: file:///svn/toku/tokudb@16936 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:58 -04:00
Bradley C. Kuszmaul
ca0bc8f302
Make recovery tests quieter. Fixes #2293 . close[t:2293]
...
git-svn-id: file:///svn/toku/tokudb@16861 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:57 -04:00
Yoni Fogel
324c278a31
Addresses #2257 refs[t:2257] Merge windows port back into main.
...
git-svn-id: file:///svn/toku/tokudb@16673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Rich Prohaska
0909fccce1
increase the backward log scan rate close[t:2256]
...
git-svn-id: file:///svn/toku/tokudb@16486 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Rich Prohaska
edaa294849
print checkpoint timestamps during recovery close[t:2255]
...
git-svn-id: file:///svn/toku/tokudb@16485 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Rich Prohaska
c521ee3a91
put the log print functions in log_print.c refs[t:2193]
...
git-svn-id: file:///svn/toku/tokudb@16447 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Rich Prohaska
26ba255118
merge the recovery changes found by barry and rich during a code review to main closes[t:2231]
...
git-svn-id: file:///svn/toku/tokudb@16298 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Dave Wells
dec996c12a
add ability to execute 2 callbacks during recovery - for [t:2028]
...
git-svn-id: file:///svn/toku/tokudb@16279 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:56 -04:00
Yoni Fogel
3d64b79078
Closes #2227 closes[t:2227] Change the way backwards recovery works for
...
fcreate/fclose/fassociate/fopen. Files that potentially do not have a full header written will never be opened
git-svn-id: file:///svn/toku/tokudb@16238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
1c5ba7650b
force recovery down an error path refs[t:2224]
...
git-svn-id: file:///svn/toku/tokudb@16219 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Rich Prohaska
4fdf978767
closes[t:2221] recovery does not call ydb callbacks
...
git-svn-id: file:///svn/toku/tokudb@16155 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Yoni Fogel
e37c1ac397
Addresses #2218 refs[t:2218] Merge r1629 to main
...
git-svn-id: file:///svn/toku/tokudb@16130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
a3a8d8cce6
Merge from 2212 branch. Fixes #2212 . Fixes[t:2212].
...
git-svn-id: file:///svn/toku/tokudb@16106 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Bradley C. Kuszmaul
ee8d5b670e
Remove about 15 lines of dead code. Refs [t:2208]
...
git-svn-id: file:///svn/toku/tokudb@16068 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:55 -04:00
Barry Perlman
645ef221d7
Add some carriage returns to dump_translation().
...
git-svn-id: file:///svn/toku/tokudb@16034 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Bradley C. Kuszmaul
4726801d1a
Fixes[t:2209] Fixes #2209 .
...
git-svn-id: file:///svn/toku/tokudb@16032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
903d51eb35
add a test for a missing tokudb file during recovery refs[t:2199]
...
git-svn-id: file:///svn/toku/tokudb@15998 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
be78fe5408
fix a valgrind bug refs[t:2199]
...
git-svn-id: file:///svn/toku/tokudb@15995 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
c3738f4487
Addresses #2197 refs[t:2197] brtdump: Provide cachefile for brt header.
...
git-svn-id: file:///svn/toku/tokudb@15989 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Yoni Fogel
daa83b2d17
Addresses #2194 refs[t:2194] Windows port work: set default for 'open' to be binary.
...
Set open of logfiles to be binary
git-svn-id: file:///svn/toku/tokudb@15986 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
5da081a536
rearrange the recovery progress refs[t:2191]
...
git-svn-id: file:///svn/toku/tokudb@15981 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
ebc6a25f03
describe the units of progress time refs[t:2191]
...
git-svn-id: file:///svn/toku/tokudb@15980 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
e73a7f83c0
test some recovery error paths closes[t:2199]
...
git-svn-id: file:///svn/toku/tokudb@15979 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
722f0aea3f
remove the fifo peek cmdstruct cruft refs[t:2189]
...
git-svn-id: file:///svn/toku/tokudb@15965 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
887a53259d
Addresses #2090 refs[t:2090] Bugfix in cachetable_reserve_filenum(), added test program to exercise filenum reservation/release.
...
git-svn-id: file:///svn/toku/tokudb@15963 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
6c30f3916d
remove the fifo_msg cruft from the newbrt refs[t:2189]
...
git-svn-id: file:///svn/toku/tokudb@15962 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Barry Perlman
25cfe8a64d
Addresses #1924 refs[t:1924] Disable automatic upgrade until we decide to actually do it.
...
We don't want to partially upgrade a database and we don't have the logic to automatically
create the fileops directory. This is done simply by setting
BRT_LAYOUT_MIN_SUPPORTED_VERSION = BRT_LAYOUT_VERSION
and leaving some unused code in place.
git-svn-id: file:///svn/toku/tokudb@15960 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:54 -04:00
Rich Prohaska
c0a2cb6fd2
improve recovery progress tracking refs[t:2191]
...
git-svn-id: file:///svn/toku/tokudb@15959 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
6282f73348
remove some more logging cruft refs[t:2189]
...
git-svn-id: file:///svn/toku/tokudb@15957 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
4f67746f66
print the number of log entries left to process during recovery refs[t:2191]
...
git-svn-id: file:///svn/toku/tokudb@15947 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
508adfd5a4
replace the timestamp and shutdown log entry with a comment log entry closes[t:2192]
...
git-svn-id: file:///svn/toku/tokudb@15946 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
e7fd532535
print recovery progress every 15 seconds closes[t:2191]
...
git-svn-id: file:///svn/toku/tokudb@15938 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
0ff48bb664
imp DB_TXN_SYNC ref[t:2190]
...
git-svn-id: file:///svn/toku/tokudb@15936 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Barry Perlman
e1877dbb59
Closes #2187 refs[t:2187] Call toku_checkpoint_destroy() from toku_brt_destroy().
...
git-svn-id: file:///svn/toku/tokudb@15931 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
f9ac445e55
delete logging cruft closes[t:2189]
...
git-svn-id: file:///svn/toku/tokudb@15929 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
c9ed5c989f
remove varray closes[t:2186]
...
git-svn-id: file:///svn/toku/tokudb@15923 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
4c337193b6
rename __rolltmp to __tokudb_rolltmp closes[t:2184]
...
git-svn-id: file:///svn/toku/tokudb@15884 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Yoni Fogel
223fc2395a
Addresses #2164 refs[t:2164] Take brtheader lock when accessing zombie/live lists during fdelete on commit.
...
git-svn-id: file:///svn/toku/tokudb@15878 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Yoni Fogel
c3a51b5f34
Addresses #2164 refs[t:2164] Remove race condition from accessing live/zombie lists.
...
git-svn-id: file:///svn/toku/tokudb@15877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
b89eb6ef9e
speed up recovery by using a large cache table closes[t:2183]
...
git-svn-id: file:///svn/toku/tokudb@15875 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00
Rich Prohaska
6196e6efca
cleanup recovery fprintf strings refs[t:2177]
...
git-svn-id: file:///svn/toku/tokudb@15870 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:53 -04:00