Yoni Fogel
7d6f6fef69
Closes #2180 closes[t:2180] Recovery forces 'fcreate' in rollback log (when replaying fcreate log entry)
...
git-svn-id: file:///svn/toku/tokudb@15841 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:52 -04:00
Barry Perlman
bb8cf498bd
Addresses #652 , #2170 , #2178 refs[t:652,2170,2178] Merge from 3.0.0-logging branch with command: svn merge -r15784:HEAD https://svn.tokutek.com/tokudb/mysql.branches/3.0.0-logging/tokudb .
...
git-svn-id: file:///svn/toku/tokudb@15839 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:52 -04:00
Rich Prohaska
e8a671d611
imp toku_file_fsync in the port layer closes[t:1748]
...
git-svn-id: file:///svn/toku/tokudb@15805 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:52 -04:00
Yoni Fogel
357ebc950d
Addresses #2172 refs[t:2172] Bugfix of commit r15040 (Addresses #2037 refs[t:2037])
...
Was not holding cachetable lock to access rwlock (whose mutex was cachetable lock).
This caused a race condition that you would sometimes grab the cachetable lock on exiting the lock but didn't have it before.
We believe this caused the deadlock
git-svn-id: file:///svn/toku/tokudb@15802 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:52 -04:00
Rich Prohaska
58cf363b8d
speedup the db-benchmark-test buffer generator refs[t:2123]
...
git-svn-id: file:///svn/toku/tokudb@15775 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:52 -04:00
Yoni Fogel
c943ab3b1c
Addresses #2168 refs[t:2168] Skip fsync for transactions that have done no (modify) work.
...
i.e. only queries
git-svn-id: file:///svn/toku/tokudb.2037b@15766 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:07 -04:00
Yoni Fogel
18c2c68f7c
Addresses #2164 refs[t:2164] Zombie locking contract now enforced in rename/remove
...
Checkpoint holds entire brt open (as zombie if necessary) instead of just holding open the cachefile.
git-svn-id: file:///svn/toku/tokudb.2037b@15740 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
a4f65b1154
Comment
...
git-svn-id: file:///svn/toku/tokudb.2037b@15739 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
86a917a99d
Closes #2160 closes[t:2160] Implement forward and backward recovery for fdelete.
...
fopen forward recovery: file missing (ENOENT) is not considered an error.
git-svn-id: file:///svn/toku/tokudb.2037b@15693 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
b3df0166e4
Closes #2158 closes[t:2158] Backwards recovery of fcreate does fclose (just like backwards fopen)
...
git-svn-id: file:///svn/toku/tokudb.2037b@15692 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
a522ceda16
Closes #2153 refs[t:2153] fopen logged only once (unless closed and reopened). Removed logger from cachefile_close,
...
removed txnid from logging of fopen.
git-svn-id: file:///svn/toku/tokudb.2037b@15691 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
a293c6dac5
Addresses #2090 refs[t:2090] Bugfix in reserving filenums during recovery.
...
Use filenum provided.
git-svn-id: file:///svn/toku/tokudb.2037b@15646 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
030df27e4d
Addresses #2090 refs[t:2090] Logging for file create is done before actually creating file on disk.
...
We reserve a filenum before logging, and then use the reserved filenum when we actually open the cachefile.
git-svn-id: file:///svn/toku/tokudb.2037b@15645 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Barry Perlman
97fa5e2467
Addresses #2075 , #2094 refs[t:2075] refs[t:2094]
...
Merge 2.2.0 scheduling statistics to 3.0.0 (#2075 ).
Restore #2094 fix to 3.0.0 (cachefiles_lock).
Command line for merge (executed in tokudb.2037b, ../tokudb.2.2.0 is local sandbox image of 2.2.0 release): svn merge -r14900:HEAD ../tokudb.2.2.0
git-svn-id: file:///svn/toku/tokudb.2037b@15629 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:06 -04:00
Yoni Fogel
6feac9ff0b
Closes #2064 closes[t:2064] Forward recovery of fcreate sets initial descriptor in brt.
...
Added test (src/tests/recover-compare-db-descriptor.abortrecover) that fails before this change, succeeds with it.
git-svn-id: file:///svn/toku/tokudb.2037b@15589 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:05 -04:00
Yoni Fogel
ae5828e7b9
Closes #2058 closes[t:2058] Recovery passes a fake DB* (zeroed out DB struct) to brt
...
for purposes of DB comparison function.
git-svn-id: file:///svn/toku/tokudb@15583 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:05 -04:00
Yoni Fogel
88d66274a1
Closes #2128 closes[t:2128] List structure renamed to toku_list, same as header, and header moved
...
> to toku_include/.
> This is done to avoid poisoning namespace, and to be easily included by handlerton.
git-svn-id: file:///svn/toku/tokudb@15579 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:05 -04:00
Rich Prohaska
6f6974aae9
port fairsched from 2.2.0 to main (for linux only) refs[t:2083]
...
git-svn-id: file:///svn/toku/tokudb@15573 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Yoni Fogel
580f5caafb
Addresses #2037 refs[t:2037] Merged #2037 back into main
...
git-svn-id: file:///svn/toku/tokudb@15562 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Rich Prohaska
805eef87be
rename the recover lock file closes[t:2095]
...
git-svn-id: file:///svn/toku/tokudb@15558 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Yoni Fogel
95f0e10dea
Addresses #2116 refs[t:2116] Fix windows build.
...
git-svn-id: file:///svn/toku/tokudb@15431 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Rich Prohaska
22b6cb163e
merge 1967.mtm2 to main refs[t:1967]
...
git-svn-id: file:///svn/toku/tokudb@15205 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Rich Prohaska
6822031243
fix some linux build problems with icc 11 close[t:2088]
...
git-svn-id: file:///svn/toku/tokudb@15149 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:04 -04:00
Yoni Fogel
d2576d5f71
Closes #2057 closes[t:2057] Add warnings about code that needs to remain in certain order to prevent recovery errors,
...
Fixed bug where lsn in header could be wrong (or crash during recovery).
git-svn-id: file:///svn/toku/tokudb@14856 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Yoni Fogel
08559dad60
Closes #2055 closes[t:2055] Addresses #2042 refs[t:2042] Fix race condition caused by r14802
...
A client (read lock) must hold the multi-operation lock during the entire duration of holding the checkpoint-safe lock.
The multi-operation lock was being released too early.
git-svn-id: file:///svn/toku/tokudb@14845 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Barry Perlman
15ead646d1
Addresses #1792 refs[t:1792] Added logger lock info to engine status.
...
git-svn-id: file:///svn/toku/tokudb@14821 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Barry Perlman
7e96e32963
Addresses #1792 refs[t:1792] Added timestamps to engine status
...
git-svn-id: file:///svn/toku/tokudb@14817 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Barry Perlman
c8b8e42194
Addresses 1792 refs[t:1792] Add more info to show engine status
...
git-svn-id: file:///svn/toku/tokudb@14804 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Yoni Fogel
86de3ebb5b
Addresses #2042 refs[t:2042] Fix race condition at lower level.
...
git-svn-id: file:///svn/toku/tokudb@14802 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Rich Prohaska
8e8c68250c
add some perf counters to the cachetable [t:1792]
...
git-svn-id: file:///svn/toku/tokudb@14801 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Rich Prohaska
46ae126764
panic brt's if recovery fails close[t:2035]
...
git-svn-id: file:///svn/toku/tokudb@14783 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Rich Prohaska
a39e28d36b
make recovery more robust refs[t:2035]
...
git-svn-id: file:///svn/toku/tokudb@14751 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Barry Perlman
4ed4cdb854
Addresses 1792 refs[t:1792] Further implementation of show engine status
...
git-svn-id: file:///svn/toku/tokudb@14742 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:03 -04:00
Yoni Fogel
5f488b2b42
Addresses #1862 refs[t:1862] Return rollback to use standard messages (accidentally set it to mega-abort/mega-commit in r1862)
...
git-svn-id: file:///svn/toku/tokudb@14713 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
bca71dc119
Addresses #1862 refs[t:1862] Return ULE_DEBUG to 0 (accidentally set it to 1 in r1862)
...
git-svn-id: file:///svn/toku/tokudb@14704 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Barry Perlman
ee6e11bcf0
Addresses #1792 refs[t:1792] Started adding show engine status
...
git-svn-id: file:///svn/toku/tokudb@14695 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
1f0a5815b1
Closes #1862 closes[t:1862] LSNs are logged/chosen during the actual close, if closed during recovery, the LSN is passed into close.
...
git-svn-id: file:///svn/toku/tokudb@14686 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
64d5d7beee
Addresses #1737 refs[t:1737] Add a test for mega abort/mega commit.
...
git-svn-id: file:///svn/toku/tokudb@14671 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Dave Wells
3106fcce80
Fix recover-missing-logfiles test. In the process, define DB_CLOSE_DONT_TRIM_LOG flag for db_close. Also, remove some old, unused code
...
git-svn-id: file:///svn/toku/tokudb@14631 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Dave Wells
2137214802
fix maxlsn initialization if an empty logfile is encountered [t:1995]
...
git-svn-id: file:///svn/toku/tokudb@14611 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Dave Wells
53b854ac5a
build log file as part of test - ticket 1968
...
git-svn-id: file:///svn/toku/tokudb@14610 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
1b8ee601f3
Addresses #1737 refs[t:1737] Optimized le_has_xids
...
In the case where |XIDS| <= num xids in leafentry, and outermost uncommitted xid matches, and |XIDS|>2
git-svn-id: file:///svn/toku/tokudb@14588 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Rich Prohaska
8be7b61512
protect the logger's n_in_buf variable by increasing the scope of the logger's input lock close[t:2015]
...
git-svn-id: file:///svn/toku/tokudb@14581 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
465065c60c
Addresses #1737 refs[t:1737] Mega abort/mega commit messages coded
...
These messages are broadcast to an entire dictionary, aborting/committing a particular transaction only.
git-svn-id: file:///svn/toku/tokudb@14571 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Yoni Fogel
a5cf59455a
Closes #1969 closes[t:1969] Fix assertion in round_to_page
...
git-svn-id: file:///svn/toku/tokudb@14570 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Rich Prohaska
191d616ee8
add another test case for nested txn recovery [t:1960]
...
git-svn-id: file:///svn/toku/tokudb@14557 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Rich Prohaska
9d4f1ee78e
fix some recovery tests close[t:2005] close[t:2010]
...
git-svn-id: file:///svn/toku/tokudb@14546 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:02 -04:00
Rich Prohaska
21ff8f9541
get the checkpoint tests working again [t:1961]
...
git-svn-id: file:///svn/toku/tokudb@14545 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:01 -04:00
Dave Wells
5ed2e4dc34
fix logfile trimming code, change ydb.c to exclusively use toku_checkpoint
...
git-svn-id: file:///svn/toku/tokudb@14522 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:01 -04:00
Rich Prohaska
0b920d5f6c
require an env to create a db [t:2001]
...
git-svn-id: file:///svn/toku/tokudb@14513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:58:01 -04:00