Bradley C. Kuszmaul
8b47359d2c
Turn off the instrumentation
...
git-svn-id: file:///svn/toku/tokudb@20033 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Bradley C. Kuszmaul
699037a889
Set the queue to depth=2 for the extractor_thread. Refs #2571 . [t:2571]
...
git-svn-id: file:///svn/toku/tokudb@20032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
eda7857638
start a test on brtloader_open memory leaks refs[t:2591] #2591
...
git-svn-id: file:///svn/toku/tokudb@20031 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Bradley C. Kuszmaul
47f2199d9d
Merge in
...
* bradley's benchmarking changes, and
* the big speedup in the sort-and-write-rows (slowness caused the lock in fidx2file).
Refs #2571 . [t:2571]
{{{
svn merge -r 19909:20027 https://svn.tokutek.com/tokudb/toku/tokudb.2571
}}}
.
git-svn-id: file:///svn/toku/tokudb@20029 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Barry Perlman
4b42c354b2
[t:2499] Induce ENOSPC errors in more places, some concentrated at beginning of load, some concentrated at end, some sprinkled in the middle."
...
git-svn-id: file:///svn/toku/tokudb@20025 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
c8e4582e59
merge -r 20020:20023 tokudb.2578 to main. build the brtloader with cilk++. refs[t:2578]
...
git-svn-id: file:///svn/toku/tokudb@20024 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
84519c2e5b
get the loader-cleanup-test to run to completion refs[t:2578]
...
git-svn-id: file:///svn/toku/tokudb@20019 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
bb7d5414f2
shutdown the extractor in loader abort. closes[t:2586] #2586
...
git-svn-id: file:///svn/toku/tokudb@20013 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
8fe975666d
loader create close hits an assert refs[t:2588] #2588
...
git-svn-id: file:///svn/toku/tokudb@19999 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
2146a8c2f7
add a simple test that exibits the loader->abort memory leaks refs[t:2586] #2586
...
git-svn-id: file:///svn/toku/tokudb@19997 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
034da281ee
[t:2499]Added TOKUDB_CANCELED error code for use in canceling during poll function of loader.
...
git-svn-id: file:///svn/toku/tokudb@19950 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
7ae6cf5cee
check error from system() to be gcc4 clean
...
git-svn-id: file:///svn/toku/tokudb@19948 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
bccc6f9550
windows port (add extra prototypes, fix type of setstacksize)
...
git-svn-id: file:///svn/toku/tokudb@19947 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
c761b3a9d0
windows port (disable uninteresting warnings)
...
git-svn-id: file:///svn/toku/tokudb@19946 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
a4955938e5
fix the print of recovery states closes[t:2579]
...
git-svn-id: file:///svn/toku/tokudb@19942 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Rich Prohaska
5a3875a5ea
cleanup old loader temp files when the env is opened closes[t:2550]
...
git-svn-id: file:///svn/toku/tokudb@19941 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
451f3e57fc
[t:2499] Windows port.
...
ECANCELED does not exist in windows
made some functions static
git-svn-id: file:///svn/toku/tokudb@19939 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
d91de8331a
[t:2499] Windows port.
...
*pthread* -> *toku_pthread*
Printf format issues
Including toku_portability and toku_os before everything else
git-svn-id: file:///svn/toku/tokudb@19938 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:10 -04:00
Yoni Fogel
fca28d4e24
[t:2499] Windows port of casting to typeof().
...
Implement workaround. Currently windows allows implicit casts from void* to whatever*.
May need to be revisited once windows cilk is included.
git-svn-id: file:///svn/toku/tokudb@19937 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Yoni Fogel
03c66d5222
[t:2499] Fix broken windows build due to r19902 (merge of 2499d branch)
...
git-svn-id: file:///svn/toku/tokudb@19935 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
b9604f998e
[t:2499] Set errno so that brtloader's bl_fwrite() function gets correct error return if the real fwrite() produces an error.
...
git-svn-id: file:///svn/toku/tokudb@19934 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
6eae60da8a
remove the 'deq' printf refs[t:2571]
...
git-svn-id: file:///svn/toku/tokudb@19932 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
486decfd7f
put the loader error callback in its own source file so we can reduce dependancies on cilk refs[t:2576]
...
git-svn-id: file:///svn/toku/tokudb@19931 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
a9b7c490d7
[t:2499] Increase number of rows by 500X to induce creation of temp files.
...
git-svn-id: file:///svn/toku/tokudb@19930 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Dave Wells
8c86529769
add thread parsing
...
git-svn-id: file:///svn/toku/tokudb@19929 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
a4eedcb492
Closes [t:2577] Fixed unitialized variable.
...
git-svn-id: file:///svn/toku/tokudb@19914 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
0612028bcf
fix the loader error callback and the pqueue-test closes[t:2576]
...
git-svn-id: file:///svn/toku/tokudb@19913 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
9cab06f7fb
Merge the instrumentation from 2499d+2571 onto the main line (since 2499d has been merged.) Refs #2571 . [t:2571].
...
{{{
svn merge -r 19857:19905 https://svn.tokutek.com/tokudb/toku/tokudb.2499d+2571
}}}
.
git-svn-id: file:///svn/toku/tokudb@19906 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
450d693d2a
Remove extra cilk context. Fixes #2575 . close[t:2575].
...
git-svn-id: file:///svn/toku/tokudb@19905 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
dd51442ed6
[t:2499] Verify loader-created iname files are deleted on recovery.
...
git-svn-id: file:///svn/toku/tokudb@19904 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
e534524e76
[t:2499] Comment changes only.
...
git-svn-id: file:///svn/toku/tokudb@19903 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
28cc5d1ed9
Merge the changes from 2499d onto the main line. Fixes #2499 . close[t:2499].
...
{{{
svn merge -r 19523:19895 https://svn.tokutek.com/tokudb/toku/tokudb.2499d
}}}
.
git-svn-id: file:///svn/toku/tokudb@19902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
82053e53d3
[t:2499] Verify no temp files before loader is run, print data_dir listing only if verbose
...
git-svn-id: file:///svn/toku/tokudb@19901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
84b65004df
[t:2499] Add recover-loader-test
...
git-svn-id: file:///svn/toku/tokudb@19900 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
a7f62478ea
address and close #2521 [t:2521]
...
git-svn-id: file:///svn/toku/tokudb@19894 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
c37f8a21a6
fix the globals test refs[t:2449]
...
git-svn-id: file:///svn/toku/tokudb@19882 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
939fd20e37
[t:2499] Delete extraneous ggg from first line.
...
git-svn-id: file:///svn/toku/tokudb@19834 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
67c439d87d
[t:2499] Added induced failure of write() with simulated enospc to loader-cleanup-test and made corresponding change in Makefile to allow use of otherwise deprecated write() system call.
...
git-svn-id: file:///svn/toku/tokudb@19828 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
0fc32fb911
[t:2449] Export test function (override loader's fwrite) via env. Fix bug in brtloader's handling of error from overridden fwrite().
...
Fix bug in ydb's handling of ephemeral loader when unable to write to disk.
Improve loader-cleanup-test.
git-svn-id: file:///svn/toku/tokudb@19825 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
fa39625528
change assert to use == instead of = as per icc error
...
git-svn-id: file:///svn/toku/tokudb@19819 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
640bb6fd5b
c++ize the ydb and locktree include files refs[t:2511]
...
git-svn-id: file:///svn/toku/tokudb@19808 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
db00df2c42
[t:2499] Added preliminary ENOSPC testing.
...
git-svn-id: file:///svn/toku/tokudb@19780 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
69ca56d9ba
[t:2449] Fix USE_PUTS
...
git-svn-id: file:///svn/toku/tokudb@19775 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
b20c6e3b1a
Added support for loader flag LOADER_USE_PUTS. Still need to add tests for enospc and crash/recovery.
...
git-svn-id: file:///svn/toku/tokudb@19766 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
10ebf5d10d
Made more real, still need to test enospc and crash recovery.
...
git-svn-id: file:///svn/toku/tokudb@19761 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
dcbc58477f
Added preliminary version of loader-cleanup-test.
...
git-svn-id: file:///svn/toku/tokudb@19691 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
36895dcfce
Revert "[t:2555] Prevent toku_free(NULL) in regular (not LOADER_USE_PUTS) loader."
...
This reverts commit 755bb963ba9c47fcf2c90da195a15544be100dc6.
This reverts svn commit r19634
toku_free(NULL) is safe. No reason to prevent it.
git-svn-id: file:///svn/toku/tokudb@19685 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
1d34be10e4
closes[t:2542] Add test for loader (both PUT and fast) that verifies no logging
...
happens for each logger->put()
git-svn-id: file:///svn/toku/tokudb@19684 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
cdda1ce0db
[t:2542] Modify all loader tests to support -p (USE_PUTS) and logging
...
All now support the behavior of the put loader
git-svn-id: file:///svn/toku/tokudb@19683 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
eadaf07bd8
[t:2542] Fix some bugs in the PUT loader.
...
Put, once it has returned one error, will continue to return errors (-1)
git-svn-id: file:///svn/toku/tokudb@19682 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00