Commit graph

3081 commits

Author SHA1 Message Date
Yoni Fogel
03c66d5222 [t:2499] Fix broken windows build due to r19902 (merge of 2499d branch)
git-svn-id: file:///svn/toku/tokudb@19935 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
b9604f998e [t:2499] Set errno so that brtloader's bl_fwrite() function gets correct error return if the real fwrite() produces an error.
git-svn-id: file:///svn/toku/tokudb@19934 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
6eae60da8a remove the 'deq' printf refs[t:2571]
git-svn-id: file:///svn/toku/tokudb@19932 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
486decfd7f put the loader error callback in its own source file so we can reduce dependancies on cilk refs[t:2576]
git-svn-id: file:///svn/toku/tokudb@19931 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
a9b7c490d7 [t:2499] Increase number of rows by 500X to induce creation of temp files.
git-svn-id: file:///svn/toku/tokudb@19930 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Dave Wells
8c86529769 add thread parsing
git-svn-id: file:///svn/toku/tokudb@19929 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
a4eedcb492 Closes [t:2577] Fixed unitialized variable.
git-svn-id: file:///svn/toku/tokudb@19914 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Rich Prohaska
0612028bcf fix the loader error callback and the pqueue-test closes[t:2576]
git-svn-id: file:///svn/toku/tokudb@19913 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
9cab06f7fb Merge the instrumentation from 2499d+2571 onto the main line (since 2499d has been merged.) Refs #2571. [t:2571].
{{{
svn merge -r 19857:19905 https://svn.tokutek.com/tokudb/toku/tokudb.2499d+2571
}}}
.


git-svn-id: file:///svn/toku/tokudb@19906 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
450d693d2a Remove extra cilk context. Fixes #2575. close[t:2575].
git-svn-id: file:///svn/toku/tokudb@19905 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
dd51442ed6 [t:2499] Verify loader-created iname files are deleted on recovery.
git-svn-id: file:///svn/toku/tokudb@19904 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
e534524e76 [t:2499] Comment changes only.
git-svn-id: file:///svn/toku/tokudb@19903 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Bradley C. Kuszmaul
28cc5d1ed9 Merge the changes from 2499d onto the main line. Fixes #2499. close[t:2499].
{{{
svn merge -r 19523:19895 https://svn.tokutek.com/tokudb/toku/tokudb.2499d
}}}
.


git-svn-id: file:///svn/toku/tokudb@19902 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:09 -04:00
Barry Perlman
82053e53d3 [t:2499] Verify no temp files before loader is run, print data_dir listing only if verbose
git-svn-id: file:///svn/toku/tokudb@19901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
84b65004df [t:2499] Add recover-loader-test
git-svn-id: file:///svn/toku/tokudb@19900 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
a7f62478ea address and close #2521 [t:2521]
git-svn-id: file:///svn/toku/tokudb@19894 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
c37f8a21a6 fix the globals test refs[t:2449]
git-svn-id: file:///svn/toku/tokudb@19882 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
939fd20e37 [t:2499] Delete extraneous ggg from first line.
git-svn-id: file:///svn/toku/tokudb@19834 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
67c439d87d [t:2499] Added induced failure of write() with simulated enospc to loader-cleanup-test and made corresponding change in Makefile to allow use of otherwise deprecated write() system call.
git-svn-id: file:///svn/toku/tokudb@19828 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
0fc32fb911 [t:2449] Export test function (override loader's fwrite) via env. Fix bug in brtloader's handling of error from overridden fwrite().
Fix bug in ydb's handling of ephemeral loader when unable to write to disk.
Improve loader-cleanup-test.

git-svn-id: file:///svn/toku/tokudb@19825 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
fa39625528 change assert to use == instead of = as per icc error
git-svn-id: file:///svn/toku/tokudb@19819 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
640bb6fd5b c++ize the ydb and locktree include files refs[t:2511]
git-svn-id: file:///svn/toku/tokudb@19808 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
db00df2c42 [t:2499] Added preliminary ENOSPC testing.
git-svn-id: file:///svn/toku/tokudb@19780 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
69ca56d9ba [t:2449] Fix USE_PUTS
git-svn-id: file:///svn/toku/tokudb@19775 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
b20c6e3b1a Added support for loader flag LOADER_USE_PUTS. Still need to add tests for enospc and crash/recovery.
git-svn-id: file:///svn/toku/tokudb@19766 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
10ebf5d10d Made more real, still need to test enospc and crash recovery.
git-svn-id: file:///svn/toku/tokudb@19761 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Barry Perlman
dcbc58477f Added preliminary version of loader-cleanup-test.
git-svn-id: file:///svn/toku/tokudb@19691 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
36895dcfce Revert "[t:2555] Prevent toku_free(NULL) in regular (not LOADER_USE_PUTS) loader."
This reverts commit 755bb963ba9c47fcf2c90da195a15544be100dc6.
This reverts svn commit r19634

toku_free(NULL) is safe.  No reason to prevent it.

git-svn-id: file:///svn/toku/tokudb@19685 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
1d34be10e4 closes[t:2542] Add test for loader (both PUT and fast) that verifies no logging
happens for each logger->put()

git-svn-id: file:///svn/toku/tokudb@19684 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
cdda1ce0db [t:2542] Modify all loader tests to support -p (USE_PUTS) and logging
All now support the behavior of the put loader

git-svn-id: file:///svn/toku/tokudb@19683 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
eadaf07bd8 [t:2542] Fix some bugs in the PUT loader.
Put, once it has returned one error, will continue to return errors (-1)

git-svn-id: file:///svn/toku/tokudb@19682 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
a652e5ed72 Revert "move changes to loader.c and its tests to main re:DB_DBT_REALLOC"
This reverts commit 86f5bc832a3ebe5dc8ecb2105491a903e7dc4700.
This reverts commit r19651

git-svn-id: file:///svn/toku/tokudb@19681 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
04993002c5 update the release/examples closes[t:2556]
git-svn-id: file:///svn/toku/tokudb@19677 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
8055c4cfd6 cleanup release/examples refs[t:2556]
git-svn-id: file:///svn/toku/tokudb@19654 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
4591931950 move changes to loader.c and its tests to main re:DB_DBT_REALLOC
git-svn-id: file:///svn/toku/tokudb@19651 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
9542e88667 [t:2555] Prevent toku_free(NULL) in regular (not LOADER_USE_PUTS) loader.
If generate_row_for_put sets flags to 0, skey/sval.data are NULL and we unconditionally free them.

git-svn-id: file:///svn/toku/tokudb@19634 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
5c2f6b60fa [t:2555] LOADER_USE_PUTS follows convention of generate_row_for_put
Prevents freeing of memory not owned by loader.

git-svn-id: file:///svn/toku/tokudb@19633 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
f935786f79 [t:2494] Merge remaining changes (minor optimizations) to main from read committed branch
git-svn-id: file:///svn/toku/tokudb@19628 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
e42cd82ae4 closes[t:2530] Windows port of (non-fork()) diskfull test
git-svn-id: file:///svn/toku/tokudb@19623 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
ae278c1013 [t:2530] Use Makefile and arguments to remove fork() from diskfull.tdbrun
git-svn-id: file:///svn/toku/tokudb@19622 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
ef89d27bbb [t:2542] Prevent extra file and fsync during non-put loader
git-svn-id: file:///svn/toku/tokudb@19618 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Rich Prohaska
23c57550fb fix the cxx permissions test closes[t:2377]
git-svn-id: file:///svn/toku/tokudb@19615 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
7c6dab0b79 gitignore
git-svn-id: file:///svn/toku/tokudb@19593 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
67fa6c4c0c [t:2542] cleaner way of holding ydb lock around pre_acquire_table_lock
git-svn-id: file:///svn/toku/tokudb@19587 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
a188bda42e closes[t:2542] Fix bug in loader: need to hold ydb lock around pre_acquire_table lock
Let LOADER_USE_PUTS trigger #2440 optimization.  DB_PRELOCKED_WRITE in loader flags prevents pre_acquire_table_lock from being called

git-svn-id: file:///svn/toku/tokudb@19586 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
0b550d3907 makefile improvements for src/tests
git-svn-id: file:///svn/toku/tokudb@19584 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
4fd875030a makefile improvements for src/tests
git-svn-id: file:///svn/toku/tokudb@19583 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
7979395fba [t:2539] Modified makefiles to behave for gcc 4.4.1.
Fixed code to remove warnings (checked result of 'system()' and printf warnings)

git-svn-id: file:///svn/toku/tokudb@19560 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
2657367d80 makefile improvements
git-svn-id: file:///svn/toku/tokudb@19554 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
060e15681e [t:2538] Fix memset usage
git-svn-id: file:///svn/toku/tokudb@19553 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00