Barry Perlman
dcbc58477f
Added preliminary version of loader-cleanup-test.
...
git-svn-id: file:///svn/toku/tokudb@19691 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
36895dcfce
Revert "[t:2555] Prevent toku_free(NULL) in regular (not LOADER_USE_PUTS) loader."
...
This reverts commit 755bb963ba9c47fcf2c90da195a15544be100dc6.
This reverts svn commit r19634
toku_free(NULL) is safe. No reason to prevent it.
git-svn-id: file:///svn/toku/tokudb@19685 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
1d34be10e4
closes[t:2542] Add test for loader (both PUT and fast) that verifies no logging
...
happens for each logger->put()
git-svn-id: file:///svn/toku/tokudb@19684 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
cdda1ce0db
[t:2542] Modify all loader tests to support -p (USE_PUTS) and logging
...
All now support the behavior of the put loader
git-svn-id: file:///svn/toku/tokudb@19683 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
eadaf07bd8
[t:2542] Fix some bugs in the PUT loader.
...
Put, once it has returned one error, will continue to return errors (-1)
git-svn-id: file:///svn/toku/tokudb@19682 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
a652e5ed72
Revert "move changes to loader.c and its tests to main re:DB_DBT_REALLOC"
...
This reverts commit 86f5bc832a3ebe5dc8ecb2105491a903e7dc4700.
This reverts commit r19651
git-svn-id: file:///svn/toku/tokudb@19681 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
04993002c5
update the release/examples closes[t:2556]
...
git-svn-id: file:///svn/toku/tokudb@19677 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Rich Prohaska
8055c4cfd6
cleanup release/examples refs[t:2556]
...
git-svn-id: file:///svn/toku/tokudb@19654 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Dave Wells
4591931950
move changes to loader.c and its tests to main re:DB_DBT_REALLOC
...
git-svn-id: file:///svn/toku/tokudb@19651 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:08 -04:00
Yoni Fogel
9542e88667
[t:2555] Prevent toku_free(NULL) in regular (not LOADER_USE_PUTS) loader.
...
If generate_row_for_put sets flags to 0, skey/sval.data are NULL and we unconditionally free them.
git-svn-id: file:///svn/toku/tokudb@19634 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
5c2f6b60fa
[t:2555] LOADER_USE_PUTS follows convention of generate_row_for_put
...
Prevents freeing of memory not owned by loader.
git-svn-id: file:///svn/toku/tokudb@19633 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
f935786f79
[t:2494] Merge remaining changes (minor optimizations) to main from read committed branch
...
git-svn-id: file:///svn/toku/tokudb@19628 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
e42cd82ae4
closes[t:2530] Windows port of (non-fork()) diskfull test
...
git-svn-id: file:///svn/toku/tokudb@19623 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
ae278c1013
[t:2530] Use Makefile and arguments to remove fork() from diskfull.tdbrun
...
git-svn-id: file:///svn/toku/tokudb@19622 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
ef89d27bbb
[t:2542] Prevent extra file and fsync during non-put loader
...
git-svn-id: file:///svn/toku/tokudb@19618 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Rich Prohaska
23c57550fb
fix the cxx permissions test closes[t:2377]
...
git-svn-id: file:///svn/toku/tokudb@19615 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
7c6dab0b79
gitignore
...
git-svn-id: file:///svn/toku/tokudb@19593 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
67fa6c4c0c
[t:2542] cleaner way of holding ydb lock around pre_acquire_table_lock
...
git-svn-id: file:///svn/toku/tokudb@19587 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
a188bda42e
closes[t:2542] Fix bug in loader: need to hold ydb lock around pre_acquire_table lock
...
Let LOADER_USE_PUTS trigger #2440 optimization. DB_PRELOCKED_WRITE in loader flags prevents pre_acquire_table_lock from being called
git-svn-id: file:///svn/toku/tokudb@19586 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
0b550d3907
makefile improvements for src/tests
...
git-svn-id: file:///svn/toku/tokudb@19584 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
4fd875030a
makefile improvements for src/tests
...
git-svn-id: file:///svn/toku/tokudb@19583 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
7979395fba
[t:2539] Modified makefiles to behave for gcc 4.4.1.
...
Fixed code to remove warnings (checked result of 'system()' and printf warnings)
git-svn-id: file:///svn/toku/tokudb@19560 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
2657367d80
makefile improvements
...
git-svn-id: file:///svn/toku/tokudb@19554 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
060e15681e
[t:2538] Fix memset usage
...
git-svn-id: file:///svn/toku/tokudb@19553 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
4711f8dffc
Removed non-literal format from snprintf
...
git-svn-id: file:///svn/toku/tokudb@19552 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Rich Prohaska
3f35cb893b
change block format to support leaf partitions closes[t:2351]
...
git-svn-id: file:///svn/toku/tokudb@19500 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
85192a46d0
[t:2350] Disable txn_nested5 test for bdb
...
git-svn-id: file:///svn/toku/tokudb@19488 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
51adc924a5
[t:2440] Fix memory leak
...
git-svn-id: file:///svn/toku/tokudb@19487 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
21d2578b25
closes[t:2350] Add ydb-layer insert ignore test
...
closes[t:2350] Add comments
git-svn-id: file:///svn/toku/tokudb@19466 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
6ae9156719
[t:2440] Add commit progress to local checkpoint
...
git-svn-id: file:///svn/toku/tokudb@19461 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
54ae26e465
git ignore
...
git-svn-id: file:///svn/toku/tokudb@19460 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
8c34dda452
closes[t:2440] Merge #2440 to main.
...
closes[t:2512] merge #2512 to main
Delete dev branch
git-svn-id: file:///svn/toku/tokudb@19439 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Rich Prohaska
02f3b82718
rename toku_test_db_redirect closes[t:2519]
...
git-svn-id: file:///svn/toku/tokudb@19425 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
a03e6093e4
[t:2493] Port filesystem redzone to windows
...
git-svn-id: file:///svn/toku/tokudb@19294 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
387d65c15e
[t:2517] Minor fix to allow build after windows port
...
git-svn-id: file:///svn/toku/tokudb@19293 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
3bb1ede015
[t:2517] utils and db-benchmark-test now compile statically only for windows
...
git-svn-id: file:///svn/toku/tokudb@19292 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
0ea12bb45b
[t:2517] Disable dynamic library for windows
...
git-svn-id: file:///svn/toku/tokudb@19289 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
7b2cc84ac9
closes[t:2515] Accurately distinguish between 32bit and 64bit windows
...
git-svn-id: file:///svn/toku/tokudb@19288 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Barry Perlman
1961aa0696
[t:2504] Restored function toku_ltm_get_max_locks() needed by tests.
...
git-svn-id: file:///svn/toku/tokudb@19282 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Barry Perlman
c4ca0a7256
[t:2504] Added range lock escalation success/failure counts to engine status.
...
git-svn-id: file:///svn/toku/tokudb@19267 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Rich Prohaska
60d43a6d82
fix cachetable unpin and remove refs[t:2507]
...
git-svn-id: file:///svn/toku/tokudb@19264 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
4c7d34d0f3
[t:2449] Bugfix in cachetable pairs for rollback log nodes.
...
We were using TOKUTXNs as the extraarg, but the TOKUTXN struct could be freed while the pair is still in memory.
We only used the TOKUTXN to get the cachefile and header. We already are given the cachefile, so we
made the extraargs be the header
git-svn-id: file:///svn/toku/tokudb@19238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
65f91e8663
Windows port minor changes
...
git-svn-id: file:///svn/toku/tokudb@19227 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
fffb7ba30a
[t:2506] [t:2507] Fix metadata (size writing) during write_pair_for_checkpoint
...
Also initialize the work item in the pair even if we actually are writing it.
Fix crash in getting size of empty FILENUMS
git-svn-id: file:///svn/toku/tokudb@19200 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
43aea2f126
[t:2449] do lru_touch on prefetch
...
git-svn-id: file:///svn/toku/tokudb@19195 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
2f1711d2a6
[t:2506] [t:2507] Forgot to initialize workitem for write_pair_for_checkpoint when enqueueing on cq
...
git-svn-id: file:///svn/toku/tokudb@19194 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
0632ad4288
[t:2449] Add prefetching of rollback logs to speed up commit/abort processing
...
git-svn-id: file:///svn/toku/tokudb@19190 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
8bd25c46ab
[t:2506] [t:2507] Fix locking mechanism for unpin_and_remove
...
We mistakenly thought that the workqueue lock was the same as the cachetable lock
git-svn-id: file:///svn/toku/tokudb@19188 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
3550e7dd38
[t:2506] [t:2507] Fix bug in toku_cachetable_unpin_and_remove
...
write_pair_for_checkpoint now uses completion queue if set
git-svn-id: file:///svn/toku/tokudb@19187 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
a5a29dbda6
[t:2506] [t:2507] Fix bug in toku_cachetable_unpin_and_remove
...
Correctly handles a blocked writer (checkpoint). it checked state before state was set,
so incorrectly thought that there was never a blocked writer
git-svn-id: file:///svn/toku/tokudb@19186 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00