Commit graph

106 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
0f29f9abe7 Group commit working in tokulogger. Need to release some locks in ydb. Addresses .
git-svn-id: file:///svn/tokudb@2763 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-12 17:55:11 +00:00
Yoni Fogel
ee2351986d Removed warnings.
git-svn-id: file:///svn/tokudb@2762 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-12 17:48:54 +00:00
Rich Prohaska
7d6663e214 malloc temps in smooth region to fit within the mysql thread stack. close
git-svn-id: file:///svn/tokudb@2525 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-04 21:27:15 +00:00
Bradley C. Kuszmaul
7ebf6bf352 Logging improvements. Mostly fixes . Addresses , .
git-svn-id: file:///svn/tokudb@2471 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-29 20:47:11 +00:00
Bradley C. Kuszmaul
56f7445fff One of the tests found a bug in the logging. (Logged key twice instead of key,data pair). Addresses .
git-svn-id: file:///svn/tokudb@2438 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-27 19:23:40 +00:00
Bradley C. Kuszmaul
957b081486 delete aborts work right now. Addresses .
git-svn-id: file:///svn/tokudb@2437 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-27 15:58:10 +00:00
Bradley C. Kuszmaul
dd4a6feabe Improvements to rollback. Addresses .
git-svn-id: file:///svn/tokudb@2435 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-27 11:05:19 +00:00
Bradley C. Kuszmaul
cb204011d6 Improvements to rollback. Addresses .
git-svn-id: file:///svn/tokudb@2434 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-27 09:05:58 +00:00
Bradley C. Kuszmaul
b0e3bf13ba halfway broken rollback for delete. Addresses .
git-svn-id: file:///svn/tokudb@2431 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-27 07:14:03 +00:00
Bradley C. Kuszmaul
2eaeb874ed Separate the code for generating rollbacks and recover log entries. Addresses .
git-svn-id: file:///svn/tokudb@2420 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-26 15:51:15 +00:00
Bradley C. Kuszmaul
712fcc5da1 Many things:
Make txn->abort work without bombing out for {{{test_txn_abort5}}} one case. Fixes .
 Start writing {{{test_txn_abort6}}}.   Addresses .
 Try to write a test for  and , but haven't managed to reproduce the problem.  Addresses , .
 Write a test for .  Addresses .


git-svn-id: file:///svn/tokudb@2406 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-25 22:46:48 +00:00
Bradley C. Kuszmaul
a1dfeebb13 Rollback is working a little better. Addresses .
git-svn-id: file:///svn/tokudb@2294 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-14 19:23:25 +00:00
Bradley C. Kuszmaul
b345dd3947 Note that pma_search might as well be written recursively. Addresses .
git-svn-id: file:///svn/tokudb@2237 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-10 15:26:10 +00:00
Bradley C. Kuszmaul
f93c6fb185 Fix , replace use a loop instead of recursion in {{{distribute_data}}}.
git-svn-id: file:///svn/tokudb@2236 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-10 14:59:43 +00:00
Bradley C. Kuszmaul
d9f3060f83 Rework the way transactions ids are used in the log (xid's on messages are used when inserting something into a leaf.) Addresses .
git-svn-id: file:///svn/tokudb@2199 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-08 19:54:00 +00:00
Bradley C. Kuszmaul
4abb5ba31d Use toku_assert instead of assert. Addresses .
git-svn-id: file:///svn/tokudb@2167 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-08 03:17:38 +00:00
Bradley C. Kuszmaul
dfa900f962 Get rid of broken printfs. Addresses .
git-svn-id: file:///svn/tokudb@1984 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-31 13:31:45 +00:00
Yoni Fogel
bd6fdd9c74 Modified %ld to %"PRIu64" as necessary to keep output
portable.

git-svn-id: file:///svn/tokudb@1952 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-30 02:59:32 +00:00
Bradley C. Kuszmaul
fa5638a0f8 Improving logging for db-benchmark-test. Addresses .
git-svn-id: file:///svn/tokudb@1951 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-29 21:43:08 +00:00
Rich Prohaska
9b89cd9c63 more testing of the pma search function. addresses
git-svn-id: file:///svn/tokudb@1894 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-25 22:12:02 +00:00
Bradley C. Kuszmaul
1ee574216a start making db-benchmark-test recoverable. Addresses .
git-svn-id: file:///svn/tokudb@1893 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-25 21:50:07 +00:00
Rich Prohaska
f1efa7b9a3 simplify the pma (remove the pma cursors and the deleted bit). closes
git-svn-id: file:///svn/tokudb@1891 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-25 20:44:16 +00:00
Rich Prohaska
d2d80add96 first cut or new cursors merge to trunk. addresses
git-svn-id: file:///svn/tokudb@1881 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-25 15:43:37 +00:00
Bradley C. Kuszmaul
9fe0391206 Add copyright 2008. Fixes .
git-svn-id: file:///svn/tokudb@1844 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-24 15:10:32 +00:00
Bradley C. Kuszmaul
271137c959 test_log5 recovers correctly now. Addresses .
git-svn-id: file:///svn/tokudb@1826 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 19:44:13 +00:00
Bradley C. Kuszmaul
51d865dceb Log the distribute for a split in the other order. Addresses .
git-svn-id: file:///svn/tokudb@1799 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 18:33:51 +00:00
Bradley C. Kuszmaul
015bc27f2f Don't be wasteful when splitting brt leaves. Fixes .
This makes big difference for space (46% smaller) and a small time difference (5% faster), as measured by benchmark-test.

Before:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial  8.753964s   119783/s    random  5.640094s   185915/s    cumulative 14.394118s   145695/s
serial  9.381472s   111771/s    random  7.325284s   143145/s    cumulative 31.100944s   134861/s
serial  9.859233s   106355/s    random  6.734307s   155707/s    cumulative 47.694553s   131911/s
serial 11.069200s    94729/s    random  6.885863s   152280/s    cumulative 65.649695s   127778/s
Shutdown  4.636875s
Total time 70.286611s for 8388608 insertions =   119349/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 730344924 Jan 22 11:47 sinsert.brt
}}}

After:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial  8.521855s   123046/s    random  5.730942s   182967/s    cumulative 14.252861s   147139/s
serial  9.106047s   115152/s    random  7.001765s   149759/s    cumulative 30.360740s   138149/s
serial  9.543696s   109871/s    random  6.651000s   157657/s    cumulative 46.555503s   135139/s
serial 10.627035s    98671/s    random  6.555884s   159944/s    cumulative 63.738491s   131610/s
Shutdown  2.818513s
Total time 66.557042s for 8388608 insertions =   126036/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 396894480 Jan 22 11:45 sinsert.brt
}}}



git-svn-id: file:///svn/tokudb@1798 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 16:27:54 +00:00
Rich Prohaska
69b27cccb8 simplify the pma searches. addresses
git-svn-id: file:///svn/tokudb@1780 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-21 21:03:23 +00:00
Bradley C. Kuszmaul
11e52586e6 Log and recover for note splits works a little better (recovery runs, but the file is wrong for test_log5). Addresses
git-svn-id: file:///svn/tokudb@1692 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 15:41:12 +00:00
Bradley C. Kuszmaul
d0e64cf702 Log and recover for note splits works a little better. Addresses
git-svn-id: file:///svn/tokudb@1691 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 14:13:21 +00:00
Bradley C. Kuszmaul
89985a3175 Improve logging. Addresses .
git-svn-id: file:///svn/tokudb@1690 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 13:50:23 +00:00
Bradley C. Kuszmaul
9566acc430 Log node splits a little better. Addresses
git-svn-id: file:///svn/tokudb@1679 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-15 21:50:45 +00:00
Bradley C. Kuszmaul
1b6c9ebca8 Undo pma movements. Addresses .
git-svn-id: file:///svn/tokudb@1630 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-13 05:52:43 +00:00
Bradley C. Kuszmaul
ae00985a15 test_abort1.tdb runs. Addresses .
git-svn-id: file:///svn/tokudb@1621 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-12 12:21:07 +00:00
Bradley C. Kuszmaul
d06d558776 Get abort to run a little bit. Addresses .
git-svn-id: file:///svn/tokudb@1608 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 22:24:43 +00:00
Rich Prohaska
e7e5c4154a simplify the cursor delete since the pivot flags are gone. addresses
git-svn-id: file:///svn/tokudb@1588 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-10 20:07:42 +00:00
Rich Prohaska
f8f1691280 remove pivot flags. addresses
git-svn-id: file:///svn/tokudb@1558 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 21:02:36 +00:00
Rich Prohaska
22a6b18356 use a cursor set to replace the brt_lookup function. addresses
git-svn-id: file:///svn/tokudb@1542 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 22:28:36 +00:00
Rich Prohaska
fba743d22e remove the unsorted duplicates code from the pma. addresses
git-svn-id: file:///svn/tokudb@1537 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 19:06:05 +00:00
Rich Prohaska
aed37ec51c first cut of delboth addresses
git-svn-id: file:///svn/tokudb@1478 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-02 20:33:51 +00:00
Rich Prohaska
ccfa1a651a remove debug code
git-svn-id: file:///svn/tokudb@1185 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-18 11:57:59 +00:00
Rich Prohaska
c7283d799f pma_set now finds the leftmost non-deleted kv pair that matches the set key. closes
git-svn-id: file:///svn/tokudb@1157 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-17 17:09:54 +00:00
Rich Prohaska
9290db6fcc unified the cursor search for cursor set, get_both, set_range, and get_both_range. still need to prune the search for some of these operations.
addresses  


git-svn-id: file:///svn/tokudb@1149 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-17 01:03:35 +00:00
Rich Prohaska
f28b2fedc1 there was a path through the pma_insert_or_replace function that did not set the replace_v_size parameter. this occurred when inserting a key that had been deleted with a cursor reference. closes
git-svn-id: file:///svn/tokudb@1148 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-16 20:57:35 +00:00
Rich Prohaska
e61251778c fix cursor->get_both in a dupsort db. closes
git-svn-id: file:///svn/tokudb@1135 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-14 20:51:27 +00:00
Rich Prohaska
8af05f08d6 set pma dupsort insert dup dup behaviour to replace. addresses
git-svn-id: file:///svn/tokudb@1132 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-14 13:18:47 +00:00
Rich Prohaska
8d098df137 cursor->del clears pivots if last match. closes
git-svn-id: file:///svn/tokudb@1114 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-13 14:53:18 +00:00
Bradley C. Kuszmaul
6a3b4d643b Recompute the fingerprint for DBC->c_del(). Fixes .
git-svn-id: file:///svn/tokudb@1017 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-07 22:27:52 +00:00
Rich Prohaska
55243e2e18 use DB_KEYEMPTY not BRT_KEYEMPTY. addresses
git-svn-id: file:///svn/tokudb@1013 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-07 20:32:59 +00:00
Rich Prohaska
d1a42e495b fix DB_NEXT_DUP when the cursor points to a deleted kv pair. closes
git-svn-id: file:///svn/tokudb@950 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 00:32:44 +00:00