Commit graph

495 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
271137c959 test_log5 recovers correctly now. Addresses #27.
git-svn-id: file:///svn/tokudb@1826 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 19:44:13 +00:00
Yoni Fogel
16a9e6592b Closes #297
toku_malloc/calloc/realloc/memdup now use size_t instead of
nonportable int types.

git-svn-id: file:///svn/tokudb@1823 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 18:35:54 +00:00
Bradley C. Kuszmaul
28428074a1 Log the pivots correctly. Addresses #27.
git-svn-id: file:///svn/tokudb@1822 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 18:29:06 +00:00
Bradley C. Kuszmaul
407c0ebebf Log the fingerprints correctly. Addresses #27.
git-svn-id: file:///svn/tokudb@1820 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 18:06:23 +00:00
Bradley C. Kuszmaul
e4b5463050 Make the dumper print more (maybe all stuff)
git-svn-id: file:///svn/tokudb@1803 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 19:30:02 +00:00
Bradley C. Kuszmaul
156d6520e8 Make benchmark-test a little quieter by default, and make -v make it a little louder again. Addresses #13.
git-svn-id: file:///svn/tokudb@1800 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 18:37:07 +00:00
Bradley C. Kuszmaul
51d865dceb Log the distribute for a split in the other order. Addresses #27.
git-svn-id: file:///svn/tokudb@1799 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 18:33:51 +00:00
Bradley C. Kuszmaul
015bc27f2f Don't be wasteful when splitting brt leaves. Fixes #294.
This makes big difference for space (46% smaller) and a small time difference (5% faster), as measured by benchmark-test.

Before:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial  8.753964s   119783/s    random  5.640094s   185915/s    cumulative 14.394118s   145695/s
serial  9.381472s   111771/s    random  7.325284s   143145/s    cumulative 31.100944s   134861/s
serial  9.859233s   106355/s    random  6.734307s   155707/s    cumulative 47.694553s   131911/s
serial 11.069200s    94729/s    random  6.885863s   152280/s    cumulative 65.649695s   127778/s
Shutdown  4.636875s
Total time 70.286611s for 8388608 insertions =   119349/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 730344924 Jan 22 11:47 sinsert.brt
}}}

After:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial  8.521855s   123046/s    random  5.730942s   182967/s    cumulative 14.252861s   147139/s
serial  9.106047s   115152/s    random  7.001765s   149759/s    cumulative 30.360740s   138149/s
serial  9.543696s   109871/s    random  6.651000s   157657/s    cumulative 46.555503s   135139/s
serial 10.627035s    98671/s    random  6.555884s   159944/s    cumulative 63.738491s   131610/s
Shutdown  2.818513s
Total time 66.557042s for 8388608 insertions =   126036/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 396894480 Jan 22 11:45 sinsert.brt
}}}



git-svn-id: file:///svn/tokudb@1798 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 16:27:54 +00:00
Rich Prohaska
69b27cccb8 simplify the pma searches. addresses #250
git-svn-id: file:///svn/tokudb@1780 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-21 21:03:23 +00:00
Bradley C. Kuszmaul
8e8588a9e4 Log block allocation. Addresses #27.
git-svn-id: file:///svn/tokudb@1737 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-18 21:28:27 +00:00
Bradley C. Kuszmaul
9e352f523c Make roll.c compile without warnings in fedora core 8. Addresses #27.
git-svn-id: file:///svn/tokudb@1735 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-18 18:18:11 +00:00
Bradley C. Kuszmaul
278653d431 rollback for 5 now runs (but the files are wrong). Started working on a brtdump that will help debug this stuff. Right away I see important file differences after recover (the unused memory and unnamed root are wrong). Addresses #27.
git-svn-id: file:///svn/tokudb@1731 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-18 16:01:25 +00:00
Rich Prohaska
14aa21f027 add list-test. addresses #277
git-svn-id: file:///svn/tokudb@1730 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-18 15:26:17 +00:00
Bradley C. Kuszmaul
fa33cff297 set child properly. Addresses #27.
git-svn-id: file:///svn/tokudb@1718 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-17 19:36:44 +00:00
Rich Prohaska
fa19e0a16a add test-primes. addresses #277
git-svn-id: file:///svn/tokudb@1717 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-17 19:35:12 +00:00
Bradley C. Kuszmaul
26bce089d0 Log node creation more accurately. Addresses #27.
git-svn-id: file:///svn/tokudb@1716 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-17 19:03:37 +00:00
Rich Prohaska
aebfdd25fa clean gcov files. addresses #277
git-svn-id: file:///svn/tokudb@1715 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-17 16:00:45 +00:00
Bradley C. Kuszmaul
6bb86b7210 Log node splits better. Addresses #27.
git-svn-id: file:///svn/tokudb@1714 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-17 15:41:42 +00:00
Bradley C. Kuszmaul
11e52586e6 Log and recover for note splits works a little better (recovery runs, but the file is wrong for test_log5). Addresses #27
git-svn-id: file:///svn/tokudb@1692 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 15:41:12 +00:00
Bradley C. Kuszmaul
d0e64cf702 Log and recover for note splits works a little better. Addresses #27
git-svn-id: file:///svn/tokudb@1691 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 14:13:21 +00:00
Bradley C. Kuszmaul
89985a3175 Improve logging. Addresses #27.
git-svn-id: file:///svn/tokudb@1690 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-16 13:50:23 +00:00
Bradley C. Kuszmaul
9566acc430 Log node splits a little better. Addresses #27
git-svn-id: file:///svn/tokudb@1679 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-15 21:50:45 +00:00
Bradley C. Kuszmaul
6e5d5485ab Get rid of calls to free. Should use toku_free. Fixes #275.
git-svn-id: file:///svn/tokudb@1677 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-15 20:15:06 +00:00
Rich Prohaska
94be297db1 add big ydb lock. addresses #7
git-svn-id: file:///svn/tokudb@1670 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-15 13:04:10 +00:00
Bradley C. Kuszmaul
1b6c9ebca8 Undo pma movements. Addresses #253.
git-svn-id: file:///svn/tokudb@1630 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-13 05:52:43 +00:00
Bradley C. Kuszmaul
982644cc0e test_abort1.tdb runs doesn't leak memory. Addresses #253.
git-svn-id: file:///svn/tokudb@1625 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-12 13:25:36 +00:00
Bradley C. Kuszmaul
ae00985a15 test_abort1.tdb runs. Addresses #253.
git-svn-id: file:///svn/tokudb@1621 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-12 12:21:07 +00:00
Bradley C. Kuszmaul
d06d558776 Get abort to run a little bit. Addresses #253.
git-svn-id: file:///svn/tokudb@1608 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 22:24:43 +00:00
Rich Prohaska
9bd88bb01d add fifo-test addresses #249
git-svn-id: file:///svn/tokudb@1607 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 22:18:39 +00:00
Rich Prohaska
a9e1d29612 add Db::fd closes #231
git-svn-id: file:///svn/tokudb@1601 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 14:38:49 +00:00
Rich Prohaska
8bed771536 replace hashtables with fifos. addresses #249
git-svn-id: file:///svn/tokudb@1600 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 14:03:33 +00:00
Rich Prohaska
0984623c63 save the hashtables. addresses #250
git-svn-id: file:///svn/tokudb@1598 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 12:37:03 +00:00
Bradley C. Kuszmaul
4de66511b4 Write an abort test. Addresses #253.
git-svn-id: file:///svn/tokudb@1590 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 03:44:21 +00:00
Bradley C. Kuszmaul
2d734fa8b1 Reorganize how rollback and recovery are organized into files. Fixes #253.
git-svn-id: file:///svn/tokudb@1589 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 03:09:14 +00:00
Rich Prohaska
e7e5c4154a simplify the cursor delete since the pivot flags are gone. addresses #250
git-svn-id: file:///svn/tokudb@1588 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-10 20:07:42 +00:00
Rich Prohaska
4374eb974f add cursor next_dup, next_nodup, prev_dup, and prev_nodup. addresses #259
git-svn-id: file:///svn/tokudb@1585 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-10 16:10:06 +00:00
Bradley C. Kuszmaul
37762ee7ff Stubs exist for all the rollback operations. Addresses #253.
git-svn-id: file:///svn/tokudb@1584 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-10 13:41:58 +00:00
Bradley C. Kuszmaul
06dfd4f0a4 Work on transactions rollback. Also Fixes #254. Addresess #253.
git-svn-id: file:///svn/tokudb@1572 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-09 19:58:46 +00:00
Rich Prohaska
12c0d21999 fixup the pma split key test
git-svn-id: file:///svn/tokudb@1571 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-09 14:52:07 +00:00
Bradley C. Kuszmaul
b938b597c4 If fsync fails on a log commit, panic the DB. (We don't know if the transaction committed or failed without doing recovery.)
Start work on saving the undo records in main memory for rollback.
Addresses #27 (recovery) 
Addresses #253 (rollback)


git-svn-id: file:///svn/tokudb@1561 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 22:18:42 +00:00
Rich Prohaska
3a29cecefb remove pivot flags. addresses #250
git-svn-id: file:///svn/tokudb@1560 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 21:43:11 +00:00
Rich Prohaska
62da09d733 simplify. addresses #247 #250
git-svn-id: file:///svn/tokudb@1559 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 21:03:17 +00:00
Rich Prohaska
f8f1691280 remove pivot flags. addresses #247
git-svn-id: file:///svn/tokudb@1558 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 21:02:36 +00:00
Rich Prohaska
22a6b18356 use a cursor set to replace the brt_lookup function. addresses #252
git-svn-id: file:///svn/tokudb@1542 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 22:28:36 +00:00
Bradley C. Kuszmaul
debadb371c Finish removing parent_brtnode. Addresse #251.
git-svn-id: file:///svn/tokudb@1541 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 20:10:31 +00:00
Bradley C. Kuszmaul
faac0f364e Remoe parent_brtnode. Fixes #251
git-svn-id: file:///svn/tokudb@1538 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 19:53:50 +00:00
Rich Prohaska
fba743d22e remove the unsorted duplicates code from the pma. addresses #247
git-svn-id: file:///svn/tokudb@1537 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 19:06:05 +00:00
Bradley C. Kuszmaul
e4f197a8bc set layout_version to 1 (for 0.4.0). Addresses #118. Fixes #248.
git-svn-id: file:///svn/tokudb@1536 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 19:02:27 +00:00
Rich Prohaska
844ba8cf2c fix 64 bit compile
git-svn-id: file:///svn/tokudb@1482 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-02 21:52:09 +00:00
Rich Prohaska
aed37ec51c first cut of delboth addresses #182
git-svn-id: file:///svn/tokudb@1478 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-02 20:33:51 +00:00