Commit graph

1441 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
ed2c880ee3 Clean up, clean up, everybody clean their share. Fixes #791.
git-svn-id: file:///svn/tokudb@3848 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-08 07:16:26 +00:00
Bradley C. Kuszmaul
8455cf0c1c Makefile hacking. Addreseses #782.
git-svn-id: file:///svn/tokudb@3847 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-08 07:06:06 +00:00
Bradley C. Kuszmaul
e81be86e43 Some keyrange support. Addresess #764.
git-svn-id: file:///svn/tokudb@3846 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-08 07:05:26 +00:00
Yoni Fogel
9abb92dc4b Addresses #394
Merge branch tokudb.394 back into trunk

git-svn-id: file:///svn/tokudb@3841 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-07 20:03:13 +00:00
Bradley C. Kuszmaul
fd51763cea Compile with -O3. Fixes #784.
git-svn-id: file:///svn/tokudb@3823 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-07 00:46:02 +00:00
Bradley C. Kuszmaul
ee986eb581 Fix a segfault in test_log6.recover. Addresses #740.
git-svn-id: file:///svn/tokudb@3822 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-07 00:40:45 +00:00
Yoni Fogel
8c0fd271d5 Addresses #783
Using DB_CURRENT no longer overwrites temporary memory owned by the db handle.
Added regression test.

git-svn-id: file:///svn/tokudb@3821 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-06 20:30:24 +00:00
Bradley C. Kuszmaul
dd8f0f3386 Hacking makefiles. Addresses #782. Also fixes a valgrind bug in one of the recovery tests.
git-svn-id: file:///svn/tokudb@3814 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-06 13:58:08 +00:00
Bradley C. Kuszmaul
7759603b6f Hacking makefiles. Addresses #782.
git-svn-id: file:///svn/tokudb@3813 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-06 10:27:46 +00:00
Bradley C. Kuszmaul
cc00885394 Hacking makefiles. Addresses #782.
git-svn-id: file:///svn/tokudb@3794 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-04 22:14:27 +00:00
Bradley C. Kuszmaul
e9d3b87315 Hacking makefiles. Addresses #782.
git-svn-id: file:///svn/tokudb@3793 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-04 22:07:52 +00:00
Bradley C. Kuszmaul
09850cc913 Hacking makefiles. Also make the filenames used by the tests work more reliably. Addresses #782.
git-svn-id: file:///svn/tokudb@3792 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-04 16:56:15 +00:00
Bradley C. Kuszmaul
5f0fab0802 Fix up {{{brt->txns}}} during recovery. Fixes #781.
git-svn-id: file:///svn/tokudb@3780 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-03 17:34:14 +00:00
Bradley C. Kuszmaul
c199a47fae Dramatic speedups: For {{{db-benchmark-test -x}}} (4 interations)
||                                    ||      DB size ||  logsize ||  rate    ||
|| Before (with transactions)         ||      .33GB   ||   3.0GB  ||  17477/s ||
|| No Transactions (with this fix)    ||      .43GB   ||   0GB    || 104124/s ||
|| After removing undo info (#775)    ||      .33GB   ||   1.4GB  ||  25696/s ||
|| After optimizing commit (#725)     ||      .43GB   ||   0.6GB  ||  39909/s ||

The file size is a larger, but the logs are a lot smaller.

Addresses #725, #775.

Manipulations:
{{{
$ (cd tokudb; svn merge -r3763:3778 https://svn.tokutek.com/tokudb/tokudb.725)
$ svn delete tokudb.725
}}}


git-svn-id: file:///svn/tokudb@3779 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-03 12:43:25 +00:00
Bradley C. Kuszmaul
77fe15598c Removed the undo information from the logs (to rely on the checkpoint to save a good copy in the log).
Also, don't record the fingerprint changes, since they can be recalculated independently.  (This is a biggy.  The fingerprints updates were half the log changes.)
We'll have to do something about the fingerprints of internal nodes, so some if may come back in some form.
Speeds up {{{db-benchmark-test-tokudb -x}}} from 17477/s to 25696/s, and reduces the size of the {{{bench.tokudb}}} directory (containing logs and data) from 3.3GB to 1.7GB for a 0.33GB datafile.

Manipulations as follows:
 (cd tokudb;svn merge -r3676:3763 https://svn.tokutek.com/tokudb/tokudb.740 )
 svn delete tokudb.740

Fixes #775.


git-svn-id: file:///svn/tokudb@3764 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-02 14:38:35 +00:00
Bradley C. Kuszmaul
71b56ba1e8 Calculate an estimate of the number of {{{LEAFENTRY}}}s below each node.
Increment {{{layout_version}}} to 6.
brtdump now has a {{{--nodata}}} option (to print only the metadata, but not the data)
Fixes #766.

Merged to main using
{{{
cd tokudb/tokudb
svn merge -r3713:3725 https://svn.tokutek.com/tokudb/tokudb.766
cd ..
svn delete tokudb.766
}}}


git-svn-id: file:///svn/tokudb@3728 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-30 13:23:04 +00:00
Bradley C. Kuszmaul
efea431321 Make brtdump print the root fifo. Fixes #748.
git-svn-id: file:///svn/tokudb@3672 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-27 17:54:24 +00:00
Bradley C. Kuszmaul
461b05f4b0 All commands now push into tree instead of root if possible. Fixes #735.
git-svn-id: file:///svn/tokudb@3670 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-27 15:12:25 +00:00
Bradley C. Kuszmaul
7523273fb8 On commit push into tree instead of root if possible. Addresses #735.
git-svn-id: file:///svn/tokudb@3668 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-27 12:34:50 +00:00
Bradley C. Kuszmaul
d5f2eec078 Add the list of txns. Addresses #735. Fixes #749.
git-svn-id: file:///svn/tokudb@3659 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-26 03:16:30 +00:00
Bradley C. Kuszmaul
4d059818dc Make the makefile happier. Don't recompile as many things. Fixes #753.
git-svn-id: file:///svn/tokudb@3658 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-26 02:56:38 +00:00
Bradley C. Kuszmaul
20bb869ac0 brt2.c undo
git-svn-id: file:///svn/tokudb@3652 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 17:46:46 +00:00
Yoni Fogel
0e863f757d Updated makefile for cscope
git-svn-id: file:///svn/tokudb@3651 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 16:34:48 +00:00
Bradley C. Kuszmaul
ecd0b0a971 Start adding the lists. Addresses #749.
git-svn-id: file:///svn/tokudb@3647 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 14:22:05 +00:00
Bradley C. Kuszmaul
9f99493d4e Change the {{{LEAFENTRY}}} to {{{OMTVALUE}}} when using the omt, and also change the type of {{{OMTVALUE}}} to {{{void*}}} so we can have two different OMTs coexisting. Fixes #750.
git-svn-id: file:///svn/tokudb@3646 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 13:46:17 +00:00
Bradley C. Kuszmaul
8489ae2389 Change the {{{LEAFENTRY}}} to {{{OMTVALUE}}} when using the omt, and also change the type of {{{OMTVALUE}}} to {{{void*}}} so we can have two different OMTs coexisting. Fixes #750.
git-svn-id: file:///svn/tokudb@3645 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 13:45:55 +00:00
Yoni Fogel
f5c013274e Added support for cscope (similar to etags) in the makefile
git-svn-id: file:///svn/tokudb@3636 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-24 22:10:13 +00:00
Rich Prohaska
0c34376208 print the node layout_version. closes #743
git-svn-id: file:///svn/tokudb@3627 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-24 15:44:10 +00:00
Yoni Fogel
49737f8ee2 Addresses #724
changed magic number 100 to a constant

git-svn-id: file:///svn/tokudb@3625 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-24 15:21:39 +00:00
Yoni Fogel
22ccd07053 Addresses #724
Changes to omt-test pursuant to code review.
Now tests split at |tree|.
Deleted duplicated delete test.

git-svn-id: file:///svn/tokudb@3622 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-24 14:58:20 +00:00
Zardosht Kasheff
e17a4c1d53 addresses #724
finished testing for split and merge (this checkin has boundary cases)

git-svn-id: file:///svn/tokudb@3605 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 21:10:03 +00:00
Zardosht Kasheff
bb6fc7ebe9 addresses #724
finished most of testing for split and merge
still need to test error cases such as times when ERANGE is expected

git-svn-id: file:///svn/tokudb@3604 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 21:02:55 +00:00
Yoni Fogel
fca58d6382 Addresses #724
Put in comments for what form of tests we need for split and merge.

git-svn-id: file:///svn/tokudb@3602 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 19:54:18 +00:00
Yoni Fogel
58d3edb58b Addresses #724
Tests for insert.
BUGFIX: Insert now properly returns DB_KEYEXIST if the heaviside function
returns 0 for some value in the tree.

git-svn-id: file:///svn/tokudb@3601 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 19:51:30 +00:00
Yoni Fogel
4141778bf7 Addresses #724
Fix memory leak in test.

git-svn-id: file:///svn/tokudb@3598 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 17:57:57 +00:00
Zardosht Kasheff
a1c8113c29 Addresses #724
test delete

git-svn-id: file:///svn/tokudb@3592 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 16:46:35 +00:00
Zardosht Kasheff
437fb1bf6b addresses #724
add test for set_at

git-svn-id: file:///svn/tokudb@3591 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 15:40:57 +00:00
Zardosht Kasheff
d4dfff49aa addresses #724
remove some tabs and replace with spaces in order to make consistent
with rest of file

git-svn-id: file:///svn/tokudb@3590 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 14:16:34 +00:00
Bradley C. Kuszmaul
0b880e866e Merge onto the main line again.
{{{
svn merge -r3571:3582 https://svn.tokutek.com/tokudb/tokudb.724
}}}


git-svn-id: file:///svn/tokudb@3583 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 04:17:28 +00:00
Bradley C. Kuszmaul
33b252772a Merge in the OMT and its integration into the main line.
{{{
$ cd tokudb
$ svn merge -r3533:3571 https://svn.tokutek.com/tokudb/tokudb.724
}}}
 
There remain a few problems with recovery, but the main line has problems with recovery, so let's bite the bullet and move forward.

Fixes #729, #724.


git-svn-id: file:///svn/tokudb@3572 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 20:39:50 +00:00
Bradley C. Kuszmaul
0a37b67326 Get rid of some junk.
git-svn-id: file:///svn/tokudb@3571 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 20:36:59 +00:00
Rich Prohaska
cc0fc35141 bradley fixed the child transaction commit with a rollback log in an external file. closes #730
git-svn-id: file:///svn/tokudb@3566 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 17:09:24 +00:00
Bradley C. Kuszmaul
23efff4b4e Tune the big-nested abort/commit tests down to about 8s usr (30s elapsed) each. (5m under valgrind.) Addresses #730.
git-svn-id: file:///svn/tokudb@3560 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 14:03:40 +00:00
Bradley C. Kuszmaul
d3dbead847 Improve test case (still works.) Addresses #730.
git-svn-id: file:///svn/tokudb@3558 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 13:43:23 +00:00
Bradley C. Kuszmaul
21ef44a7c5 Another test case (this one works). Addresses #730.
git-svn-id: file:///svn/tokudb@3556 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 13:25:16 +00:00
Bradley C. Kuszmaul
e90cf30c7f Another test case. Addresses #730.
git-svn-id: file:///svn/tokudb@3555 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 13:22:04 +00:00
Bradley C. Kuszmaul
3c2f77f978 Rename. Addresses #730.
git-svn-id: file:///svn/tokudb@3554 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 13:18:06 +00:00
Bradley C. Kuszmaul
e18b1e765f Add a BDB-layer test for #730. Addresses #730.
git-svn-id: file:///svn/tokudb@3553 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 13:17:37 +00:00
Rich Prohaska
ddd8dff149 32 bit port
git-svn-id: file:///svn/tokudb@3532 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-21 12:09:12 +00:00
Bradley C. Kuszmaul
8813e3eb3a Store the rollbacks on disk. Fixes #711. Addresses #698 (maybe fixes it).
git-svn-id: file:///svn/tokudb@3528 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-21 04:22:45 +00:00