Bradley C. Kuszmaul
f714e3e873
Merge in the final hash shortcuts.
...
{{{
svn merge -r4633:4638 https://svn.tokutek.com/tokudb/tokudb.906
}}}
Addresses #906 .
git-svn-id: file:///svn/tokudb@4639 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-18 21:38:01 +00:00
Rich Prohaska
f4ec866165
merge some seq insert code to main. addresses #896
...
git-svn-id: file:///svn/tokudb@4626 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-18 10:02:06 +00:00
Bradley C. Kuszmaul
6b685145d1
Merge {{{tokudb.906}}} into {{{tokudb}}}. Very few hash calls remain.
...
Did
{{{
svn merge -r4600:4610 https://svn.tokutek.com/tokudb/tokudb.906
}}}
and delete the 906 branch.
Fixes #906 .
git-svn-id: file:///svn/tokudb@4615 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-18 00:30:36 +00:00
Bradley C. Kuszmaul
4db5b5063c
Did
...
{{{
svn merge -r4556:4568 https://svn.tokutek.com/tokudb/tokudb.906
}}}
to incorporate the hash improvements.
Addresses #906 .
git-svn-id: file:///svn/tokudb@4596 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-17 17:05:19 +00:00
Bradley C. Kuszmaul
9ebb4b4080
Don't always fill with zeros. Fixes #917 . Gives some speedups on random.
...
git-svn-id: file:///svn/tokudb@4543 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-15 17:09:14 +00:00
Bradley C. Kuszmaul
a4f4d06ff9
Merge the streamlining changes from #911 . Fixes #911 .
...
git-svn-id: file:///svn/tokudb@4500 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-12 20:32:22 +00:00
Bradley C. Kuszmaul
33d04ef55f
Integrate the omtcursors into the BRT. So far only DB_NEXT is implemented. Addresses #855 , #856 .
...
git-svn-id: file:///svn/tokudb@4325 c7de825b-a66e-492c-adef-691d508d4ae1
2008-06-02 20:52:12 +00:00
Vincenzo Liberatore
bf759aa8bb
Closes #855 Merged back into trunk
...
git-svn-id: file:///svn/tokudb@4308 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-30 20:41:12 +00:00
Bradley C. Kuszmaul
e9323991d7
{{{
...
svn delete tokudb.872
cd tokudb
svn merge -r4187:4233 https://svn.tokutek.com/tokudb/tokudb.872
}}}
Fixes #849 , #872 .
Addresses #820 .
git-svn-id: file:///svn/tokudb@4234 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-29 03:12:59 +00:00
Bradley C. Kuszmaul
f60c54cad0
Fixes #22 , #333 and Addresses #818 :
...
* Create an exact bit (#818 ) for the sums (but doesn't calculate it.)
* Add magic to the file header (#22 )
* Add per-subdb dupsort flags. (#333 ).
Did
{{{
$ cd tokudb
$ svn merge -r3990:4094 https://svn.tokutek.com/tokudb/tokudb.818/
$ cd ..
$ svn delete tokudb.818
}}}
git-svn-id: file:///svn/tokudb@4095 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-22 21:28:00 +00:00
Bradley C. Kuszmaul
ed2c880ee3
Clean up, clean up, everybody clean their share. Fixes #791 .
...
git-svn-id: file:///svn/tokudb@3848 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-08 07:16:26 +00:00
Bradley C. Kuszmaul
09850cc913
Hacking makefiles. Also make the filenames used by the tests work more reliably. Addresses #782 .
...
git-svn-id: file:///svn/tokudb@3792 c7de825b-a66e-492c-adef-691d508d4ae1
2008-05-04 16:56:15 +00:00
Bradley C. Kuszmaul
71b56ba1e8
Calculate an estimate of the number of {{{LEAFENTRY}}}s below each node.
...
Increment {{{layout_version}}} to 6.
brtdump now has a {{{--nodata}}} option (to print only the metadata, but not the data)
Fixes #766 .
Merged to main using
{{{
cd tokudb/tokudb
svn merge -r3713:3725 https://svn.tokutek.com/tokudb/tokudb.766
cd ..
svn delete tokudb.766
}}}
git-svn-id: file:///svn/tokudb@3728 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-30 13:23:04 +00:00
Bradley C. Kuszmaul
ecd0b0a971
Start adding the lists. Addresses #749 .
...
git-svn-id: file:///svn/tokudb@3647 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 14:22:05 +00:00
Bradley C. Kuszmaul
9f99493d4e
Change the {{{LEAFENTRY}}} to {{{OMTVALUE}}} when using the omt, and also change the type of {{{OMTVALUE}}} to {{{void*}}} so we can have two different OMTs coexisting. Fixes #750 .
...
git-svn-id: file:///svn/tokudb@3646 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-25 13:46:17 +00:00
Bradley C. Kuszmaul
0b880e866e
Merge onto the main line again.
...
{{{
svn merge -r3571:3582 https://svn.tokutek.com/tokudb/tokudb.724
}}}
git-svn-id: file:///svn/tokudb@3583 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-23 04:17:28 +00:00
Bradley C. Kuszmaul
33b252772a
Merge in the OMT and its integration into the main line.
...
{{{
$ cd tokudb
$ svn merge -r3533:3571 https://svn.tokutek.com/tokudb/tokudb.724
}}}
There remain a few problems with recovery, but the main line has problems with recovery, so let's bite the bullet and move forward.
Fixes #729 , #724 .
git-svn-id: file:///svn/tokudb@3572 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-22 20:39:50 +00:00
Bradley C. Kuszmaul
8511ea7372
Log db close so that recovery will work right if the same db is opened and closed repeatedly.
...
Also the file numbers can thus be reused.
Don't pass the BRT into the flush commands, since the BRT may no longer be present.
Put a counter in to see how many rollback records are present. (Addresses #698.)
Increment the file version to 4.
Fixes #545 , #703 .
Note: All the tests pass except
* Many cxx tests are getting valgrind errors. (Addresses #716 . Possibly causes #716.)
* {{{test_log9.recover}}} fails with "Binary files ... differ". These will presumably be fixed by #711 or #714 . (Addresses #711 , #714.)
* {{{test_log10.recover}}} fails. There are two failures:
1. A valgrind problem (see #718.) (Addresses #718 . Possibly causes #718.)
1. The "Binary files ... differ" issue.
git-svn-id: file:///svn/tokudb@3486 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-17 03:11:55 +00:00
Bradley C. Kuszmaul
b58a413bce
{{{
...
svn merge -r3352:3375 https://svn.tokutek.com/tokudb/tokudb.558a
}}}
with no conflicts.
Fixes #672 , #558 , #680 .
git-svn-id: file:///svn/tokudb@3376 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-09 02:45:27 +00:00
Bradley C. Kuszmaul
6298988642
Merge the tokudb.558 branch back to to the main branch with:
...
{{{
svn merge -r3272:3320 https://svn.tokutek.com/tokudb/tokudb.558
}}}
No conflicts.
git-svn-id: file:///svn/tokudb@3322 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-07 01:30:25 +00:00
Bradley C. Kuszmaul
22cf859734
Write leafentry code, and get things to compile. Make it more compatible with -Wconversion. Addresses #558 .
...
git-svn-id: file:///svn/tokudb@3270 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-04 18:22:01 +00:00
Bradley C. Kuszmaul
7e5dfd3e5d
Write leafentry code, and get things to compile. Addresses #558 .
...
git-svn-id: file:///svn/tokudb@3269 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-04 18:03:03 +00:00
Bradley C. Kuszmaul
83d416fa09
Merge the 558 branch back to the main with
...
{{{
svn merge -r3061:3225 https://svn.tokutek.com/tokudb/tokudb.558
}}}
Fixes #630 .
Addresses #558 .
git-svn-id: file:///svn/tokudb@3226 c7de825b-a66e-492c-adef-691d508d4ae1
2008-04-02 23:40:36 +00:00
Bradley C. Kuszmaul
538a507a30
Make rollback do the right thing in some cases fo internal nodes. Addresses #556 .
...
git-svn-id: file:///svn/tokudb@2955 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-19 19:23:45 +00:00
Bradley C. Kuszmaul
99b75cabcd
Deal with the multithreaded cursor DBT memory allocaiton problem. Addresses #538 . (I'm going to write a few more tests before calling it fixed.)
...
git-svn-id: file:///svn/tokudb@2854 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-15 19:06:39 +00:00
Bradley C. Kuszmaul
7997c793d1
Implement {{{db_env_set_func_fsync}}} and write a test that can discern the use of group commit. Fixes #499 , #496 .
...
git-svn-id: file:///svn/tokudb@2655 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-09 02:39:37 +00:00
Bradley C. Kuszmaul
241c5392df
Break up brt-test some more. Addresses #475 . Also make the fanout flexible. Fixes #126 .
...
git-svn-id: file:///svn/tokudb@2593 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-06 21:46:57 +00:00
Bradley C. Kuszmaul
5c52e7c64a
Separate some of the test helpers from brt.c to brt-test-helpers.c. Addresses #472 .
...
git-svn-id: file:///svn/tokudb@2556 c7de825b-a66e-492c-adef-691d508d4ae1
2008-03-05 18:34:32 +00:00
Bradley C. Kuszmaul
7ebf6bf352
Logging improvements. Mostly fixes #27 . Addresses #455 , #27 .
...
git-svn-id: file:///svn/tokudb@2471 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-29 20:47:11 +00:00
Bradley C. Kuszmaul
712fcc5da1
Many things:
...
Make txn->abort work without bombing out for {{{test_txn_abort5}}} one case. Fixes #431 .
Start writing {{{test_txn_abort6}}}. Addresses #443 .
Try to write a test for #399 and #400 , but haven't managed to reproduce the problem. Addresses #399 , #400 .
Write a test for #332 . Addresses #332 .
git-svn-id: file:///svn/tokudb@2406 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-25 22:46:48 +00:00
Bradley C. Kuszmaul
eeaef7284a
Add XID (Addresses #242 ), and also fix the problem where deletes were sneaking around inserts (Fixes #332.)
...
git-svn-id: file:///svn/tokudb@2098 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-05 18:25:23 +00:00
Bradley C. Kuszmaul
016a5b8fea
Change BRT_CMD to be a pointer instead (struct brt_cmd *) instead of a struct (struct brt_cmd). Addresses #242 .
...
git-svn-id: file:///svn/tokudb@2072 c7de825b-a66e-492c-adef-691d508d4ae1
2008-02-04 15:04:22 +00:00
Bradley C. Kuszmaul
885e0bbb2e
Put all the child info into one struct. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@2002 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-31 22:05:43 +00:00
Rich Prohaska
f1f9661f2a
remove cursor count from the brt node. closes #310
...
git-svn-id: file:///svn/tokudb@1914 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-26 23:11:38 +00:00
Rich Prohaska
d2d80add96
first cut or new cursors merge to trunk. addresses #250
...
git-svn-id: file:///svn/tokudb@1881 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-25 15:43:37 +00:00
Bradley C. Kuszmaul
9fe0391206
Add copyright 2008. Fixes #283 .
...
git-svn-id: file:///svn/tokudb@1844 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-24 15:10:32 +00:00
Bradley C. Kuszmaul
407c0ebebf
Log the fingerprints correctly. Addresses #27 .
...
git-svn-id: file:///svn/tokudb@1820 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-23 18:06:23 +00:00
Bradley C. Kuszmaul
015bc27f2f
Don't be wasteful when splitting brt leaves. Fixes #294 .
...
This makes big difference for space (46% smaller) and a small time difference (5% faster), as measured by benchmark-test.
Before:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial 8.753964s 119783/s random 5.640094s 185915/s cumulative 14.394118s 145695/s
serial 9.381472s 111771/s random 7.325284s 143145/s cumulative 31.100944s 134861/s
serial 9.859233s 106355/s random 6.734307s 155707/s cumulative 47.694553s 131911/s
serial 11.069200s 94729/s random 6.885863s 152280/s cumulative 65.649695s 127778/s
Shutdown 4.636875s
Total time 70.286611s for 8388608 insertions = 119349/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 730344924 Jan 22 11:47 sinsert.brt
}}}
After:
{{{
$ ./benchmark-test
nodesize=1048576
keysize=8
valsize=8
Serial and random insertions of 1048576 per batch
serial 8.521855s 123046/s random 5.730942s 182967/s cumulative 14.252861s 147139/s
serial 9.106047s 115152/s random 7.001765s 149759/s cumulative 30.360740s 138149/s
serial 9.543696s 109871/s random 6.651000s 157657/s cumulative 46.555503s 135139/s
serial 10.627035s 98671/s random 6.555884s 159944/s cumulative 63.738491s 131610/s
Shutdown 2.818513s
Total time 66.557042s for 8388608 insertions = 126036/s
$ ls -l sinsert.brt
-rwxrwxr-x 1 bradley bradley 396894480 Jan 22 11:45 sinsert.brt
}}}
git-svn-id: file:///svn/tokudb@1798 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-22 16:27:54 +00:00
Rich Prohaska
8bed771536
replace hashtables with fifos. addresses #249
...
git-svn-id: file:///svn/tokudb@1600 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-11 14:03:33 +00:00
Rich Prohaska
3a29cecefb
remove pivot flags. addresses #250
...
git-svn-id: file:///svn/tokudb@1560 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-08 21:43:11 +00:00
Bradley C. Kuszmaul
faac0f364e
Remoe parent_brtnode. Fixes #251
...
git-svn-id: file:///svn/tokudb@1538 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-07 19:53:50 +00:00
Rich Prohaska
aed37ec51c
first cut of delboth addresses #182
...
git-svn-id: file:///svn/tokudb@1478 c7de825b-a66e-492c-adef-691d508d4ae1
2008-01-02 20:33:51 +00:00
Rich Prohaska
ea16495aa8
handle cursor DB_SET into the right subtree. closes #186
...
git-svn-id: file:///svn/tokudb@1187 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-18 12:48:14 +00:00
Bradley C. Kuszmaul
3a073c1e17
Start moving more stuff out of dir. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@982 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 20:58:45 +00:00
Bradley C. Kuszmaul
6ab4529c91
Switch over the fingerprints to be in the subfield
...
git-svn-id: file:///svn/tokudb@977 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 19:16:18 +00:00
Bradley C. Kuszmaul
d1569489ca
Get rid of childkeylens. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@964 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 14:30:33 +00:00
Bradley C. Kuszmaul
4dfccf0d81
Get rid of a few more cases where childkeylens are used. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@962 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 14:20:47 +00:00
Bradley C. Kuszmaul
85a62db892
Nothing uses the childkeylens now. So we'll be able to remove them next. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@960 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 13:52:52 +00:00
Bradley C. Kuszmaul
6ac3943735
Start making structs for the children. Addresses #126 .
...
git-svn-id: file:///svn/tokudb@957 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-06 12:00:24 +00:00
Bradley C. Kuszmaul
accc92e4b0
Add some information needed for recovery. Changed the size of the serialization, and caused a new cursor bug to show up. Addresses #27 .
...
git-svn-id: file:///svn/tokudb@927 c7de825b-a66e-492c-adef-691d508d4ae1
2007-12-04 22:18:21 +00:00