Commit graph

731 commits

Author SHA1 Message Date
Rich Prohaska
5ef2e3e59f fix valgrind errors introduced by checkin 6279. addresses #1054
git-svn-id: file:///svn/tokudb.1131b+1080a@6284 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Rich Prohaska
00edc91492 move the root_put_counter to the brt_header. closes #1054
git-svn-id: file:///svn/tokudb.1131b+1080a@6279 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Rich Prohaska
2adbbe6d15 fix 1172. we can not use the brt in the block serialize functions as the brt may not be valid. addresses #1172
git-svn-id: file:///svn/tokudb.1131b+1080a@6272 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
728b016482 Merge main line (up to 6206) and resolve the differences.
{{{
svn merge -r5900:6206 https://svn.tokutek.com/tokudb/tokudb
}}}

Addresses #699, #1000, #1075, #1080, #1100, #1131, #1132, #1134, #1153, #1158.


git-svn-id: file:///svn/tokudb.1131b+1080a@6207 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Rich Prohaska
21f189703d get db truncate working
git-svn-id: file:///svn/tokudb.1131b+1080a@6191 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
a55bb70df2 Turn on multithreaded writes, and also lock the pwrites and block allocator. Addresses #1080, #1000.
git-svn-id: file:///svn/tokudb.1131b+1080a@6177 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
cb7297248a Allocate blocks on alignment and don't write the root FIFO over the translate block. Addresses #1080, #1000, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6167 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
6818460aa6 Fix up placement of root fifo. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6160 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
34b4ceec63 Fix up placement of root fifo. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6159 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
cae5601985 Get rid of memory leaks. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6158 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
c126b01af5 The tests may be running. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6156 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
f35926ad91 brt-test runs for a much longer time before barfing. Addresse #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
7ba939a031 Manage the header not in the cachetable. This will help with #1054. Addresses #1000, #1054, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6128 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
550c6c0e6d Add the extraargs callback for fetch. Also make brt-serial-test run. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6115 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
21be0ea0ef More progress. Right now the translation table is overwriting the actual data. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6107 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
7e5a096387 Compile with the block allocator. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6097 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
d929e0889c Start doing the I/O on the block allocator
git-svn-id: file:///svn/tokudb.1131b+1080a@6087 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
9e8e600430 Block allocator works and is tested. Addresses #1080, #1031, #1000.
git-svn-id: file:///svn/tokudb.1131b+1080a@6076 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
fcd8cb084c Deserialize the fifo header inside the header deserialization code instead of separately. Addresses #1131, #1080, #1000.
git-svn-id: file:///svn/tokudb.1131b+1080a@6057 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
5ff7b0c746 Forgot to dirty the root block when allocating a disk block. Addresses #1131, #1080, #1000.
git-svn-id: file:///svn/tokudb.1131b+1080a@6038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
616abc829e Incorporate blocknum code from 1080a. Runs a little, need a big run on coyote. Addresses #1000, #1080, #1131.
git-svn-id: file:///svn/tokudb.1131b+1080a@6025 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
287767a3ee Turn on multithreading. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131b@5990 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
ce6b171044 Merge the multihreaded writer changes as
{{{
svn merge -r 5899:5987 https://svn.tokutek.com/tokudb/tokudb
}}}
and resolve the conflicts.


git-svn-id: file:///svn/tokudb.1131b@5988 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
aa4caae5e4 Compression numbers measured and mailed out to tokueng. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131@5970 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
de8dcf85f2 Add compress supresssion for valgrind. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131@5957 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
9d9c4f78d7 Add compress supresssion for valgrind. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131@5955 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
344fb94fd3 newbrt tests pass with compression. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131@5952 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:16 -04:00
Bradley C. Kuszmaul
37e2267341 Did some decompression stuff. But it's broken. Addresses #1131.
git-svn-id: file:///svn/tokudb.1131@5951 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:16 -04:00
Bradley C. Kuszmaul
48facf2ce5 Compress (but don't uncompress right)
git-svn-id: file:///svn/tokudb.1131@5901 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:16 -04:00
Yoni Fogel
f81bffebc5 Removed non-existant test.
git-svn-id: file:///svn/tokudb@5867 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-27 15:29:23 +00:00
Rich Prohaska
681f15a8c0 measure the times of errorcheck mutexes
git-svn-id: file:///svn/tokudb@5856 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-26 18:57:34 +00:00
Yoni Fogel
6e4182f8f8 Fixed warnings in trylock.c
git-svn-id: file:///svn/tokudb@5850 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-26 15:34:23 +00:00
Rich Prohaska
29ac9b3ceb merge cachetable tests from the 1075 branch to main. addresses #1075
git-svn-id: file:///svn/tokudb@5849 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-26 14:07:27 +00:00
Yoni Fogel
de17684f30 Set more functions as inline.
git-svn-id: file:///svn/tokudb@5838 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-26 00:32:16 +00:00
Rich Prohaska
d2c6783c09 test lock overhead. addresses #1075
git-svn-id: file:///svn/tokudb@5830 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-25 16:25:30 +00:00
Rich Prohaska
5a9b210d74 print some pthread object sizes
git-svn-id: file:///svn/tokudb@5800 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-22 19:27:28 +00:00
Rich Prohaska
3b23ec425a merge new cachetable tests. addresses #1075
git-svn-id: file:///svn/tokudb@5797 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-22 17:50:05 +00:00
Yoni Fogel
aeded2f184 Closes #1106
Uses  instead of make.
This helps if make is aliased

git-svn-id: file:///svn/tokudb@5729 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-18 19:53:39 +00:00
Rich Prohaska
bcacaae98e more the root_put_counter to the brt object. this speeds up cursor operations. we will address multiple brt handles later. addresses #1054
git-svn-id: file:///svn/tokudb@5651 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-14 01:00:48 +00:00
Bradley C. Kuszmaul
30cfaf522b Measure compression ratio
git-svn-id: file:///svn/tokudb@5626 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-12 15:19:34 +00:00
Rich Prohaska
58435beac0 add the gcc atomic builtin fetch_and_add
git-svn-id: file:///svn/tokudb@5501 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-04 18:05:09 +00:00
Bradley C. Kuszmaul
f4d9c56627 Measure some more locking primitives.
git-svn-id: file:///svn/tokudb@5498 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-04 14:40:24 +00:00
Bradley C. Kuszmaul
a635d5c552 Measure some more locking primitives.
git-svn-id: file:///svn/tokudb@5497 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-04 14:39:22 +00:00
Bradley C. Kuszmaul
955787457e Improve comment. Addresses #1021.
git-svn-id: file:///svn/tokudb@5472 c7de825b-a66e-492c-adef-691d508d4ae1
2008-08-01 17:56:53 +00:00
Rich Prohaska
5fa2c451c5 delete the unused mempool compress feature
git-svn-id: file:///svn/tokudb@5439 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-30 19:36:37 +00:00
Yoni Fogel
df1c7a9379 Addresses #903
Created function that peeks at both key and value at the same time
(to avoid repeated OMT calls).
This was worth 4-5% performance in scanscan --lwc --prelock --prelockflag


git-svn-id: file:///svn/tokudb@5386 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-28 17:55:14 +00:00
Yoni Fogel
b5d3b778d6 Addresses #903
Speed up light weight cursors.
Instead of asking the brt to use 'copyout' (by passing key and/or val pointers)
we pass in NULLs to brt_cursor_get.
We then later use the peek_current functions to obtain pointers to the current
key and val of the cursor.

That was worth ~22% reduction in time for scanscan --lwc --prelock --prelockflag

Also, now copyout quits immediately if both key and val are NULL
This increased the (total) value of the patch to ~30% reduction  in time.

git-svn-id: file:///svn/tokudb@5383 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-28 16:19:59 +00:00
Rich Prohaska
1f05fe210f port to 32 bit linux
git-svn-id: file:///svn/tokudb@5381 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-28 14:55:41 +00:00
Bradley C. Kuszmaul
3aafa0d873 Some files didn't merge right. Fixes #1021.
git-svn-id: file:///svn/tokudb@5364 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-27 22:19:08 +00:00
Bradley C. Kuszmaul
9b7fdbcfd0 Convert from crc to x1764. Fixes #1021.
git-svn-id: file:///svn/tokudb@5363 c7de825b-a66e-492c-adef-691d508d4ae1
2008-07-27 22:16:49 +00:00