Bradley C. Kuszmaul
4257a03411
Double check that uses of snprintf inside brt code are OK. Refs #1508 .
...
git-svn-id: file:///svn/toku/tokudb@9717 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:42 -04:00
Rich Prohaska
2a7eca3e3c
merge the read a block using a single read system call to main. closes #1500
...
git-svn-id: file:///svn/toku/tokudb@9667 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:42 -04:00
Yoni Fogel
3b42b55489
Closes #1378 Merged all changes into main.
...
git-svn-id: file:///svn/toku/tokudb@9507 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:41 -04:00
Yoni Fogel
d1aab2ef76
Addresses #1463
...
Abstracted out the block translation table and the block allocator
into BLOCK_TABLE
All use is done by accessors surrounded by locks.
git-svn-id: file:///svn/toku/tokudb@9360 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:41 -04:00
Rich Prohaska
908ad92c45
fix an obsolete assert. closes #1413
...
git-svn-id: file:///svn/toku/tokudb@9060 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:38 -04:00
Bradley C. Kuszmaul
d51bc82a86
Turn on higher compression ( #1192 ), increase block size ( #1168 ), and provide a way to measure workqueue fullness ( #1399 ).
...
Fixes #1168 , #1192 , #1399 .
{{{
svn merge -r8927:9039 https://svn.tokutek.com/tokudb/toku/tokudb.1399
}}}
and resolve conflicts.
git-svn-id: file:///svn/toku/tokudb@9040 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:38 -04:00
Bradley C. Kuszmaul
3b5808f0e0
Quiet down diskfull. Fixes #1409 .
...
git-svn-id: file:///svn/toku/tokudb@9037 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:38 -04:00
Bradley C. Kuszmaul
85f355d631
Improve error messages and error handling when writes fail.
...
* Fixes #78 ({{{lg_bsize}}} works)
* Fixes #1323 (write errors)
Did
{{{
svn merge -r8967:9031 https://svn.tokutek.com/tokudb/toku/tokudb.1323a
}}}
(And I'll delete the 1323 branches in a moment.)
git-svn-id: file:///svn/toku/tokudb@9032 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:38 -04:00
Yoni Fogel
afdb6c6bb9
Closes #1321
...
Remove locks around pread (pread in windows is now thread safe)
git-svn-id: file:///svn/toku/tokudb@8740 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:38 -04:00
Yoni Fogel
a9c69fd3fe
Manual glue for svn-git migration for r8452 due to multiple merge + diffs in the same patch.
...
Original message:
Create a branch to make Doug Lea's malloc work. The big problem is having another malloc() in the system breaks things. Address #1343 , #1032 .
2013-04-16 23:57:33 -04:00
Bradley C. Kuszmaul
c8eba4924f
change {{{db-benchmark-test}}} so that it can skip creating recovery logs. Addresses #1332 .
...
git-svn-id: file:///svn/toku/tokudb.1032b@8430 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:33 -04:00
Bradley C. Kuszmaul
2e02d2518b
Candidate fix for #1308 (part a). Addresses #1308 .
...
git-svn-id: file:///svn/toku/tokudb.1032b@8279 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Bradley C. Kuszmaul
244db7712a
Create a test for 1308. Addresses #1308 .
...
git-svn-id: file:///svn/toku/tokudb.1032b@8277 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Bradley C. Kuszmaul
95c77b2f6a
Fix two of the cases in #1308 . Addresses #1308 .
...
git-svn-id: file:///svn/toku/tokudb.1032b@8274 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Yoni Fogel
cfb07b7d5d
Addresses #1307
...
fstat calls replaced with toku_os calls.
fstat deprecated everywhere except the 'linux' portability directory
git-svn-id: file:///svn/toku/tokudb.1032b@8264 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Zardosht Kasheff
1e794e4d01
addresses #1032
...
put locks around pread
git-svn-id: file:///svn/toku/tokudb.1032b@8179 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Yoni Fogel
ca79f7aed3
Addresses #1296
...
Global mutexes are now initialized in toku_ydb_init, destroyed in toku_ydb_destroy.
Globals in tdbtrace.c (not default) are not yet initialized.
git-svn-id: file:///svn/toku/tokudb.1032b@8149 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:30 -04:00
Rich Prohaska
987c03b986
merge tokudb revision 7776-7883 to toudb.1032b. closes #1260
...
git-svn-id: file:///svn/toku/tokudb.1032b@7888 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:29 -04:00
Rich Prohaska
a12ca96fba
use toku_htonl. closes #1247
...
git-svn-id: file:///svn/toku/tokudb.1032b@7850 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:29 -04:00
Rich Prohaska
fbfd0476ba
more merging of 1032 to 1032b. addresses #1032
...
git-svn-id: file:///svn/toku/tokudb.1032b@7779 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:27 -04:00
Rich Prohaska
0d44815bf5
merge some tokudb.1032 into 1032b. addresses #1032
...
git-svn-id: file:///svn/toku/tokudb.1032b@7778 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:27 -04:00
Rich Prohaska
ab0ac5ad70
merge ticket 1200 changeset 6617 to the tokudb.1195 branch. addresses #1200 adresses #1195
...
git-svn-id: file:///svn/toku/tokudb.1195@7705 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:25 -04:00
Bradley C. Kuszmaul
6b654211c0
free diskblocks. Addresses #1195 .
...
git-svn-id: file:///svn/toku/tokudb.1195@7679 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:25 -04:00
Bradley C. Kuszmaul
586af672c5
newbrt tests run (had to get the keylen computation right.) Still does not reuse blocknums and diskspace. Addresses #1195 .
...
git-svn-id: file:///svn/toku/tokudb.1195@7605 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:24 -04:00
Bradley C. Kuszmaul
2dd4dd7b0d
the splitting works again. Addresses #1195 .
...
git-svn-id: file:///svn/toku/tokudb.1195@7054 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:23 -04:00
Bradley C. Kuszmaul
2f0936b291
Fix up some sizing issues, set the dirty bit after splitting, and put in a lot of printfs. Addresses #1195 .
...
git-svn-id: file:///svn/toku/tokudb.1195@6883 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:23 -04:00
Bradley C. Kuszmaul
cd8840f04d
Get rid of icc warnings (with port-win warnings.) Addresss #1185 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185+nostatementexprs@6466 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:21 -04:00
Bradley C. Kuszmaul
0ed47ea357
CIL gets upset if includes are not in the same order, because int64_t gets typedefed to different things depending on what you include. So do all the includes in a standard way. Addresses #1185 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185@6439 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:20 -04:00
Rich Prohaska
8ae6c215b3
get brt-serialize-test working. addresses #1185
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185@6379 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:20 -04:00
Bradley C. Kuszmaul
4267767fe9
Get rid of some compiler warnings. brt-test runs under valgrind. Addresses #1185 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185@6374 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:19 -04:00
Bradley C. Kuszmaul
0d2788eb22
Get rid of some compiler warnings. Addresses #1185 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185@6371 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:19 -04:00
Bradley C. Kuszmaul
31da3f370b
Get rid of some compiler warnings. Addresses #1185 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a+1185@6370 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:19 -04:00
Rich Prohaska
2adbbe6d15
fix 1172. we can not use the brt in the block serialize functions as the brt may not be valid. addresses #1172
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6272 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
a55bb70df2
Turn on multithreaded writes, and also lock the pwrites and block allocator. Addresses #1080 , #1000 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6177 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
cb7297248a
Allocate blocks on alignment and don't write the root FIFO over the translate block. Addresses #1080 , #1000 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6167 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
34b4ceec63
Fix up placement of root fifo. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6159 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
c126b01af5
The tests may be running. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6156 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
f35926ad91
brt-test runs for a much longer time before barfing. Addresse #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6130 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
7ba939a031
Manage the header not in the cachetable. This will help with #1054 . Addresses #1000 , #1054 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6128 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
550c6c0e6d
Add the extraargs callback for fetch. Also make brt-serial-test run. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6115 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
21be0ea0ef
More progress. Right now the translation table is overwriting the actual data. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6107 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
7e5a096387
Compile with the block allocator. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6097 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
d929e0889c
Start doing the I/O on the block allocator
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6087 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
9e8e600430
Block allocator works and is tested. Addresses #1080 , #1031 , #1000 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6076 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
fcd8cb084c
Deserialize the fifo header inside the header deserialization code instead of separately. Addresses #1131 , #1080 , #1000 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6057 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
5ff7b0c746
Forgot to dirty the root block when allocating a disk block. Addresses #1131 , #1080 , #1000 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6038 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
616abc829e
Incorporate blocknum code from 1080a. Runs a little, need a big run on coyote. Addresses #1000 , #1080 , #1131 .
...
git-svn-id: file:///svn/tokudb.1131b+1080a@6025 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:18 -04:00
Bradley C. Kuszmaul
aa4caae5e4
Compression numbers measured and mailed out to tokueng. Addresses #1131 .
...
git-svn-id: file:///svn/tokudb.1131@5970 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:17 -04:00
Bradley C. Kuszmaul
344fb94fd3
newbrt tests pass with compression. Addresses #1131 .
...
git-svn-id: file:///svn/tokudb.1131@5952 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:16 -04:00
Bradley C. Kuszmaul
37e2267341
Did some decompression stuff. But it's broken. Addresses #1131 .
...
git-svn-id: file:///svn/tokudb.1131@5951 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:16 -04:00