Commit graph

2382 commits

Author SHA1 Message Date
Bradley C. Kuszmaul
9dc6fcc385 Candidate fix for #1632. Refs #1632.
git-svn-id: file:///svn/toku/tokudb@10848 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:47 -04:00
Bradley C. Kuszmaul
0630b6922c {{{db->stat64}}} now has all functionality required for #447.
Merge [10806] into tokudb.  Refs #1629, #447.
{{{
svn merge -r10805:10806 https://svn.tokutek.com/tokudb/toku/tokudb.1629
}}}


git-svn-id: file:///svn/toku/tokudb@10807 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:47 -04:00
Bradley C. Kuszmaul
da0efde586 Merge in 1591 and fix conflicts. Fixes #1591.
{{{
svn merge -r10512:10803 https://svn.tokutek.com/tokudb/toku/tokudb.1591
}}}


git-svn-id: file:///svn/toku/tokudb@10804 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:47 -04:00
Bradley C. Kuszmaul
53e2bc74b1 quiet down test-stat. Fixes #1628.
git-svn-id: file:///svn/toku/tokudb@10802 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
0d081b83da Addresses #1626 Add test1626 to list of tests in Makefile
git-svn-id: file:///svn/toku/tokudb@10778 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
caff96a622 Fixes #1626 Flags array is updated when removing a subdb. Added test that verifies fix
git-svn-id: file:///svn/toku/tokudb@10777 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
5ac1e6ba57 Closes #1616, Addresses #1510 Merge #1616 into #1510.
svn merge --accept=postpone -r 10716:HEAD ../tokudb.1510+1616/
Checkpoint makes a copy of the header for checkpoint purposes (similar to how the block table makes a copy of the btt)

git-svn-id: file:///svn/toku/tokudb@10762 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
36d41294b7 Addresses #1350 Added test that verifies max key size >= 3KiB and max val size >= 80KiB (independantly and together) on DUPSORT databases.
git-svn-id: file:///svn/toku/tokudb@10754 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
5d16c33726 Addresses #1350 Added test that verifies max key size >= 3KiB and max val size >= 80KiB (independantly and together) on NODUP databases.
git-svn-id: file:///svn/toku/tokudb@10753 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
6daac11581 Fix windows build
git-svn-id: file:///svn/toku/tokudb@10747 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
cab4fe72c8 Addresses #1617 Add byte-order verification to header. version/size of header is always stored in network order
version of log is always stored in network order
cleaned up toku_htod

git-svn-id: file:///svn/toku/tokudb@10723 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b2991231d6 Addresses #1611 Log reading lsn now reads it as disk order instead of hardcoded network order.
Previous commit [10714] should say addresses #1611 instead of #10694

git-svn-id: file:///svn/toku/tokudb@10715 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
2a36852736 Addresses #10694 Modified recovery to use toku_dtoh32 instead of manual intel byteswap
Recovery was assuming network byte order on disk, intel byte order in memory, and hardcoding a ntohl (not even calling ntohl).
This fixes the recovery tests with intel byte order on disk

git-svn-id: file:///svn/toku/tokudb@10714 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
4860352fb8 Addresses #1611 toku_htod32 and toku_dtoh32 replace htonl and ntohl (for internal use).
d stands for disk-byte-order (as opposed to n for network-byte-order)
Disk-byte-order set as Intel byte order for now

git-svn-id: file:///svn/toku/tokudb@10694 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
75adfb68c7 build with icl on windows. closes #1608
git-svn-id: file:///svn/toku/tokudb@10663 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
526beea523 Addresses #1607 Static utilities now call initializers/destroyers. src/tests now use static utilities
git-svn-id: file:///svn/toku/tokudb@10662 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
a223e28aa5 Closes #1606 Replace 2&> with 2> in cxx/tests/Makefile
git-svn-id: file:///svn/toku/tokudb@10651 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
f87a582938 fix a 32/64 bit compile issue. addresses #1489
git-svn-id: file:///svn/toku/tokudb@10644 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
9d20502817 merge 1489 to main. addresses #1489
git-svn-id: file:///svn/toku/tokudb@10639 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Bradley C. Kuszmaul
7815feaa2e Fix verbosity. Fixes #1600.
git-svn-id: file:///svn/toku/tokudb@10618 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
e1730f6c7a Closes #1596 Closed 2 security holes in use of toku_ydb_do_error
git-svn-id: file:///svn/toku/tokudb@10559 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
2df4d345e6 Addresses #1590 copying out lsn is non-ignorable overhead. Logging functions now copy out lsn
git-svn-id: file:///svn/toku/tokudb@10522 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
522bd41792 Fix build due to windows porting
git-svn-id: file:///svn/toku/tokudb@10521 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Bradley C. Kuszmaul
4686fb2b3e Refs #1531. The fix is don't compile {{{test_txn_abort6}}} under BDB, rather than hacking around with the #ifdefs inside the code. I noticed this because the main line wouldn't compile tonight.
git-svn-id: file:///svn/toku/tokudb@10513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
f84c352b63 Addresses #1590 Remove most of the logging overhead when we don't write log files.
git-svn-id: file:///svn/toku/tokudb@10507 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
c12bb0c325 Addresses #1589 Add test in db-benchmark-test to help find regression
git-svn-id: file:///svn/toku/tokudb@10502 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b7c69ff8ed Fixed build
git-svn-id: file:///svn/toku/tokudb@10501 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
29854b7c7e Addresses #1577 Fix calculation of total memory size of a memarena
Use size of memarena struct instead of memarena pointer.
Include size of the 'other_bufs' array in size calculation.

git-svn-id: file:///svn/toku/tokudb@10500 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b97ed02dfe Addresses #1577 Don't forget about buffers in memarena when one buffer gets full
git-svn-id: file:///svn/toku/tokudb@10499 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
0844eec052 Addresses #1531 Removed -w option as a workaround for diffs
Windows utils/dump/etc will need to output the correct dos/unix endline format


git-svn-id: file:///svn/toku/tokudb@10495 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
ecbada03b1 Addresses #1531 windows test_db_remove does not fail
git-svn-id: file:///svn/toku/tokudb@10494 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
68a6285528 Addresses #1531 tdb-recover calls brt_init/destroy as necessary
git-svn-id: file:///svn/toku/tokudb@10493 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
3cec87fc6a Addresses #1531 linux port (fix compile) of [10491]
git-svn-id: file:///svn/toku/tokudb@10492 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
c191b67324 Addresses #1531 Ported stat/fstat. toku_stat, toku_fstat (struct is toku_struct_stat), poisoned the use of the functions
git-svn-id: file:///svn/toku/tokudb@10491 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
cd11b163cd Closes #1299 Workaround: any warnings that -WX doesn't work with, add a -Qdiag-error: for
git-svn-id: file:///svn/toku/tokudb@10490 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Rich Prohaska
8df1c07ddb speed up leafentry_disksize. addresses #1585
git-svn-id: file:///svn/toku/tokudb@10482 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
2d037dc6cc Addresses #1531 portability layer changes required for porting utils
git-svn-id: file:///svn/toku/tokudb@10480 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
8828c84d1a Addresses #1531 Ported db-benchmark-test to windows (including bdb version)
git-svn-id: file:///svn/toku/tokudb@10479 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
6737a3be2f Addresses #1531 Ported utils to windows
git-svn-id: file:///svn/toku/tokudb@10478 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
c2d7783293 Addresses #1531 More porting for windows
git-svn-id: file:///svn/toku/tokudb@10477 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
52819f0e4d Fix regression where we would not pass some memarenas to a parent transactions. Fixes #1577
git-svn-id: file:///svn/toku/tokudb@10456 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
19665ad1b3 Addresses #1531 Additional porting for windows, to attempt to support bdb tests
git-svn-id: file:///svn/toku/tokudb@10438 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
7ccbae3c9f Closes #1582 Dirty bit allows 10 characters for process/thread id.
git-svn-id: file:///svn/toku/tokudb@10424 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
682405a0f6 Fixes #1580. logformat now only runs once.
git-svn-id: file:///svn/toku/tokudb@10417 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
426f087123 Make a test for #1572. This test causes the assertion reported by kayak to fail in the old code, but doesn't fail in the new code.
{{{
log.c:1125 toku_txn_note_brt: Assertion `(TOKUTXN)txnv==txn' failed
}}}
Fixes #1572.


git-svn-id: file:///svn/toku/tokudb@10416 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Rich Prohaska
12d9850444 clean the 4g.dir. closes #1578
git-svn-id: file:///svn/toku/tokudb@10414 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
22e4312701 test1572 doesn't really test #1572 yet, but it did point out #1577. Now we are more careful about memory management in the rollback logs, so that we don't blow out memory. Fixes #1577. Refs #1572.
git-svn-id: file:///svn/toku/tokudb@10397 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
2ad6f1330c Addresses #1576 Remove 'return a-b' comparison trick from default key compare function
git-svn-id: file:///svn/toku/tokudb@10394 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
9f2d99f24d Start trying to write a test for #1572 (make sure we can do 4 billion transactions. But the memory is getting out of control. Refs #1572.
git-svn-id: file:///svn/toku/tokudb@10393 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
603221c685 Addresses #1576 Removed (return a-b) comparison trick in tests, added comments about the issue
git-svn-id: file:///svn/toku/tokudb@10392 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00