Commit graph

2274 commits

Author SHA1 Message Date
Yoni Fogel
5d16c33726 Addresses #1350 Added test that verifies max key size >= 3KiB and max val size >= 80KiB (independantly and together) on NODUP databases.
git-svn-id: file:///svn/toku/tokudb@10753 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
6daac11581 Fix windows build
git-svn-id: file:///svn/toku/tokudb@10747 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
cab4fe72c8 Addresses #1617 Add byte-order verification to header. version/size of header is always stored in network order
version of log is always stored in network order
cleaned up toku_htod

git-svn-id: file:///svn/toku/tokudb@10723 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b2991231d6 Addresses #1611 Log reading lsn now reads it as disk order instead of hardcoded network order.
Previous commit [10714] should say addresses #1611 instead of #10694

git-svn-id: file:///svn/toku/tokudb@10715 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
2a36852736 Addresses #10694 Modified recovery to use toku_dtoh32 instead of manual intel byteswap
Recovery was assuming network byte order on disk, intel byte order in memory, and hardcoding a ntohl (not even calling ntohl).
This fixes the recovery tests with intel byte order on disk

git-svn-id: file:///svn/toku/tokudb@10714 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
4860352fb8 Addresses #1611 toku_htod32 and toku_dtoh32 replace htonl and ntohl (for internal use).
d stands for disk-byte-order (as opposed to n for network-byte-order)
Disk-byte-order set as Intel byte order for now

git-svn-id: file:///svn/toku/tokudb@10694 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
75adfb68c7 build with icl on windows. closes #1608
git-svn-id: file:///svn/toku/tokudb@10663 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
526beea523 Addresses #1607 Static utilities now call initializers/destroyers. src/tests now use static utilities
git-svn-id: file:///svn/toku/tokudb@10662 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
a223e28aa5 Closes #1606 Replace 2&> with 2> in cxx/tests/Makefile
git-svn-id: file:///svn/toku/tokudb@10651 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
f87a582938 fix a 32/64 bit compile issue. addresses #1489
git-svn-id: file:///svn/toku/tokudb@10644 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Rich Prohaska
9d20502817 merge 1489 to main. addresses #1489
git-svn-id: file:///svn/toku/tokudb@10639 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Bradley C. Kuszmaul
7815feaa2e Fix verbosity. Fixes #1600.
git-svn-id: file:///svn/toku/tokudb@10618 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
e1730f6c7a Closes #1596 Closed 2 security holes in use of toku_ydb_do_error
git-svn-id: file:///svn/toku/tokudb@10559 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
2df4d345e6 Addresses #1590 copying out lsn is non-ignorable overhead. Logging functions now copy out lsn
git-svn-id: file:///svn/toku/tokudb@10522 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
522bd41792 Fix build due to windows porting
git-svn-id: file:///svn/toku/tokudb@10521 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Bradley C. Kuszmaul
4686fb2b3e Refs #1531. The fix is don't compile {{{test_txn_abort6}}} under BDB, rather than hacking around with the #ifdefs inside the code. I noticed this because the main line wouldn't compile tonight.
git-svn-id: file:///svn/toku/tokudb@10513 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
f84c352b63 Addresses #1590 Remove most of the logging overhead when we don't write log files.
git-svn-id: file:///svn/toku/tokudb@10507 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
c12bb0c325 Addresses #1589 Add test in db-benchmark-test to help find regression
git-svn-id: file:///svn/toku/tokudb@10502 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b7c69ff8ed Fixed build
git-svn-id: file:///svn/toku/tokudb@10501 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
29854b7c7e Addresses #1577 Fix calculation of total memory size of a memarena
Use size of memarena struct instead of memarena pointer.
Include size of the 'other_bufs' array in size calculation.

git-svn-id: file:///svn/toku/tokudb@10500 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:46 -04:00
Yoni Fogel
b97ed02dfe Addresses #1577 Don't forget about buffers in memarena when one buffer gets full
git-svn-id: file:///svn/toku/tokudb@10499 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
0844eec052 Addresses #1531 Removed -w option as a workaround for diffs
Windows utils/dump/etc will need to output the correct dos/unix endline format


git-svn-id: file:///svn/toku/tokudb@10495 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
ecbada03b1 Addresses #1531 windows test_db_remove does not fail
git-svn-id: file:///svn/toku/tokudb@10494 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
68a6285528 Addresses #1531 tdb-recover calls brt_init/destroy as necessary
git-svn-id: file:///svn/toku/tokudb@10493 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
3cec87fc6a Addresses #1531 linux port (fix compile) of [10491]
git-svn-id: file:///svn/toku/tokudb@10492 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
c191b67324 Addresses #1531 Ported stat/fstat. toku_stat, toku_fstat (struct is toku_struct_stat), poisoned the use of the functions
git-svn-id: file:///svn/toku/tokudb@10491 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
cd11b163cd Closes #1299 Workaround: any warnings that -WX doesn't work with, add a -Qdiag-error: for
git-svn-id: file:///svn/toku/tokudb@10490 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Rich Prohaska
8df1c07ddb speed up leafentry_disksize. addresses #1585
git-svn-id: file:///svn/toku/tokudb@10482 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
2d037dc6cc Addresses #1531 portability layer changes required for porting utils
git-svn-id: file:///svn/toku/tokudb@10480 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
8828c84d1a Addresses #1531 Ported db-benchmark-test to windows (including bdb version)
git-svn-id: file:///svn/toku/tokudb@10479 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
6737a3be2f Addresses #1531 Ported utils to windows
git-svn-id: file:///svn/toku/tokudb@10478 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
c2d7783293 Addresses #1531 More porting for windows
git-svn-id: file:///svn/toku/tokudb@10477 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
52819f0e4d Fix regression where we would not pass some memarenas to a parent transactions. Fixes #1577
git-svn-id: file:///svn/toku/tokudb@10456 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
19665ad1b3 Addresses #1531 Additional porting for windows, to attempt to support bdb tests
git-svn-id: file:///svn/toku/tokudb@10438 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
7ccbae3c9f Closes #1582 Dirty bit allows 10 characters for process/thread id.
git-svn-id: file:///svn/toku/tokudb@10424 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
682405a0f6 Fixes #1580. logformat now only runs once.
git-svn-id: file:///svn/toku/tokudb@10417 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
426f087123 Make a test for #1572. This test causes the assertion reported by kayak to fail in the old code, but doesn't fail in the new code.
{{{
log.c:1125 toku_txn_note_brt: Assertion `(TOKUTXN)txnv==txn' failed
}}}
Fixes #1572.


git-svn-id: file:///svn/toku/tokudb@10416 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Rich Prohaska
12d9850444 clean the 4g.dir. closes #1578
git-svn-id: file:///svn/toku/tokudb@10414 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
22e4312701 test1572 doesn't really test #1572 yet, but it did point out #1577. Now we are more careful about memory management in the rollback logs, so that we don't blow out memory. Fixes #1577. Refs #1572.
git-svn-id: file:///svn/toku/tokudb@10397 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
2ad6f1330c Addresses #1576 Remove 'return a-b' comparison trick from default key compare function
git-svn-id: file:///svn/toku/tokudb@10394 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Bradley C. Kuszmaul
9f2d99f24d Start trying to write a test for #1572 (make sure we can do 4 billion transactions. But the memory is getting out of control. Refs #1572.
git-svn-id: file:///svn/toku/tokudb@10393 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
603221c685 Addresses #1576 Removed (return a-b) comparison trick in tests, added comments about the issue
git-svn-id: file:///svn/toku/tokudb@10392 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
784f4eb22c Closes #1575 Added toku_omt_create_steal_sorted_array
git-svn-id: file:///svn/toku/tokudb@10378 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Yoni Fogel
bad2519b8a Closes #1572 find_xid now defines a total order on TXNIDs
git-svn-id: file:///svn/toku/tokudb@10374 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:45 -04:00
Rich Prohaska
7ee5d85680 measure point query times. addresses #1489
git-svn-id: file:///svn/toku/tokudb@10360 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00
Yoni Fogel
f3b347a94e Addresses #1531 make check in windows/tests and windows/ now works
git-svn-id: file:///svn/toku/tokudb@10350 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00
Yoni Fogel
97a6c4d3fe Addresses #1531 made test-stat more comprehensive
git-svn-id: file:///svn/toku/tokudb@10349 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00
Yoni Fogel
5696890bb1 Addresses #1531 Fix test-open-rename
git-svn-id: file:///svn/toku/tokudb@10348 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00
Yoni Fogel
23ea22b624 Closes #1445 diskfull.tdb now passes in windows
Unknown what change made this work.

Added additional asserts to verify it is really working.

git-svn-id: file:///svn/toku/tokudb@10347 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00
Yoni Fogel
42f2f8d1a3 Merged windows compile error fix from #1510
git-svn-id: file:///svn/toku/tokudb@10346 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:57:44 -04:00