Commit graph

1579 commits

Author SHA1 Message Date
Yoni Fogel
6ae9156719 [t:2440] Add commit progress to local checkpoint
git-svn-id: file:///svn/toku/tokudb@19461 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:07 -04:00
Yoni Fogel
54ae26e465 git ignore
git-svn-id: file:///svn/toku/tokudb@19460 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
8c34dda452 closes[t:2440] Merge #2440 to main.
closes[t:2512] merge #2512 to main
Delete dev branch

git-svn-id: file:///svn/toku/tokudb@19439 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
7b2cc84ac9 closes[t:2515] Accurately distinguish between 32bit and 64bit windows
git-svn-id: file:///svn/toku/tokudb@19288 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Rich Prohaska
60d43a6d82 fix cachetable unpin and remove refs[t:2507]
git-svn-id: file:///svn/toku/tokudb@19264 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
4c7d34d0f3 [t:2449] Bugfix in cachetable pairs for rollback log nodes.
We were using TOKUTXNs as the extraarg, but the TOKUTXN struct could be freed while the pair is still in memory.
We only used the TOKUTXN to get the cachefile and header.  We already are given the cachefile, so we
made the extraargs be the header

git-svn-id: file:///svn/toku/tokudb@19238 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
65f91e8663 Windows port minor changes
git-svn-id: file:///svn/toku/tokudb@19227 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
fffb7ba30a [t:2506] [t:2507] Fix metadata (size writing) during write_pair_for_checkpoint
Also initialize the work item in the pair even if we actually are writing it.
Fix crash in getting size of empty FILENUMS

git-svn-id: file:///svn/toku/tokudb@19200 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
43aea2f126 [t:2449] do lru_touch on prefetch
git-svn-id: file:///svn/toku/tokudb@19195 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
2f1711d2a6 [t:2506] [t:2507] Forgot to initialize workitem for write_pair_for_checkpoint when enqueueing on cq
git-svn-id: file:///svn/toku/tokudb@19194 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
0632ad4288 [t:2449] Add prefetching of rollback logs to speed up commit/abort processing
git-svn-id: file:///svn/toku/tokudb@19190 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
8bd25c46ab [t:2506] [t:2507] Fix locking mechanism for unpin_and_remove
We mistakenly thought that the workqueue lock was the same as the cachetable lock

git-svn-id: file:///svn/toku/tokudb@19188 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
3550e7dd38 [t:2506] [t:2507] Fix bug in toku_cachetable_unpin_and_remove
write_pair_for_checkpoint now uses completion queue if set

git-svn-id: file:///svn/toku/tokudb@19187 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
a5a29dbda6 [t:2506] [t:2507] Fix bug in toku_cachetable_unpin_and_remove
Correctly handles a blocked writer (checkpoint).  it checked state before state was set,
so incorrectly thought that there was never a blocked writer

git-svn-id: file:///svn/toku/tokudb@19186 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
e521486e82 [t:2506] [t:2507] Added some temporary asserts
git-svn-id: file:///svn/toku/tokudb@19182 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:06 -04:00
Yoni Fogel
1bf7a7a403 closes[t:2449] [t:2484] Merge #2449 changes to main.
Rollback logs are now checkpointed.  There are no rolltmp files.


git-svn-id: file:///svn/toku/tokudb@19167 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Yoni Fogel
1c3241f9dc closes[t:2505] Clean up makefiles. Remove support for old versions of valgrind (older than ~3.5)
git-svn-id: file:///svn/toku/tokudb@19137 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Yoni Fogel
667e46d60c closes[t:2483] Fix recovery bug in loader.
checkpoint_lsn written to headers made by loader are now the fsynced 'load' log entry's lsn instead of MAX_UINT64

git-svn-id: file:///svn/toku/tokudb@19136 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
1440b4a3b9 merge -r 18992:head ptq to main refs[t:2351]
git-svn-id: file:///svn/toku/tokudb@19099 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Zardosht Kasheff
a87006b10c [t:2494], merge read committed to main
git-svn-id: file:///svn/toku/tokudb@19073 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
95035e9dde fix some icc on linux errors in the fractal tree refs[t:2500]
git-svn-id: file:///svn/toku/tokudb@18997 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
f6749714bc fix some icc on linux errors in the fractal tree refs[t:2500]
git-svn-id: file:///svn/toku/tokudb@18993 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
48414ab76b create multiple sub blocks per leaf in the loader. merge -r 18961:head ptq branch to main refs[t:2351]
git-svn-id: file:///svn/toku/tokudb@18992 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
c1b0e91b95 new block format with a header checksum and sub block checksums. merge -c 18916:head from 2351.ptq to main refs[t:2351]
git-svn-id: file:///svn/toku/tokudb@18961 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
654d3a08f8 fix a windows build problem
git-svn-id: file:///svn/toku/tokudb@18954 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Rich Prohaska
864812ad48 some reorganization of brt serialize. merge -r 18898:head https://svn.tokutek.com/tokudb/toku/tokudb.2351.ptq main refs[t:2351] #2351
git-svn-id: file:///svn/toku/tokudb@18919 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:05 -04:00
Bradley C. Kuszmaul
a3a44f8e57 Fixes #2487. close[t:2487]. One of the problems was a buffer overflow problem because the header hadn't been extended.
git-svn-id: file:///svn/toku/tokudb@18900 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Dave Wells
50c95d2d1a fix memory leak in logcursor, rearrange code to share common code, improve error messages refs #2446 [t:2446]
git-svn-id: file:///svn/toku/tokudb@18896 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Rich Prohaska
5150671302 fix a rollback memory leak refs[t:2490]
git-svn-id: file:///svn/toku/tokudb@18894 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Yoni Fogel
a4a459c709 [t:2488] Reclaim memory, on checkpoint, for translation table if a suffix of the table's numbers have been freed
git-svn-id: file:///svn/toku/tokudb@18891 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Rich Prohaska
70c37a9a67 fix a memory leak closes[t:2490] #2490
git-svn-id: file:///svn/toku/tokudb@18882 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Barry Perlman
13c324ed06 Merge from 3.1.0 using following commands:
> svn merge --accept=postpone -r18405:HEAD https://svn.tokutek.com/tokudb/mysql.branches/3.0.5/tokudb
> svn merge --accept=postpone -r18484:HEAD https://svn.tokutek.com/tokudb/mysql.branches/3.1.0/tokudb
> svn merge --accept=postpone -c18403 https://svn.tokutek.com/tokudb/mysql.branches/3.0.5/tokudb
> all executed inside directory tokudb/toku/tokudb

git-svn-id: file:///svn/toku/tokudb@18877 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Bradley C. Kuszmaul
e97dc367c0 Set compresison_level to 5
git-svn-id: file:///svn/toku/tokudb@18836 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Bradley C. Kuszmaul
3bfdfa2921 Get rid of the gratuitous IDX files.
git-svn-id: file:///svn/toku/tokudb@18835 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Yoni Fogel
0db1dce5de [t:2480] Bugfix with setting descriptor during redirect.
git-svn-id: file:///svn/toku/tokudb@18808 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Dave Wells
c9e32bbe03 add toku_brt_loader_abort, fix up error handling in toku_loader_*
git-svn-id: file:///svn/toku/tokudb@18804 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Bradley C. Kuszmaul
3919e85519 Merge the finer-grained progress report for the loader. Refs #2462. [t:2462]
{{{
svn merge -r 18775:18791 https://svn.tokutek.com/tokudb/toku/tokudb.2462
}}}
.


git-svn-id: file:///svn/toku/tokudb@18792 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Yoni Fogel
d4bdc29194 [t:2216] Bugfix with load:
If a transaction does a load(oldname,newname), and commits, the xcommit log entry MUST
be fsynced, even if the user said we can turn off fsyncs.

This is similar to an fdelete done by a transaction.

git-svn-id: file:///svn/toku/tokudb@18789 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Yoni Fogel
98e4b12454 [t:2476] Recovery yield calls the function it is told to.
Added asserts to rwlock locks

git-svn-id: file:///svn/toku/tokudb@18779 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:04 -04:00
Bradley C. Kuszmaul
eb9ad2a896 Merge in the 2462 branch that has a rudimentary implementation of polling. Refs #2462. [t:2462]
{{{
svn merge -c 18768 https://svn.tokutek.com/tokudb/toku/tokudb.2462
}}}
.


git-svn-id: file:///svn/toku/tokudb@18771 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Rich Prohaska
287f0e8384 fix 32 bit linux build of brtloader test #2475 closes[t:2475]
git-svn-id: file:///svn/toku/tokudb@18769 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Yoni Fogel
b33a8c1830 [t:2216] windows port of #2216 merge (remove statement expressions)
git-svn-id: file:///svn/toku/tokudb@18753 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
788b96e407 Merge 2216b onto main line. Refs #2216. [t:2216]
{{{
svn merge -r18206:18672 https://svn.tokutek.com/tokudb/toku/tokudb.2216b
svn merge -r 18738:18746 https://svn.tokutek.com/tokudb/toku/tokudb.2216b
}}}
.


git-svn-id: file:///svn/toku/tokudb@18749 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
53d376d7c3 Add keywords. [t:2468]. Refs #2468.
git-svn-id: file:///svn/toku/tokudb@18673 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
91d93e80ca Merge r18344. No actual changes. Refs #2467. [t:2467].
git-svn-id: file:///svn/toku/tokudb@18656 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
73cc033ae4 get_tdiff shouldn't be in logger.c. [t:2434] Refs #2434.
git-svn-id: file:///svn/toku/tokudb@18653 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
9fb8e42bac Merge r18221. No substantial changes. Refs #2467. [t:2467].
git-svn-id: file:///svn/toku/tokudb@18651 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
83ad86f23e Merge r18411 (which increments output_condition_lock_ctr while lock is held.) Refs #2450. [t:2450]
{{{
svn merge -c18411 https://svn.tokutek.com/tokudb/mysql.branches/3.1.0/tokudb/
}}}
.


git-svn-id: file:///svn/toku/tokudb@18644 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
e8af332d42 Merge r18357 to put the logger statistics. Refs #2385. [t:2385].
{{{
svn merge -c18357 https://svn.tokutek.com/tokudb/mysql.branches/3.1.0/tokudb/
}}}
.


git-svn-id: file:///svn/toku/tokudb@18640 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00
Bradley C. Kuszmaul
9bac0b073a move get_tdiff to test.h. Refs #2434. [t:2434]
{{{
svn merge -c18257 https://svn.tokutek.com/tokudb/mysql.branches/3.1.0/tokudb/
}}}
.


git-svn-id: file:///svn/toku/tokudb@18638 c7de825b-a66e-492c-adef-691d508d4ae1
2013-04-16 23:59:03 -04:00