Commit Graph

193 Commits

Author SHA1 Message Date
Mick Semb Wever 2ec96ae669
Merge branch 'cassandra-3.0' into cassandra-3.11 2021-04-19 17:34:05 +02:00
Mick Semb Wever 50a97a0d76
Merge branch 'cassandra-2.2' into cassandra-3.0 2021-04-19 17:29:00 +02:00
Ekaterina Dimitrova 2330545827 Metrics backward compatibility restored after CASSANDRA-15066
Authored by Ekaterina Dimitrova, reviewed by Benjamin Lerer for CASSANDRA-16083
2021-02-12 10:19:39 -05:00
Marcus Eriksson 8742f3a414 CASSANDRA-16274 followup - fix JMXCompatabilityTest 2020-12-02 07:42:24 +01:00
Sam Tunnicliffe a7c4ba9eee Improve checksumming and compression in protocol V5
This reverts the changes made to the native protocol V5 wire format in
CASSANDRA-13304 and subsequent follow up JIRAs (CASSANDRA-15556 &
CASSANDRA-14716). The framing format has been re-implemented based on the
internode messaging format developed in CASSANDRA-15066.

OPTIONS and STARTUP messages are unframed (i.e. identical to the V4 format).
After sending its response to a STARTUP message, the server modifies the
pipeline and all further messages are sent (and should be expected by the
client to be received) in the format determined by the protocol version of
the STARTUP message.

Patch by Sam Tunnicliffe; reviewed by Alex Petrov and Caleb Rackliffe
for CASSANDRA-15299
2020-12-01 18:49:06 +00:00
Marcus Eriksson 22abff779d Optimised repair streaming improvements
Patch by marcuse; reviewed by Sam Tunnicliffe for CASSANDRA-16274
2020-12-01 12:39:25 +01:00
Andrés de la Peña 83b41b6b69 Merge branch 'cassandra-3.11' into trunk
# Conflicts:
#	CHANGES.txt
#	src/java/org/apache/cassandra/db/filter/ColumnFilter.java
#	test/unit/org/apache/cassandra/db/filter/ColumnFilterTest.java
2020-10-19 15:31:20 +01:00
Zhao Yang 699a1f74fc CASSANDRA-15229: Segregate Network and Chunk Cache BufferPools and Recirculate Partially Freed Chunks
* initiate multiple buffer pool for different lifespan and usages
  - Chunk Cache Buffer Pool - conf.file_cache_size_in_mb=512mb
  - Networking Buffer Pool - conf.temporary_cache_size_in_mb=128mb

* Add overflowSize and usedSize to buffer pool metrics

* re-circulate buffer pool Chunk for ChunkCache whenever it has free space, even thoughput it may not be able to allocate due to fragmentation

patch by Zhao Yang; reviewed by Caleb Rackliffe and Aleksey Yeschenko for CASSANDRA-15229
2020-10-15 22:55:06 +08:00
David Capwell 91bcbb2873 Add a new jmxtool which can dump what JMX objects exist and diff
patch by David Capwell, Stephen Mallette; reviewed by Berenguer Blasi, Jon Meredith for CASSANDRA-16082
2020-09-15 17:01:01 -07:00
Alex Petrov 056c9eff4b Merge branch 'cassandra-3.0' into cassandra-3.11 2020-06-04 20:17:31 +02:00
Alex Petrov c4064dd80e Allow recovery from the cases when CQL-created compact sense tables have bytes in EmptyType columns.
Patch by Alex Petrov; reviewed by Sylvain Lebresne for CASSANDRA-15778.
2020-06-04 20:04:27 +02:00
David Capwell f80a2ce10c Prevent the JVM from crashing due to corrupt LZ4 streams
Patch by David Capwell; reviewed by Jordan West and brandonwilliams for
CASSANDRA-15556
2020-02-11 11:00:24 -06:00
Cameron Zemek 31a86f891b
Fix LegacyLayout to have same behavior as 2.x when handling unknown column names
patch by Cameron Zemek; reviewed by Mick Semb Wever for CASSANDRA-15081
2019-11-15 18:53:40 +01:00
Marcus Eriksson 2d90e3c2a4 Merge branch 'cassandra-3.0' into cassandra-3.11 2019-10-30 15:14:59 +01:00
Marcus Eriksson 767a68cd00 Ensure legacy rows have primary key livenessinfo when they contain illegal cells
Patch by marcuse and Sam Tunnicliffe; reviewed by Benedict Elliott Smith for CASSANDRA-15365
2019-10-30 15:09:04 +01:00
Aleksey Yeschenko f9ff884377 Untangle RepairMessage sub-hierarchy of messages, use new messaging (more) correctly
patch by Aleksey Yeschenko; reviewed by Blake Eggleston for
CASSANDRA-15163
2019-09-20 15:52:19 -07:00
Sam Tunnicliffe 83baa27104 Merge branch 'cassandra-3.0' into cassandra-3.11 2019-06-27 16:25:43 +01:00
Sam Tunnicliffe f4b6e1d51f Filter illegal legacy cells when collating rows
Alternative solution for CASSANDRA-15086, which allows the illegal cells to
be read from disk and deserialized as normal so as not to interfere with
tracking bytes read during reverse iteration of indexed partitions.

Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson for CASSANDRA-15178
2019-06-27 16:21:01 +01:00
Benedict Elliott Smith 310a48efcf Rewrite the internode messaging subsystem
patch by Aleksey Yeschenko and Benedict Elliott Smith; reviewed by Alex
Petrov, Aleksey Yeschenko, and Benedict Elliott Smith for CASSANDRA-15066

Co-authored-by: Aleksey Yeschenko <aleksey@apache.org>
Co-authored-by: Benedict Elliott Smith <benedict@apache.org>
2019-06-12 16:26:54 +01:00
Sam Tunnicliffe ba01089a0f Merge branch 'cassandra-3.0' into cassandra-3.11 2019-05-08 10:03:42 +01:00
Sam Tunnicliffe daf6c85b05 Skip cells with illegal column names when reading legacy sstables
Patch by Sam Tunnicliffe; reviewed by Aleksey Yeschenko for CASSANDRA-15086
2019-05-08 09:57:32 +01:00
Sam Tunnicliffe 64d828b9de Merge branch 'cassandra-3.0' into cassandra-3.11 2018-11-28 16:11:08 +00:00
Sam Tunnicliffe 0a7fbee43f Reading legacy tables handles tombstones for dropped collections
Patch by Sam Tunnicliffe; reviewed by Aleksey Yeschenko and
Benedict Elliott Smith for CASSANDRA-14912
2018-11-28 16:03:16 +00:00
Aleksey Yeshchenko 5431b87ede Merge branch 'cassandra-3.0' into cassandra-3.11 2018-11-13 15:30:56 +00:00
Aleksey Yeshchenko 9eee7aa787 Fix missing rows when reading 2.1 SSTables with static columns in 3.0
patch by Aleksey Yeschenko; reviewed by Blake Eggleston for
CASSANDRA-14873
2018-11-12 19:27:31 +00:00
Blake Eggleston 6ec445282a Merge branch 'cassandra-3.11' into trunk 2018-11-06 11:20:52 -08:00
Blake Eggleston a6a9dce157 Merge branch 'cassandra-3.0' into cassandra-3.11 2018-11-06 11:19:04 -08:00
Blake Eggleston d60c78358b Sstable min/max metadata can cause data loss
Patch by Blake Eggleston; Reviewed by Sam Tunnicliffe for CASSANDRA-14861
2018-11-06 11:17:06 -08:00
Blake Eggleston 075f458623 Merge branch 'cassandra-3.0' into cassandra-3.11 2018-10-16 12:48:38 -07:00
Blake Eggleston 285153f621 Legacy sstables with multi block range tombstones create invalid bound sequences
Patch by Blake Eggleston; Reviewed by Sam Tunnicliffe and Aleksey Yeschenko for CASSANDRA-14823
2018-10-16 12:37:24 -07:00
Blake Eggleston 70303563e9 Merge branch 'cassandra-3.0' into cassandra-3.11 2018-10-04 12:56:39 -07:00
Blake Eggleston ab0e30e759 Reverse order reads can return incomplete results
Patch by Blake Eggleston; Reviewed by Sam Tunnicliffe for CASSANDRA-14803
2018-10-04 12:46:21 -07:00
Aleksey Yeshchenko 4d3f5a32b2 Merge branch 'cassandra-3.0' into cassandra-3.11 2018-09-25 17:03:57 +01:00
Aleksey Yeshchenko 45937def31 DESC order reads can fail to return the last Unfiltered in the partition
patch by Aleksey Yeschenko; reviewed by Sam Tunnicliffe and Benedict
Elliott Smith for CASSANDRA-14766
2018-09-25 17:02:06 +01:00
Ariel Weisberg f7431b4328 Transient Replication and Cheap Quorums
Patch by Blake Eggleston, Benedict Elliott Smith, Marcus Eriksson, Alex Petrov, Ariel Weisberg; Reviewed by Blake Eggleston, Marcus Eriksson, Benedict Elliott Smith, Alex Petrov, Ariel Weisberg for CASSANDRA-14404

Co-authored-by: Blake Eggleston <bdeggleston@gmail.com>
Co-authored-by: Benedict Elliott Smith <benedict@apache.org>
Co-authored-by: Marcus Eriksson <marcuse@apache.org>
Co-authored-by: Alex Petrov <oleksandr.petrov@gmail.com>
2018-08-31 21:34:22 -04:00
Paulo Motta 6034c268c3 Merge branch 'cassandra-3.11' into trunk 2018-02-10 15:03:59 -02:00
Paulo Motta 0a6b6f506b Merge branch 'cassandra-3.0' into cassandra-3.11 2018-02-10 14:59:28 -02:00
Paulo Motta c231ed5be0 Merge branch 'cassandra-2.2' into cassandra-3.0 2018-02-10 14:57:53 -02:00
Paulo Motta 1602e60634 Merge branch 'cassandra-2.1' into cassandra-2.2 2018-02-10 14:54:56 -02:00
Paulo Motta b2949439ec Protect against overflow of local expiration time
Patch by Paulo Motta; Reviewed by Sam Tunnicliffe for CASSANDRA-14092
2018-02-10 14:33:50 -02:00
Ariel Weisberg 59b5b6bef0 Allow storage port to be configurable per node
Patch by Ariel Weisberg; Reviewed by Jason Brown for CASSANDRA-7544
2018-01-25 14:32:24 -05:00
Jay Zhuang d6cc594325 New Bloomfilter format without changing the byte ordering
patch by Jay Zhuang; reviewed by jasobrown for CASSANDRA-9067
2018-01-19 06:40:50 -08:00
Jeff Jirsa 0525145422 Merge branch 'cassandra-3.0' into cassandra-3.11 2017-12-12 09:55:39 -08:00
Jeff Jirsa 4a2b516a34 Extra range tombstone bound creates double rows in 3.0
Patch by Jeff Jirsa; Reviewed by Aleksey Yeschenko for CASSANDRA-14008
2017-12-12 09:52:19 -08:00
Aleksey Yeschenko 912fdb3ea4 Switch to CRC32 for sstable metadata checksums
patch by Aleksey Yeschenko; reviewed by Marcus Eriksson for
CASSANDRA-13953
2017-10-17 16:48:32 +01:00
Marcus Eriksson cfee3e93be Checksum sstable metadata
Patch by marcuse; reviewed by Jason Brown for CASSANDRA-13321
2017-10-06 15:25:28 +02:00
Sam Tunnicliffe 6214b1ec86 Merge branch 'cassandra-3.0' into cassandra-3.11 2017-05-24 19:09:32 +01:00
Sam Tunnicliffe 62092e45c8 Fix current position calculation in OldFormatDeserializer
Patch by Sam Tunnicliffe; reviewed by Jeff Jirsa for CASSANDRA-13525

This patch also adds a unit test for CASSANDRA-13236.
2017-05-24 19:01:25 +01:00
Blake Eggleston 4cfaf855c4 Add repair streaming preview
Patch by Blake Eggleston; Reviewed by Marcus Eriksson for CASSANDRA-13257
2017-04-24 09:21:33 -07:00
Branimir Lambov f97db26f8e Adds the ability to use uncompressed chunks in compressed files
Triggered when size of compressed data surpasses a configurable
threshold.

Patch by Branimir Lambov; reviewed by Ropert Stupp for CASSANDRA-10520
2017-02-21 18:05:18 +02:00
Sylvain Lebresne 4a2464192e Remove pre-3.0 compatibility code for 4.0
patch by Sylvain Lebresne; reviewed by Aleksey Yeschenko for CASSANDRA-12716
2016-11-30 10:23:18 +01:00
Stefan Podkowinski c4cb915eaf Replace keystore for utests with non export restricted cipher keys
patch by Stefan Podkowinski; reviewed by Jason Brown for CASSANDRA-12945
2016-11-29 11:06:08 -08:00
Stefan Podkowinski 554d53664c Replace keystore for utests with non export restricted cipher keys
patch by Stefan Podkowinski; reviewed by Jason Brown for CASSANDRA-12945
2016-11-28 05:14:19 -08:00
Pavel Yaskevich 490c1c27c9 Revert "Add row offset support to SASI"
This reverts commit 7d857b46fb.
2016-11-17 15:20:04 -08:00
Alex Petrov 7d857b46fb Add row offset support to SASI
Patch by Alex Petrov; reviewed by Pavel Yaskevich for CASSANDRA-11990
2016-09-05 22:17:11 -07:00
Stefania Alborghetti ce84226318 Merge branch 'cassandra-3.0' into trunk 2016-09-01 10:06:57 +08:00
Stefania Alborghetti a1d9a0295c Fix legacy regex for temporary files from 2.2
Patch by Stefania Alborghetti; reviewed by Robert Stupp for CASSANDRA-12565
2016-09-01 10:05:37 +08:00
Sylvain Lebresne 7b1021733b Merge commit '904cb5d10e0de1a6ca89249be8c257ed38a80ef0' into cassandra-3.9
* commit '904cb5d10e0de1a6ca89249be8c257ed38a80ef0':
  Change commitlog and sstables to track dirty and clean intervals.
  Disable passing control to post-flush after flush failure to prevent data loss.
2016-08-05 15:39:56 +02:00
Branimir Lambov 904cb5d10e Change commitlog and sstables to track dirty and clean intervals.
patch by Branimir Lambov; reviewed by Sylvain Lebresne for
CASSANDRA-11828
2016-08-05 15:38:37 +02:00
Sylvain Lebresne d4ced24535 Merge branch 'cassandra-3.0' into cassandra-3.9
* cassandra-3.0:
  Fix problem with undeleteable rows on upgrade to new sstable format.
2016-07-19 12:03:08 +02:00
Alex Petrov c481e8dc84 Fix problem with undeleteable rows on upgrade to new sstable format.
Patch by Alex Petrov; reviewed by Sylvain Lebresne for CASSANDRA-12144.
2016-07-19 11:57:09 +02:00
Josh McKenzie e31e216234 Add Change Data Capture
Patch by jmckenzie; reviewed by cyeksigian and blambov for CASSANDRA-8844
2016-06-16 10:01:39 -04:00
Sylvain Lebresne c9ac0506c4 Merge commit '78a3d2bba95b9efcda152a157f822f4970f22636' into cassandra-3.7 2016-05-12 15:20:41 +02:00
Sylvain Lebresne 78a3d2bba9 Merge commit '849a438690aa97a361227781108cc90355dcbcd9' into cassandra-3.0 2016-05-12 15:19:15 +02:00
Yuki Morishita 587773fa47 Merge branch 'cassandra-3.0' into cassandra-3.5 2016-03-17 10:42:20 -05:00
Paulo Motta e8651b6625 Support streaming of older version sstables in 3.0
patch by Paulo Motta; reviewed by Yuki Morishita for CASSANDRA-10990
2016-03-17 10:04:44 -05:00
Marcus Eriksson 7d7ff7f3cd Merge branch 'cassandra-2.1' into cassandra-2.2 2016-02-11 08:25:14 +01:00
Marcus Eriksson 96549946fe Properly release sstable reference when doing offline scrub
Patch by marcuse; reviewed by Stefania for CASSANDRA-10697
2016-02-11 08:20:47 +01:00
Jason Brown 7374e9b5ab Encrypted commit logs
patch by jasobrown; reviewed by blambov for (CASSANDRA-6018)
2016-01-19 07:00:32 -08:00
Marcus Eriksson 882df8a217 Merge branch 'cassandra-2.1' into cassandra-2.2 2015-12-02 15:06:43 +01:00
Branimir Lambov 0b26ca6874 Avoid writing range tombstones after END_OF_ROW marker.
Patch by Branimir Lambov; reviewed by marcuse for CASSANDRA-10791
2015-12-02 14:59:11 +01:00
Benedict Elliott Smith 6094974714 9975: Flatten Iterator Transformation Hierarchy
To improve clarity of control flow, all iterator transformations
are applied via a single class that manages an explicit stack of
named transformation objects.

patch by benedict; reviewed by branimir for CASSANDRA-9975
2015-10-26 20:59:06 +00:00
Sylvain Lebresne 89293efc7d Update current format sstables for LegacySSTableTest 2015-10-16 17:18:45 +02:00
Robert Stupp 1b823ec2c1 Ninja fix failing LegacySSTableTest 2015-09-18 12:36:26 +02:00
Robert Stupp 51b1a1c6d3 Update index file format
patch by Robert Stupp; reviewed by Ariel Weisberg for CASSANDRA-10314
2015-09-14 22:06:37 +02:00
Robert Stupp 16497fd93f ninja-fix failing LegacySSTableTest 2015-09-13 14:18:46 +02:00
Robert Stupp 0600d7dc03 CFS.loadNewSSTables() broken for pre-3.0 sstables
patch by Robert Stupp; reviewed by Blake Eggleston for CASSANDRA-10237
2015-09-11 10:49:56 +02:00
Branimir Lambov d12d2d4965 Honors commit log policy when replaying; treats errors in the last segment (section for compressed files) as permissible due to incomplete flush.
Reviewed by aweisberg for CASSANDRA-9749
2015-08-18 20:16:31 -05:00
Branimir Lambov fce8478ff4 Honors commit log policy when replaying; treats errors in the last segment (section for compressed files) as permissible due to incomplete flush.
Reviewed by aweisberg for CASSANDRA-9749
2015-08-18 20:13:26 -05:00
Stefania Alborghetti 76ca69717c 2.1 format sstable filenames with tmp are not handled by 3.0
patch by stefania; reviewed by yukim for CASSANDRA-10006
2015-08-10 20:21:47 -05:00
Marcus Olsson 0dd50a6cdc Repair common subranges of a set of nodes in one session
reviewed by Stefania Alborghetti for CASSANDRA-5220
2015-08-06 08:23:20 -05:00
Yuki Morishita df3b6027bc ScrubTest should generate out-of-order SSTable on the fly
with some other ScrubTest fixes.

patch by yukim; reviewed by Stefania Alborghetti for CASSANDRA-9880
2015-07-30 10:09:07 -05:00
Branimir Lambov 5f4cc45cdb Add upgrade tests for lz4 and snappy compressed 2.2 commit logs
patch by Branimir Lambov; reviewed by Aleksey Yeschenko for
CASSANDRA-9790
2015-07-29 20:25:48 +03:00
Stefania Alborghetti b09e60f72b Introduce safer durable sstable membership management
(and simplify cleanup of compaction leftovers)

Instead of using temporary files and system tables,
this patch introduces a simple transaction log for sstable
membership edits that can be committed/aborted atomically
and simply replayed on startup.

patch by stefania; reviewed by benedict for CASSANDRA-7066
2015-07-24 14:41:51 +01:00
Sylvain Lebresne 2457599427 Simplify some 8099's implementations
patch by slebresne; reviewed by iamalesky for CASSANDRA-9705
2015-07-22 18:05:09 +02:00
Robert Stupp 582ef4b3eb ninja-fix missing test file 2015-07-05 23:45:40 +07:00
Robert Stupp 23fd75f27c Bloom filter false positive ratio is not honoured
patch by Robert Stupp, reviewed by Benedict Elliott-Smith for CASSANDRA-8413
2015-07-05 22:14:36 +07:00
Sylvain Lebresne a991b64811 Storage engine refactor, a.k.a CASSANDRA-8099
Initial patch, see ticket for details
2015-06-30 12:47:01 +02:00
Branimir Lambov a384faaa8a Expand upgrade testing for commitlog changes
Patch by blambov; reviewed by jmckenzie for CASSANDRA-9346
2015-06-24 12:47:59 -04:00
Sam Tunnicliffe 20c5ea02c4 CASSANDRA-8049 follow up: only check versioning of *.db files at startup
patch by Sam Tunnicliffe; reviewed by Aleksey Yeschenko for
CASSANDRA-8049
2015-05-06 13:07:06 +03:00
Sam Tunnicliffe 194bad22f7 Add pre-startup checks to detect potential incompatibilities
patch by Sam Tunnicliffe; reviewed by Aleksey Yeschenko for
CASSANDRA-8049
2015-04-28 15:18:36 +03:00
Jake Luciani ae374107b7 ninja fix LegacySSTable test with new versioned files from 2.0 2014-07-09 16:21:36 -04:00
Marcus Eriksson b75ed1c34b Add missing files 2014-02-08 13:22:13 +01:00
Yuki Morishita 29d5dd03ae Fix serialization test 2014-01-14 20:23:35 -06:00
Sylvain Lebresne 362cc05352 Push composites support in the storage engine
patch by slebresne; reviewed by benedict for CASSANDRA-5417
2013-12-17 17:03:21 +01:00
Jonathan Ellis 36cdf34bd9 Remove multithreaded compaction and PCR
patch by jbellis; reviewed by marcuse for CASSANDRA-6142
2013-10-30 10:17:23 -05:00
Jonathan Ellis d493030784 add back ScrubTest
patch by Tyler Hobbs; reviewed by jbellis for CASSANDRA-5730
2013-09-26 13:19:04 -05:00
Aleksey Yeschenko bffd9ea8eb Upgrade Thrift to 0.9.1
patch by Carl Yeksigian and Jake Farrell; reviewed by Aleksey Yeschenko
for CASSANDRA-5923
2013-08-30 02:57:12 +03:00
Jake Luciani 815b2382a3 Switch from crc32 to adler32 for compressed sstable checksumns
and change to checksum the post-compressed data

Patch by tjake; reviewed by jbellis for (CASSANDRA-5862)
2013-08-08 17:23:57 -04:00
Vijay Parthasarathy 4f2fdc2e73 Fix trigger directory detection code
Patch by Vijay, reviewed by jebllis for CASSANDRA-5826
2013-08-03 11:21:07 -07:00