Commit Graph

8384 Commits

Author SHA1 Message Date
Sunil Ramchandra Pawar 7a8335c273 Optimize initial skipping logic for SAI queries on large partitions
patch by Sunil Ramchandra Pawar; reviewed by Caleb Rackliffe and David Capwell for CASSANDRA-20191
2025-05-08 14:28:07 -05:00
Szymon Miężał 6a81306876 Reading mmapped trie-index exceeding 2GiB results in exception
Memory-mapping is done in buffers of size less than 2GiB.
When these buffers aren't aligned to 4KiB and the trie-index file
spans many buffers then reading it results in going out of buffer
bounds.

This patch fixes it by making sure that the buffers are correctly
aligned.

patch by Szymon Miezal; reviewed by blambov and brandonwilliams for CASSANDRA-20351
2025-05-06 06:38:53 -05:00
Doug Rohrer 2aeb6a0290 CASSANDRA-20609 - CQLSSTableWriter should support setting the format (5.0) 2025-05-01 13:33:57 -04:00
Caleb Rackliffe 4bcae8e57e Ensure RowFilter#isMutableIntersection() properly evaluates numeric ranges on a single column
patch by Caleb Rackliffe; reviewed by Ariel Weisberg for CASSANDRA-20566
2025-04-27 09:46:59 -05:00
Dmitry Konstantinov ae82efc013 Add LittleEndianMemoryUtil and NativeEndianMemoryUtil, switch memtable-related off-heap objects and Memory to use them and have Little Endian now.
Add BE offsets detection on Summary loading.
Add test SSTables in an old format with BE offsets in Summary component to LegacySSTableTest.

Patch by Dmitry Konstantinov; reviewed by Branimir Lambov, Michael Semb Wever for CASSANDRA-20190
2025-04-24 11:45:26 +01:00
David Capwell 07831c9cc7 SAI marks an index as non-empty when a partial partition/row modifications is flushed due to repair
patch by David Capwell; reviewed by Caleb Rackliffe for CASSANDRA-20567
2025-04-23 17:58:45 -07:00
Sunil Ramchandra Pawar 97037496f2 SAI fails queries when multiple columns exist and a non-indexed column is a composite with a map
patch by Sunil Ramchandra Pawar; reviewed by Caleb Rackliffe, David Capwell for CASSANDRA-19891
2025-04-23 15:05:54 -07:00
Jon Meredith 32cfd477df Merge branch 'cassandra-4.1' into cassandra-5.0 2025-04-22 14:43:49 -06:00
Jon Meredith 2ac701629b Merge branch 'cassandra-4.0' into cassandra-4.1 2025-04-22 14:42:51 -06:00
Jon Meredith d4d858d382 Updating a column with a new TTL but same expiration time is non-deterministic and causes repair mismatches.
patch by Jon Meredith; reviewed by Marcus Eriksson for CASSANDRA-20561
2025-04-22 14:42:02 -06:00
Branimir Lambov f327b63db0 Introduce SSTableSimpleScanner for compaction
This removes the usage of index files during compaction and simplifies
and improves the performance of compaction.

patch by Branimir Lambov; reviewed by Sylvain Lebresne for CASSANDRA-20092
2025-04-19 13:21:14 -07:00
Francisco Guerrero b83fef6efa Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  allow grant permission on virtual keyspaces
2025-04-18 09:19:49 -07:00
Francisco Guerrero 60ea852811 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  allow grant permission on virtual keyspaces
2025-04-18 09:16:00 -07:00
Tibor Répási 348ffb0ba0 allow grant permission on virtual keyspaces
Patch by Tibor Répási; reviewed by Francisco Guerrero, Maxwell Guo for CASSANDRA-20171
2025-04-18 09:13:04 -07:00
Bereng 0f9bb246cd Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  CASSANDRA-19633 Replaced node is stuck in a loop calculating ranges
2025-04-14 09:23:14 +02:00
Bereng 3e2e4c3ea1 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  CASSANDRA-19633 Replaced node is stuck in a loop calculating ranges
2025-04-14 09:21:58 +02:00
Bereng fcea0b6fd8 CASSANDRA-19633 Replaced node is stuck in a loop calculating ranges 2025-04-14 09:20:33 +02:00
Caleb Rackliffe 725e4ba3eb Avoid purging deletions in RowFilter when reconciliation is required
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20541
2025-04-10 22:31:53 -05:00
Jordan West bcd5c48307 Fix test failure with negative position in ThreadLocalReadAheadBufferTest
patch by Jordan West; reviewed by Jon Haddad, Dmitry Konstantinov for CASSANDRA-20507
2025-04-10 11:39:51 -07:00
Caleb Rackliffe 4e2e5f3c57 Fixed multiple single-node SAI query bugs relating to static columns
- Ensure MemtableIndexWriter calculates min/max properly with indexes on partition key elements
- Ensure only rows with live data are indexed
- Ensure min cannot be greater than max in intersection statistics with static keys
- Correct tracking of last key in the searcher in the presence of static keys

patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20338
2025-04-08 21:58:21 -05:00
Ariel Weisberg ec00426584 Merge branch 'cassandra-4.0' into cassandra-4.1 2025-04-08 15:18:23 -04:00
Ariel Weisberg 96bfbe6250 Dropwizard Meter causes timeouts when infrequently used
patch by Ariel Weisberg; reviewed by Maxim Muzafarov for CASSANDRA-19332
2025-04-08 15:16:08 -04:00
mck 694a88bdbe
Upgrade java-driver-core to 3.12.1 and org.apache coords
patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17231
2025-04-07 15:45:39 +02:00
Blake Eggleston eaa20275ff Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Fix mixed mode paxos hang
2025-04-03 15:28:19 -07:00
Blake Eggleston cf60eb8672 Fix mixed mode paxos hang
- reinstates the mrc check from CASSANDRA-12043 for legacy paxos purging

Patch by Blake Eggleston; Reviewed by Ariel Weisberg for CASSANDRA-20514
2025-04-03 15:22:45 -07:00
Blake Eggleston 31235c4314 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  convert legacy zero ballots to 4.1 zero value on deserialization
2025-03-28 14:12:32 -07:00
Blake Eggleston 2a5749f203 convert legacy zero ballots to 4.1 zero value on deserialization
Patch by Blake Eggleston, reviewed by Alex Petrov and Ariel Weisberg for CASSANDRA-20493
2025-03-28 14:10:18 -07:00
Roxana Neophytou ab51b79473
Add LegacySSTableTest data for past sstable formats
Also add test method testVerifyOldTupleSSTables for frozen tuples and dropping of them.

The test data also adds different versions of me format sstables from C* version 3.0.25 and 3.11.11 as they do (unfortunately) differ. Test sstable files have had their sequence generation ids changed to represent the server version used to create them, while this shouldn't be necessary it is for debug purposes when sstable formats have changed between versions.

 patch by Roxana Neophytou, Mick Semb Wever; reviewed by Dmitry Konstantinov for CASSANDRA-20485

Co-authored-by: mck <mck@apache.org>
2025-03-28 12:33:28 +01:00
Dmitry Konstantinov 10f66d5ccb Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Fix CommitlogShutdownTest flakiness by testing a real drain logic instead an emulation which is affected by background activities for system tables
2025-03-27 13:12:14 +00:00
Dmitry Konstantinov 1a0ea33188 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Fix CommitlogShutdownTest flakiness by testing a real drain logic instead an emulation which is affected by background activities for system tables
2025-03-27 12:48:55 +00:00
Dmitry Konstantinov bc8941e377 Fix CommitlogShutdownTest flakiness by testing a real drain logic instead an emulation which is affected by background activities for system tables
Patch by Dmitry Konstantinov; reviewed by Josh McKenzie for CASSANDRA-19101
2025-03-27 12:19:55 +00:00
Caleb Rackliffe 1d47fab638 Serialization can lose complex deletions in a mutation with multiple collections in a row
patch by Caleb Rackliffe; reviewed by Berenguer Blasi and Abe Ratnofsky for CASSANDRA-20449
2025-03-19 12:21:47 -05:00
Tiago Alves c925228a4d
Improve error messages when initializing auth classes
patch by Tiago Alves; reviewed by Stefan Miklosovic, Maxwell Guo for CASSANDRA-20368
2025-03-17 18:37:50 +01:00
Stefan Miklosovic 9e04c7a789
Merge branch 'cassandra-4.1' into cassandra-5.0 2025-03-17 09:14:16 +01:00
Stefan Miklosovic dff453350a
Optionally skip exception logging on invalid legacy protocol magic exception
patch by Stefan Miklosovic; reviewed by David Capwell, Brad Schoening for CASSANDRA-19483
2025-03-17 09:12:21 +01:00
Ariel Weisberg b17e4ee88a Fix SSTableReader interval mock in UnifiedCompactionStrategyTest
patch by Ariel Weisberg; reviewed by Caleb Rackliffe for CASSANDRA-20437
2025-03-14 14:04:59 -04:00
Caleb Rackliffe 740d6d0805 Prioritize legacy 2i over SAI for columns with multiple indexes
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20334
2025-03-13 12:15:25 -05:00
Dmitry Konstantinov c4eb9a3aad Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
2025-03-13 14:24:48 +00:00
Dmitry Konstantinov f711292902 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Disable role and network permission caches to avoid interference between test methods
2025-03-13 14:15:33 +00:00
Dmitry Konstantinov 8cb58bf97a Disable role and network permission caches to avoid interference between test methods
Patch by Dmitry Konstantinov; reviewed by TBD for CASSANDRA-20423
2025-03-13 13:37:20 +00:00
Caleb Rackliffe aee3c7531b Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Support null column value tombstones in FQL batch statements
2025-03-06 11:16:57 -06:00
Caleb Rackliffe 985e121404 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Support null column value tombstones in FQL batch statements
2025-03-06 11:09:01 -06:00
Caleb Rackliffe f375a3914f Support null column value tombstones in FQL batch statements
patch by Caleb Rackliffe; reviewed by Abe Ratnofsky for CASSANDRA-20397
2025-03-06 10:56:49 -06:00
Stefan Miklosovic 4f382d93f5
Merge branch 'cassandra-4.1' into cassandra-5.0 2025-03-06 14:27:06 +01:00
Stefan Miklosovic 16bca9d343
Merge branch 'cassandra-4.0' into cassandra-4.1 2025-03-06 14:23:11 +01:00
Stefan Miklosovic ef354d0d5e
Update Zstd library to 1.5.7-1
patch by Stefan Miklosovic; reviewed by Yifan Cai for CASSANDRA-20367
2025-03-06 14:19:01 +01:00
Jordan West a09d5240ab Add read ahead buffer for scans of compressed data files
Patch by Jordan West, Jon Haddad; Reviewed by David Capwell, Caleb Rackliffe, Dmitry Konstantinov for CASSANDRA-15452
2025-03-05 15:37:07 -08:00
Ariel Weisberg 4edf79a263 Ninja add missing license to IntervalTreeTest 2025-03-04 18:58:16 -05:00
Ariel Weisberg 20562d10a0 Improve IntervalTree build throughput
patch by Ariel Weisberg; reviewed by Marcus Eriksson for CASSANDRA-19596
2025-03-04 17:10:43 -05:00
Caleb Rackliffe 5483165938 Avoid limit on RFP fetch in the case of an unresolved static row
patch by Caleb Rackliffe; reviewed by David Capwell and Zhao Yang for CASSANDRA-20323
2025-02-26 17:41:15 -06:00
Stefan Miklosovic 378c93de90
Include materialized views to the output of DESCRIBE TABLE statements
patch by Stefan Miklosovic; reviewed by Brandon Williams for CASSANDRA-20365
2025-02-25 09:39:44 +01:00
Caleb Rackliffe bd99331bf2 Avoid fetching entire partitions on unresolved static rows in RFP when no static column predicates exist
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20243
2025-02-12 17:29:22 -06:00
Bereng 026f73eacb Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Long running repairs autofail prematurely
2025-02-12 11:14:49 +01:00
Bereng fc232f45f0 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Long running repairs autofail prematurely
2025-02-12 11:12:53 +01:00
Bereng 914046ae46 Long running repairs autofail prematurely
patch by Berenguer Blasi; reviewed by Bernardo Botella Corbi, Michael Semb Wever for CASSANDRA-20312
2025-02-12 11:09:14 +01:00
Caleb Rackliffe f28a16740a Avoid indexing empty values for non-literals and types that do not allow them
patch by Caleb Rackliffe; reviewed by David Capwell and Andres de la Peña for CASSANDRA-20313

Co-authored-by: Caleb Rackliffe <calebrackliffe@gmail.com>
Co-authored-by: Andres de la Peña <a.penya.garcia@gmail.com>
2025-02-11 14:49:53 -06:00
Stefan Miklosovic 881a1f023f
Fix incorrect results of min / max in-built functions on clustering columns in descending order
Not unwrapping returnType has consequences of not
returning the correct results when using aggregate in-built functions
(max / min) on clustering columns having descending order.

The safest solution, is to unwrap returnType "at source"
and work with unwrapped type only since then.

patch by Stefan Miklosovic; reviewed by David Capwell for CASSANDRA-20295
2025-02-07 23:18:40 +01:00
Dmitry Konstantinov 11480a8b08 Wait for completion of async dumpMemtable in CommitLogTestCQL
Patch by Dmitry Konstantinov; reviewed by brandonwilliams and
smiklosovic for CASSANDRA-20298
2025-02-07 15:36:48 -06:00
Caleb Rackliffe 953ab6cf64 Avoid possible consistency violations for SAI intersection queries over repaired index matches and multiple non-indexed column matches
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20189
2025-02-06 13:32:39 -06:00
Sam Tunnicliffe 066c489d76 Tighten up permissions on system keyspaces
* Restrict which permissions can be granted on system keyspaces
* Ensure that GRANT... ON ALL KEYSPACES excludes system keyspaces
* Add system_traces to the always readable set

Patch by Sam Tunnicliffe and Francisco Guerrero; reviewed by Sam
Tunnicliffe and Francisco Guerrero for CASSANDRA-20090

Note: this is a re-application of the commit to cassandra-4.0 only,
to fix a bad merge the first time around.

Co-authored-by: Francisco Guerrero <frankgh@apache.org>
2025-02-06 09:13:03 +00:00
Caleb Rackliffe a118a704cb Avoid under-skipping during intersections when an iterator has mixed STATIC and WIDE keys
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20258
2025-02-03 16:02:43 -06:00
Josh McKenzie a9f2c7f4ba Merge branch 'cassandra-4.1' into cassandra-5.0
# Conflicts:
#	CHANGES.txt
2025-02-03 11:00:11 -05:00
Dmitry Konstantinov 68b7425332 WaitQueue.Signal.awaitUninterruptibly may block forever if invoking thread is interrupted
Patch by Dmitry Konstantinov; reviewed by Benedict Elliott Smith and Josh McKenzie for CASSANDRA-20084
2025-02-03 10:58:56 -05:00
Caleb Rackliffe 225eb2feeb Correct the default behavior of compareTo() when comparing WIDE and STATIC PrimaryKeys
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20238
2025-01-27 15:05:44 -06:00
Stefan Miklosovic 0d420a0df4
Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-27 08:26:53 +01:00
Stefan Miklosovic 85647ceadb
Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-27 08:23:35 +01:00
Stefan Miklosovic 6207a305ba
Tighten up permissions in dc authorizers
patch by Stefan Miklosovic; reviewed by Francisco Guerrero for CASSANDRA-20225
2025-01-26 17:52:09 +01:00
David Capwell 975c309eee Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-24 15:00:52 -08:00
David Capwell 935effb7e0 Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-24 14:59:34 -08:00
David Capwell 3ddccf4521 CBUtil serialization of UTF8 does not handle all UTF8 properly
patch by David Capwell; reviewed by Yifan Cai for CASSANDRA-20234
2025-01-24 14:56:44 -08:00
Marcus Eriksson 751d3f24cf
Make sure we can set parameters when configuring CassandraCIDRAuthorizer
patch by Marcus Eriksson; reviewed by Stefan Miklosovic for CASSANDRA-20220
2025-01-22 01:08:14 +01:00
Blake Eggleston 0cc7a03523 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Use mutation creation time for hint expiry rather than hint submission time
2025-01-21 12:13:37 -08:00
Blake Eggleston 246e65e69c Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Use mutation creation time for hint expiry rather than hint submission time
2025-01-21 12:10:53 -08:00
Matt Byrd 4f0ad22f12 Use mutation creation time for hint expiry rather than hint submission time
patch by Matt Byrd; reviewed by Chris Lohfink, reviewed by Blake Eggleston for CASSANDRA-20014
2025-01-21 12:05:00 -08:00
Sunil Ramchandra Pawar 79630fb42a Add selected SAI index state and query performance metrics to nodetool tablestats
patch by Sunil Ramchandra Pawar; reviewed by Caleb Rackliffe, Matt Byrd, and Maxim Muzafarov for CASSANDRA-20026
2025-01-17 12:24:27 -06:00
Sam Tunnicliffe 217490bdd8 Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-17 09:09:56 +00:00
Sam Tunnicliffe d14d16926e Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-17 09:08:09 +00:00
Brandon Williams ba73f7ce34 Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-16 13:54:12 -06:00
Brandon Williams 18c777f641 Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-16 13:53:59 -06:00
Kristijonas Zalys 7ffbd714b4 Set setIsShutdownUnsafeForTests(true) in dtests to fix shutdown race condition
Patch by Kristijonas Zalys, reviewed by brandonwilliams and mck for
CASSANDRA-18440
2025-01-16 13:52:51 -06:00
Sam Tunnicliffe 332341b9b6 Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-13 09:50:38 +00:00
Dmitry Konstantinov 6f90e962f5 Enforce CQL message size limit on multiframe messages
Patch by Dmitry Konstantinov; reviewed by Sam Tunnicliffe,
Caleb Rackliffe for CASSANDRA-20052
2025-01-13 09:47:37 +00:00
Caleb Rackliffe 184887069f Remove v30 and v3X from 5.x in-JVM upgrade tests
patch by Caleb Rackliffe; reviewed by Mick Semb Wever and Brandon Williams for CASSANDRA-20103
2025-01-10 13:13:12 -06:00
Brandon Williams 02755193f9 Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-08 13:40:55 -06:00
Brandon Williams 0edd63287b Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-08 13:40:41 -06:00
Brandon Williams b074675c37 Add in-jvm dtest for durable writes
Patch by brandonwilliams; reviewed by smiklosovic for CASSANDRA-19601
2025-01-08 13:40:02 -06:00
David Capwell 8125a69480 Merge branch 'cassandra-4.1' into cassandra-5.0 2025-01-07 17:45:52 -08:00
David Capwell 4da92af589 Merge branch 'cassandra-4.0' into cassandra-4.1 2025-01-07 17:40:39 -08:00
Sunil Ramchandra Pawar 4fc8bb29fc IndexOutOfBoundsException when accessing partition where the column was deleted
patch by Sunil Ramchandra Pawar; reviewed by Caleb Rackliffe, David Capwell for CASSANDRA-20108
2025-01-07 17:38:20 -08:00
Dmitry Konstantinov 4ae1aee39b
Avoid memory allocation in NativeCell.valueSize() and NativeClustering.dataSize()
patch by Dmitry Konstantinov; reviewed by Branimir Lambov, Mick Semb Wever for CASSANDRA-20162
2025-01-04 21:55:31 +01:00
Marcus Eriksson f9ab5cf797 Add flag to avoid invalidating key cache on sstable deletions
Patch by marcuse; reviewed by Caleb Rackliffe for CASSANDRA-20068
2024-12-11 10:27:11 +01:00
Caleb Rackliffe 2651623af6 Interpret inet, bigint, varint, and decimal as non-reversed types for query construction and post-filtering
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20100
2024-12-09 15:06:02 -06:00
Yifan Cai 1655578ae8 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Enhance CQLSSTableWriter to notify client on sstable production
2024-11-22 14:59:16 -08:00
Yifan Cai c44008e9e4 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Enhance CQLSSTableWriter to notify client on sstable production
2024-11-22 14:57:36 -08:00
Yifan Cai 659558c980 Enhance CQLSSTableWriter to notify client on sstable production
Patch by Yifan Cai; Reviewed by Francisco Guerrero for CASSANDRA-19800
2024-11-22 14:49:22 -08:00
Caleb Rackliffe 376fe2a9fe Streamline the serialized format for index status gossip messages
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-20058
2024-11-21 14:59:38 -06:00
Mick Semb Wever 0d9d67bcb1
Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  A node should always return back the full information about itself for gossip regardless the asked heartbeat version
2024-11-19 00:49:52 +01:00
Mick Semb Wever 7559e2708a
Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  A node should always return back the full information about itself for gossip regardless the asked heartbeat version
2024-11-19 00:38:23 +01:00
Runtian Liu 426eebb513
A node should always return back the full information about itself for gossip regardless the asked heartbeat version
patch by Runtian Liu; reviewed by Brandon Williams, Michael Semb Wever for CASSANDRA-19983
2024-11-19 00:23:45 +01:00
Bereng af140beee5 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Flaky PstmtPersistenceTest take 2
2024-11-15 13:25:40 +01:00
Bereng 364b641abc Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Flaky PstmtPersistenceTest take 2
2024-11-15 13:19:36 +01:00
Bereng f3c29e08fa Flaky PstmtPersistenceTest take 2
patch by Berenguer Blasi; reviewed by Stefan Miklosovic for CASSANDRA-20055
2024-11-15 13:17:12 +01:00
Bereng 022002531d Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Flaky PstmtPersistenceTest
2024-11-11 09:47:11 +01:00
Bereng 4acce2af89 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Flaky PstmtPersistenceTest
2024-11-11 09:45:33 +01:00
Bereng 7ba691e3d3 Flaky PstmtPersistenceTest
patch by Berenguer Blasi; reviewed by Stefan Miklosovic for CASSANDRA-20055
2024-11-11 09:43:31 +01:00
Stefan Miklosovic 0f590133f8
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-11-06 22:27:28 +01:00
Josh McKenzie 8ea70cd1f0
Backport of CASSANDRA-17812: Rate-limit new client connection auth setup to avoid overwhelming bcrypt
This backport differs from CASSANDRA-17812 in such a way that by default the number
of auth request threads is set to 0. That will route all requests to request executor as before this change.
The patch in 5.0 and later sets the default number of auth request threads to 4.

patch by Josh McKenzie; reviewed by Chris Lohfink for CASSANDRA-20057

Co-authored-by: Stefan Miklosovic <smiklosovic@apache.org>
2024-11-06 22:23:16 +01:00
Stefan Miklosovic 4b6dcf873b
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-11-06 14:37:18 +01:00
Stefan Miklosovic 17418a2ba0
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-11-06 14:33:00 +01:00
Stefan Miklosovic 6093c2d99b
Support UDTs and vectors as clustering keys in descending order
patch by Stefan Miklosovic; reviewed by David Capwell for CASSANDRA-20050
2024-11-06 14:28:48 +01:00
Stefan Miklosovic 008d04d8df
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-11-06 09:55:16 +01:00
Stefan Miklosovic 521891c196
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-11-06 09:47:00 +01:00
Stefan Miklosovic 181ddc0600
Fix CQL in snapshot's schema which did not contained UDTs used as reverse clustering columns
patch by Stefan Miklosovic; reviewed by David Capwell for CASSANDRA-20036
2024-11-06 09:41:45 +01:00
mck 34bed3df49
Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Add nodetool checktokenmetadata command that checks TokenMetadata is insync with Gossip endpointState
2024-11-05 22:46:27 +01:00
jaydeepkumar1984 e5c919f273
Add nodetool checktokenmetadata command that checks TokenMetadata is insync with Gossip endpointState
patch by Jaydeepkumar Chovatia; reviewed by Brandon Williams, Mick Semb Wever for CASSANDRA-18758
2024-11-05 22:42:28 +01:00
Bereng 0e11be9ce6 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  CASSANDRA-19986 Prepared statements cache computation improvements
2024-11-04 10:02:47 +01:00
Bereng 94c2a09772 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  CASSANDRA-19986 Prepared statements cache computation improvements
2024-11-04 10:00:03 +01:00
Bereng ff54fd5ffd CASSANDRA-19986 Prepared statements cache computation improvements
patch by Berenguer Blasi; reviewed by Maxwell Guo, Stefan Miklosovic for CASSANDRA-19986
2024-11-04 09:56:32 +01:00
Sam Tunnicliffe 8153a0b321 Merge branch 'cassandra-4.1' into cassandra-5.0 2024-11-01 19:01:16 +00:00
David Capwell 28759d8bbc CEP-10: Simulator Java11 Support (backport to cassandra-4.1)
patch by David Capwell; reviewed by Benedict Elliott Smith, Ekaterina Dimitrova for CASSANDRA-17178
backported to 4.1 in CASSANDRA-19935
2024-11-01 18:59:05 +00:00
Sam Tunnicliffe 9ff31e8060 Equality check for Paxos.Electorate should not depend on collection types
Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson for CASSANDRA-19935
2024-11-01 18:53:22 +00:00
Bereng 5e4ff921af Add extra compaction junit
patch by Berenguer Blasi; reviewed by Branimir Lambov, Michael Semb Wever for CASSANDRA-19863
2024-10-24 08:13:05 +02:00
mck 2801ed3366
Add new cassandra_latest.yaml entries to latest tests
Both CASSANDRA-18120 and CASSANDRA-19946 updated cassandra_latest.yaml but not the corresponding test configs

 patch by Mick Semb Wever; reviewed by Brandon Williams, Tiago L. Alves for CASSANDRA-20002
2024-10-19 09:42:54 +02:00
Bereng 38857dc047 Add extra compaction junit
patch by Berenguer Blasi; reviewed by Branimir Lambov for CASSANDRA-19863
2024-10-16 13:36:13 +02:00
mck dcff5a0fad
Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Add configurable batchlog endpoint strategies
2024-10-15 13:43:31 +02:00
mck 26bf80706b
Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Add configurable batchlog endpoint strategies
2024-10-15 13:38:12 +02:00
shunsaker b8c5436293
Add configurable batchlog endpoint strategies
Batchlog endpoint strategy was previously only random placements on other racks.  Options now are random_remote, prefer_local, dynamic_remote, and dynamic.

 patch by Shayne Hunsaker; reviewed by Mick Semb Wever, Brandon Williams for CASSANDRA-18120
2024-10-15 13:34:40 +02:00
Caleb Rackliffe 019c9118d4 Use SinglePartitionReadCommand for index queries that use strict filtering
patch by Caleb Rackliffe; reviewed by Ariel Weisberg for CASSANDRA-19968
2024-10-11 15:25:02 -05:00
Caleb Rackliffe 176ce395bb Always write local expiration time as an int to LivenessInfo digest
patch by Caleb Rackliffe; reviewed by Mick Semb Wever, David Capwell, and Marcus Eriksson for CASSANDRA-19989
2024-10-11 11:39:20 -05:00
Tiago Alves 50d94f4b46
Enables IAuthenticator's to return own AuthenticateMessage
Allows custom implementations of IAuthenticator to return their own
AuthenticateMessage based on ClientState information.

ClientState contains information about driver's name and version which
could be used to determine the contents of the AuthenticateMessage that
is sent back to the clients. This enables, for instance, returning
driver's known authenticator implementations (e.g. DseAuthenticator)
which enables SASL negotiation.

 patch by Tiago Alves; reviewed by Mick Semb Wever, Andy Tolbert for CASSANDRA-19984
2024-10-11 14:31:44 +02:00
Stefan Miklosovic 0e5aa9b912
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-10-10 09:33:56 -06:00
Stefan Miklosovic dbc87a44d1
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-10-10 09:31:20 -06:00
Dmitry Konstantinov d939e40dfb
Fix flakiness of TopPartitionsTest
patch by Dmitry Konstantinov; reviewed by Stefan Miklosovic, Berenguer Blasi for CASSANDRA-19991
2024-10-10 08:11:11 -06:00
Tiago Alves 2dea5c7588
Use ParameterizedClass for all auth-related implementations
Uses ParameterizedClass for IAuthorizer, INetworkAuthorizer, and
IRoleManager implementations enabling those to be configurable from
parameters specified directly in cassandra.yaml.

Opportunistically makes consistent the initialization and setting of
all auth-related implementations and removes code duplication.

Notes:
 * IInternodeAuthenticator implementations are expected to be set as
   default directly in DatabaseDescriptor instead of done via
   AuthConfig.applyAuth(). This is assumed in tests and client logic.
   For instance ReconnectableSnitchHelperTest fetches this authenticator
   before calling daemonInitialize(). Also, BulkLoader fetches this
   directly when creating an outbound connection.
 * Changing this behavior in BulkLoader causes a cascade of changes.
   First, one would need to add AuthConfig.applyAuth() directly in
   clientInitialize() and then would need to enable all the additional
   classes that this change causes. Long term this might be justified
   as if we're depending on the auth logic to be properly set. However,
   in the context of this change it was decided to postpone further
   changes.
 * Standardize auth-related configurations by using a short-form with
   the class name instead of the full qualified class name containing
   the package name.

 patch by Tiago Alves; reviewed by Mick Semb Wever, Stefan Miklosovic for CASSANDRA-19946
2024-10-09 13:51:51 +02:00
Maxim Muzafarov 9dfcfaee65 Merge branch 'cassandra-4.1' into cassandra-5.0 2024-10-02 15:30:20 +02:00
Maxim Muzafarov ad4ad5ef5a Fix race condition in DecayingEstimatedHistogramReservoir during rescale
patch by Maxim Muzafarov; reviewed by Caleb Rackliffe for CASSANDRA-19365

Co-authored-by: Jakub Zytka <jakub.zytka@datastax.com>
2024-10-02 15:14:20 +02:00
Stefan Miklosovic 07c1f93b06
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-09-27 14:06:25 +02:00
Stefan Miklosovic e5ea7c950e
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-09-23 17:09:25 +02:00
Stefan Miklosovic 2bcd68f8be
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-09-23 17:07:49 +02:00
Sunil Ramchandra Pawar 06a05ccde5
Fix indexing of a frozen collection that is the clustering key and reversed
patch by Sunil Ramchandra Pawar; reviewed by David Capwell, Stefan Miklosovic for CASSANDRA-19889
2024-09-23 17:06:46 +02:00
Stefan Miklosovic 703dd13a54
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-09-18 23:10:10 +02:00
Stefan Miklosovic 7b1eb1f0b7
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-09-18 22:48:54 +02:00
Stefan Miklosovic 39b1c2df89
Emit error when altering a table with non-frozen UDTs with nested non-frozen collections the same way as done upon table creation
patch by Stefan Miklosovic; reviewed by Maxim Muzafarov for CASSANDRA-19925
2024-09-18 22:44:39 +02:00
Bereng f26457afe4 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Add extra compaction junit
2024-09-18 08:47:35 +02:00
Bereng 5e37fcde46 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Add extra compaction junit
2024-09-18 08:45:01 +02:00
Bereng 366ee9da6c Add extra compaction junit
patch by Berenguer Blasi; reviewed by Branimir Lambov for CASSANDRA-19863
2024-09-18 08:41:42 +02:00
Caleb Rackliffe 2c94b27bed Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Safer handling of out-of-range tokens
2024-09-17 17:21:16 -05:00
Caleb Rackliffe 8670d98498 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Safer handling of out-of-range tokens
2024-09-17 17:09:57 -05:00
Caleb Rackliffe b4f1c6d250 Safer handling of out-of-range tokens
patch by Caleb Rackliffe; reviewed by Mick Semb Wever for CASSANDRA-13704

Co-authored-by: Sam Tunnicliffe <sam@beobal.com>
Co-authored-by: Caleb Rackliffe <calebrackliffe@gmail.com>
Co-authored-by: Mick Semb Wever <mck@apache.org>
Co-authored-by: Ariel Weisberg <aweisberg@apple.com>
2024-09-17 17:04:11 -05:00
Brandon Williams 2cd5515c12 Merge branch 'cassandra-4.1' into cassandra-5.0 2024-09-16 12:25:42 -05:00
Brandon Williams a5b4fbc64c Merge branch 'cassandra-4.0' into cassandra-4.1 2024-09-16 12:25:02 -05:00
Benedict Elliott Smith 2842c01ce7 Fix BTree.FastBuilder.reset() and test
Patch by benedict; reviewed by blambov for CASSANDRA-19785
2024-09-16 12:24:32 -05:00
Stefan Miklosovic 78ab095c87
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-09-15 20:05:52 +02:00
Stefan Miklosovic 48eab9afd8
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-09-15 19:57:53 +02:00
maxwellguo 9f18aab1dc
Fix millisecond and microsecond precision for commit log replay
patch by Maxwell Guo; reviewed by Brandon Williams, Stefan Miklosovic for CASSANDRA-19448
2024-09-13 15:42:20 +02:00
Stefan Miklosovic ddb01d2f8e
CASSANDRA-19911 Remove MemtableSizeTest
This is a ninja / leftover from CASSANDRA-17298, we replaced this test but
forgot to remove it as was done in other branches.
2024-09-12 08:56:30 +02:00
Stefan Miklosovic 971747e3e2
Make configuration entries in memtable section order-independent
patch by Stefan Miklosovic; reviewed by David Capwell for CASSANDRA-19906

Co-authored-by: David Capwell <dcapwell@apache.org>
2024-09-11 08:37:59 +02:00
Stefan Miklosovic c76fae6a8e
Merge branch 'cassandra-4.1' into cassandra-5.0
This merge just removes LongToken from SkipListMemtable and it replaces it with
a partitioner-agnostic DatabaseDescriptor.getPartitioner().getRandomToken().
The issues in 4.0 / 4.1 are not present in later branches anymore however we
identified that the changes done in 5.0+ are welcome so we included them as well.
2024-09-10 10:09:59 +02:00
Stefan Miklosovic 6ec8c5bb81
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-09-10 10:00:38 +02:00
Dmitry Konstantinov c56ba3b317
Improve accuracy of memtable heap usage tracking
Fix estimateRowOverhead in Memtable: ByteBuffer in Partition key was not counted
Fix non-counted size of "columns" field in Columns.unsharedHeapSize
BTree.sizeOfStructureOnHeap wrongly reported a non-zero size for EMPTY_LEAF shared constant value
Fix MemtableSizeTest flakeness by not measuring of allocator and ColumnFamilyStore/Keyspace

Patch by Dmitry Konstantinov; reviewed by Branimir Lambov, Stefan Miklosovic for CASSANDRA-17298
2024-09-09 12:00:11 +02:00
Abe Ratnofsky b4894226c5 Add guardrail for enabling usage of VectorType
patch by Abe Ratnofsky; reviewed by Caleb Rackliffe, David Capwell for CASSANDRA-19903
2024-09-06 15:19:03 -07:00
Jacek Lewandowski 2521b83c92 Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Fix rendering UNSET collection types in query tracing
2024-08-30 10:41:41 +02:00
Jacek Lewandowski 505aff4517 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Fix rendering UNSET collection types in query tracing
2024-08-30 10:41:39 +02:00
Lukasz Antoniak c53d3ac8c6 Fix rendering UNSET collection types in query tracing
Patch by Lukasz Antoniak reviewed by Jacek Lewandowski for CASSANDRA-19880
2024-08-30 10:41:38 +02:00
Ariel Weisberg f7d407ba31 Merge branch 'cassandra-4.1' into cassandra-5.0 2024-08-21 16:04:44 -04:00
Ariel Weisberg 02f38208b1 Merge branch 'cassandra-4.0' into cassandra-4.1 2024-08-21 16:03:51 -04:00
Dmitry Konstantinov 6da9141d3c Fix latency reported by ideal consistency level monitoring
patch by Dmitry Konstantinov; reviewed by Ariel Weisberg for CASSANDRA-19651
2024-08-21 16:01:46 -04:00
Caleb Rackliffe 5abe213ad0 Streamline tests based on RandomIntersectionTester
patch by Caleb Rackliffe; reviewed by Stefan Miklosovic for CASSANDRA-19823
2024-08-16 13:57:24 -05:00
Maxwell Guo a846987533
Throw ConfigurationException when commitlog_disk_access_mode is direct but direct IO is not supported by filesystem
patch by Maxwell Guo; reviewed by Branimir Lambov, Stefan Miklosovic for CASSANDRA-19812
2024-08-16 09:00:37 +02:00
Caleb Rackliffe 47fe3a12cf Merge branch 'cassandra-5.0.0' into cassandra-5.0
* cassandra-5.0.0:
  Use default commitlog settings in test YAMLs
2024-08-15 11:09:43 -05:00
Caleb Rackliffe c91ffe8a9f Merge branch 'cassandra-4.1' into cassandra-5.0.0
* cassandra-4.1:
  Use default commitlog settings in test YAMLs
2024-08-15 10:49:50 -05:00
Caleb Rackliffe e5fc9b3e14 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Use default commitlog settings in test YAMLs
2024-08-15 10:19:46 -05:00
Caleb Rackliffe 93415c91af Use default commitlog settings in test YAMLs
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-19830
2024-08-15 10:12:39 -05:00
David Capwell b4087b7f5b Merge branch 'cassandra-5.0.0' into cassandra-5.0 2024-08-14 14:50:41 -07:00
David Capwell 3afa2585d9 Memtable allocation type unslabbed_heap_buffers_logged will cause an assertion error for TrieMemtables and SegmentedTrieMemtables
patch by David Capwell; reviewed by Brandon Williams, Caleb Rackliffe for CASSANDRA-19835
2024-08-14 14:49:51 -07:00
Alex Petrov ff3e5ab76d Ninja: Fix test merge after fixing CASSANDRA-19534 2024-08-09 19:56:15 +02:00
Stefan Miklosovic 9a13a75940
Merge branch 'cassandra-5.0.0' into cassandra-5.0 2024-08-09 13:53:01 +02:00
Stefan Miklosovic aca11d4fc3
Fix tests extending FuzzTestBase when running test-compression profile
patch by Stefan Miklosovic; reviewed by Michael Semb Wever for CASSANDRA-19820
2024-08-09 13:44:03 +02:00
Stefan Miklosovic e2495e182f
Merge branch 'cassandra-5.0.0' into cassandra-5.0 2024-08-05 00:51:06 +02:00
Stefan Miklosovic 5ab976d796
Fix direct IO support always being evaluated to false upon the first start of a node
patch by Stefan Miklosovic; reviewed by Branimir Lambov, Maxwell Guo for CASSANDRA-19779
2024-08-04 23:59:35 +02:00
Arun Ganesh 273975ef26 Prioritize built indexes in IndexStatusManager
Patch by Arun Ganesh; reviewed by Caleb Rackliffe and Zhao Yang for CASSANDRA-19400
2024-07-24 15:28:19 -05:00
Stefan Miklosovic 52a513f724
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-07-10 10:47:09 +02:00
Stefan Miklosovic 31e2edf052
Merge branch 'cassandra-4.0' into cassandra-4.1 2024-07-10 10:42:39 +02:00
Stefan Miklosovic a5767a5834
Fix schema.cql created by a snapshot after dropping more than one column
patch by Stefan Miklosovic; reviewed Benjamin Lerer, Francisco Guerrero for CASSANDRA-19747
2024-07-10 10:34:54 +02:00
Sam Tunnicliffe d45d87f125 Merge branch 'cassandra-4.1' into cassandra-5.0 2024-07-10 09:25:19 +01:00
Sam Tunnicliffe 1cd0b38214 Revert to localised start time for coordinator read latency measurement
Patch by Sam Tunnicliffe; reviewed by Marcus Ericsson for
CASSANDRA-19755
2024-07-10 09:17:55 +01:00
Stefan Miklosovic 63b4e1c41c
Merge branch 'cassandra-4.1' into cassandra-5.0 2024-07-09 17:09:30 +02:00
Stefan Miklosovic a878adfc89
Do not create a role if ALTER ROLE IF EXISTS operates on non-existing role
patch by Stefan Miklosovic; reviewed by Brandon Williams for CASSANDRA-19749
2024-07-09 17:03:25 +02:00
Caleb Rackliffe 1bec8b99ca Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  UnsupportedOperationException when reducing scope for LCS compactions
2024-07-02 14:27:36 -05:00
Caleb Rackliffe f378f92030 Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  UnsupportedOperationException when reducing scope for LCS compactions
2024-07-02 14:13:30 -05:00
Marcus Eriksson d54646e409 UnsupportedOperationException when reducing scope for LCS compactions
patch by Caleb Rackliffe; reviewed by Zhao Yang, Brandon Williams, and Marcus Eriksson for CASSANDRA-19704

Co-authored-by: Marcus Eriksson <marcuse@apache.org>
Co-authored-by: Caleb Rackliffe <calebrackliffe@gmail.com>
2024-07-02 13:35:34 -05:00
Benjamin Lerer 43d99c2259 Merge branch cassandra-4.1 into cassandra-5.0 2024-06-27 12:36:18 +02:00
Benjamin Lerer ef8bc82f1b Merge branch cassandra-4.0 into cassandra-4.1 2024-06-27 12:27:55 +02:00
Benjamin Lerer 90208c0a29 Makes LWT conditions behavior on frozen and non-frozen columns consistent for null column values
Patch by Benjamin Lerer; review by Ekaterina Dimitrova for CASSANDRA-19637
2024-06-27 10:15:03 +02:00
Marcus Eriksson cfdeef43b3 Lower the number of tables and repairs to avoid timeouts in ClearSnapshotTest
Patch by marcuse; reviewed by Sam Tunnicliffe for CASSANDRA-19070

backported to 5.0 in CASSANDRA-19622
2024-06-20 13:19:31 -05:00
Benedict Elliott Smith 53b06453b7 Refresh stale paxos commit
patch by Benedict Elliott Smith; review by Blake Eggleston for CASSANDRA-19617
2024-06-11 15:24:57 +02:00
Benedict Elliott Smith 8c165b4cc0 Refresh stale paxos commit
patch by Benedict Elliott Smith; review by Blake Eggleston for CASSANDRA-19617
2024-06-10 18:37:08 +02:00
Brandon Williams 258a04a361 Ninja remove unused imports 2024-06-04 08:26:10 -05:00
Alex Petrov 617a75843c Merge branch 'cassandra-4.1' into cassandra-5.0 2024-05-31 11:24:37 +02:00
Alex Petrov dc17c29724 Add native transport deadline, an ultimate deadline for all tasks related to a specific request
* Add an ability to base _replica_ side queries on the queue time
      * Use queue time as a base for message timeouts
      * Use native transport deadline for internode messages
      * Make sure that local runnables respect transport timeouts and deadlines
      * Make sure that remote mutation handler respects message expiration times

Patch by Alex Petrov; reviewed by Caleb Rackliffe for CASSANDRA-19534
2024-05-31 11:10:58 +02:00