Commit Graph

32073 Commits

Author SHA1 Message Date
Dmitry Konstantinov 480320f3cf Expose immediately-executed tasks in the queries virtual table
SEPExecutor.maybeExecuteImmediately() runs a task synchronously on the
calling worker thread, nested within the task the worker is already
running. Such immediate tasks were invisible in system_views.queries, which only exposed each worker's primary running task.
This is common on the coordinator path, where a local read or mutation is executed immediately within the enclosing QUERY task.

Each SEPWorker now also tracks an immediate current task, set around
maybeExecuteImmediately(), and exposes it as an additional
DebuggableTaskRunner, so the queries table reports both the enclosing
task and the immediate one as separate rows.

patch by Dmitry Konstantinov; reviewed by Caleb Rackliffe for CASSANDRA-21471
2026-07-09 09:22:10 +01:00
Sam Tunnicliffe 1332e217f9 Merge branch 'cassandra-6.0' into trunk 2026-07-08 15:36:49 +01:00
Sam Tunnicliffe 1df3a8cef0 Setup async transformation before making internode request
Patch by Sam Tunnicliffe and Dmitry Konstantinov; reviewed by Sam
Tunnicliffe and Dmitry Konstantinov for CASSANDRA-21384

Co-authored-by: Dmitry Konstantinov <netudima@gmail.com>
2026-07-08 15:35:09 +01:00
Sam Tunnicliffe 6bee931da9 Merge branch 'cassandra-6.0' into trunk 2026-07-06 11:53:17 +01:00
Sam Tunnicliffe e1e56e5d5d Add CMS membership directly to ClusterMetadata
Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson for
CASSANDRA-20736
2026-07-06 11:52:18 +01:00
Stefan Miklosovic 50ddce8455
Merge branch 'cassandra-6.0' into trunk 2026-07-03 11:15:03 +02:00
Stefan Miklosovic 15f139b91e
Merge branch 'cassandra-5.0' into cassandra-6.0 2026-07-03 11:08:42 +02:00
arvindksi274-ksolves 464b2e54f4
Support Python 3.12 and 3.13 in cqlsh
patch by Arvind Kandpal; reviewed by Stefan Miklosovic, Michael Semb Wever for CASSANDRA-20997
2026-07-03 11:02:14 +02:00
Caleb Rackliffe 9783cfeb73 Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Make synchronization on VectorMemoryIndex inserts more granular
2026-07-02 16:09:18 -05:00
Caleb Rackliffe bf4437296b Merge branch 'cassandra-5.0' into cassandra-6.0
* cassandra-5.0:
  Make synchronization on VectorMemoryIndex inserts more granular
2026-07-02 15:50:45 -05:00
Caleb Rackliffe 448d98ce31 Make synchronization on VectorMemoryIndex inserts more granular
patch by Caleb Rackliffe; reviewed by David Capwell for CASSANDRA-21160

Co-authored-by: Caleb Rackliffe <calebrackliffe@gmail.com>
Co-authored-by: David Capwell <dcapwell@apache.org>
2026-07-02 15:22:41 -05:00
Mick Semb Wever a44720c779
Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Fix publishing to ASF Nexus of Accord artefacts when release staging
2026-07-01 19:29:25 +02:00
Mick Semb Wever 5282f81d0a
Fix publishing to ASF Nexus of Accord artefacts when release staging
Also fail the build if any artefacts fail to upload.

 patch by mick semb wever; reviewed by David Capwell for CASSANDRA-21261
2026-07-01 19:25:15 +02:00
Sam Tunnicliffe 807cb652fb Merge branch 'cassandra-6.0' into trunk 2026-07-01 14:39:03 +01:00
Jon Meredith b1f30e94f5 Move long running TCM operations to a longer timout
Replaces the fixed-retry commit loop with deadline-based exponential
backoff for long running CMS commit operations (cms_commit_timeout=1h, 5s-60s jitter)
to allow heavily contended CMS nodes time to commit transforms.

Patch by Jon Meredith and Sam Tunnicliffe; reviewed by Jon Meredith and
Sam Tunnicliffe for CASSANDRA-21453

Co-authored-by: Sam Tunnicliffe <samt@apache.org>
2026-07-01 14:36:28 +01:00
Stefan Miklosovic 2b3258fe86
Merge branch 'cassandra-6.0' into trunk 2026-06-30 10:33:03 +02:00
Arvind Kandpal 26d6b4f665
Offline nodetool commands should not print network options in help
- Introduced LocalCommand marker interface to identify commands that execute purely locally without a JMX connection.
- Updated History command to implement LocalCommand.
- Updated CassandraCliHelpLayout to check for LocalCommand instead of calling execution-flow methods, safely suppressing JMX options for offline commands.

patch by Arvind Kandpal; reviewed by Stefan Miklosovic, Maxim Muzafarov for CASSANDRA-20876
2026-06-30 10:23:39 +02:00
Sam Tunnicliffe 8f8c4ec09e Merge branch 'cassandra-6.0' into trunk 2026-06-29 18:17:54 +01:00
Sam Tunnicliffe 896d1d6415 Defer the creation of system_cluster_metadata keyspace until CMS initialization
* Insert the actual PreInitialize entry in the distribute metadata log
  table using a callback after the log is bootstrapped.
* Remove the implicit insert on subsequent commit, i.e. of the Initialize entry
* Enables the full specifics of PreInit to be encoded in the serialized form,
  removing the special casing for the first CMS member and other nodes
* Correctly invalidate cached KeyspaceMetadata when in a pre-initialized state
* Update Host ids in the system.peers_v2 table directly following CMS initialization
* Initialise gossip/local host id after CMS initialization completes
* Clean up CMS initialization errors which occur after the PreInitialize stage

Co-authored-by: Alex Petrov <oleksandr.petrov@gmail.com>
Co-authored-by: Marcus Eriksson <marcuse@apache.org>
2026-06-29 18:09:42 +01:00
Dmitry Konstantinov 3ace21c90d Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Support direct I/O for background SSTable writes
2026-06-24 15:08:41 +01:00
samlightfoot 002190748b Support direct I/O for background SSTable writes
Adds an opt-in O_DIRECT write path for background SSTable producers,
bypassing the OS page cache for data that is unlikely to be re-read
soon after being written. Memtable flushes remain buffered.

Enabled via two new YAML knobs:
 - background_write_disk_access_mode: standard (default) | direct
 - direct_write_buffer_size: 1MiB (default; aligned up to FS block
   size, auto-grown to fit a worst-case compressed chunk)

The path is gated by config, table compression being enabled, and an
OperationType allowlist in DataComponent. The allowlist is exhaustive
over OperationType: any new value left unclassified fails static
initialization.

Operations on the DIO path: COMPACTION, MAJOR_COMPACTION,
TOMBSTONE_COMPACTION, ANTICOMPACTION, GARBAGE_COLLECT, CLEANUP,
UPGRADE_SSTABLES, WRITE, STREAM (chunked receiver only), RELOCATE,
UNKNOWN (offline sstablesplit).

Operations off the DIO path:
 - FLUSH (policy: just-flushed data is hot, keep in page cache)
 - SCRUB (correctness: tryAppend needs mark/resetAndTruncate)
 - Zero-Copy Streaming (bypasses DataComponent.buildWriter)
 - Uncompressed writers (only CompressedSequentialWriter has a DIO
   subclass in this change)

StartupChecks fails fast if 'direct' is requested on a platform/FS
that does not support O_DIRECT.

patch by Sam Lightfoot; reviewed by Ariel Weisberg, Dmitry Konstantinov for CASSANDRA-21134
2026-06-24 14:57:46 +01:00
Sam Tunnicliffe ee0dcc30ba Merge branch 'cassandra-6.0' into trunk 2026-06-24 14:17:11 +01:00
Sam Tunnicliffe 03422edb4b Relax assertion on partitioner instances in SinglePartitionReadCommand
Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson for CASSANDRA-21251
2026-06-24 14:12:51 +01:00
Stefan Miklosovic 5ddc434569
Merge branch 'cassandra-6.0' into trunk 2026-06-24 13:52:59 +02:00
Stefan Miklosovic 3c23da478f
Merge branch 'cassandra-5.0' into cassandra-6.0 2026-06-24 13:49:23 +02:00
Patrick Lee db631675df
Fix AssertionError in hasReplicaWithOngoingRepair when parallel_repair_count > 1
patch by Patrick Lee; reviewed by Paulo Motta, Jaydeepkumar Chovatia for CASSANDRA-21426

Co-authored-by: Paulo Motta <paulo@apache.org>
2026-06-24 13:45:43 +02:00
Stefan Miklosovic 4c252387d2
Merge branch 'cassandra-6.0' into trunk 2026-06-24 13:21:31 +02:00
Stefan Miklosovic 39d18f50d2
Merge branch 'cassandra-5.0' into cassandra-6.0 2026-06-24 13:14:22 +02:00
Stefan Miklosovic 4b821d1bc7
Merge branch 'cassandra-4.1' into cassandra-5.0 2026-06-24 13:12:29 +02:00
Stefan Miklosovic 19dcb2b784
Merge branch 'cassandra-4.0' into cassandra-4.1 2026-06-24 13:10:18 +02:00
Arvind Kandpal c2901c71eb
Fix skipped tests and flakiness in CassandraRoleManagerTest
Adds missing @Test annotations to testPasswordUpdateRateLimiting and testPasswordUpdateRateLimitingDisabled.
Also fixes minor typos in comments and assertion strings.
Fix flaky CassandraRoleManagerTest by grouping per-role rate limit checks consecutively.

patch by Arvind Kandpal; reviewed by Stefan Miklosovic, Michael Semb Wever for CASSANDRA-21262
2026-06-24 13:04:14 +02:00
Stefan Miklosovic 0324f01de2
Merge branch 'cassandra-6.0' into trunk 2026-06-24 11:26:27 +02:00
Stefan Miklosovic 0673d743aa
Merge branch 'cassandra-5.0' into cassandra-6.0 2026-06-24 11:25:16 +02:00
Stefan Miklosovic a3ee4c4f9a
Merge branch 'cassandra-4.1' into cassandra-5.0 2026-06-24 11:23:40 +02:00
Stefan Miklosovic 003f35ba51
Merge branch 'cassandra-4.0' into cassandra-4.1 2026-06-24 11:21:42 +02:00
maoling 0f9f6dd6e5
Fix flaky Test org.apache.cassandra.io.sstable.VerifyTest.testMutateRepair
patch by Ling Mao; reviewed by Stefan Miklosovic, Dmitry Konstantinov for CASSANDRA-18919
2026-06-24 11:18:15 +02:00
Dmitry Konstantinov aaae5b6417 Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  run_cqlsh.py: fix parsing of a multi-byte UTF-8 sequence, os.read()/pipe reads can split the sequence across two reads
2026-06-23 13:02:16 +01:00
Dmitry Konstantinov abd7dea7aa Merge branch 'cassandra-5.0' into cassandra-6.0
* cassandra-5.0:
  run_cqlsh.py: fix parsing of a multi-byte UTF-8 sequence, os.read()/pipe reads can split the sequence across two reads
2026-06-23 13:01:01 +01:00
Dmitry Konstantinov 5858baf199 run_cqlsh.py: fix parsing of a multi-byte UTF-8 sequence, os.read()/pipe reads can split the sequence across two reads
patch by Dmitry Konstantinov; reviewed by Stefan Miklosovic for CASSANDRA-21466
2026-06-23 12:55:46 +01:00
Kokoori, Shylaja c68dd59d4a
Implementation of CEP-49: Hardware-accelerated compression
The implementation of this CEP adds the ability to plug-in custom compressors providers
which might delegate the de/compression to a specialized hardware. An operator does not
need to change any schema definition, the mere implementation of a compressor provider
put on a class path and its related configuration in cassandra.yaml will transparently
start to use appropriate compressor, e.g. backed by a specialized hardware.

patch by Shylaja Kokoori; reviewed by Joey Lynch, Stefan Miklosovic for CASSANDRA-20975

Co-authored-by: Stefan Miklosovic <smiklosovic@apache.org>
2026-06-23 11:37:53 +02:00
Dmitry Konstantinov f7bcc1b8e1 Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Fix TLS-related tests after a JDK update in build image
2026-06-21 22:23:43 +01:00
Dmitry Konstantinov 105694f625 Merge branch 'cassandra-5.0' into cassandra-6.0
* cassandra-5.0:
  Fix TLS-related tests after a JDK update in build image
2026-06-21 22:05:32 +01:00
Dmitry Konstantinov fb7efd6219 Fix TLS-related tests after a JDK update in build image
add SAN to certificates used by tests
add TLS_ECDHE_* to ciphers list in SSTableLoaderEncryptionOptionsTest

Patch by Dmitry Konstantinov; reviewed by Michael Semb Wever for CASSANDRA-21441
2026-06-21 21:56:39 +01:00
Dmitry Konstantinov 961f813dac Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Report cancelled read command execution to coordinator as a RequestFailure.TIMEOUT
2026-06-20 15:04:06 +01:00
Dmitry Konstantinov d46b8a827a Report cancelled read command execution to coordinator as a RequestFailure.TIMEOUT
patch by Dmitry Konstantinov; reviewed by Sam Tunnicliffe for CASSANDRA-21468
2026-06-20 15:02:11 +01:00
Maxim Muzafarov 1b37872410
Merge branch 'cassandra-6.0' into trunk
* cassandra-6.0:
  Rename conflicting nodetool import --copy-data short option from -p to -cd
2026-06-19 22:27:38 +02:00
Maxim Muzafarov d1212e8017
Merge branch 'cassandra-5.0' into cassandra-6.0
* cassandra-5.0:
  Rename conflicting nodetool import --copy-data short option from -p to -cd
2026-06-19 22:24:25 +02:00
Maxim Muzafarov 3fa111c70f
Merge branch 'cassandra-4.1' into cassandra-5.0
* cassandra-4.1:
  Rename conflicting nodetool import --copy-data short option from -p to -cd
2026-06-19 22:17:16 +02:00
Maxim Muzafarov 95088443ff
Merge branch 'cassandra-4.0' into cassandra-4.1
* cassandra-4.0:
  Rename conflicting nodetool import --copy-data short option from -p to -cd
2026-06-19 22:00:30 +02:00
Maxim Muzafarov bd835726f2
Rename conflicting nodetool import --copy-data short option from -p to -cd
Patch by Maxim Muzafarov; reviewed by Stefan Miklosovic, Caleb Rackliffe, Bernardo Botella Corbi for CASSANDRA-20214
2026-06-19 21:58:04 +02:00