Commit Graph

27693 Commits

Author SHA1 Message Date
Stefan Miklosovic a124cfce85
Merge branch 'cassandra-3.11' into cassandra-4.0 2024-02-29 11:38:39 +01:00
Abe Ratnofsky 099fdf2673
Move ClientWarn.State#warnings to a thread-safe list
patch by Abe Ratnofsky; reviewed by Caleb Rackliffe, Stefan Miklosovic for CASSANDRA-19427
2024-02-29 11:33:03 +01:00
Bereng dee7947422 Bug in generate.sh removal of jobs 2024-02-26 07:43:40 +01:00
Stefan Miklosovic 5430e69e77
Merge branch 'cassandra-3.11' into cassandra-4.0 2024-02-23 14:49:06 +01:00
Stefan Miklosovic af5733124d
Merge branch 'cassandra-3.0' into cassandra-3.11 2024-02-23 14:48:02 +01:00
Jack Green 98eea87aa5
Fix SCM URL links
patch by Jack Green; reviewed by Stefan Miklosovic and Brandon Williams for CASSANDRA-19422
2024-02-23 14:43:41 +01:00
Runtian Liu c2041ba45b
Filter remote DC replicas out when constructing the initial replica plan for the local read repair
patch by Runtian Liu; reviewed by Blake Eggleston and Stefan Miklosovic for CASSANDRA-19120
2024-02-22 23:21:16 +01:00
maoling 8c4a58f035
Remove redundant code in StorageProxy#sendToHintedReplicas
patch by Ling Mao; reviewed by Stefan Miklosovic, Brandon Williams and Maxwell Guo for CASSANDRA-19412
2024-02-22 09:54:08 +01:00
Stefan Miklosovic 98d0e181d5
Remove bashisms for mx4j tool in cassandra-env.sh
/bin/sh (our shebang in bin/cassandra) does not recognize the
`if` construct which is available in /bin/bash only hence if
MX4J_ADDRESS or MX4J_PORT was not commented out, the script would
fail to execute it.

patch by Stefan Miklosovic; reviewed by Brandon Williams for CASSANDRA-19416
2024-02-21 08:37:23 +01:00
Andrés de la Peña 505f5af645 Ensure that repair doesn't exceed repair_session_space by running limiting validation parallelism
patch by Andrés de la Peña; reviewed by David Capwell for CASSANDRA-19336

Co-authored-by: Andrés de la Peña <a.penya.garcia@gmail.com>
Co-authored-by: David Capwell <dcapwell@apache.org>
2024-02-08 11:09:21 +00:00
Jacek Lewandowski 9613af24f3 Merge branch 'cassandra-3.11' into cassandra-4.0
* cassandra-3.11:
  Backport CASSANDRA-16418 to 3.x
2024-02-07 15:12:01 +01:00
Jacek Lewandowski 2170825f0e Merge branch 'cassandra-3.0' into cassandra-3.11
* cassandra-3.0:
  Backport CASSANDRA-16418 to 3.x
2024-02-07 15:12:00 +01:00
Szymon Miężał 5be57829b0 Backport CASSANDRA-16418 to 3.x
When a node is decommissioned, it triggers data transfer to other nodes.
During this transfer process, receiving nodes temporarily hold token ranges in a pending state.
However, the current cleanup process doesn't account for these pending ranges when calculating token ownership,
leading to inadvertent cleanup of data already stored in SSTables.
To address this issue, this patch introduces two changes.
Firstly, it backports CASSANDRA-16418, introducing a preventive check in `StorageService#forceKeyspaceCleanup`.
This check disallows the initiation of cleanup when a node contains any pending ranges for the requested keyspace.
Secondly, it reintroduces a similar condition to test for the existence of pending ranges in `CompactionManager#performCleanup`.
This ensures the safety of this API as well.

Patch by Szymon Miezal; reviewed by Brandon Williams, Jacek Lewandowski for CASSANDRA-18824

Co-authored-by: Szymon Miezal <szymon.miezal@datastax.com>
Co-authored-by: Jacek Lewandowski <lewandowski.jacek@gmail.com>
2024-02-07 15:11:59 +01:00
Brandon Williams 1e450dbb1a Merge branch 'cassandra-3.11' into cassandra-4.0 2024-02-02 07:24:13 -06:00
Brandon Williams 653337ed06 Merge branch 'cassandra-3.0' into cassandra-3.11 2024-02-02 07:23:02 -06:00
Brandon Williams 0bc95bbebd Set log-cli-level to DEBUG in circle config
Patch by brandonwilliams; reviewed by edimitrova for CASSANDRA-19350
2024-02-02 07:21:53 -06:00
Ekaterina Dimitrova 74079562f2 Merge branch 'cassandra-3.11' into cassandra-4.0 2024-01-31 11:15:49 -05:00
Ekaterina Dimitrova aa561f2373 Switch memtable_allocation_type from offheap_objects to heap_buffers in test/conf/cassandra.yaml
patch by Ekaterina Dimitrova; reviewed by Brandon Williams for CASSANDRA-19326
2024-01-31 11:11:35 -05:00
Ekaterina Dimitrova 21988ed3f0 Merge branch 'cassandra-3.11' into cassandra-4.0 2024-01-29 18:04:48 -05:00
Ekaterina Dimitrova 604776b9c6 Merge branch 'cassandra-3.0' into cassandra-3.11 2024-01-29 18:01:19 -05:00
Ekaterina Dimitrova 22e12adaec Fix Compact Storage section in NEWS.txt
patch by Ekaterina Dimitrova; reviewed by Paulo Motta for CASSANDRA-19291
2024-01-29 17:58:20 -05:00
Stefan Miklosovic 2a7c64027d
increment version to 4.0.13 2024-01-23 18:40:10 +01:00
Stefan Miklosovic af752fcd53
Prepare debian changelog for 4.0.12 2024-01-17 12:02:37 +01:00
Runtian Liu ee9e418782
Skip version check if an endpoint is dead state in Gossiper#upgradeFromVersionSupplier
patch by Runtian Liu; reviewed by Stefan Miklosovic and Brandon Williams for CASSANDRA-19187
2024-01-11 10:37:11 +01:00
Ekaterina Dimitrova 290a5990d4 Fix flaky test org.apache.cassandra.tools.BulkLoaderTest.testBulkLoader_WithArgs1
patch by Ekaterina Dimitrova; reviewed by Berenguer Blasi for CASSANDRA-19205
2024-01-10 13:12:00 -05:00
Isaac Reath 475c0035e6 [CASSANDRA-18999] Gossiper::hasMajorVersion3Nodes returns true when a cluster is upgrading patch version without Cassandra 3 nodes.
This commit fixes Gossiper::hasMajorVersion3Nodes so that it does not return true when all hosts have a known version, no hosts are on a version earlier than 4.0, and there is a 4.x minor version or patch version upgrade in progress. Additionally, this commit improves the clarity of Gossiper::hasMajorVersion3Nodes's name to indicate that it will return true when the cluster has 3.x nodes or if the cluster state is unknown, matching the description in the in-line comment.

patch by Isaac Reath; reviewed by Paulo Motta and Stefan Miklosovic for CASSANDRA-18999

Closes #2967
2024-01-10 11:14:49 -05:00
Caleb Rackliffe d5cea135c9 Revert unnecessary read lock acquisition when reading ring version in TokenMetadata introduced in CASSANDRA-16286
patch by Caleb Rackliffe; reviewed by Francisco Guerrero for CASSANDRA-19107
2024-01-09 12:23:13 -06:00
Jacek Lewandowski 891f1119a0 Merge branch 'cassandra-3.11' into cassandra-4.0
* cassandra-3.11:
  Updated the OWASP plugin to 9.0.5 and refactored dependency checks
2023-12-20 12:59:53 +01:00
Jacek Lewandowski 09c46750f6 Merge branch 'cassandra-3.0' into cassandra-3.11
* cassandra-3.0:
  Updated the OWASP plugin to 9.0.5 and refactored dependency checks
2023-12-20 12:59:52 +01:00
Jacek Lewandowski 4c3b96e4cd Updated the OWASP plugin to 9.0.5 and refactored dependency checks
Configured OWASP database to use caching and NVD key. Properties can be
configured in ~/.ant/build.properties and define both the key and
the storage location

Patch by Jacek Lewandowski; reviewed by Maxim Muzafarov, Stefan Miklosovic for CASSANDRA-19146
2023-12-20 12:59:51 +01:00
Brandon Williams 8e5fc74c9a Merge branch 'cassandra-3.11' into cassandra-4.0 2023-12-06 06:32:32 -06:00
Brandon Williams 2e3d7e76f5 Merge branch 'cassandra-3.0' into cassandra-3.11 2023-12-06 06:32:19 -06:00
Brandon Williams a1421ec324 Suppress CVE-2023-6378
Patch by brandonwilliams, reviewed by smiklosovic for CASSANDRA-19142
2023-12-06 06:31:27 -06:00
Jacek Lewandowski e1b0b44f9e Fix repeated tests on CircleCI and long-testsome/burn-testsome targets
Patch by Jacek Lewandowski; reviewed by Berenguer Blasi for CASSANDRA-19086
2023-12-01 19:40:44 +01:00
Yifan Cai 50273d98e4 Support max SSTable size in sorted CQLSSTableWriter
patch by Yifan Cai; reviewed by Alex Petrov, Francisco Guerrero, Maxwell Guo for CASSANDRA-18941
2023-11-30 17:39:00 +08:00
Szymon Miężał 9affcf169f
Fix nodetool repair_admin summarize-pending command to not throw exception
Fixed a bug causing the `OpenDataException` being thrown
when executing the `repair_admin summarize-pending` command.
This patch addresses the problem by including a missing composite
in `PendingStats.toComposite`, ensuring proper data conversion.

patch by Szymon Miezal; reviewed by Stefan Miklosovic and Brandon Williams for CASSANDRA-19014
2023-11-29 18:32:53 +01:00
dmi0 0f2af6ab3f
Fix cassandra-stress in simplenative mode with prepared statements
patch by Dmitry Bychkov; reviewed by Stefan Miklosovic and Brandon Williams for CASSANDRA-18744
2023-11-29 17:45:15 +01:00
Stefan Miklosovic 8dc32c5dd7
Merge branch 'cassandra-3.11' into cassandra-4.0 2023-11-29 12:12:22 +01:00
Stefan Miklosovic 6d7cd61412
Merge branch 'cassandra-3.0' into cassandra-3.11 2023-11-29 12:11:29 +01:00
Stefan Miklosovic c1b12058e7
Do not set RPC_READY to false on transports shutdown in order to not fail counter updates for deployments with coordinator and storage nodes with transports turned off
This is the follow-up commit of CASSANDRA-18935 where we set RPC_READY to false
when transports were shut down in runtime. The problem is that the current logic in StorageProxy.findSuitableEndpoint method,
used for the selection of a leader for counter mutations, is filtering out all endpoints which do not have RPC_READY
set to true. Hence, if there is a deployment of a coordinator node (not joining a ring) and storage nodes which
have transports turned off (e.g. for security reasons), then a coordinator node will select no endpoint as a
counter mutation leader which renders counter mutations impossible.

This change just reverts the original fix which was setting RPC_READY to false when transports were shut down in runtime
(e.g. by nodetool disablebinary).

For trunk (to be 5.1 at time of writing this), there is already TCM in place and the correct fix yet to be implemented
is to decouple from checking RCP_READY state and base it e.g. on JOINED state from TCM perspective. Please follow
CASSANDRA-19103 where this will be addressed.

patch by Stefan Miklosovic; reviewed by Brandon Williams for CASSANDRA-18935
2023-11-29 12:09:59 +01:00
Jacek Lewandowski dece96f21d Fix filtering system ks sstables for relocation on startup
Patch by Jacek Lewandowski; reviewed by Benjamin Lerer for CASSANDRA-18963
2023-11-28 14:20:26 +01:00
Ekaterina Dimitrova 55fecfb65e Fix BulkLoaderTest.testBulkLoader_WithArgs2
patch by Ekaterina Dimitrova; reviewed by Michael Semb Wever and Andres de la Pena for CASSANDRA-19000
2023-11-20 15:56:50 -05:00
Stefan Miklosovic 7fdb88d10a
Merge branch 'cassandra-3.11' into cassandra-4.0 2023-11-20 10:29:09 +01:00
Stefan Miklosovic 13d44774a1
Merge branch 'cassandra-3.0' into cassandra-3.11 2023-11-20 10:28:23 +01:00
Stefan Miklosovic 8c69f85502
ninja fix CASSANDRA-19002: Set gcgs in HintsMaker to Integer.MAX_VALUE
HintsMaker was creating hint files which ttl'ed after 10 days which started to fail the tests.
By setting it explicitly to Integer.MAX_VALUE, newly generated hint files will expire in cca 68 years.

Branches 3.0 to trunk introduce the fix to HintsMaker. Branches 5.0 and trunk contain regenerated hint files as well.
2023-11-20 10:26:59 +01:00
Bereng 3ba6de70c7 Test failure: org.apache.cassandra.db.commitlog.CommitLogSegmentManagerCDCTest
patch by Berenguer Blasi; reviewed by Andres de la Peña for CASSANDRA-18948
2023-11-20 07:34:57 +01:00
Brandon Williams a912085f5e Merge branch 'cassandra-3.11' into cassandra-4.0 2023-11-13 14:16:00 -06:00
Brandon Williams 46996c24bf Merge branch 'cassandra-3.0' into cassandra-3.11 2023-11-13 14:14:59 -06:00
Brandon Williams d41afac8bf Set cqlshlib.serverversion to UNKNOWN if not found
Patch by brandonwilliams; reviewed by mck and paulo for CASSANDRA-19020
2023-11-13 14:12:21 -06:00
Abe Ratnofsky fe1be800b4
Remove completed coordinator sessions
patch by Abe Ratnofsky; reviewed by Caleb Rackliffe, Marcus Eriksson for CASSANDRA-18903
2023-11-13 15:17:47 +01:00