Commit Graph

725 Commits

Author SHA1 Message Date
Eugene Ostroukhov 4c5771d27c
PSM Interop: revert adding XDS protos to protoc args (#32640)
This dependency is no longer needed after #32631
2023-03-17 18:50:55 -07:00
Eugene Ostroukhov 555f3e26a4
PSM Interop: add orca proto to the legacy test driver dependencies (#32620)
ref b/273575071
2023-03-14 19:45:02 -07:00
Sergii Tkachenko c16338581d
PSM Interop: add orca proto to the new test driver dependencies (#32619)
Now `messages.proto` requires `xds/v3/orca_load_report.proto`.
The dependency introduced in https://github.com/grpc/grpc/pull/32524.

ref b/273575071
2023-03-14 18:43:34 -07:00
Paulo Castello da Costa d5d509d3f9
Stop php7 image build in OSS benchmarks CI. (#32437)
Follow-up to https://github.com/grpc/grpc/pull/32420.
2023-02-21 10:02:23 -08:00
Paulo Castello da Costa 758f1c2b11
Exclude php7 from OSS benchmarks CI. (#32420)
PHP7 build is failing, removing from CI while investigating the failure.




<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-02-17 12:48:27 -08:00
sanjaypujare 7139bb1d2e
xds-interop-testing: move TESTING_VERSION check to after calling kokoro_setup_test_driver func and fix script_dir (#32405) 2023-02-15 16:59:18 -08:00
sanjaypujare 9dd4b7757d
xds-interop-tests: add cross branch testing to the script (#31569)
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
2023-02-14 12:28:43 -08:00
Richard Belleville c608379c70
Freeze xDS interop test runner dependencies (#31859)
* Freeze xDS interop test runner dependencies

* Address review comments

* Reviewer comments on scripts

* Create venv in tmpdir instead

* Moved freeze.sh to bin directory

* Fix shellcheck

* Update tools/run_tests/xds_k8s_test_driver/bin/freeze.sh

Co-authored-by: Sergii Tkachenko <hi@sergii.org>

* Revert

---------

Co-authored-by: Sergii Tkachenko <hi@sergii.org>
2023-02-07 18:32:23 -08:00
Esun Kim ac66562349
Bazel update (#32251) 2023-02-06 13:52:54 -08:00
Esun Kim 6943c1841f
Excluding more tests from build_submodule_at_head (#32290) 2023-02-03 10:25:29 -08:00
Esun Kim 0014c91858
Increased timeout for sanity test variants (#32288) 2023-02-03 09:49:23 -08:00
Sergii Tkachenko 947b30b231
PSM Interop: Switch to the new GKE clusters (except the URL map) (#32280)
Our test clusters are in the broken/dirty state (except the URL map's
"basic" cluster, which isn't affected).

This PR switches to the newly created clusters to:

1. Get a data point on whether newly created clusters are affected
   by the same issues.
2. Allow for descriptive work on the old clusters.
3. Hopefully, bring our tests back to green.

Bonus: more sensible cluster names.
2023-02-02 19:57:49 -08:00
Paulo Castello da Costa 1a5b4e31e4
Filter out tags when getting remote head commit. (#32276) 2023-02-02 17:06:04 -08:00
Richard Belleville 190d095a62
Fix Python epoll1 Fork Support (#32196)
* WIP. A seemingly properly failing test

* WIP. Pre-fork handlers now work

* Roughly working.

* Clean up

* Clean up more

* Add to CI

* Format

* Ugh. Remove swap file

* And another

* clean up

* Add copyright

* Format

* Remove another debug line

* Add stub forkable methods

* Remove use of 3.9+ function

* Remove unintentional double copyright

* drfloob review comments

* Only hold lock during Close once

* Create separate job for fork test

* Bump up gdb timeout

* Format
2023-02-02 14:46:16 -08:00
Esun Kim 9403786b11
Changing parallelism of linux/grpc_portability_build_only (#32246)
* Change args

* Fix args
2023-01-31 14:53:40 -08:00
Yash Tibrewal 82c697e2e7
CI: Move kokoro bazel output root to /tmpfs/bazel (#32156) 2023-01-19 15:32:04 -08:00
Sergii Tkachenko 80e5f98139
xds interop: Fix buildscripts not continuing on a failed test suite (#32093)
Apparently there's a difference between bash 3 and bash 4. OSX comes with bash 3 out-of-box, so for whoever wrote this logic it "worked on my machine".
2023-01-13 18:13:09 -08:00
Sergii Tkachenko 70d0b21e2a
xDS interop: resume circuit_breaking test (#32038)
This is a test running on legacy (GCE) framework.
It was disabled in https://github.com/grpc/grpc/pull/27355,
however it has never been ported to the new framework.
Unless there were reasons I'm not aware of, disabling it is a mistake.
Other languages still run it:

- Java: cc5378453f/buildscripts/kokoro/xds_v3.sh (L21)
- Go: f2fbb0e07e/test/kokoro/xds.sh (L30)
- Node: 81083bd229/packages/grpc-js-xds/scripts/xds.sh (L57)
2023-01-06 14:49:01 -08:00
apolcyn b27d726342
testing: bump timeout of grpc/abseil-head build job from 4 to 5 hours (#31936) 2023-01-03 12:35:44 +01:00
Sergii Tkachenko 7e850a101f
[tests] Restore grpc_interop_matrix_adhoc.cfg (#31709)
Previously deleted in https://github.com/grpc/grpc/pull/31423.
We still need this build config to execute adhoc run of interop matrix
tests per https://github.com/grpc/grpc/blob/master/tools/interop_matrix/README.md
instructions.
2022-11-18 16:46:58 -08:00
Sergii Tkachenko 517e96ee11
PSM Interop: add missing GCP service account to the cleanup job (#31577)
Recently we had an issue with Service Account IAM policy getting too large.
RC is the cleanup script missing GCP SA account.
This PR adds adds missing `gcp_service_account` to the cleanup script.
2022-11-08 11:11:41 -08:00
Jan Tattermusch 78fd1f637a
Run grpc_android job under docker for better maintainability. (#31504)
* run grpc_android in a docker container

* add TODO

* fixup android_ndk dockerfile
2022-11-02 11:09:19 +01:00
Jan Tattermusch 7b0fc97bfc
run peformance_profile jobs in docker (#31505) 2022-11-02 08:53:46 +01:00
sanjaypujare 06cd65e813
upgrade to testing 1.50.x (#31512) 2022-10-31 15:27:55 -07:00
Jan Tattermusch 5bfc367cc5
run microbenchmarks_diff under docker (#31503) 2022-10-31 20:51:29 +01:00
Jan Tattermusch 3cf3ed7d59
Revert "Revert "Add back C# distribtests for Grpc.Tools"" (#31436)
* Revert "Revert "Add back C# distribtests for Grpc.Tools (#31399)" (#31412)"

This reverts commit dbc45208e2.

* avoid clash with internal protos
2022-10-27 09:59:06 +02:00
Craig Tiller 29175b97ee
[tests] Remove interop tests from PR flows (#31423) 2022-10-21 11:15:15 -07:00
Alisha Nanda dbc45208e2
Revert "Add back C# distribtests for Grpc.Tools (#31399)" (#31412)
This reverts commit 50bad293c9.
2022-10-20 12:08:29 -07:00
Jan Tattermusch 50bad293c9
Add back C# distribtests for Grpc.Tools (#31399)
* remove remains of grpc_csharp_ext artifact build completely

* add back part of C# distribtests

* redirect C# linux distribtests

* comment out some distribtests

* switch updateversion to Grpc.tools

* fix .proto

* fix distribtest complile

* temporarily comment out service in .proto

* cleanup

* improvements

* reenable mac distribtests

* fixes
2022-10-20 16:42:29 +02:00
Jan Tattermusch 2ebd03d9e2
cleanup grpc_sample_fuzzers job (#31358) 2022-10-17 21:04:07 +02:00
Wanlin Du faf7999a42
Remove installaton of go 1.17 in the CI jobs. (#31379) 2022-10-17 10:38:05 -07:00
Sergii Tkachenko 6016651794
xDS Interop: update default prefix in the cleanup script (#31325)
We don't have a separate security prefix anymore. The default script was updated in https://github.com/grpc/grpc/pull/30754.
2022-10-12 12:00:40 -07:00
Sergii Tkachenko 279b97ecaa
xDS Interop: require Python 3.7 (#31323) 2022-10-12 11:56:25 -07:00
Wanlin Du cf917bc365
Move PSM benchmark to a separated cluster. (#31223)
This PR moves the PSM benchmark away from the benchmark-prod2
cluster to psm-benchmarks-performance cluster. This is to avoid
any unexpected change on the OSS benchmarks due to the tuning
we may perform for PSM benchmarks.

The psm-benchmarks-performance cluster has 2 system nodes,
1 driver-ci and 2 worker-ci nodes. The node type is the same as
the benchmark-prod2 cluster.
2022-10-04 15:43:07 -07:00
Sergii Tkachenko 42e45f93a8
[CPP] xDS interop GCE framework: pin grpcio-tools to use protobuf 3.x (#31214) 2022-10-03 11:45:40 -07:00
Sergii Tkachenko 203bc0dc52
xDS interop GCE framework: pin grpcio-tools to use protobuf 3.x (#31191) 2022-09-30 16:54:54 -07:00
Craig Tiller f69c64b270
[sanity] Split IWYU, clang-tidy into their own jobs (#31141)
* [sanity] Split IWYU, clang-tidy into their own jobs

* fix typo

* fix

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-09-27 17:04:54 -07:00
Jan Tattermusch 2f5d06af6b
make legacy artifact -> packages -> distribtest jobs a noop (#31124) 2022-09-27 21:01:32 +02:00
sanjaypujare 731a7d6fd1
xds-interop-tests: we have decided to enable cross-lang testing for master and latest only (currently 1.49) (#30794) 2022-09-18 09:19:44 -07:00
Esun Kim 888c64adf8
Fix the build script (#30985)
* Fix the build script

* Set -ex

* fix unsigned int comparisons and ignored return values

Co-authored-by: AJ Heller <hork@google.com>
2022-09-14 15:36:55 -07:00
Wanlin Du ba6e5af377
Revert "Stop dotnet tests in the OSS benchmark. (#30787)" (#30906)
This reverts commit 97f29a1dca.
2022-09-08 19:06:04 -07:00
Jan Tattermusch b45c5244cb
increase arm64 C/C++ bazel test timeout (#30872) 2022-09-08 11:04:38 +02:00
Craig Tiller c580d0d9a7
[experiments] Add experiment framework (#30775)
* [experiments] Add experiment framework

* auto-ci-config

* fix

* fix

* Automated change: Fix sanity tests

* support different configs

* Automated change: Fix sanity tests

* cleaner generated code

* Automated change: Fix sanity tests

* enforce expiry

* make sure expiry isnt far in the future

* fix

* Automated change: Fix sanity tests

* remove specified testing

* cleaner

* fix

* fix

* Automated change: Fix sanity tests

* fix

* fix

* docstring

* clean up code

* Automated change: Fix sanity tests

* review feedback

* build fix

* Automated change: Fix sanity tests

* ownership

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-08-31 10:52:40 -07:00
Wanlin Du 97f29a1dca
Stop dotnet tests in the OSS benchmark. (#30787) 2022-08-30 13:08:17 -07:00
Sergii Tkachenko 6b365de65d
xDS interop: buildscripts: fix run_test return status (#30768)
To capture the return status of the test in run_test the last command must be the call to the test itself.
This removes `set +x`, which makes the run_test always return success, and not propagate the test status.

I can't find it, but this exact error bit us before. Looks like it leaked to other scripts.
The good thing is if the test was executed, it's failure would still be picked up from the result xml.

However, if the test framework didn't start in the first place, the result will be false positive.
Example: https://source.cloud.google.com/results/invocations/98d3e679-ec8a-40bd-9f36-88179747b0d6/targets

```
/home/kbuilder/.pyenv/versions/k8s_xds_test_runner/bin/python3: Error while finding module specification for 'tests.authz_test' (ModuleNotFoundError: No module named 'tests')
+ set +x
Failed test suites: 0

[ID: 3548168] Command finished after 625 secs, exit value: 0
```
2022-08-26 15:07:14 -07:00
Sergii Tkachenko 1e42fbeb52
xDS interop: enable pod log collection in the buildscripts (#30735)
- Enables pod log collection in all PSM interop jobs implemented in https://github.com/grpc/grpc/pull/30594.
- Associate test suite runs with their own log file, so it's displayed on "Target Log" tab
2022-08-26 13:05:06 -07:00
Michael Lumish 9519fdc956
Enable prod outlier detection interop tests for C++ and Python (#30624) 2022-08-26 11:38:41 -07:00
Sergii Tkachenko c7ea4a2ee7
xDS interop: Python LB tests build and use the python server (#30637)
Undoes https://github.com/grpc/grpc/pull/27096.
While we lost context why py tests were used pinned cpp server,
we think this is due to lack of support of the set_not_serving RPC
in the python server, see https://github.com/grpc/grpc/issues/30635.

This RPC is only used in two tests, and for them we added a
temporary override of the test server to the reference Java server,
see https://github.com/grpc/grpc/pull/30636.

All other LB tests should work with the python server just fine.
2022-08-19 10:33:54 -07:00
Sergii Tkachenko 6a74cf535a
xDS interop: add missing image tagging to the buildscripts (#30520) 2022-08-05 18:12:09 -07:00
Yash Tibrewal 3c87019897
Update python version for AWS tests (#30500) 2022-08-04 13:12:38 -07:00