Commit Graph

1075 Commits

Author SHA1 Message Date
Denny C. Dai e2b772cbd8
[gRPC/iOS] Interop test deflake (#29997) 2022-06-13 16:51:42 -07:00
Hannah Shi 932878b1ce
[ObjC] unit tests with bazel (#29799)
* unit tests with bazel

* passing via --test_env from bazel command line

* remove env from BUILD; fix sanity check in run_one_test_bazel.sh

* add port server
2022-06-10 19:37:07 -07:00
Hannah Shi 3ad945947c
[ObjC]interop tests with bazel (#29800)
* interop tests with bazel

* remove env in BUILD

* clang format
2022-06-09 19:03:17 -07:00
Craig Tiller 50ae54dd1c
[fuzzing] Run fuzzers a little bit as a test (#29919)
* [fuzzer] Add a script to sample fuzzers

* remember the script

* add ci

* bleh

* fix

* Update sample_fuzzers.sh

* tweak

* tweak

* tweak

* tweak

* tweak

* fix fuzzer found bug

* add explainer

* make it bold af

* limit max fuzzing time in addition to runs
2022-06-07 07:37:59 -07:00
Wanlin Du 831ce7d579
Add experimental CI for PSM tests. (#29477)
This commit adds experimental CI for PSM tests.

Test included initially are Java and cxx tests. With expected load
from 100 to 30000, same as the manual test. Running proxied and proxyless
tests on benchmark-prod2 cluster, 8-core-machines (both client and server).

Data are uploaded to experimental tables.

Open for initial feedback on what we want to run on CI.
2022-05-26 13:21:31 -07:00
Jan Tattermusch 5051566b27
Enable remote cache for selected ObjC bazel tests. (#29731)
* enable remote cache for ObjC bazel tests

* add bazel RBE cache for mac ios bazel builds
2022-05-20 11:07:04 +02:00
Jan Tattermusch 6a09523029
Remove opt MacOS builds from PR presubmit cmake C/C++ basic tests (#29730) 2022-05-19 19:29:45 +02:00
Sergii Tkachenko 8b1cef6e19
xds_k8s_install: Allow to override PYTHON_VERSION for local testing (#29722) 2022-05-18 11:33:50 -07:00
Jan Tattermusch b7034041de
Convert ObjC codegen plugin tests to bazel tests. (#29676)
* add initial version of bazelified plugin tests

* polish the bazel sh_test scripts

* add objc_codegen_plugin tests

* add objc plugin tests to bazel test job
2022-05-18 14:54:29 +02:00
Jan Tattermusch ad2ca50712
Simplify building release packages through per-language grpc_distribtests_* jobs. (#29699)
* add release version of grpc_distribtests_* jobs .cfg files

* make grpc_distribtests_ruby more aligned with other single-job distribtests

* dont hide packages from build_artifacts step for python an php
2022-05-18 13:09:15 +02:00
Jan Tattermusch 345f12afa6
Improve ObjC bazel test and add TODOs. (#29665)
* objC bazel test: run InteropTests and MacTests

* objC bazel test: run TvTests

* Revert "objC bazel test: run TvTests"

This reverts commit 46a81991a9.

* avoid running flaky objC InteropTests under bazel

* add TODOs for objc run_tests.py tasks

* add a note about GRPC_VERBOSITY=debug being set

* increase timeout for ios-buildtest-example-tvOS-sample test task
2022-05-18 12:25:30 +02:00
Paulo Castello da Costa aa6493aff3
Reorder arguments to match experimental script. (#29705) 2022-05-17 15:51:18 +02:00
Jan Tattermusch 748a8d527f
Add a job for ObjC bazel tests (#29599)
* grpc_objc_bazel.sh test script

* add a test job for obj bazel tests
2022-05-12 09:45:17 +02:00
Wanlin Du bb2d69b8f3
Add log urls to junit report. (#29495)
This pr adds the feature of providing links to logs in load test Junit reports.
2022-05-11 14:58:47 -07:00
apolcyn 409db4dd0f
Upgrade ruby rake-compiler-dock images (#29304)
* Upgrade rake-compiler-dock images
2022-05-11 13:58:45 -07:00
Jan Tattermusch 4ab3103293
Upload results from bazel C/C++ ARM64 tests to bigquery (#29619)
* upload RBE results for linux arm64 tests

* propagate UPLOAD_TEST_RESULTS env variable

* improve arm64 c/c++ job config

* add comment
2022-05-11 17:12:45 +02:00
Jan Tattermusch cfa03d83d6
remove duplicate ./reports/ mount for xds tests (#29618) 2022-05-09 16:00:20 -07:00
Jan Tattermusch eb8cf1544b
cleanup config for existing macos kokoro jobs that run bazel (#29600) 2022-05-09 09:21:09 +02:00
Jan Tattermusch e8404698d5
Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225)
* remove examples/csharp

* remove reference to examples/csharp

* remove C# references from doc/

* remove src/csharp

* update test_creds locations

* remove C# distribtests

* remove buildgen templates for files under src/csharp

* remove grpc_csharp_ext C build target

* regenerate projects

* update tools/run_tests/README.md

* change many C# test/build scripts to noop

* unbreak run_tests.py -l csharp

* unbreak C# build_package targets

* unbreak C# distribtests

* remove C# pre-build steps from prepare_build_windows.bat

* remove src/csharp from clang_format

* remove csharp and csharpcoreclr from run_interop_tests.py

* remove C# interop test docker images

* Revert "remove src/csharp"

This reverts commit 97f2b6d707.

* remove src/csharp, but keep Grpc.Tools

* add back templates/src/csharp/build/dependencies.props.template

* remove everything but Grpc.Tools and Grpc.Tools.Tests from sln

* Revert "unbreak run_tests.py -l csharp"

This reverts commit 529b5e2ec1.

* revive Grpc.Tools.Tests through run_tests.py

* Revert "unbreak C# build_package targets"

This reverts commit 79d8d83c8b.

* experiment with build_nuget.sh fixes

* simplify create_fake_native_artifacts.sh

* building of Grpc.Tools in package_targets.py

* move shared files from Grpc.Core to Grpc.Tools

* yapf format: distribtest_targets.py

* Revert "remove C# pre-build steps from prepare_build_windows.bat"

This reverts commit bd38956a2b.

* update C# README.md

* disable C# in gke OSS benchmarks
2022-04-28 12:00:34 +02:00
Jan Tattermusch 45ab03cd8b
remove long-disabled grpc_coverage kokoro job (#29400) 2022-04-26 18:01:15 +02:00
Jan Tattermusch e26c812aeb
Cleanup & improve bazel-based test jobs running under docker. (#29402)
* use EXTRA_DOCKER_ARGS in grpc_bazel_privileged_docker.sh

* docker_propagate_env.list: propagate all variables needed by workspace_status_kokoro.sh

* simplify bazel invocations in docker

* use respawn script for grpc_bazel.sh

* cleanup grpc_flaky_network test

* cleanup grpc_binder_transport_apk job

* cleanup grpc_feature_example_tests

* additional cleanup & improvements
2022-04-22 19:02:58 +02:00
Jan Tattermusch 1bf8414630
build_and_run_docker.sh cleanup and simplification (#29468)
* unify DOCKER_TTY_ARGS in docker scripts

* improvements and cleanup in build_and_run_docker.sh

* fix shellcheck

* make sure python sdist artifact is readable
2022-04-22 06:02:18 +02:00
AJ Heller 667c81d9dc
Add feature example tests for the master branch (#29429) 2022-04-19 10:57:24 -07:00
Yash Tibrewal 050eb43430
PSM Security: Increase test timeout to 240 for C++ and Python (#29420) 2022-04-15 15:06:09 -07:00
Jan Tattermusch 25bade9be5
Simplify ARM64 bazel invocation (and produce resultstore bazel results). (#29355)
* resultstore results from arm64 bazel run

* simplify bazel invocation in linux arm64 C/C++

* address comments
2022-04-14 11:09:58 +02:00
Jan Tattermusch c33963d371
iOS binary size script cleanup (#29377)
* iOS binary size script cleanup

* add job cfg for running iOS binary size on master
2022-04-14 11:01:16 +02:00
Jan Tattermusch da1977f98c
Cleanup configuration of bazel RBE jobs (#29301)
* cleanup bazel_rbe .cfg and .sh files

* upload sponge_log.xml artifacts for selected bazel jobs

* use move_src_tree_and_respawn_itself_rc for bazel RBE tests on linux

* fix wrong config
2022-04-13 13:14:00 +02:00
Jan Tattermusch 3052919efa
add grpc-dotnet to stable GKE benchmarks (#29369) 2022-04-13 06:31:50 +02:00
Jan Tattermusch c64d6f3f57
Better bazel C++ iOS tests (with structured test results) (#29354)
* introduce bazelrc for tests with resultstore-uploaded results

* modernize bazel cpp ios tests

* simplify bazel invocation in bazel_cpp_ios_tests

* remove unused bazel core ios tests
2022-04-12 13:16:48 +02:00
Jan Tattermusch 07a75427bd
Simplify running bazel with structured test results on CI (#29353)
* add bazel_report_helper.py

* simplify bazel invocations in selected builds

* introduce __main__

* update gitignore

* introduce sleep constant

* add type annotations

* use f-strings

* Revert "use f-strings"

This reverts commit f970d6a40b.
2022-04-12 11:31:41 +02:00
Richard Belleville e53ea89bca
Add Python GCF Distribtest (#29303)
* Initial GCF distribtest

* Tenatively hook up to CI

* Try again

* Allow dev0 artifacts

* Fix invocation path

* Update gcloud

* Add a 3.8 artifact for presubmits

* And 3.9 too

* Put test files back to normal

* Formatting/linting

* Copyright

* That copyright script doesn't work with shebangs

* Review comments

* Try to create latest-manylinux label

* Accidentally a letter

* Add Python 3.7 manylinux 2014 to presubmit

* Revert CI config file used for test

* Review comments

* Yapf

* Re-add presubmit wheel

* Review comments
2022-04-07 11:51:07 -07:00
Jan Tattermusch 2c6ab431a1
Add support for grpc-dotnet in GKE benchmarks (#28975)
* GKE benchmarks: add support for benchmarking grpc-dotnet

* add dotnet to loadtest basic templates

* print full path for generated examples

* add grpc-dotnet scenario to loadtest_example.sh generator

* add grpc-dotnet to the experimental kokoro job

* yapf format code
2022-04-07 05:13:37 -07:00
Lidi Zheng 817420318a
Use "main" as the protobuf head branch name (#29319) 2022-04-06 14:44:49 -07:00
Marco Concetto Rudilosso 06e2fcc6c7
Support pre-built binaries for Ruby 3.1 (#29000)
* Support pre-built binaries for Ruby 3.1

* use 3.1.0

* use 3.1.0 and install 3.1 in build files

* fix

* update gemspec template

* fix naming of variable

* Fix ruby 3.1 link

Co-authored-by: Jan Tattermusch <jtattermusch@users.noreply.github.com>
2022-04-06 14:02:13 +02:00
Jan Tattermusch 1973b4f9b1
Cleanup bazel RBE configs (#29281)
* refactor RBE configs

* better naming for linux specific RBE configs

* update names of RBE configs elsewhere

* move partial configs to tools/remote_build/include
2022-04-04 09:47:43 +02:00
Richard Belleville f688f5fcf2
Rehome python bazel distribtest (#29275)
* WIP

* Test multiple languages

* Yapf

* isort

* Shellcheck

* comment not provided

* Fix import ordering issue.

* Turn up Bazel logging
2022-04-01 15:04:50 -07:00
Jan Tattermusch f40fe16aab
enable bazel remote cache for macos C/C++ CI tests (#29272) 2022-04-01 18:29:43 +02:00
Yash Tibrewal 02bddf2017
Enable authz_test for C++ and Python (#29147)
* Enable authz_test for C++ and Python

* Try increasing duration

* Debugging

* Tests pass
2022-03-28 14:26:23 -07:00
Lidi Zheng f5885880a1
Upgrade Python versions in Windows CI (#29184) 2022-03-25 12:02:45 -07:00
Mark D. Roth daed9caf4c
fix path to xds_end2end_test (#29195) 2022-03-23 15:24:21 -07:00
Jan Tattermusch 59d9749c71
fix csharp single-job distribtest on grpc-win2016 (#29183) 2022-03-22 20:00:13 +01:00
Jan Tattermusch 9f87a1dbb5
avoid collision with pre-installed protoc on grpc-win2016 workers (#29171) 2022-03-21 16:52:25 +01:00
Jan Tattermusch dd1bdb1b15
Fix C# "dotnet restore" on grpc-win2016 kokoro workers. (#29170) 2022-03-21 16:17:12 +01:00
Jan Tattermusch c8430e6ac4
add grpc_distribtests_python for windows (#29153) 2022-03-18 20:07:32 +01:00
Jan Tattermusch 37ab609103
Add macos grpc_distribtests_python and grpc_distribtests_ruby (#29141)
* small cleanup in singlejob distribtest jobs

* add macos grpc_distribtest_ruby and grpc_distribtest_python jobs
2022-03-18 19:22:10 +01:00
Jan Tattermusch 409c732813
C# windows single-job distribtest (#29152)
* add windows grpc_distribtest_csharp

* add kokoro cfg files
2022-03-18 16:34:31 +01:00
Jan Tattermusch 83ccb0deed
add C# macos distribtest in a single job (#28614) 2022-03-18 06:26:38 +01:00
Jan Tattermusch 208619cdce
exclude arm64 tests from build_submodule_at_head (#29131) 2022-03-17 19:11:19 +01:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch a3be072605
Switch .py shebang to python3 (#28963)
* switch shebang to python3

* prepare_build_macos: install latest available patch for each python
2022-03-14 10:41:30 +01:00