Commit Graph

196 Commits

Author SHA1 Message Date
Jan Tattermusch e8404698d5
Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225)
* remove examples/csharp

* remove reference to examples/csharp

* remove C# references from doc/

* remove src/csharp

* update test_creds locations

* remove C# distribtests

* remove buildgen templates for files under src/csharp

* remove grpc_csharp_ext C build target

* regenerate projects

* update tools/run_tests/README.md

* change many C# test/build scripts to noop

* unbreak run_tests.py -l csharp

* unbreak C# build_package targets

* unbreak C# distribtests

* remove C# pre-build steps from prepare_build_windows.bat

* remove src/csharp from clang_format

* remove csharp and csharpcoreclr from run_interop_tests.py

* remove C# interop test docker images

* Revert "remove src/csharp"

This reverts commit 97f2b6d707.

* remove src/csharp, but keep Grpc.Tools

* add back templates/src/csharp/build/dependencies.props.template

* remove everything but Grpc.Tools and Grpc.Tools.Tests from sln

* Revert "unbreak run_tests.py -l csharp"

This reverts commit 529b5e2ec1.

* revive Grpc.Tools.Tests through run_tests.py

* Revert "unbreak C# build_package targets"

This reverts commit 79d8d83c8b.

* experiment with build_nuget.sh fixes

* simplify create_fake_native_artifacts.sh

* building of Grpc.Tools in package_targets.py

* move shared files from Grpc.Core to Grpc.Tools

* yapf format: distribtest_targets.py

* Revert "remove C# pre-build steps from prepare_build_windows.bat"

This reverts commit bd38956a2b.

* update C# README.md

* disable C# in gke OSS benchmarks
2022-04-28 12:00:34 +02:00
Michael Lumish 28f1453ad5
Use a non-root user in Node interop docker images (#29062)
* Use a non-root user in Node interop docker images

* Make node interop scripts without being root

* Update cwd in Node interop tests

* Update cwd in other Node interop tests

* Update cwd in Node interop tests relative to hardcoded path

* Fix updated Node interop test cwd

* Make service account file location more generic

* Use service account creds directly from mounted directory

* Fixing source path is recursive local submodule clone.

* Move creds file to /root, make /root accessible

Co-authored-by: Nicolas "Pixel" Noble <pixel@nobis-crew.org>
2022-03-15 14:41:21 -07:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch d15711d2bb
Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Jan Tattermusch 1289cdae2e
Upgrade PHP docker images to debian11 (#28701)
* upgrade PHP docker images to debian11

* regenerate dockerfiles

* adjust testrunners to php debian11 images
2022-01-27 06:45:52 +01:00
Jan Tattermusch b0cdd3cba2
Cleanup (followup for ccache addition) (#28702)
* nit in python interop dockerfile

* address TODO in prepare_ccache_symlinks_rc

* enable ccache for C# and ruby distribtest jobs

* use debian11 instead of bullseye consistently
2022-01-26 18:56:46 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
apolcyn 3c368a5b2c
Don't gem install rake-compiler on macos setup scripts (#28415)
* Don't gem install rake-compiler on macos setup scripts
2021-12-28 09:57:33 -08:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Jan Tattermusch 79b58431ed
Update csharp SDK to LTS versions (#27966)
* update C# SDK

* regenerate dockerfiles

* install .NET6 and .NET Core 3.1

* regenerate dockerfiles

* change netcoreapp2.1 targets to netcoreapp3.1

* update installed SDKs in aarch64 C# job

* update run_tests scripts to use netcoreapp3.1 for C#
2021-11-17 10:41:02 +01:00
Richard Belleville 179a7c7459
Fix Python Interop (#27620) (#27703) (#27749)
* WIP. Attempt to fix interop

* Yapf
2021-10-15 18:22:29 -07:00
Esun Kim 11d2f86e5e
Upgrade PHP7 docker image to use Debian 9 (#27537)
* Upgrade PHP7 docker image to use Debian 9

* update
2021-10-01 08:33:19 -07:00
Esun Kim 420a98f96b
Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Jan Tattermusch 288fe131b4
Reintroduce #22964 with extra fixes (#26465)
* Revert "Revert "Upgrade dotnet SDK 3 for C# build (#22964)" (#26462)"

This reverts commit 736d914cfd.

* Revert "Exclude csharp from performance test continuous runs. (#26458)"

This reverts commit 6744e8f84a.

* switch remaining tests to C# buster image

* remove C#'s global.json (which requires dotnet SDK 3+)

* dotnet SDK3 currently breaks C# package build

* regenerate dockerfiles
2021-06-15 18:50:13 +02:00
Esun Kim 736d914cfd
Revert "Upgrade dotnet SDK 3 for C# build (#22964)" (#26462)
This reverts commit a44bafec08.
2021-06-10 16:46:44 -07:00
Jan Tattermusch a44bafec08
Upgrade dotnet SDK 3 for C# build (#22964)
* upgrade dotnet SDK 3 for C# build

* add C# global.json

* install dotnet SDK 3 on macos

* upgrade C# docker images to debian buster

* regenerate dockerfiles
2021-06-09 09:25:48 +02:00
Yash Tibrewal 39ab85a6d9
Add logging to xDS client server images (#26327) 2021-05-21 12:53:21 -07:00
Richard Belleville cc22375572
Fix Python xDS k8s Interop (#26158)
* Increase core logging verbosity

* Make repo URL injectable

* Apparently that's not allowed

* Use ipv4 in interop server

* Add CSDS to Python interop client

* Revert CI script change

* Scale back logging

* Move env variable to dockerfile

* And Python too
2021-05-20 17:58:29 -07:00
Jan Tattermusch 802375393a
Use go1.16 for go interop tests and for newly added interop_matrix tests. (#26124)
* use go1.16 for go interop tests

* add go1.16 runtime support for interop_matrix tests

* update copyright headers
2021-04-30 13:29:21 +02:00
Yash Tibrewal 57cb063fb7
Add kokoro job for xds psm security tests (#26033)
* add kokoro job for xds psm security

* Fix scripts

* Cleanup

* Add copyright
2021-04-20 19:23:28 -07:00
Ivan Inozemtsev 5c95dd5c2c
Update dart to 2.12 release (#25657) 2021-03-09 15:39:42 +01:00
Richard Belleville 1437dc9816
Fix pypa link (#25647)
* Fix pypa link

* And 3.5 as well
2021-03-08 17:26:52 -08:00
Lidi Zheng a6c5d6c43e
[xDS Proto] Pin PyPI dependencies in Dockerfiles (#25510) 2021-02-22 10:10:56 -08:00
Jan Tattermusch cd53c55269 regenerate dockerfiles 2021-02-11 14:11:42 +01:00
Ivan Inozemtsev 2453a4b2d5 Fix dart interop test 2021-02-01 14:43:50 +01:00
James Newton-King f759267c56
Flag to build latest framework to ASP.NET Core interop tests 2021-01-19 15:37:10 +13:00
Jan Tattermusch 254730af92
Merge pull request #24000 from jtattermusch/makefile_more_cleanup2
Makefile: remove support for building protobuf, C++ libraries and executables
2020-12-13 19:13:34 +01:00
Jan Tattermusch 64e33aa505 cmake not needed for grpc_interop_ruby 2020-12-12 17:56:23 +01:00
Jan Tattermusch c5c123efc9 add cmake to ruby dockerfiles 2020-12-09 11:54:45 +01:00
Alexander Polcyn 70f3a25125 Delete unused grpclb-in-dns interop test suite 2020-12-08 17:02:29 +01:00
Jan Tattermusch b29676dec5 restore go1.8 image 2020-12-01 11:19:53 +01:00
Jan Tattermusch 1fb53d9698 remove unused go1.7 image 2020-12-01 11:18:02 +01:00
Jan Tattermusch 0f2385a28d generate go build_interop.sh from the template 2020-12-01 11:09:30 +01:00
Easwar Swaminathan 2b21f774c6 remove calls to deps 2020-11-30 15:59:10 -08:00
Easwar Swaminathan 694f226586 interop: Enable Go modules support 2020-11-24 15:38:18 -08:00
Jan Tattermusch cf3d407e69 upgrade dart interop SDK to 2.10 2020-11-16 13:21:01 +01:00
Esun Kim a07345a5e2 Upgrade six 1.15 2020-10-08 12:46:00 -07:00
root 840e67984a del several docker related files 2020-09-30 22:11:40 +00:00
Jan Tattermusch b1ab3c1217 add cmake to grpc_interop_cxx docker image 2020-07-31 13:08:43 +02:00
Jan Tattermusch d4f3e05fef switch C++ interop tests to cmake 2020-07-31 10:33:10 +02:00
Stanley Cheung ac0f7e80ea Attempt to de-flake dart interop build 2020-07-28 22:35:42 -07:00
James Newton-King 21e855592a
Output grpc-dotnet interop apps to specific directories 2020-07-22 09:02:13 +12:00
Stanley Cheung 15a16df640 Add --verbose to dart pub get command 2020-07-15 15:10:44 -07:00
Jan Tattermusch 91f36feac8 fix PHP interop tests build 2020-07-15 08:56:46 +02:00
Jan Tattermusch d8c76321c3 fix C++ interop test build 2020-07-15 08:56:46 +02:00
Stanley Cheung 7d8f295ab0 Fix run_tests pip install error 2020-05-13 10:59:09 -07:00
Eric Anderson eee38e35dd tools/dockerfile: Run Java build twice to reduce flakiness
Downloads fail from time to time because Gradle does not retry certain
types of network failures
(https://github.com/gradle/gradle/issues/8264).

Retrying twice should reduce the flake rate below noticeable without
increasing the size of the interop image created for each new release
for historical testing.

Fixes #18892
2020-05-11 11:37:49 -07:00
Jan Tattermusch cfbeb3edd7 Fix wrong error handling logic in php's build_interop.sh
If [[ "$DONE" != 1 ]] && echo "Failed to do composer install" && exit 1
is at the end of a shell script, even if DONE is 1, this will return with error
exit status. That's because [[ $DONE != 1 ]] has exitcode 1 and thus anything after && doesn't get executed
and the entire scripts exits the last exit code it seen (which is 1).
2020-04-23 16:18:22 +02:00
Jan Tattermusch 710be13856 refactor generate_proto_php.sh 2020-04-22 16:35:13 +02:00
Jan Tattermusch bb3b5d1d23 switch grpc-dart interop test to dart2.7 2020-04-08 11:52:03 -04:00