Commit Graph

477 Commits

Author SHA1 Message Date
Esun Kim 4edd63772e
Bump version of gcc and clang (#29594) 2022-05-06 10:26:03 -07:00
Craig Tiller 42b083322f
Check IWYU status in presubmits (#28180)
* fixes

* fixes

* fixes

* allow running outside docker

* x

* Automated change: Fix sanity tests

* fix

* fix

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-04-30 21:37:20 -07:00
Jan Tattermusch e8404698d5
Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225)
* remove examples/csharp

* remove reference to examples/csharp

* remove C# references from doc/

* remove src/csharp

* update test_creds locations

* remove C# distribtests

* remove buildgen templates for files under src/csharp

* remove grpc_csharp_ext C build target

* regenerate projects

* update tools/run_tests/README.md

* change many C# test/build scripts to noop

* unbreak run_tests.py -l csharp

* unbreak C# build_package targets

* unbreak C# distribtests

* remove C# pre-build steps from prepare_build_windows.bat

* remove src/csharp from clang_format

* remove csharp and csharpcoreclr from run_interop_tests.py

* remove C# interop test docker images

* Revert "remove src/csharp"

This reverts commit 97f2b6d707.

* remove src/csharp, but keep Grpc.Tools

* add back templates/src/csharp/build/dependencies.props.template

* remove everything but Grpc.Tools and Grpc.Tools.Tests from sln

* Revert "unbreak run_tests.py -l csharp"

This reverts commit 529b5e2ec1.

* revive Grpc.Tools.Tests through run_tests.py

* Revert "unbreak C# build_package targets"

This reverts commit 79d8d83c8b.

* experiment with build_nuget.sh fixes

* simplify create_fake_native_artifacts.sh

* building of Grpc.Tools in package_targets.py

* move shared files from Grpc.Core to Grpc.Tools

* yapf format: distribtest_targets.py

* Revert "remove C# pre-build steps from prepare_build_windows.bat"

This reverts commit bd38956a2b.

* update C# README.md

* disable C# in gke OSS benchmarks
2022-04-28 12:00:34 +02:00
Lidi Zheng 4f8b3f476b
Upgrade Python versions for CI Dockerfiles (#29186)
* Upgrade Python versions for CI Dockerfiles

* Generate project
2022-03-25 14:58:09 -07:00
Michael Lumish 28f1453ad5
Use a non-root user in Node interop docker images (#29062)
* Use a non-root user in Node interop docker images

* Make node interop scripts without being root

* Update cwd in Node interop tests

* Update cwd in other Node interop tests

* Update cwd in Node interop tests relative to hardcoded path

* Fix updated Node interop test cwd

* Make service account file location more generic

* Use service account creds directly from mounted directory

* Fixing source path is recursive local submodule clone.

* Move creds file to /root, make /root accessible

Co-authored-by: Nicolas "Pixel" Noble <pixel@nobis-crew.org>
2022-03-15 14:41:21 -07:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch d15711d2bb
Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Esun Kim 6a10e41db7
Upgrade IWYU to use clang 13 (#28891)
* Upgrade IWYU to use clang 13

* Update by review
2022-02-16 09:43:05 -08:00
Esun Kim 6565584c7b
Bump the minimum gcc to 5 (#28786) 2022-02-11 10:31:25 -08:00
Esun Kim 92738290ab
Upgrade base-builder to the latest for blaze build (#28768)
* Upgrade base-builder to the latest for blaze build

* Fix warnings.

* Added -Wno-deprecated-copy
2022-02-02 15:14:36 -08:00
Esun Kim 2057bfd182
Upgrade clang to 13 for clang-format, clang-tidy, and sanity (#28763) 2022-02-02 11:03:26 -08:00
Jan Tattermusch 1289cdae2e
Upgrade PHP docker images to debian11 (#28701)
* upgrade PHP docker images to debian11

* regenerate dockerfiles

* adjust testrunners to php debian11 images
2022-01-27 06:45:52 +01:00
Jan Tattermusch 2c1239c7fd
add back pip virtualenv back to ruby image for XDS tests (#28703) 2022-01-26 18:58:28 +01:00
Jan Tattermusch b0cdd3cba2
Cleanup (followup for ccache addition) (#28702)
* nit in python interop dockerfile

* address TODO in prepare_ccache_symlinks_rc

* enable ccache for C# and ruby distribtest jobs

* use debian11 instead of bullseye consistently
2022-01-26 18:56:46 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch 27b6b45c32
Upgrade C++ and Python docker images to debian stable (debian 11) (#28664)
* upgrade C++ and python docker images

* regenerate dockerfiles

* upgrade grpc_artifact_python docker images

* adjust run_tests scripts to dockerimages upgrades
2022-01-25 10:23:01 +01:00
Esun Kim 55d7631a99
Bump clang 12 to 13 (#28639) 2022-01-21 14:47:04 -08:00
Jan Tattermusch 98999225be
Speedup linux portability build_only tests (#28461)
* try speeding up linux portability test

* remove gcc8.3 portability test

* c-ares is the default resolver on linux

* dont set parallel run_tests jobs too high

* original parallelism might lead to better results
2022-01-12 14:56:28 +01:00
Jan Tattermusch 6b869a12fe
remove python2 from bazel docker images (#28458) 2022-01-05 20:10:19 +01:00
Esun Kim c007ea297c
Added virtualenv to ruby and php73 docker for psm (#28263) 2021-12-02 15:06:11 -08:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim 8e0a361cce
Update cxx docker images (#28162) 2021-11-22 14:53:06 -08:00
Jan Tattermusch 79b58431ed
Update csharp SDK to LTS versions (#27966)
* update C# SDK

* regenerate dockerfiles

* install .NET6 and .NET Core 3.1

* regenerate dockerfiles

* change netcoreapp2.1 targets to netcoreapp3.1

* update installed SDKs in aarch64 C# job

* update run_tests scripts to use netcoreapp3.1 for C#
2021-11-17 10:41:02 +01:00
Craig Tiller e602169fa0
First pass IWYU tooling (#27857)
* First pass IWYU tooling

* fix

* Automated change: Fix sanity tests

* Update iwyu.sh

* Update iwyu.sh

* Update Dockerfile.template

* Update iwyu.sh

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2021-11-05 12:05:13 -07:00
Richard Belleville 179a7c7459
Fix Python Interop (#27620) (#27703) (#27749)
* WIP. Attempt to fix interop

* Yapf
2021-10-15 18:22:29 -07:00
AJ Heller 9841366806
Upgrade libuv to v1.37.0 (#27684)
* Upgrade libuv to v1.42.0

Also eliminates some cruft from the node implementation from 5 years ago

* sanitize.sh added a blank line?? ok then.

* pin to libuv v1.37.0
2021-10-12 15:09:15 -07:00
Esun Kim 11d2f86e5e
Upgrade PHP7 docker image to use Debian 9 (#27537)
* Upgrade PHP7 docker image to use Debian 9

* update
2021-10-01 08:33:19 -07:00
Esun Kim 5690ea0106
Added gcc11 and clang12 tests (#27190) 2021-09-27 10:48:58 -07:00
Jan Tattermusch 0042c2b86f
Upgrade bazel to 4.2.1 (LTS), upgrade bazel toolchain to 4.1.0 (#27410)
* update bazel to 4.2.1

* add bazel 4.2.1 to update_mirror.sh

* regenerate dockerfiles

* upgrade bazel toolchains to 4.1.0

* use create_rbe_exec_properties_dict instead of the deprecated create_exec_properties_dict

* RBE ubsan doesnt require the crosstool_top hack anymore

* update rules_apple and build_bazel_apple_support
2021-09-23 16:20:25 +02:00
Craig Tiller bbf41f2980
Remove seemingly dead code (#27404)
* Remove seemingly dead code

* more cleanup
2021-09-20 04:40:22 -07:00
Esun Kim 420a98f96b
Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Craig Tiller 4966a6bcbd
Add tooling to auto-fix sanity tests (#26852)
* auto-fix experiment

* document optout

* temp fix
2021-08-05 14:37:04 -07:00
Esun Kim 6005cf4c4e
Upgrade gcr.io/oss-fuzz-base/base-builder to the latest (#26859)
* Upgrade gcr.io/oss-fuzz-base/base-builder to the latest
2021-08-02 16:52:15 -07:00
Lidi Zheng 25a849baf3
Fix pytype missing bz2 lib error (#26638) 2021-07-08 13:39:40 -07:00
Esun Kim 83681f2721
Revert "Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812)" (#25860)
This reverts commit b55fba3382.
2021-06-15 11:17:42 -07:00
Jan Tattermusch 288fe131b4
Reintroduce #22964 with extra fixes (#26465)
* Revert "Revert "Upgrade dotnet SDK 3 for C# build (#22964)" (#26462)"

This reverts commit 736d914cfd.

* Revert "Exclude csharp from performance test continuous runs. (#26458)"

This reverts commit 6744e8f84a.

* switch remaining tests to C# buster image

* remove C#'s global.json (which requires dotnet SDK 3+)

* dotnet SDK3 currently breaks C# package build

* regenerate dockerfiles
2021-06-15 18:50:13 +02:00
Esun Kim 736d914cfd
Revert "Upgrade dotnet SDK 3 for C# build (#22964)" (#26462)
This reverts commit a44bafec08.
2021-06-10 16:46:44 -07:00
Jan Tattermusch a44bafec08
Upgrade dotnet SDK 3 for C# build (#22964)
* upgrade dotnet SDK 3 for C# build

* add C# global.json

* install dotnet SDK 3 on macos

* upgrade C# docker images to debian buster

* regenerate dockerfiles
2021-06-09 09:25:48 +02:00
Jan Tattermusch 802375393a
Use go1.16 for go interop tests and for newly added interop_matrix tests. (#26124)
* use go1.16 for go interop tests

* add go1.16 runtime support for interop_matrix tests

* update copyright headers
2021-04-30 13:29:21 +02:00
Esun Kim b55fba3382
Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812)
This reverts commit 0147d99c41.
2021-03-25 11:28:10 -07:00
Esun Kim 0147d99c41
Added portability test with openssl 1.0.2 (#25770)
* Added openssl102 test to portability

* Update by review
2021-03-24 09:37:54 -07:00
Richard Belleville 1437dc9816
Fix pypa link (#25647)
* Fix pypa link

* And 3.5 as well
2021-03-08 17:26:52 -08:00
Esun Kim 377fe6095a
Upgrade clang-tidy and clang-format to 11 (#25590)
* Upgrade clang-tidy and clang-format to 11
* Reformat code
* Fix abseil-string-find-str-contains
* Fix modernize-make-unique
2021-03-04 11:54:30 -08:00
Esun Kim f862a2259f
Add abseil thread annotations to grpcpp/sync (#25560)
* Add abseil annotation to grpcpp/sync
* Bump alpine linux to 3.11 from 3.9
2021-03-03 08:39:20 -08:00
Lidi Zheng a6c5d6c43e
[xDS Proto] Pin PyPI dependencies in Dockerfiles (#25510) 2021-02-22 10:10:56 -08:00
Lidi Zheng c95e1ff0e5 Use template to generate the Dockerfile 2021-02-12 15:44:58 -08:00
Jan Tattermusch 2b6bebc8f5 pin version of gcr.io/oss-fuzz-base/base-builder 2021-02-11 15:59:23 +01:00
Jan Tattermusch 0507d4d49a remove no-longer-needed fuzzer dockerfile 2021-02-11 14:11:42 +01:00
Jan Tattermusch 5909eec5c6 fix getting pip for python3.5 2021-02-11 14:11:42 +01:00
Jan Tattermusch c4c493e8f4 use python27 specific pip in python dockerfiles 2021-02-11 14:11:42 +01:00