Commit Graph

494 Commits

Author SHA1 Message Date
Richard Belleville 86bd0721ea
[fork] Generate GDB backtraces in fork tests on Kokoro (#32535)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-03-08 10:30:46 -08:00
Esun Kim faa80eaa10
Updated clang 15 images (#32317)
This is to get the latest version of clang 15 (15.0.7) for our docker
images based on that. By doing so, I had to address this new git
security enforcement so I added a new file to tame it. In a nutshell,
this PR is about polishing docker images based on clang 15.
2023-02-13 13:06:07 -08:00
Esun Kim 564a46291b
Update all Debian:9 to Debian:10 (#31917) 2023-01-23 10:50:41 -08:00
Esun Kim 25b0aff1e7
Update a sanity docker image to run iwyu (#31956)
* Added missing iwyu deps

* Docker image pushed
2022-12-21 14:54:38 -08:00
Doug Fawley a65382d9f9
Use go1.19 for go interop tests and for future interop_matrix tests (#31732) 2022-11-22 13:07:36 -08:00
Esun Kim 50fbe51238
Fix IWYU with clang-15 (#31556)
* Fix iwyu

* iwyu fix

* more fixed

* Build fix

* more fix

* More fixes 3
2022-11-04 15:49:56 -07:00
Jan Tattermusch 401c751cb4
Update dart SDK version in dart interop image (#31542)
* update dart SDK version in dart interop image

* fix dart interop docker build
2022-11-04 09:27:27 -07:00
Esun Kim 530b702259
Update Clang 15 (#31518)
* clang-15

* iwyu

* run clang_format_code

* Clang-Tidy config

* Fix misc-unused-using-decls

* Fixed performance-inefficient-vector-operation

* Sanity
2022-11-04 09:08:03 -07:00
Jan Tattermusch 78fd1f637a
Run grpc_android job under docker for better maintainability. (#31504)
* run grpc_android in a docker container

* add TODO

* fixup android_ndk dockerfile
2022-11-02 11:09:19 +01:00
Eric Anderson 9098d8b8db
Upgrade Java interop to Bullseye and Java 11 (#30599) 2022-10-20 13:44:18 -07:00
Jan Tattermusch 3f1c3f23bd
Python virtualenv dockerfile cleanup (#31139)
* python tests install pinned virtualenv themselves

* more alpine image simplifications

* regenerate alpine image

* introduce dockerfile template for xds interop tests harness deps

* cleanup interop_http2 docker image, remove python_deps.include
2022-10-04 19:20:02 +02:00
Richard Belleville b15097142a
Silence dubious ownership issue in bazel image (#30963)
* Silence dubious ownership issue in bazel image

* Agh. It's a template
2022-09-13 16:42:21 -07:00
Esun Kim e90972bef6
Bump gcc 6 to 7 (#30903)
* Bump gcc 6 to 7

* Update

* Update 2
2022-09-09 09:23:11 -07:00
Jan Tattermusch 631392f2e7
Upgrade bazel version to bazel 5.3 (repo-wide) (#30844)
* update bazel to 5.3.0

* regenerate dockerfiles

* update bazel distribtest

* update docker image templates

* regenerate dockerfiles 2

* regenerate bazel_support.md

* upgrade rules_apple and apple_support bazel deps

* Revert "upgrade rules_apple and apple_support bazel deps"

This reverts commit eb9a0d2155.

* fix objc bazel 5.3 build on kokoro mojave image
2022-09-08 11:18:54 +02:00
apolcyn 8b941bb648
Drop support for ruby 2.5 (#30699)
* Drop ruby 2.5 support
2022-08-25 21:39:31 -07:00
Esun Kim 8f7927f7bc
Added gcc12 (#30388) 2022-07-22 14:32:49 -07:00
Eric Anderson f4c162f30d
Allow Gradle to use more memory when building Java interop (#30249)
Should fix "Expiring Daemon because JVM heap space is exhausted".

https://github.com/grpc/grpc-java/pull/9269 probably pushed the build
over the edge, but there's been evidence via flakes for a good while
that we've been reaching the limit.

b/238438006
2022-07-08 13:00:12 -07:00
Esun Kim 4edd63772e
Bump version of gcc and clang (#29594) 2022-05-06 10:26:03 -07:00
Craig Tiller 42b083322f
Check IWYU status in presubmits (#28180)
* fixes

* fixes

* fixes

* allow running outside docker

* x

* Automated change: Fix sanity tests

* fix

* fix

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-04-30 21:37:20 -07:00
Jan Tattermusch e8404698d5
Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225)
* remove examples/csharp

* remove reference to examples/csharp

* remove C# references from doc/

* remove src/csharp

* update test_creds locations

* remove C# distribtests

* remove buildgen templates for files under src/csharp

* remove grpc_csharp_ext C build target

* regenerate projects

* update tools/run_tests/README.md

* change many C# test/build scripts to noop

* unbreak run_tests.py -l csharp

* unbreak C# build_package targets

* unbreak C# distribtests

* remove C# pre-build steps from prepare_build_windows.bat

* remove src/csharp from clang_format

* remove csharp and csharpcoreclr from run_interop_tests.py

* remove C# interop test docker images

* Revert "remove src/csharp"

This reverts commit 97f2b6d707.

* remove src/csharp, but keep Grpc.Tools

* add back templates/src/csharp/build/dependencies.props.template

* remove everything but Grpc.Tools and Grpc.Tools.Tests from sln

* Revert "unbreak run_tests.py -l csharp"

This reverts commit 529b5e2ec1.

* revive Grpc.Tools.Tests through run_tests.py

* Revert "unbreak C# build_package targets"

This reverts commit 79d8d83c8b.

* experiment with build_nuget.sh fixes

* simplify create_fake_native_artifacts.sh

* building of Grpc.Tools in package_targets.py

* move shared files from Grpc.Core to Grpc.Tools

* yapf format: distribtest_targets.py

* Revert "remove C# pre-build steps from prepare_build_windows.bat"

This reverts commit bd38956a2b.

* update C# README.md

* disable C# in gke OSS benchmarks
2022-04-28 12:00:34 +02:00
Lidi Zheng 4f8b3f476b
Upgrade Python versions for CI Dockerfiles (#29186)
* Upgrade Python versions for CI Dockerfiles

* Generate project
2022-03-25 14:58:09 -07:00
Michael Lumish 28f1453ad5
Use a non-root user in Node interop docker images (#29062)
* Use a non-root user in Node interop docker images

* Make node interop scripts without being root

* Update cwd in Node interop tests

* Update cwd in other Node interop tests

* Update cwd in Node interop tests relative to hardcoded path

* Fix updated Node interop test cwd

* Make service account file location more generic

* Use service account creds directly from mounted directory

* Fixing source path is recursive local submodule clone.

* Move creds file to /root, make /root accessible

Co-authored-by: Nicolas "Pixel" Noble <pixel@nobis-crew.org>
2022-03-15 14:41:21 -07:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch d15711d2bb
Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Esun Kim 6a10e41db7
Upgrade IWYU to use clang 13 (#28891)
* Upgrade IWYU to use clang 13

* Update by review
2022-02-16 09:43:05 -08:00
Esun Kim 6565584c7b
Bump the minimum gcc to 5 (#28786) 2022-02-11 10:31:25 -08:00
Esun Kim 92738290ab
Upgrade base-builder to the latest for blaze build (#28768)
* Upgrade base-builder to the latest for blaze build

* Fix warnings.

* Added -Wno-deprecated-copy
2022-02-02 15:14:36 -08:00
Esun Kim 2057bfd182
Upgrade clang to 13 for clang-format, clang-tidy, and sanity (#28763) 2022-02-02 11:03:26 -08:00
Jan Tattermusch 1289cdae2e
Upgrade PHP docker images to debian11 (#28701)
* upgrade PHP docker images to debian11

* regenerate dockerfiles

* adjust testrunners to php debian11 images
2022-01-27 06:45:52 +01:00
Jan Tattermusch 2c1239c7fd
add back pip virtualenv back to ruby image for XDS tests (#28703) 2022-01-26 18:58:28 +01:00
Jan Tattermusch b0cdd3cba2
Cleanup (followup for ccache addition) (#28702)
* nit in python interop dockerfile

* address TODO in prepare_ccache_symlinks_rc

* enable ccache for C# and ruby distribtest jobs

* use debian11 instead of bullseye consistently
2022-01-26 18:56:46 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch 27b6b45c32
Upgrade C++ and Python docker images to debian stable (debian 11) (#28664)
* upgrade C++ and python docker images

* regenerate dockerfiles

* upgrade grpc_artifact_python docker images

* adjust run_tests scripts to dockerimages upgrades
2022-01-25 10:23:01 +01:00
Esun Kim 55d7631a99
Bump clang 12 to 13 (#28639) 2022-01-21 14:47:04 -08:00
Jan Tattermusch 98999225be
Speedup linux portability build_only tests (#28461)
* try speeding up linux portability test

* remove gcc8.3 portability test

* c-ares is the default resolver on linux

* dont set parallel run_tests jobs too high

* original parallelism might lead to better results
2022-01-12 14:56:28 +01:00
Jan Tattermusch 6b869a12fe
remove python2 from bazel docker images (#28458) 2022-01-05 20:10:19 +01:00
Esun Kim c007ea297c
Added virtualenv to ruby and php73 docker for psm (#28263) 2021-12-02 15:06:11 -08:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim 8e0a361cce
Update cxx docker images (#28162) 2021-11-22 14:53:06 -08:00
Jan Tattermusch 79b58431ed
Update csharp SDK to LTS versions (#27966)
* update C# SDK

* regenerate dockerfiles

* install .NET6 and .NET Core 3.1

* regenerate dockerfiles

* change netcoreapp2.1 targets to netcoreapp3.1

* update installed SDKs in aarch64 C# job

* update run_tests scripts to use netcoreapp3.1 for C#
2021-11-17 10:41:02 +01:00
Craig Tiller e602169fa0
First pass IWYU tooling (#27857)
* First pass IWYU tooling

* fix

* Automated change: Fix sanity tests

* Update iwyu.sh

* Update iwyu.sh

* Update Dockerfile.template

* Update iwyu.sh

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2021-11-05 12:05:13 -07:00
Richard Belleville 179a7c7459
Fix Python Interop (#27620) (#27703) (#27749)
* WIP. Attempt to fix interop

* Yapf
2021-10-15 18:22:29 -07:00
AJ Heller 9841366806
Upgrade libuv to v1.37.0 (#27684)
* Upgrade libuv to v1.42.0

Also eliminates some cruft from the node implementation from 5 years ago

* sanitize.sh added a blank line?? ok then.

* pin to libuv v1.37.0
2021-10-12 15:09:15 -07:00
Esun Kim 11d2f86e5e
Upgrade PHP7 docker image to use Debian 9 (#27537)
* Upgrade PHP7 docker image to use Debian 9

* update
2021-10-01 08:33:19 -07:00
Esun Kim 5690ea0106
Added gcc11 and clang12 tests (#27190) 2021-09-27 10:48:58 -07:00
Jan Tattermusch 0042c2b86f
Upgrade bazel to 4.2.1 (LTS), upgrade bazel toolchain to 4.1.0 (#27410)
* update bazel to 4.2.1

* add bazel 4.2.1 to update_mirror.sh

* regenerate dockerfiles

* upgrade bazel toolchains to 4.1.0

* use create_rbe_exec_properties_dict instead of the deprecated create_exec_properties_dict

* RBE ubsan doesnt require the crosstool_top hack anymore

* update rules_apple and build_bazel_apple_support
2021-09-23 16:20:25 +02:00
Craig Tiller bbf41f2980
Remove seemingly dead code (#27404)
* Remove seemingly dead code

* more cleanup
2021-09-20 04:40:22 -07:00
Esun Kim 420a98f96b
Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Craig Tiller 4966a6bcbd
Add tooling to auto-fix sanity tests (#26852)
* auto-fix experiment

* document optout

* temp fix
2021-08-05 14:37:04 -07:00
Esun Kim 6005cf4c4e
Upgrade gcr.io/oss-fuzz-base/base-builder to the latest (#26859)
* Upgrade gcr.io/oss-fuzz-base/base-builder to the latest
2021-08-02 16:52:15 -07:00