Commit Graph

941 Commits

Author SHA1 Message Date
Lidi Zheng 4f8b3f476b
Upgrade Python versions for CI Dockerfiles (#29186)
* Upgrade Python versions for CI Dockerfiles

* Generate project
2022-03-25 14:58:09 -07:00
Craig Tiller 766cd6b573
Remove epollex poller (#29160)
* start delete

* remove build.gn... again

* remove more

* Automated change: Fix sanity tests

* fixes

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-03-21 10:27:52 -07:00
Yash Tibrewal 01f333a1c1
TlsCredentials: Comparator implementation (#28940)
* TlsCredentials: Comparator implementation

* Update tests

* Redundant namespace qualifiers

* clang-tidy

* Reviewer comments

* Reviewer comments

* Reviewer comments

* Reviewer comments

* Reviewer comments

* Add generator for grpc_tls_credentials_options.h

* Generator script modifications for tests

* Sanity

* Reviewer comments

* Reviewer comments

* Add a common place to look-up known types

* Formatting

* Script fix

* Reviewer comments

* Add test mode to script

* Add to sanitize.sh

* clang-tidy

* Fix

* Fix

* Reviewer comments

* Clang-format
2022-03-16 17:11:07 -07:00
Michael Lumish 28f1453ad5
Use a non-root user in Node interop docker images (#29062)
* Use a non-root user in Node interop docker images

* Make node interop scripts without being root

* Update cwd in Node interop tests

* Update cwd in other Node interop tests

* Update cwd in Node interop tests relative to hardcoded path

* Fix updated Node interop test cwd

* Make service account file location more generic

* Use service account creds directly from mounted directory

* Fixing source path is recursive local submodule clone.

* Move creds file to /root, make /root accessible

Co-authored-by: Nicolas "Pixel" Noble <pixel@nobis-crew.org>
2022-03-15 14:41:21 -07:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch d15711d2bb
Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Esun Kim 2a699b9a09
Removed jessie-based distribtest (#29029)
* Removed jessie-based distribtest

* Update by review
2022-03-08 08:13:13 -08:00
AJ Heller 762cde4d24
Delete end2end nosec tests (#28946)
* rm nosec tests (TODO: identify coverage differences)

* grpc::load_reporter

* delete unused nosec test files & config

* trigger build

* re-delete nosec test file (snuck in with a merge)

* revert TODO deletion
2022-03-07 08:52:30 -08:00
Esun Kim 6a10e41db7
Upgrade IWYU to use clang 13 (#28891)
* Upgrade IWYU to use clang 13

* Update by review
2022-02-16 09:43:05 -08:00
Esun Kim 6565584c7b
Bump the minimum gcc to 5 (#28786) 2022-02-11 10:31:25 -08:00
Lidi Zheng cd4261b946
Support musllinux binary wheels on x64 and x86 (#28092)
* Support musllinux binary wheels

* Skip aarach64 for now
* Consolidate the difference of mktemp
* Extend linux artifact building time && install bash for distribtest
* Stop using grpc.tools, use grpc_tools
* Update the README to use grpc_tools
* Force static link libc++ for alpine binaries
* Rebase recent build script changes

* Install ccache for musllinux distribtest images

* Revert timeout change to grpc_build_artifacts
2022-02-10 14:14:56 -08:00
Esun Kim 92738290ab
Upgrade base-builder to the latest for blaze build (#28768)
* Upgrade base-builder to the latest for blaze build

* Fix warnings.

* Added -Wno-deprecated-copy
2022-02-02 15:14:36 -08:00
Esun Kim 2057bfd182
Upgrade clang to 13 for clang-format, clang-tidy, and sanity (#28763) 2022-02-02 11:03:26 -08:00
Jan Tattermusch c8c1774ec4
Revert "Revert "Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)" (#28741)" (#28748)
* Revert "Revert "Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)" (#28741)"

This reverts commit 9a79d44e9b.

* fix python distribtest failure on fedora34
2022-02-01 11:33:56 +01:00
Jan Tattermusch 1289cdae2e
Upgrade PHP docker images to debian11 (#28701)
* upgrade PHP docker images to debian11

* regenerate dockerfiles

* adjust testrunners to php debian11 images
2022-01-27 06:45:52 +01:00
Jan Tattermusch 2c1239c7fd
add back pip virtualenv back to ruby image for XDS tests (#28703) 2022-01-26 18:58:28 +01:00
Jan Tattermusch b0cdd3cba2
Cleanup (followup for ccache addition) (#28702)
* nit in python interop dockerfile

* address TODO in prepare_ccache_symlinks_rc

* enable ccache for C# and ruby distribtest jobs

* use debian11 instead of bullseye consistently
2022-01-26 18:56:46 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch 27b6b45c32
Upgrade C++ and Python docker images to debian stable (debian 11) (#28664)
* upgrade C++ and python docker images

* regenerate dockerfiles

* upgrade grpc_artifact_python docker images

* adjust run_tests scripts to dockerimages upgrades
2022-01-25 10:23:01 +01:00
Esun Kim 55d7631a99
Bump clang 12 to 13 (#28639) 2022-01-21 14:47:04 -08:00
Jan Tattermusch 98999225be
Speedup linux portability build_only tests (#28461)
* try speeding up linux portability test

* remove gcc8.3 portability test

* c-ares is the default resolver on linux

* dont set parallel run_tests jobs too high

* original parallelism might lead to better results
2022-01-12 14:56:28 +01:00
apolcyn 95b313de82
Remove ruby 2.4 support (#28522)
* changes to remove ruby 2.4 support

* some fixes

* remove opensuse since eol

* fixes

* remove unused x86 dockerfile

* stop building for ruby 2.4

* update build scripts

* fix scripts

* fix sanity

Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
2022-01-11 13:30:58 +01:00
Jan Tattermusch 6b869a12fe
remove python2 from bazel docker images (#28458) 2022-01-05 20:10:19 +01:00
apolcyn 3c368a5b2c
Don't gem install rake-compiler on macos setup scripts (#28415)
* Don't gem install rake-compiler on macos setup scripts
2021-12-28 09:57:33 -08:00
Esun Kim c007ea297c
Added virtualenv to ruby and php73 docker for psm (#28263) 2021-12-02 15:06:11 -08:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim 8e0a361cce
Update cxx docker images (#28162) 2021-11-22 14:53:06 -08:00
Jan Tattermusch 79b58431ed
Update csharp SDK to LTS versions (#27966)
* update C# SDK

* regenerate dockerfiles

* install .NET6 and .NET Core 3.1

* regenerate dockerfiles

* change netcoreapp2.1 targets to netcoreapp3.1

* update installed SDKs in aarch64 C# job

* update run_tests scripts to use netcoreapp3.1 for C#
2021-11-17 10:41:02 +01:00
Craig Tiller 6001ea84b9
Faster clang-format (#28086)
* use parallelism to speed clang-format performance

* use parallelism to speed clang-format performance
2021-11-16 06:59:13 -08:00
Craig Tiller e602169fa0
First pass IWYU tooling (#27857)
* First pass IWYU tooling

* fix

* Automated change: Fix sanity tests

* Update iwyu.sh

* Update iwyu.sh

* Update Dockerfile.template

* Update iwyu.sh

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2021-11-05 12:05:13 -07:00
Richard Belleville 179a7c7459
Fix Python Interop (#27620) (#27703) (#27749)
* WIP. Attempt to fix interop

* Yapf
2021-10-15 18:22:29 -07:00
Ming-Chuan bb1c7fce6c
Update bazel version to 4.2.1 in binder_transport_apk docker image (#27721)
This image is for testing binder transport Android APK build
2021-10-15 12:38:23 +08:00
AJ Heller 9841366806
Upgrade libuv to v1.37.0 (#27684)
* Upgrade libuv to v1.42.0

Also eliminates some cruft from the node implementation from 5 years ago

* sanitize.sh added a blank line?? ok then.

* pin to libuv v1.37.0
2021-10-12 15:09:15 -07:00
Esun Kim 11d2f86e5e
Upgrade PHP7 docker image to use Debian 9 (#27537)
* Upgrade PHP7 docker image to use Debian 9

* update
2021-10-01 08:33:19 -07:00
Lidi Zheng 9978223a26
Add python_requires field to grpcio-* packages (#27495)
- Update the run_tests.py and distrib tests
- Update the Dockerfiles
2021-09-28 16:01:15 -07:00
Esun Kim 5690ea0106
Added gcc11 and clang12 tests (#27190) 2021-09-27 10:48:58 -07:00
Jan Tattermusch 0042c2b86f
Upgrade bazel to 4.2.1 (LTS), upgrade bazel toolchain to 4.1.0 (#27410)
* update bazel to 4.2.1

* add bazel 4.2.1 to update_mirror.sh

* regenerate dockerfiles

* upgrade bazel toolchains to 4.1.0

* use create_rbe_exec_properties_dict instead of the deprecated create_exec_properties_dict

* RBE ubsan doesnt require the crosstool_top hack anymore

* update rules_apple and build_bazel_apple_support
2021-09-23 16:20:25 +02:00
Richard Belleville eada6c6e56
Update Alpine Test Image to Use Python 3.8 (#27415)
* Upgrade Alpine to Python 3.8

* Upgrade docker image to use 3.8
2021-09-20 19:38:36 -07:00
Jan Tattermusch 82d8bb089d
Use manylinux_2_17 instead of manylinux_2_24 tag for manylinux2014 aarch64 wheels (#27280)
* Let's see if the aarch64 manylinux bug is fixed or not

* rename aarch64 image back to manylinux2014 for consistency

* fix C# aarch64 artifact build

Co-authored-by: Lidi Zheng <lidiz@google.com>
2021-09-09 14:43:39 +02:00
Craig Tiller ea389c00c2
Adjust include order per style guide (#27175)
Introduce clang-format configuration to sort includes closer to our rules.
2021-09-08 12:14:44 -07:00
Richard Belleville 2349aad7a4
Install Python 3.10.0 (#27247) 2021-09-03 15:15:38 -07:00
Lidi Zheng 4729f6fdcc
Add Python 3.10 drop 3.5 (#26074)
* Add Python 3.10.0rc1 binary wheels

* Drop Python 3.5 artifacts

* Document the drop of 3.5

* Fix the wrong pip pointer

* Update manylinux2014 to a newer version, remove 3.5 distribtest

* Update manylinux aarch64 to see if the absl error go away

* Use the preferred alias

* Allow different wheel library to produce different tag order

* Remove unused shell var and log produced wheels

* Use copy instead of move

* Make bash happy about the wildcard

* Upgrade the debian image to use 3.5+ Python

* Polish the comments for the Dockerfiles
2021-09-02 14:02:53 -07:00
Ming-Chuan 44fc369f05
Add examples/android/binder/ to clang_format_all_the_things (#27114) 2021-08-28 05:12:24 +08:00
Esun Kim 420a98f96b
Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Craig Tiller 4966a6bcbd
Add tooling to auto-fix sanity tests (#26852)
* auto-fix experiment

* document optout

* temp fix
2021-08-05 14:37:04 -07:00
Esun Kim 6005cf4c4e
Upgrade gcr.io/oss-fuzz-base/base-builder to the latest (#26859)
* Upgrade gcr.io/oss-fuzz-base/base-builder to the latest
2021-08-02 16:52:15 -07:00
Nicolas Noble a325d7f77a
Pointing the protobuf submodule to the new URL (#26811)
* Pointing the protobuf submodule to the new URL

* Also changing WORKSPACE dependencies

* More references to the old URL...
2021-07-29 10:19:16 -07:00
Ming-Chuan db9fa2eaa0
Add Kokoro job for binder transport (#26783)
1. A new Dockerfile is added
2. Required configurations and scripts are added
2021-07-29 06:09:13 +08:00
Lidi Zheng 5820e152cd
Remove Python 2.7 binary wheel generations (#26691)
* Remove Python 2.7 binary wheels

* Make sure pip won't pick-up newer versions

* Attempt to fix the distribtest

* Fallback to virtualenv==16.7.9 for 34 and 35

* Remove 34 from binary wheel distribtests
2021-07-23 08:20:39 -07:00
Lidi Zheng 25a849baf3
Fix pytype missing bz2 lib error (#26638) 2021-07-08 13:39:40 -07:00