Commit Graph

56 Commits

Author SHA1 Message Date
Esun Kim 1ce1159a75 [CI] Moved to Bazel 7 (#36105)
Let's use Bazel 7 by default.

Closes #36105

PiperOrigin-RevId: 617653203
2024-03-20 16:16:12 -07:00
Esun Kim 0703276770 [CI] Bazel upgrade (#36104)
Upgraded Bazel as follows;
- Bazel 6.4 to 6.5
- Bazel 7.0 to 7.1

Closes #36104

PiperOrigin-RevId: 616237591
2024-03-15 14:08:10 -07:00
Esun Kim d77e5c0dd3
[Build] Dropped Bazel 5.x and Upgraded Bazel 6.4.0 (#34813)
- Dropped Bazel 5.x support aligned with [Foundational C++ support
policy:
Bazel](https://opensource.google/documentation/policies/cplusplus-support).
- Upgraded Bazel 6 to 6.4.0 (the latest)
- Updated gRPC Bazel documentation to be aligned with the policy above.
2023-11-06 15:47:29 -08:00
Jan Tattermusch 14f5d4768d
[bazelify tests] Add "concurrent_bazel.sh" wrapper to enable parallel invocations of bazel (#34568)
(I had to first solve a problem with "dubious file ownership" error that
was happening inside the grpc_repo_archive action when using the
concurrent wrapper).

Example:
```
tools/docker_runners/examples/concurrent_bazel.sh --bazelrc=tools/remote_build/linux.bazelrc test --genrule_strategy=remote,local --workspace_status_command=tools/bazelify_tests/workspace_status_cmd.sh //tools/bazelify_tests/test:runtests_csharp_linux_dbg
```
2023-10-06 01:02:40 -07:00
Jan Tattermusch d3548a3941
[bazel] Upgrade bazel repo-wide to 6.3.2 (#34088)
- Upgrade bazel
- Reduce the number of places where bazel version needs to be upgraded
in future.
- also make sure the list of bazel versions to test by bazelified tests
is loaded from supported_versions.txt (it was hardcoded before).
- ~~Try upgrading windows RBE build to bazel 6.3.2 as well.~~

The core idea:
- the source of truth for supported bazel versions is in
`bazel/supported_versions.txt`
- the first version listed in `bazel/supported_versions.txt` is
considered to be the "primary" bazel version and is going to be used in
most places thoroughout the repo.
- use templates to include the primary bazel version in testing
dockerfiles and in a newly introduced `.bazelversion` files (which gets
loaded by our existing `tools/bazel` wrapper).


~~Supersedes https://github.com/grpc/grpc/pull/33880~~
2023-08-18 10:11:33 +02:00
Jan Tattermusch a526a091ae
[docker images] Consolidate git directory ownership workaround and upgrade ccache (#34035)
Based on https://github.com/grpc/grpc/pull/34033

Bunch of cleanup and rebuilding many docker images from scratch
- consolidate the workaround for "dubious ownership" issue reported by
git. Other team members have run into this recently and used similar but
not identical workarounds so some cleanup is due.
- rebuilding many images increases the chance that we fix the "dubious
ownership" git issue early on rather than later on in the one-at-a-time
fashion in the future (and the former will prevent many teammembers from
wasting time on this weird issue).
- Newer version of ccache is needed for some portability tests to be
able to benefit from caching (e.g. the GCC 12 portability test to get
benefits of local disk caching) - this is a prerequisite for reenabling
the bazelified gcc12 portability test.
- upgrade node interop images to debian:11 (since debian jessie is long
past EOL).
2023-08-17 00:28:21 +02:00
Esun Kim 3bd6c38650
[Infra] Use Bazel 6 and drop Bazel 4 (Part 2) (#32910)
Oops I missed important changes from
https://github.com/grpc/grpc/pull/32712. And it turned out that there
are two problems that I couldn't fix at this point.
- Windows Bazel RBE Linker Error: This may be caused by how new Bazel 6
invokes build tools chain but it's not clear. I put workaround to use
Bazel 5 by using `OVERRIDE_BAZEL_VERSION=5.4.1`
- Rule `rules_pods` to fetch CronetFramework from CocoaPod has
incompatibility with sort of built-in apple toolchain.
(https://github.com/bazel-xcode/PodToBUILD/issues/232): I couldn't find
a workaround to fix this so I ended up disabling all tests depending
this target.
2023-04-21 15:53:52 -07:00
Richard Belleville 86bd0721ea
[fork] Generate GDB backtraces in fork tests on Kokoro (#32535)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-03-08 10:30:46 -08:00
Esun Kim faa80eaa10
Updated clang 15 images (#32317)
This is to get the latest version of clang 15 (15.0.7) for our docker
images based on that. By doing so, I had to address this new git
security enforcement so I added a new file to tame it. In a nutshell,
this PR is about polishing docker images based on clang 15.
2023-02-13 13:06:07 -08:00
Richard Belleville b15097142a
Silence dubious ownership issue in bazel image (#30963)
* Silence dubious ownership issue in bazel image

* Agh. It's a template
2022-09-13 16:42:21 -07:00
Jan Tattermusch 631392f2e7
Upgrade bazel version to bazel 5.3 (repo-wide) (#30844)
* update bazel to 5.3.0

* regenerate dockerfiles

* update bazel distribtest

* update docker image templates

* regenerate dockerfiles 2

* regenerate bazel_support.md

* upgrade rules_apple and apple_support bazel deps

* Revert "upgrade rules_apple and apple_support bazel deps"

This reverts commit eb9a0d2155.

* fix objc bazel 5.3 build on kokoro mojave image
2022-09-08 11:18:54 +02:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Esun Kim 92738290ab
Upgrade base-builder to the latest for blaze build (#28768)
* Upgrade base-builder to the latest for blaze build

* Fix warnings.

* Added -Wno-deprecated-copy
2022-02-02 15:14:36 -08:00
Jan Tattermusch 27b6b45c32
Upgrade C++ and Python docker images to debian stable (debian 11) (#28664)
* upgrade C++ and python docker images

* regenerate dockerfiles

* upgrade grpc_artifact_python docker images

* adjust run_tests scripts to dockerimages upgrades
2022-01-25 10:23:01 +01:00
Jan Tattermusch 6b869a12fe
remove python2 from bazel docker images (#28458) 2022-01-05 20:10:19 +01:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Jan Tattermusch 0042c2b86f
Upgrade bazel to 4.2.1 (LTS), upgrade bazel toolchain to 4.1.0 (#27410)
* update bazel to 4.2.1

* add bazel 4.2.1 to update_mirror.sh

* regenerate dockerfiles

* upgrade bazel toolchains to 4.1.0

* use create_rbe_exec_properties_dict instead of the deprecated create_exec_properties_dict

* RBE ubsan doesnt require the crosstool_top hack anymore

* update rules_apple and build_bazel_apple_support
2021-09-23 16:20:25 +02:00
Esun Kim 6005cf4c4e
Upgrade gcr.io/oss-fuzz-base/base-builder to the latest (#26859)
* Upgrade gcr.io/oss-fuzz-base/base-builder to the latest
2021-08-02 16:52:15 -07:00
Richard Belleville 1437dc9816
Fix pypa link (#25647)
* Fix pypa link

* And 3.5 as well
2021-03-08 17:26:52 -08:00
Jan Tattermusch 2b6bebc8f5 pin version of gcr.io/oss-fuzz-base/base-builder 2021-02-11 15:59:23 +01:00
Jan Tattermusch cd53c55269 regenerate dockerfiles 2021-02-11 14:11:42 +01:00
Jan Tattermusch caddd2f3e9 regenerate dockerfiles 2020-12-15 17:34:46 +01:00
Esun Kim a07345a5e2 Upgrade six 1.15 2020-10-08 12:46:00 -07:00
Jan Tattermusch bc4d478a21 regenerate dockerfiles 2020-08-20 16:49:58 +02:00
Stanley Cheung 7d8f295ab0 Fix run_tests pip install error 2020-05-13 10:59:09 -07:00
Lidi Zheng b2f72702c9 Pin virtualenv to 16.7.9 2020-02-11 11:05:23 -08:00
Lidi Zheng fe919dd71e Pin to 19.3.1 2019-12-19 10:53:55 -08:00
Lidi Zheng 0404939ad0 Let our CI use the latest pip version 2019-12-19 10:53:55 -08:00
Jan Tattermusch e5e3f70a1a Revert "Revert "Upgrade to bazel 1.0.0"" 2019-10-29 06:31:38 -04:00
Lidi Zheng 6f878d5d12 Generate Docker files 2019-10-21 17:41:14 -07:00
Nicolas Noble 04d7e0d11f
Revert "Upgrade to bazel 1.0.0" 2019-10-15 14:26:32 -07:00
Jan Tattermusch 27f1a94aa5 upgrade to bazel 1.0.0 2019-10-14 10:20:59 -04:00
Jan Tattermusch 98d2d32b9e upgrade to bazel 0.29.1 2019-09-10 12:11:19 -04:00
Jan Tattermusch 107db8dab4 upgrade bazel to 0.29 2019-09-10 12:07:45 -04:00
Jan Tattermusch 4e8ecb9fe6
Revert "Upgrade to Bazel 0.29 (including Windows RBE)" 2019-09-06 12:31:45 +02:00
Jan Tattermusch 36574888be upgrade bazel to 0.29 2019-09-04 02:59:50 -04:00
Richard Belleville 1444cd1dd3 Revert "Revert "Merge pull request #20097 from gnossen/dual_version_python_tests""
This reverts commit 24c562dbaa.
2019-08-29 10:51:36 -07:00
Richard Belleville 24c562dbaa Revert "Merge pull request #20097 from gnossen/dual_version_python_tests"
This reverts commit c9c847f334, reversing
changes made to 07ba4de392.
2019-08-29 10:47:44 -07:00
Jan Tattermusch b7667478cf bump bazel version to 0.27 2019-08-27 17:39:15 -07:00
Nicolas "Pixel" Noble 46ed7524f9 Bazel version syncup. 2019-06-14 07:35:27 +02:00
Jan Tattermusch e66fb82495 disable bazel wrapper inside docker containers 2019-06-05 16:53:12 -04:00
Jan Tattermusch ed7e8c53e0 update scripts 2019-06-05 14:21:51 -04:00
Jan Tattermusch b53e707c3c update bazel version in dockerfile 2019-05-23 17:54:40 +02:00
Bill Feng d74e4079c5 upgrade bazel to 0.23.2 for docker legacy bazel builds
excluded Python tests from Bazel legacy C/C++ Kokoro CI jobs
disabled building examples due to existance of python
2019-04-04 17:22:03 -07:00
Lidi Zheng c372768fee Install Bazel using its installation script 2019-01-31 12:10:43 -08:00
yang-g f29c56bff5 Update templates too 2019-01-18 13:32:57 -08:00
yang-g 0d22c2ff48 Add comment to keep Dockerfile up to date against oss-fuzz 2019-01-18 11:39:39 -08:00
Jan Tattermusch 4de6dac703 upgrade bazel in Dockerfile to 0.17.1 2018-10-30 21:09:10 +01:00
Naresh ebcf04d075
Kokoro setup for building gRPC Python with Bazel
In preparation for #8079, new CI tests have to be added to Kokoro for
testing gRPC Python with Bazel.

python-dev has to installed so that Python.h headers are available for
building Cython code.
2018-07-13 15:28:33 +00:00
Naresh b6518afdd6
Upgrade Bazel to 0.15.0 2018-07-12 19:35:11 +00:00