Commit Graph

39 Commits

Author SHA1 Message Date
Jan Tattermusch a526a091ae
[docker images] Consolidate git directory ownership workaround and upgrade ccache (#34035)
Based on https://github.com/grpc/grpc/pull/34033

Bunch of cleanup and rebuilding many docker images from scratch
- consolidate the workaround for "dubious ownership" issue reported by
git. Other team members have run into this recently and used similar but
not identical workarounds so some cleanup is due.
- rebuilding many images increases the chance that we fix the "dubious
ownership" git issue early on rather than later on in the one-at-a-time
fashion in the future (and the former will prevent many teammembers from
wasting time on this weird issue).
- Newer version of ccache is needed for some portability tests to be
able to benefit from caching (e.g. the GCC 12 portability test to get
benefits of local disk caching) - this is a prerequisite for reenabling
the bazelified gcc12 portability test.
- upgrade node interop images to debian:11 (since debian jessie is long
past EOL).
2023-08-17 00:28:21 +02:00
Jan Tattermusch 4c3ff07dac
[bazel] Reintroduce bazelified ruby and python tests (#34033)
Reintroduce https://github.com/grpc/grpc/pull/33959.

I added a fix for the python arm64 build (which is the reason why the
change has been reverted earlier).
2023-08-16 19:00:19 +02:00
Xuan Wang 08659ad1c3
Revert "[bazel] Add bazelified run_tests.py tests for ruby and python" (#33999)
Reverts grpc/grpc#33959
2023-08-07 12:43:55 -07:00
Jan Tattermusch cb235a3e22
[bazel] Add bazelified run_tests.py tests for ruby and python (#33959)
Context: https://github.com/grpc/grpc/pull/33707

Add python and ruby tests. Both required a few fixes so I wanted to add
them separately from https://github.com/grpc/grpc/pull/33707

Manual run of all the tests:
https://source.cloud.google.com/results/invocations/24c7b6ed-a8b3-4367-a4bf-8828919a9340
2023-08-07 16:14:17 +02:00
apolcyn 8b941bb648
Drop support for ruby 2.5 (#30699)
* Drop ruby 2.5 support
2022-08-25 21:39:31 -07:00
Jan Tattermusch d15711d2bb
Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim 420a98f96b
Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Richard Belleville 1437dc9816
Fix pypa link (#25647)
* Fix pypa link

* And 3.5 as well
2021-03-08 17:26:52 -08:00
Jan Tattermusch cd53c55269 regenerate dockerfiles 2021-02-11 14:11:42 +01:00
Jan Tattermusch 64e33aa505 cmake not needed for grpc_interop_ruby 2020-12-12 17:56:23 +01:00
Jan Tattermusch c5c123efc9 add cmake to ruby dockerfiles 2020-12-09 11:54:45 +01:00
Esun Kim a07345a5e2 Upgrade six 1.15 2020-10-08 12:46:00 -07:00
Stanley Cheung 7d8f295ab0 Fix run_tests pip install error 2020-05-13 10:59:09 -07:00
Lidi Zheng b2f72702c9 Pin virtualenv to 16.7.9 2020-02-11 11:05:23 -08:00
Lidi Zheng fe919dd71e Pin to 19.3.1 2019-12-19 10:53:55 -08:00
Lidi Zheng 0404939ad0 Let our CI use the latest pip version 2019-12-19 10:53:55 -08:00
Eric Anderson 1f84f8950c Remove vestigial sed for /etc/apt/sources.list in Dockerfiles
Jessie has a line that looks like this, now-a-days, so the regex is no
longer matching:
deb http://security.debian.org/debian-security jessie/updates main

But because that line was changed, downloads are also working correctly
out-of-the-box. The sed was originally added in #18530.
2019-04-04 17:45:00 -07:00
murgatroid99 f08b3ffa67 Fix ruby bundler package version mismatch 2019-03-28 17:08:09 -07:00
murgatroid99 2a12b47f0b Fix other docker build issues 2019-03-28 15:56:08 -07:00
Alexander Polcyn 67f523ce13 Add support for ruby 2.6.0 binary package builds, drop 2.1 and 2.0
binary package builds; pin bundler to 1.17.3 where necessary
2019-01-03 18:08:05 +00:00
Jan Tattermusch e1efb43345
Revert "Install pyyaml through pip in docker" 2018-06-18 16:03:59 +02:00
Alex Polcyn f3fb98e75f Install pyyaml through pip in docker 2018-06-14 06:44:56 +00:00
Jan Tattermusch 0c4a3ba63b regenerate dockerfiles 2018-05-23 06:29:19 +02:00
Jan Tattermusch 2e679e664d
Revert "Remove ccache from all docker images" 2018-05-19 06:25:35 -07:00
Jan Tattermusch 80095a046c regenerate dockerfiles 2018-05-18 00:29:31 +02:00
Mehrdad Afshari c176917789 Bump Python protobuf to 3.5.2.post1 2018-04-19 15:48:31 -04:00
Mehrdad Afshari d0d8ce8568 Bump pip version to 10.0.1 2018-04-19 15:48:23 -04:00
Matt Kwong 4598eb8a7a Update pip pin from 9.0.1 to 9.0.2 2018-04-06 15:37:37 -07:00
Mehrdad Afshari 0df9c8acdc Update Python dependency to protobuf v3.5.0.post1 2017-11-27 12:52:41 -08:00
Nathaniel Manista 8bba3bfc25 Pin pip at 9.0.1 2017-09-28 17:28:01 +00:00
Alexander Polcyn 27bf05d003 Add tests for c-ares wrapper using a local DNS server. 2017-09-14 14:32:30 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Mehrdad Afshari 9b3c73d1cd Updated protobuf dependency for python to 3.2.0 2017-03-07 22:10:15 +00:00
siddharthshukla 0589e533cd Make testing toolchain python 3.x compliant
six is necessary for making these scripts cross compatible
between python 2.x and 3.x

Changes:
Add six to python_deps.include
Include python_deps.include to all Dockerfile templates in test directory
Include python_deps.include to all Dockerfile templates in stress_test directory
Include python_deps.include to all Dockerfile templates in interop_test directory
Replace print statements with print function calls (from futute..)
Replace .iteritems() with .items() wherever necessary
use six.moves to import BaseHTTPServer
Generate new dockerfiles using generate_projects.sh
2016-07-12 01:35:53 +02:00
Craig Tiller eda85c6765 Expunge all references to zookeeper 2016-07-01 12:45:19 -07:00
Jan Tattermusch 24b68cd62f generate interop test Dockerfiles using templates 2016-04-27 15:31:11 -07:00
Jan Tattermusch c218d05029 move interop test docker files to a subdir 2016-04-27 15:27:55 -07:00