Commit Graph

1022 Commits

Author SHA1 Message Date
Craig Tiller 2bcca66712
[fuzzing] Roll forward dep on fuzztest (#32667)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->

---------

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2023-03-21 13:37:32 -07:00
Craig Tiller 522bed8cc6
Revert "[fuzzing] Add dep on google fuzz test" (#32666)
Reverts grpc/grpc#32578
2023-03-20 20:31:06 -07:00
Craig Tiller dbb131b193
[fuzzing] Add dep on google fuzz test (#32578)
Initial PR to establish a bazel dependency on
https://github.com/google/fuzztest, with which I'm planning on basing a
hardening program.

Casting a relatively wide net with reviewers: I'm genuinely interested
in feedback building up the docs, and general ergonomics of this change.

I've located relevant files in the `fuzztest/...` directory. The tests
only build with the `--config fuzztest` bazel argument for now (because
of needing C++17), so locating them separately keeps `bazel test
test/...` working as it does today. In a few years time, when we adopt
C++17, we'll be able to rationalize the test directories a little bit.

We'll need to add some kokoro jobs (maybe with this PR?) to execute the
relevant tests.

<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->

---------

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2023-03-20 17:45:52 -07:00
Stanley Cheung 40ccf97217
Observability Testing: Pass interop parameters to each lang's run.sh script as-is (#32586)
Each `run.sh` should just pass those parameters through to the interop
client/server binaries as-is.

Corresponding framework PR:
https://github.com/GoogleCloudPlatform/grpc-gcp-tools/pull/28
2023-03-10 11:48:57 -08:00
Richard Belleville 86bd0721ea
[fork] Generate GDB backtraces in fork tests on Kokoro (#32535)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-03-08 10:30:46 -08:00
Stanley Cheung db62c06171
GCP Observability testing for C++ (#32531)
Third try for #32466. 

This adds an interop client / server for GCP Observability integration
testing.

Everything is new here with no refactor. Plan is to get this in first
before trying to refactor out the flags.
2023-03-02 18:10:48 -08:00
Craig Tiller 78c799bce6
Revert "GCP Observability testing for C++" (#32518)
Reverts grpc/grpc#32466
2023-03-01 23:11:07 -08:00
Stanley Cheung f217a732d3
GCP Observability testing for C++ (#32466)
This PR enables GCP Observability testing for C++.

This re-uses the existing interop test client and server and adds an
`--enable_observability=true` flag.

This also adds a `Dockerfile` and `run.sh` script to allow the test
framework to execute the test.


Framework PR:
https://github.com/GoogleCloudPlatform/grpc-gcp-tools/pull/18
Java PR: https://github.com/grpc/grpc-java/pull/9858
Golang PR: https://github.com/grpc/grpc-go/pull/5979
2023-03-01 14:25:02 -08:00
Esun Kim faa80eaa10
Updated clang 15 images (#32317)
This is to get the latest version of clang 15 (15.0.7) for our docker
images based on that. By doing so, I had to address this new git
security enforcement so I added a new file to tame it. In a nutshell,
this PR is about polishing docker images based on clang 15.
2023-02-13 13:06:07 -08:00
Yash Tibrewal f2d5c47ff3
xDS Interop: Update tracers (#32352)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-02-10 18:22:07 -08:00
Mickaël Guérin 56ad4d964a
Support python 3.11 on aarch64 (#32270)
* Support python 3.11 on aarch64

Fixes https://github.com/grpc/grpc/issues/30927

* Change base tag to something more specific

* Update current version

---------

Co-authored-by: Richard Belleville <rbellevi@google.com>
2023-02-06 12:21:59 -08:00
Esun Kim 564a46291b
Update all Debian:9 to Debian:10 (#31917) 2023-01-23 10:50:41 -08:00
apolcyn 86d314a4cb
Undrop ruby 2.6 (#32160) 2023-01-20 09:36:59 -08:00
apolcyn c1a4b526fb
[ruby]: add pre-compiled binaries for ruby 3.2; drop them for ruby 2.6 (#32089)
[ruby]: add pre-compiled binaries for ruby 3.2; drop them for ruby 2.6
2023-01-19 15:32:26 -08:00
Craig Tiller feb43c589f
[iwyu] Better error checking in script (#31957)
* fff

* fff

* fff

* better error checking

* x

* fix

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-12-21 14:55:33 -08:00
Esun Kim 25b0aff1e7
Update a sanity docker image to run iwyu (#31956)
* Added missing iwyu deps

* Docker image pushed
2022-12-21 14:54:38 -08:00
Craig Tiller 49a3035d44
[iwyu] Fix CI job (#31921)
* fix-includes

* fix

* fix

* fix

* fix

* fix

* Automated change: Fix sanity tests

* add warning label

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-12-19 08:18:39 -08:00
Jan Tattermusch 7ab2a95979
More cleanup after moving testing docker images to artifact registry. (#31689)
* remove DOCKERHUB_ORGANIZATION from prepare_build_interop_rc

* switch rubys rake-compiler-dock to .current_version files

* remove DOCKERHUB_ORGANIZATION from prepare_build_linux_rc

* fix .current_version files for third_party/rake-compiler-dock

* fix: avoid .current_version files named */.current_version

* fix: avoid pushing in local only mode
2022-11-24 14:09:16 +01:00
Eric Anderson 8770adcbb7
tools/dockerfile: Document how to configure pkg.dev authentication (#31746) 2022-11-22 15:48:07 -08:00
Doug Fawley a65382d9f9
Use go1.19 for go interop tests and for future interop_matrix tests (#31732) 2022-11-22 13:07:36 -08:00
Jan Tattermusch ed39634fe8
Move docker images from dockerhub to artifact registry. (#31591)
* push_testing_images.sh overhaul

* simplify dockerize scripts

* update run_in_docker.sh script

* add generated .current_version files for docker images

* improvements to push_testing_images.sh

* add local-only check for push_testing_images.sh to sanity tests

* fix sanity check

* add expiration for TRANSFER_FROM_DOCKERHUB

* add a readme file
2022-11-17 10:12:39 +01:00
Esun Kim 50fbe51238
Fix IWYU with clang-15 (#31556)
* Fix iwyu

* iwyu fix

* more fixed

* Build fix

* more fix

* More fixes 3
2022-11-04 15:49:56 -07:00
Jan Tattermusch 401c751cb4
Update dart SDK version in dart interop image (#31542)
* update dart SDK version in dart interop image

* fix dart interop docker build
2022-11-04 09:27:27 -07:00
Esun Kim 530b702259
Update Clang 15 (#31518)
* clang-15

* iwyu

* run clang_format_code

* Clang-Tidy config

* Fix misc-unused-using-decls

* Fixed performance-inefficient-vector-operation

* Sanity
2022-11-04 09:08:03 -07:00
Jan Tattermusch 78fd1f637a
Run grpc_android job under docker for better maintainability. (#31504)
* run grpc_android in a docker container

* add TODO

* fixup android_ndk dockerfile
2022-11-02 11:09:19 +01:00
Eric Anderson 9098d8b8db
Upgrade Java interop to Bullseye and Java 11 (#30599) 2022-10-20 13:44:18 -07:00
Jan Tattermusch 3f1c3f23bd
Python virtualenv dockerfile cleanup (#31139)
* python tests install pinned virtualenv themselves

* more alpine image simplifications

* regenerate alpine image

* introduce dockerfile template for xds interop tests harness deps

* cleanup interop_http2 docker image, remove python_deps.include
2022-10-04 19:20:02 +02:00
Craig Tiller 8174a75079
[iwyu] Add more test directories (#30952)
* [iwyu] Add more test directories

* fix

* fix

* fix

* fix

* fix

* Automated change: Fix sanity tests

* fix

* iwyu

* Automated change: Fix sanity tests

* fix

* fix

* fix

* fix

* Automated change: Fix sanity tests

* fix

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-09-29 06:47:07 -07:00
Richard Belleville b15097142a
Silence dubious ownership issue in bazel image (#30963)
* Silence dubious ownership issue in bazel image

* Agh. It's a template
2022-09-13 16:42:21 -07:00
Richard Belleville 2297249e47
Support Python 3.11 (#30818)
* Support Python 3.11

* Update build images for 3.11

* Whoopsie

* The architecture of this thing is garbage

* Silence ownership warning

* Account for change in git behavior

* Fix directory

* I am in great pain

* Update Windows and arm linux

* Agh

* Clean up
2022-09-12 11:53:44 -07:00
Esun Kim e90972bef6
Bump gcc 6 to 7 (#30903)
* Bump gcc 6 to 7

* Update

* Update 2
2022-09-09 09:23:11 -07:00
Jan Tattermusch 631392f2e7
Upgrade bazel version to bazel 5.3 (repo-wide) (#30844)
* update bazel to 5.3.0

* regenerate dockerfiles

* update bazel distribtest

* update docker image templates

* regenerate dockerfiles 2

* regenerate bazel_support.md

* upgrade rules_apple and apple_support bazel deps

* Revert "upgrade rules_apple and apple_support bazel deps"

This reverts commit eb9a0d2155.

* fix objc bazel 5.3 build on kokoro mojave image
2022-09-08 11:18:54 +02:00
Vignesh Babu e2ceb1368a
Choose proper exit code for iwyu script upon failure (#30813)
* Print diffs made by iwyu

* Choose proper exit code for iwyu script upon failure
2022-08-31 17:43:43 -07:00
Vignesh Babu e8685fc8d2
Print diffs made by iwyu (#30808) 2022-08-31 14:17:45 -07:00
Craig Tiller b8605a424e
[iwyu] Add test/core/transport (#30288)
* [iwyu] Add test/core/transport

* Automated change: Fix sanity tests

* Automated change: Fix sanity tests

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-08-27 08:37:31 -07:00
apolcyn 8b941bb648
Drop support for ruby 2.5 (#30699)
* Drop ruby 2.5 support
2022-08-25 21:39:31 -07:00
Richard Belleville 4472304d63
Drop Python 3.6 From Distribtests (#30562)
* First attempt at fixing distribtest

* Add dev ubuntu 20.04 image

* Plase the copyright overlords
2022-08-12 15:05:16 -07:00
Yash Tibrewal 41ec08c69a
Update third_party/protobuf to 3.21.4 (#30377)
* Update third_party/protobuf

* run tools/distrib/python/make_grpcio_tools.py

* regenerate protos for ruby, php

* update build_handwritten.yaml

* regenerate projects

* Build - Use :well_known_type_protos instead of :well_known_protos

* Fix target

* Update upb

* Update Python for Protobuf 4.21 (#140)

* Update protobuf dependency on grpcio-tools

* Off by one

* Drop python 3.6 support

* Try upgrading pip

* And in the other script

* Try to figure out if we're compatible with abi3

* See what we've already got installed

* Update the requirements.txt file I didn't know existed

* And here too

* See what's installed

* Let's try that again

* Remove

* Try to confirm version

* Let me see the generated code

* Fix non-Bazel test runner

* Work for all test directories

* Regenerate example protos

* Clean up

* Generate .pyi files

* Fix type checking and linting

* Exclude pyi files from isort

* Upgrade to 3.21.4

* Update iwyu to get around messy protobuf IWYU rules

Co-authored-by: Richard Belleville <gnossen@gmail.com>
2022-08-04 09:39:49 -07:00
Craig Tiller 9511ab003a
[iwyu] Add test/core/memory_usage (#30408)
* include-fix

* include-fix

* iwyu headers

* clang-fmt

* fix
2022-07-25 23:32:25 -07:00
Esun Kim 8f7927f7bc
Added gcc12 (#30388) 2022-07-22 14:32:49 -07:00
Craig Tiller df52004032
[iwyu] Add test/core/end2end (#29998)
* [iwyu] Add test/core/end2end

* Automated change: Fix sanity tests

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* update

* fix

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-07-20 16:18:45 -07:00
Craig Tiller 856abd9446
[iwyu] Add test/core/util (#30289)
* [iwyu] Add test/core/util

* Automated change: Fix sanity tests

* fix

* fix

* fix

* fix

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-07-20 16:18:19 -07:00
Eric Anderson f4c162f30d
Allow Gradle to use more memory when building Java interop (#30249)
Should fix "Expiring Daemon because JVM heap space is exhausted".

https://github.com/grpc/grpc-java/pull/9269 probably pushed the build
over the edge, but there's been evidence via flakes for a good while
that we've been reaching the limit.

b/238438006
2022-07-08 13:00:12 -07:00
Michael Lumish 7b10852a98
xDS k8s: Enable outlier detection tracing in client images (#30227) 2022-07-06 15:17:44 -07:00
Nicolas Noble a285704aaf
bG6b3V2MNxQ (#30021) 2022-06-21 08:00:32 -07:00
Craig Tiller fbe6a4d941
[iwyu] Add test/core/resource_quota (#29999)
* [iwyu] Add test/core/resource_quota

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-06-17 08:24:01 -07:00
Craig Tiller cdd340cbdb
[iwyu] Add test/core/uri (#30000)
* [iwyu] Add test/core/uri

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-06-16 19:36:09 -07:00
Craig Tiller e2ebebadfc
[iwyu] Add test/core/promise (#29994)
* [iwyu] Add test/core/promise

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-06-13 13:59:12 -07:00
Craig Tiller 6532084a06
[iwyu] rest of the owl: src/core/lib - excluding iomgr, gpr (#29735)
* [iwyu] rest of the owl: src/core/lib - excluding iomgr, gpr

* Automated change: Fix sanity tests

* Automated change: Fix sanity tests

* fixes

* Automated change: Fix sanity tests

* fix

* fix

* fixes

* fixes

* x

* fix?

* fix

* windows fix

* fix

* fix

* fix

* fix

* fix

* debug

* fix

* fix

* Revert "debug"

This reverts commit c99b8d12dd.

* Automated change: Fix sanity tests

* fix?

* Automated change: Fix sanity tests

* header cleanup

* fix

* fix

* fix

* Automated change: Fix sanity tests

* fix

* fix

* Automated change: Fix sanity tests

* Automated change: Fix sanity tests

* fixes

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-06-10 13:04:47 -07:00
Lidi Zheng 347d9ed3ea
Add ring_hash_lb to trace logs for Python/C++ xds interop clients (#29956) 2022-06-08 15:41:29 -07:00