Commit Graph

176 Commits

Author SHA1 Message Date
Xuan Wang 67a15395d2 [Python Distribution] Add a check for file size (#35831)
Add a step in distribution test which checks if any of the artifacts exceeds 80 MB since Pypi has a per-file size limit.

<!--

If you know who should review your pull request, please assign it to that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the appropriate
lang label.

-->

Closes #35831

COPYBARA_INTEGRATE_REVIEW=https://github.com/grpc/grpc/pull/35831 from XuanWang-Amos:dist_test_add_size_check de50f20e14
PiperOrigin-RevId: 605664419
2024-02-09 10:14:55 -08:00
Esun Kim 1f979d2a83 [BoringSSL] Update third_party/boringssl-with-bazel (#35768)
Change was created by the release automation script. See go/grpc-release.

On top of changes made by the script, `setup.py` had to be updated to have `/std:c11` option for MSVC to use c11 features for boringssl.

Closes #35768

PiperOrigin-RevId: 603403329
2024-02-01 10:06:33 -08:00
Xuan Wang 2d7b751d4e [Python run_test] Support Python3.12 (#35325)
Fix: https://github.com/grpc/grpc/issues/35085
<!--

If you know who should review your pull request, please assign it to that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the appropriate
lang label.

-->

Closes #35325

PiperOrigin-RevId: 592635611
2023-12-20 12:59:24 -08:00
Hannah Shi b0090d5486 [ObjC] remove grpc_bazel_cpp_ios_event_engine_experiment_tests (#35283)
zero cases ran according to CI logs:
e.g.:
```
Executing tests from //test/core/event_engine/cf:cf_engine_test_on_ios
-----------------------------------------------------------------------------
2023-12-09 21:28:59,623 Creating a new simulator:
Name: New-iPhone X-16.1
OS: iOS 16.1
Type: iPhone X
2023-12-09 21:29:00,377 Created new simulator 9958E216-2526-4A95-A70F-8E006D6DB512.
2023-12-09 21:29:01,105 Will consider the test as test type logic_test to run.
Test Suite 'All tests' started at 2023-12-09 13:29:01.708
Test Suite 'All tests' passed at 2023-12-09 13:29:01.709.
	 Executed 0 tests, with 0 failures (0 unexpected) in 0.000 (0.001) seconds
2023-12-09 21:29:01,715 Deleting simulator 9958E216-2526-4A95-A70F-8E006D6DB512 asynchronously.
2023-12-09 21:29:01,720 Done.
```

All logs in:
https://source.cloud.google.com/results/invocations/f77ffe5d-d5c8-4aea-a54d-80e02c7d54fd/targets/grpc%2Fcore%2Fpull_request%2Fmacos%2Fgrpc_bazel_cpp_ios_event_engine_experiment_tests/log
https://source.cloud.google.com/results/invocations/2a12c3be-1f7c-48af-8a2d-26982a72c04b/targets
https://source.cloud.google.com/results/invocations/2a12c3be-1f7c-48af-8a2d-26982a72c04b/targets/%2F%2Ftest%2Fcore%2Fevent_engine%2Fcf:cf_engine_test_on_ios/log

-----
PS: although no tests were executed, we are seeing random timeouts in the internal CI most likely due to the environment issue as tests are still being build and emulators are being lunched.

Closes #35283

COPYBARA_INTEGRATE_REVIEW=https://github.com/grpc/grpc/pull/35283 from HannahShiSFB:remove-grpc_bazel_cpp_ios_event_engine_experiment_tests c149b4eb39
PiperOrigin-RevId: 590792491
2023-12-13 20:07:56 -08:00
Hannah Shi 239a5fce2d
[ObjC] dns service resolver for cf event engine (#33971)
re-submit of #33233 with refactored tests

1. split ios event engine tests to client tests (require oracle engine)
and unit test
2. disable dns server setup in
[dns_test.cc](https://github.com/grpc/grpc/blob/master/test/core/event_engine/test_suite/tests/dns_test.cc#L127)
for ios test, this is what's caused the revert.
3. disable dns_test in cf_event_engine_test for MacOS
2023-08-04 15:51:42 -07:00
Hannah Shi 20cd331e55
[ObjC] address review comments in #33590 (#33747)
follow up from #33590

<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-07-20 21:07:18 -07:00
Richard Belleville d714ae72e7
[dependency] Restrict cython to less than 3.X (#33738)
This should resolve breakage on master caused by the jump to Cython
3.0.0 this morning.
2023-07-18 12:56:16 -07:00
Hannah Shi 2556033de0
[ObjC] run ios tests with event engine enabled (#33590)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-07-17 08:27:07 +02:00
Hannah Shi c6e4a60f8f
[ObjC] run cf event engine test suit on ios (#33534)
Run cf event engine test suit on ios

CC: @sampajano  @mikefan1991
2023-06-25 20:11:56 +00:00
Yingwei Fan a9f3c4031d
[Event Engine] Add event engine core tests to iOS pull request process (#33084)
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->

---------

Co-authored-by: Yash Tibrewal <yashkt@google.com>
Co-authored-by: Stanley Cheung <stanleycheung@google.com>
Co-authored-by: AJ Heller <hork@google.com>
Co-authored-by: Yijie Ma <yijiem.main@gmail.com>
Co-authored-by: apolcyn <apolcyn@google.com>
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
2023-05-13 10:02:16 +09:00
Esun Kim 3bd6c38650
[Infra] Use Bazel 6 and drop Bazel 4 (Part 2) (#32910)
Oops I missed important changes from
https://github.com/grpc/grpc/pull/32712. And it turned out that there
are two problems that I couldn't fix at this point.
- Windows Bazel RBE Linker Error: This may be caused by how new Bazel 6
invokes build tools chain but it's not clear. I put workaround to use
Bazel 5 by using `OVERRIDE_BAZEL_VERSION=5.4.1`
- Rule `rules_pods` to fetch CronetFramework from CocoaPod has
incompatibility with sort of built-in apple toolchain.
(https://github.com/bazel-xcode/PodToBUILD/issues/232): I couldn't find
a workaround to fix this so I ended up disabling all tests depending
this target.
2023-04-21 15:53:52 -07:00
Esun Kim 638dad052c
Bump the timeout of macos/grpc_basictests_c_cpp to 4h (#32866)
It already started hitting the limit resulting in continuous failure.
https://github.com/grpc/grpc/pull/32603 is believed to contribute to
this time increase but let's bump it first and visit this issue later.
2023-04-13 14:26:45 -07:00
AJ Heller d551a512c8
[EventEngine] Simple iOS EventEngine experiment configuration. (#32782)
cc @sampajano
2023-04-03 16:29:15 -07:00
Hannah Shi 2ac1b1708d
[ObjC] run cpp ios cronet test with bazel (#31808)
Cleanup and remove ios cpp test cronet

To test manually:
./tools/bazel test //src/objective-c/tests:CppCronetTests

@sampajano 
<!--

If you know who should review your pull request, please assign it to
that
person, otherwise the pull request would get assigned randomly.

If your pull request is for a specific language, please add the
appropriate
lang label.

-->
2023-02-13 17:51:03 -08:00
Hannah Shi 0ca4bbfb9f
run cf stream test with bazel (#31555) 2022-12-06 15:52:16 -08:00
Jan Tattermusch 3cf3ed7d59
Revert "Revert "Add back C# distribtests for Grpc.Tools"" (#31436)
* Revert "Revert "Add back C# distribtests for Grpc.Tools (#31399)" (#31412)"

This reverts commit dbc45208e2.

* avoid clash with internal protos
2022-10-27 09:59:06 +02:00
Hannah Shi c7a2fc8e75
[ObjC] Run ios perf test from bazel (#31019)
* run ios CronetTest from bazel

* run ios perf test from bazel

* ci fix

Co-authored-by: Denny C. Dai <dennycd@me.com>
2022-10-24 23:58:32 -07:00
Alisha Nanda dbc45208e2
Revert "Add back C# distribtests for Grpc.Tools (#31399)" (#31412)
This reverts commit 50bad293c9.
2022-10-20 12:08:29 -07:00
Jan Tattermusch 50bad293c9
Add back C# distribtests for Grpc.Tools (#31399)
* remove remains of grpc_csharp_ext artifact build completely

* add back part of C# distribtests

* redirect C# linux distribtests

* comment out some distribtests

* switch updateversion to Grpc.tools

* fix .proto

* fix distribtest complile

* temporarily comment out service in .proto

* cleanup

* improvements

* reenable mac distribtests

* fixes
2022-10-20 16:42:29 +02:00
Jan Tattermusch db693b37c2
Move objc TvTests to bazel (and make it "build-only") (#31046)
* try TvTests with bazel

* remove tvos-test-basictests from run_tests.py

* add a build-only test for TvTests

* style fixes
2022-10-17 21:03:50 +02:00
Jan Tattermusch 108444e9f7
Fix python tests on kokoro macos monterey (#31126)
* fix python build on kokoro macos monterey

* avoid using realpath

* fix grpc_distribtests_python on macos monterey

* try upgrade setuptools
2022-10-10 17:45:31 +02:00
Hannah Shi 96d27634a4
run ios CronetTest from bazel (#30439) 2022-09-27 14:49:38 -07:00
Jan Tattermusch 2f5d06af6b
make legacy artifact -> packages -> distribtest jobs a noop (#31124) 2022-09-27 21:01:32 +02:00
Jan Tattermusch 3d7fc93e1f
restore sane repeat count and timeout for objC tests (#30897) 2022-09-09 11:20:17 +02:00
Jan Tattermusch 631392f2e7
Upgrade bazel version to bazel 5.3 (repo-wide) (#30844)
* update bazel to 5.3.0

* regenerate dockerfiles

* update bazel distribtest

* update docker image templates

* regenerate dockerfiles 2

* regenerate bazel_support.md

* upgrade rules_apple and apple_support bazel deps

* Revert "upgrade rules_apple and apple_support bazel deps"

This reverts commit eb9a0d2155.

* fix objc bazel 5.3 build on kokoro mojave image
2022-09-08 11:18:54 +02:00
Jan Tattermusch 070a15aa29
switch cfstream tests to buildonly (#30849) 2022-09-07 09:38:55 +02:00
Denny C. Dai 67be31c38c
[iOS/ObjC] Adding test flake repeat run support for interop (#30287) 2022-07-14 13:34:33 -07:00
Denny C. Dai e2b772cbd8
[gRPC/iOS] Interop test deflake (#29997) 2022-06-13 16:51:42 -07:00
Hannah Shi 932878b1ce
[ObjC] unit tests with bazel (#29799)
* unit tests with bazel

* passing via --test_env from bazel command line

* remove env from BUILD; fix sanity check in run_one_test_bazel.sh

* add port server
2022-06-10 19:37:07 -07:00
Hannah Shi 3ad945947c
[ObjC]interop tests with bazel (#29800)
* interop tests with bazel

* remove env in BUILD

* clang format
2022-06-09 19:03:17 -07:00
Jan Tattermusch 5051566b27
Enable remote cache for selected ObjC bazel tests. (#29731)
* enable remote cache for ObjC bazel tests

* add bazel RBE cache for mac ios bazel builds
2022-05-20 11:07:04 +02:00
Jan Tattermusch 6a09523029
Remove opt MacOS builds from PR presubmit cmake C/C++ basic tests (#29730) 2022-05-19 19:29:45 +02:00
Jan Tattermusch b7034041de
Convert ObjC codegen plugin tests to bazel tests. (#29676)
* add initial version of bazelified plugin tests

* polish the bazel sh_test scripts

* add objc_codegen_plugin tests

* add objc plugin tests to bazel test job
2022-05-18 14:54:29 +02:00
Jan Tattermusch ad2ca50712
Simplify building release packages through per-language grpc_distribtests_* jobs. (#29699)
* add release version of grpc_distribtests_* jobs .cfg files

* make grpc_distribtests_ruby more aligned with other single-job distribtests

* dont hide packages from build_artifacts step for python an php
2022-05-18 13:09:15 +02:00
Jan Tattermusch 345f12afa6
Improve ObjC bazel test and add TODOs. (#29665)
* objC bazel test: run InteropTests and MacTests

* objC bazel test: run TvTests

* Revert "objC bazel test: run TvTests"

This reverts commit 46a81991a9.

* avoid running flaky objC InteropTests under bazel

* add TODOs for objc run_tests.py tasks

* add a note about GRPC_VERBOSITY=debug being set

* increase timeout for ios-buildtest-example-tvOS-sample test task
2022-05-18 12:25:30 +02:00
Jan Tattermusch 748a8d527f
Add a job for ObjC bazel tests (#29599)
* grpc_objc_bazel.sh test script

* add a test job for obj bazel tests
2022-05-12 09:45:17 +02:00
apolcyn 409db4dd0f
Upgrade ruby rake-compiler-dock images (#29304)
* Upgrade rake-compiler-dock images
2022-05-11 13:58:45 -07:00
Jan Tattermusch eb8cf1544b
cleanup config for existing macos kokoro jobs that run bazel (#29600) 2022-05-09 09:21:09 +02:00
Jan Tattermusch c33963d371
iOS binary size script cleanup (#29377)
* iOS binary size script cleanup

* add job cfg for running iOS binary size on master
2022-04-14 11:01:16 +02:00
Jan Tattermusch c64d6f3f57
Better bazel C++ iOS tests (with structured test results) (#29354)
* introduce bazelrc for tests with resultstore-uploaded results

* modernize bazel cpp ios tests

* simplify bazel invocation in bazel_cpp_ios_tests

* remove unused bazel core ios tests
2022-04-12 13:16:48 +02:00
Jan Tattermusch 07a75427bd
Simplify running bazel with structured test results on CI (#29353)
* add bazel_report_helper.py

* simplify bazel invocations in selected builds

* introduce __main__

* update gitignore

* introduce sleep constant

* add type annotations

* use f-strings

* Revert "use f-strings"

This reverts commit f970d6a40b.
2022-04-12 11:31:41 +02:00
Jan Tattermusch f40fe16aab
enable bazel remote cache for macos C/C++ CI tests (#29272) 2022-04-01 18:29:43 +02:00
Jan Tattermusch 37ab609103
Add macos grpc_distribtests_python and grpc_distribtests_ruby (#29141)
* small cleanup in singlejob distribtest jobs

* add macos grpc_distribtest_ruby and grpc_distribtest_python jobs
2022-03-18 19:22:10 +01:00
Jan Tattermusch 83ccb0deed
add C# macos distribtest in a single job (#28614) 2022-03-18 06:26:38 +01:00
Esun Kim adb8611da4
Using tsan_macos config for cfstream_tsan test (#28690) 2022-01-25 15:05:52 -08:00
Esun Kim 94adc74145
Fix dyld errors on macos (#28684) 2022-01-25 13:49:57 -08:00
Jan Tattermusch 7dfdf3d679
Delete no-longer-used kokoro jobs .cfg files. (#28465)
* remove .cfg files for non-existent kokoro jobs

* more cleanup
2022-01-04 20:26:25 +01:00
apolcyn 3c368a5b2c
Don't gem install rake-compiler on macos setup scripts (#28415)
* Don't gem install rake-compiler on macos setup scripts
2021-12-28 09:57:33 -08:00
Lidi Zheng 7cfd399dd6
Reduce the workload of presubmit artifact builds and distribtests (#28228)
* Reduce the workload of presubmit artifact builds and distribtests

* Create and redirect Kokoro config
* Remove duplicated scripts and use env var config

* Clean-up Kokoro cfg

* [DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS

* Revert "[DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS"

This reverts commit 9436ac54ac.
2021-12-06 10:03:31 -08:00
Jan Tattermusch 3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. (#28259)
* support "move and respawn" for kokoro jobs

* delete_nonartifacts.sh no longer needed

* bazel distribtest dont publish any artifacts

* try the altsrc respawn for selected jobs

* use altsrc for all windows CI jobs

* use altsrc for all macos CI jobs

* only move files under src/github

* fix uploading artifacts on windows
2021-12-03 19:41:14 +01:00