Commit Graph

181 Commits

Author SHA1 Message Date
Esun Kim 076f719286
Revert "Revert "[Test] Dedup vs2019 test in the Windows test" (#33393)" (#33394) 2023-06-09 16:10:29 -07:00
Sergii Tkachenko de6ed9ba9f
[Python] Migrate from yapf to black (#33138)
- Switched  from yapf to black
- Reconfigure isort for black
- Resolve black/pylint idiosyncrasies 

Note: I used `--experimental-string-processing` because black was
producing "implicit string concatenation", similar to what described
here: https://github.com/psf/black/issues/1837. While currently this
feature is experimental, it will be enabled by default:
https://github.com/psf/black/issues/2188. After running black with the
new string processing so that the generated code merges these `"hello" "
world"` strings concatenations, then I removed
`--experimental-string-processing` for stability, and regenerated the
code again.

To the reviewer: don't even try to open "Files Changed" tab 😄 It's
better to review commit-by-commit, and ignore `run black and isort`.
2023-06-09 15:08:55 -07:00
Esun Kim e9e5dc0cf6
Revert "[Test] Dedup vs2019 test in the Windows test" (#33393)
Reverts grpc/grpc#33385

Temporary revert to unblock https://github.com/grpc/grpc/pull/33138
2023-06-09 15:08:20 -07:00
Esun Kim 6b3949593d
[Test] Dedup vs2019 test in the Windows test (#33385)
`cmake_ninja_vs2019` and `default` are using the same
`cmake_ninja_vs2019` so having two tests are waste so this is removing
`cmake_ninja_vs2019` leaving `default` which does `cmake_ninja_vs2019`.

This change can cut the space consumption by half and with 250GB disc, 

- Pre-test: 267,770,322,944 bytes free 
- Post-test: 134,499,295,232 bytes free
2023-06-09 13:52:58 -07:00
Esun Kim 931c6e31fb
[Test] Disable gcc10.2_openssl102 from portability tests (#33287)
b/283304471: Currently h2_ssl_cert_test failing under openssl102 so this
is being disabled temporarily until it's fixed.
2023-05-31 11:34:02 -07:00
Jan Tattermusch df5af05ce7
[test-infra] Sanity test job should only run sanity, not iwyu and clang-tidy (#32874)
Followup for https://github.com/grpc/grpc/pull/31141.

IWYU and clang-tidy have been "moved" to a separate kokoro job, but as
it turns out the sanity job still runs all of `[sanity, clang-tidy,
iwyu]`, which makes the grpc_sanity jobs very slow.

The issue is that grpc_sanity selects tasks that have "sanity" label on
them and as of now, clang-tidy and iwyu still do.
It can be verified by:
```
tools/run_tests/run_tests_matrix.py -f sanity --dry_run
Will run these tests:
  run_tests_sanity_linux_dbg_native: "python3 tools/run_tests/run_tests.py --use_docker -t -j 2 -x run_tests/sanity_linux_dbg_native/sponge_log.xml --report_suite_name sanity_linux_dbg_native -l sanity -c dbg --iomgr_platform native --report_multi_target"
  run_tests_clang-tidy_linux_dbg_native: "python3 tools/run_tests/run_tests.py --use_docker -t -j 2 -x run_tests/clang-tidy_linux_dbg_native/sponge_log.xml --report_suite_name clang-tidy_linux_dbg_native -l clang-tidy -c dbg --iomgr_platform native --report_multi_target"
  run_tests_iwyu_linux_dbg_native: "python3 tools/run_tests/run_tests.py --use_docker -t -j 2 -x run_tests/iwyu_linux_dbg_native/sponge_log.xml --report_suite_name iwyu_linux_dbg_native -l iwyu -c dbg --iomgr_platform native --report_multi_target"
```

This PR should fix this (be removing the umbrella "sanity" label from
clang-tidy and iwyu)
2023-04-19 04:25:17 -07:00
Jan Tattermusch 43c3d1f932
Switch all VS2017 builds to VS2019 (#32662)
(part of removing support for VS2017)

Also see https://github.com/grpc/grpc/pull/32649
Also see https://github.com/grpc/grpc/pull/32615

The switch to grpc-win2019 windows workers has already happened:
(cl/517400022).

Once this PR lands, I'll backport to 1.53.x branch as well (since that
release removes the VS2017 support).
2023-03-23 16:44:39 +01:00
Esun Kim 6943c1841f
Excluding more tests from build_submodule_at_head (#32290) 2023-02-03 10:25:29 -08:00
Esun Kim 530b702259
Update Clang 15 (#31518)
* clang-15

* iwyu

* run clang_format_code

* Clang-Tidy config

* Fix misc-unused-using-decls

* Fixed performance-inefficient-vector-operation

* Sanity
2022-11-04 09:08:03 -07:00
Craig Tiller f69c64b270
[sanity] Split IWYU, clang-tidy into their own jobs (#31141)
* [sanity] Split IWYU, clang-tidy into their own jobs

* fix typo

* fix

* Automated change: Fix sanity tests

Co-authored-by: ctiller <ctiller@users.noreply.github.com>
2022-09-27 17:04:54 -07:00
Esun Kim e90972bef6
Bump gcc 6 to 7 (#30903)
* Bump gcc 6 to 7

* Update

* Update 2
2022-09-09 09:23:11 -07:00
Esun Kim 8f7927f7bc
Added gcc12 (#30388) 2022-07-22 14:32:49 -07:00
Esun Kim 9aa91e9e4d
Remove vs2015 test (#29824) 2022-05-27 14:21:03 -07:00
Esun Kim 4edd63772e
Bump version of gcc and clang (#29594) 2022-05-06 10:26:03 -07:00
Jan Tattermusch 6d3c45ff7b
Add dockerized ARM64 tests (bazel C/C++, C#, PHP, ruby, python) (#28966)
* C# arm64 docker image

* add ruby arm64 docker image

* add bazel_arm64 docker image

* add python arm64 image

* add php arm64 docker image

* regenerate

* add support for running arm64 tests with run_tests.py

* restrict arm64 testing to python3.9

* first version of bazel arm64 C++ tests

* add arm64 job configs

* add initial checks to push_testing_images.sh
2022-03-14 13:30:52 +01:00
Jan Tattermusch a3be072605
Switch .py shebang to python3 (#28963)
* switch shebang to python3

* prepare_build_macos: install latest available patch for each python
2022-03-14 10:41:30 +01:00
Esun Kim 6565584c7b
Bump the minimum gcc to 5 (#28786) 2022-02-11 10:31:25 -08:00
Jan Tattermusch e324bf5eee
Speed up windows C/C++ builds by using cmake Ninja generator (#28833)
* support building C/C++ with ninja

* make cmake_ninja_vs2015 build the default for C/C++

* fix vcvarsall location for vs2017
2022-02-11 09:59:51 +01:00
Jan Tattermusch 27b6b45c32
Upgrade C++ and Python docker images to debian stable (debian 11) (#28664)
* upgrade C++ and python docker images

* regenerate dockerfiles

* upgrade grpc_artifact_python docker images

* adjust run_tests scripts to dockerimages upgrades
2022-01-25 10:23:01 +01:00
Esun Kim 55d7631a99
Bump clang 12 to 13 (#28639) 2022-01-21 14:47:04 -08:00
Jan Tattermusch a215992f0e
speedup C# basictests: only build C# once for coreclr and mono tests (#28587)
* only build C# once for coreclr and mono tests

* one more attempt

* only build C# once for coreclr and mono
2022-01-18 11:09:49 -08:00
Lidi Zheng 7069770ee0
Merge the 3 repeating Python binary compilations (Attempt 2) (#28543)
* Revert "Revert "Merge the 3 repeating Python binary compilations (#28500)" (#28539)"

This reverts commit 0554cbee9c.

* Update hardcoded Python path

* Repect existing images and only use new path for newer releases

* fix interop_matrix testcases

Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
2022-01-14 09:25:33 -08:00
Jan Tattermusch 0554cbee9c
Revert "Merge the 3 repeating Python binary compilations (#28500)" (#28539)
This reverts commit 2d4f3c5600.
2022-01-12 18:31:02 +01:00
Jan Tattermusch 98999225be
Speedup linux portability build_only tests (#28461)
* try speeding up linux portability test

* remove gcc8.3 portability test

* c-ares is the default resolver on linux

* dont set parallel run_tests jobs too high

* original parallelism might lead to better results
2022-01-12 14:56:28 +01:00
Lidi Zheng 2d4f3c5600
Merge the 3 repeating Python binary compilations (#28500)
* Merge the 3 repeating Python binary compilations

* Restore grpcio_metadata.py

* run_tests.py is running on <3.6

* Restore the Windows gevent version pin
2022-01-11 17:14:22 -08:00
Jan Tattermusch 3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. (#28259)
* support "move and respawn" for kokoro jobs

* delete_nonartifacts.sh no longer needed

* bazel distribtest dont publish any artifacts

* try the altsrc respawn for selected jobs

* use altsrc for all windows CI jobs

* use altsrc for all macos CI jobs

* only move files under src/github

* fix uploading artifacts on windows
2021-12-03 19:41:14 +01:00
Jan Tattermusch 205d7569ea
Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim ddb9d5d700
Increase iOS test timeout from 1.5h to 2.0h (#28110) 2021-11-16 13:05:26 -08:00
Craig Tiller 512e1ec1dc
Speed up portability tests (#27884)
* test

* cpp only

* moar cpu

* tweaks

* Update run_tests_matrix.py

* tweaks

* only-xds

* fix

* inner harmony
2021-11-01 15:31:26 -07:00
Esun Kim 5690ea0106
Added gcc11 and clang12 tests (#27190) 2021-09-27 10:48:58 -07:00
AJ Heller 2d16865693
Delete libuv-iomgr implementation and GRPC_UV build option (#27188)
This has been unmaintained for years, last supported in gRPC-core v1.24.
2021-08-31 13:26:43 -07:00
Lidi Zheng 2231c2ba77
Introduce Python import sorting to our sanity test suite (#26768)
* Add isort_code.sh to sanity tests

* Run tools/distrib/isort_code.sh

* Fine tune the import order for relative imports

* Make pylint and project generation happy

* Fix a few corner cases

* Use --check instead of --diff

* The import order impacts test result somehow

* Make isort print diff and check output at the same time

* Let tools/run_tests/python_utils be firstparty library

* Run isort against latest HEAD
2021-07-26 12:31:21 -07:00
Esun Kim 83681f2721
Revert "Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812)" (#25860)
This reverts commit b55fba3382.
2021-06-15 11:17:42 -07:00
Esun Kim b55fba3382
Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812)
This reverts commit 0147d99c41.
2021-03-25 11:28:10 -07:00
Esun Kim 0147d99c41
Added portability test with openssl 1.0.2 (#25770)
* Added openssl102 test to portability

* Update by review
2021-03-24 09:37:54 -07:00
Lidi Zheng 8be2ac94a8 Bump up minimum supported clang to 4.0 2021-02-12 15:11:44 -08:00
Sergii Tkachenko 8db79e2e71 Python style: reformat code using updated yapf 0.30.0 2021-01-13 14:00:12 -05:00
root 60b5d06ec1 replace to php7 2020-10-01 19:35:00 +00:00
Jan Tattermusch 2c95b8f6fb yapf code 2020-08-03 19:20:28 +02:00
Jan Tattermusch fcc679a692 remove clang3.5 from portability (>5years old compiler) 2020-08-03 19:18:39 +02:00
Jan Tattermusch 31e2ecc1ba c-ares is already the default resolver on windows 2020-08-03 19:18:39 +02:00
Jan Tattermusch 8a2e1b82dc no need for linux cmake portability tests: cmake is already the default 2020-08-03 19:18:39 +02:00
Jan Tattermusch 99cfec0034 remove no longer useful cxx_sanitizers_jessie portability test (clang "7.0") 2020-08-03 19:18:39 +02:00
Jan Tattermusch 1316ae2d30 remove run_tests.py sanitizers from run_tests_matrix.py 2020-03-18 06:08:52 -04:00
Esun Kim 7dac73264b Bump the version of gcc to 4.9 2020-01-15 11:00:23 -08:00
Esun Kim 7be821ac47 Yapf all target python sources 2020-01-03 09:25:10 -08:00
Esun Kim b7ac4d6611 Increase timeout for windows portability tests 2019-11-07 14:51:21 -08:00
Lidi Zheng c8c41e4f6a
Merge pull request #20771 from lidizheng/aio-tests
[AIO] AsyncIO Tests Kokoro Integration
2019-10-25 15:22:10 -07:00
Jan Tattermusch 9586644ea0 add gcc8.3 portability test 2019-10-24 06:22:23 -04:00
Jan Tattermusch 92fa3c3d4e replace ubuntu1710 image by ubuntu1804 2019-10-24 05:54:28 -04:00