Commit Graph

28 Commits

Author SHA1 Message Date
Sergii Tkachenko de6ed9ba9f
[Python] Migrate from yapf to black (#33138)
- Switched  from yapf to black
- Reconfigure isort for black
- Resolve black/pylint idiosyncrasies 

Note: I used `--experimental-string-processing` because black was
producing "implicit string concatenation", similar to what described
here: https://github.com/psf/black/issues/1837. While currently this
feature is experimental, it will be enabled by default:
https://github.com/psf/black/issues/2188. After running black with the
new string processing so that the generated code merges these `"hello" "
world"` strings concatenations, then I removed
`--experimental-string-processing` for stability, and regenerated the
code again.

To the reviewer: don't even try to open "Files Changed" tab 😄 It's
better to review commit-by-commit, and ignore `run black and isort`.
2023-06-09 15:08:55 -07:00
Jan Tattermusch e8404698d5
Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225)
* remove examples/csharp

* remove reference to examples/csharp

* remove C# references from doc/

* remove src/csharp

* update test_creds locations

* remove C# distribtests

* remove buildgen templates for files under src/csharp

* remove grpc_csharp_ext C build target

* regenerate projects

* update tools/run_tests/README.md

* change many C# test/build scripts to noop

* unbreak run_tests.py -l csharp

* unbreak C# build_package targets

* unbreak C# distribtests

* remove C# pre-build steps from prepare_build_windows.bat

* remove src/csharp from clang_format

* remove csharp and csharpcoreclr from run_interop_tests.py

* remove C# interop test docker images

* Revert "remove src/csharp"

This reverts commit 97f2b6d707.

* remove src/csharp, but keep Grpc.Tools

* add back templates/src/csharp/build/dependencies.props.template

* remove everything but Grpc.Tools and Grpc.Tools.Tests from sln

* Revert "unbreak run_tests.py -l csharp"

This reverts commit 529b5e2ec1.

* revive Grpc.Tools.Tests through run_tests.py

* Revert "unbreak C# build_package targets"

This reverts commit 79d8d83c8b.

* experiment with build_nuget.sh fixes

* simplify create_fake_native_artifacts.sh

* building of Grpc.Tools in package_targets.py

* move shared files from Grpc.Core to Grpc.Tools

* yapf format: distribtest_targets.py

* Revert "remove C# pre-build steps from prepare_build_windows.bat"

This reverts commit bd38956a2b.

* update C# README.md

* disable C# in gke OSS benchmarks
2022-04-28 12:00:34 +02:00
Jan Tattermusch 69bf041e9b
Try fix csharp macos distribtests (#29156)
* try fix csharp macos distribtests

* another attempt

* another fix attempt
2022-03-19 20:03:39 +01:00
Jan Tattermusch 409c732813
C# windows single-job distribtest (#29152)
* add windows grpc_distribtest_csharp

* add kokoro cfg files
2022-03-18 16:34:31 +01:00
Jan Tattermusch 83ccb0deed
add C# macos distribtest in a single job (#28614) 2022-03-18 06:26:38 +01:00
Jan Tattermusch a3be072605
Switch .py shebang to python3 (#28963)
* switch shebang to python3

* prepare_build_macos: install latest available patch for each python
2022-03-14 10:41:30 +01:00
Jan Tattermusch c8c1774ec4
Revert "Revert "Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)" (#28741)" (#28748)
* Revert "Revert "Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)" (#28741)"

This reverts commit 9a79d44e9b.

* fix python distribtest failure on fedora34
2022-02-01 11:33:56 +01:00
Yash Tibrewal 9a79d44e9b
Revert "Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)" (#28741)
This reverts commit be723121fc.
2022-01-28 11:42:12 -08:00
Jan Tattermusch be723121fc
Cleanup run docker machinery in run_tests.py, task_runner.py and elsewhere (#28704)
* attempt

* slim down build_docker_and_run_tests.sh

* HOST_GIT_ROOT is unused

* config and arch variable no need to propagate to run_tests.py

* unify unused LOCAL_GIT_ROOT to EXTERNAL_GIT_ROOT

* mounting gcloud config seems useless

* reorder docker args

* cleanup

* allow passing args to build_docker_and_run_tests.sh

* converge build_docker_and_run_tests.sh and build_and_run_docker.sh

* more convergence

* convergence of docker runners

* finalize convergence of run_docker scripts

* GRPC_TEST_REPORT_BASE_DIR might not exist

* adjust report copying

* make report_dir and output_dir readable

* alpine linux does not support cp -t
2022-01-28 11:46:36 +01:00
Jan Tattermusch ac139598f0
Upmerge 1.44.x branch into master (#28700)
* xDS: Rbac filter updates (#28568) (#28608)

* Bump version to v1.44.0-pre1 (on the release branch) (#28593)

* bump version to 1.44.0-pre1

* regenerate projects

* only apply "singleplatform" nuget suffix when actually needed (#28677)

* Bump version to 1.44.0-pre2 (#28681)

* bump version to 1.44.0-pre2

* regenerate projects

Co-authored-by: Yash Tibrewal <yashkt@google.com>
2022-01-26 18:13:48 +01:00
Jan Tattermusch 1cf6b085f2
Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch f23e1d9e85
task_runner.py improvements (foundations for future speedup) (#28480)
* add --dry_run support for task_runner.py

* dont sort task_runner targets before running

* fixup dry run

* support task_runner.py --inner_jobs

* pass inner_jobs to build_jobspec for task_runner.py

* support inner_jobs for C# artifacts

* support inner_jobs for protoc artifacts

* inner jobs support for src/csharp/experimental/build_native_ext_for_android.sh

* address review feedback
2022-01-11 10:26:32 +01:00
Jan Tattermusch 858eff5ab9
Introduce C# single-platform nuget build (and distribtests) (#27180)
* C# linux distribtests

* add distribtests C# linux job cfg

* support running a subset of C# artifact/distribtests on jobs
2021-12-07 12:58:31 +01:00
Richard Belleville 59693b7e72
Migrate Infrastructure Scripts to Python 3 (#27135)
* Run 2to3 on tools directory

* Delete github_stats_tracking

* Re-run 2to3

* Remove unused script

* Remove unused script

* Remove unused line count utility

* Yapf. Isort

* Remove accidentally included file

* Migrate tools/distrib directory to python 3

* Remove unnecessary shebang

* Restore line_count directory

* Immediately convert subprocess.check_output output to string

* Take care of Python 2 shebangs

* Invoke scripts using a Python 3 interpreter

* Yapf. Isort

* Try installing Python 3 first

* See if we have any Python 3 versions installed

* Add Python 3.7 to Windows path

* Try adding a symlink

* Try to symlink differently

* Install six for Python 3

* Run run_interop_tests with python 3

* Try installing six in python3.7 explicitly

* Revert "Try installing six in python3.7 explicitly"

This reverts commit 2cf60d72f3.

* And debug some more

* Fix issue with jobset.py

* Add debug for CI failure

* Revert microbenchmark changes
2021-11-08 08:55:25 -08:00
Richard Belleville b6cc72f129
Revert "Run 2to3 on tools directory (#26002)" (#27183)
This reverts commit a388361c3d.
2021-08-30 12:29:20 -07:00
Richard Belleville a388361c3d
Run 2to3 on tools directory (#26002)
* Run 2to3 on tools directory

* Delete github_stats_tracking

* Re-run 2to3

* Remove unused script

* Remove unused script

* Remove unused line count utility

* Yapf. Isort

* Remove accidentally included file

* Restore line_count directory
2021-08-30 09:25:21 -07:00
Jan Tattermusch 288fe131b4
Reintroduce #22964 with extra fixes (#26465)
* Revert "Revert "Upgrade dotnet SDK 3 for C# build (#22964)" (#26462)"

This reverts commit 736d914cfd.

* Revert "Exclude csharp from performance test continuous runs. (#26458)"

This reverts commit 6744e8f84a.

* switch remaining tests to C# buster image

* remove C#'s global.json (which requires dotnet SDK 3+)

* dotnet SDK3 currently breaks C# package build

* regenerate dockerfiles
2021-06-15 18:50:13 +02:00
Jan Tattermusch cb8114d689
Delete no longer needed artifact_linux dockerfiles (#25542)
* delete no longer needed artifact_linux dockerfiles

* fix build_package_python.sh
2021-03-04 09:40:31 +01:00
Jan Tattermusch 417db4fdd6 build C# nugets on linux instead of windows for simplicity 2020-10-21 15:04:53 +02:00
Esun Kim 7be821ac47 Yapf all target python sources 2020-01-03 09:25:10 -08:00
Jan Tattermusch 6574f5def4 add unity package build to package_targets.py 2018-08-02 08:14:34 +02:00
Mehrdad Afshari 87cd994b04 Upgrade yapf to 0.20.0
Upgrade yapf version to 0.20.0 and reformat Python files.
2018-01-02 14:40:00 -08:00
ncteisen a69c6901f9 yapf tools/run_tests/artifacts 2017-12-11 17:51:23 -08:00
murgatroid99 38007753b0 Remove src/node and references to it
This removes all of the node code and tests from the repo, along with the
scripts for running Node unit tests, performance tests, and artifact builds.
The scripts for running tests from the grpc-node repository are untouched.
2017-10-25 13:21:57 -07:00
Jan Tattermusch c3e2510bd4 csharp_coreclr_x64 dockerfile not useful 2017-09-05 17:09:58 +02:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Siddharth Shukla 8e64d901fd Modify shebang on python scripts
Change shebangs to `#!/usr/bin/env python` instead of
`#!/usr/bin/env python2.7`.
2017-03-12 19:53:12 +01:00
Jan Tattermusch 5c79a3199c cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00