Commit Graph

44 Commits

Author SHA1 Message Date
Richard Belleville 5933b52e11
Build native MacOS arm64 artifacts (universal2) (#31747)
* Attempt to build universal2 artifacts

* Whoops

* Reverse the hack

* Turn off boringssl assembly optimizations

* Whoopsie
2022-12-01 09:57:02 -08:00
Jan Tattermusch 108444e9f7
Fix python tests on kokoro macos monterey (#31126)
* fix python build on kokoro macos monterey

* avoid using realpath

* fix grpc_distribtests_python on macos monterey

* try upgrade setuptools
2022-10-10 17:45:31 +02:00
Richard Belleville 0b4f95b352
Set Correct Platform Tag in Wheels on Mac OS with Python 3.10 (#29857)
* Attempt to set correct platform on Mac OS

* Add some debug

* Make it fail

* Print more

* Try again

* Maybe it's an ordering issue?

* Get logs back

* Try copying distutils to see exactly what is being used

* Actually export the variable

* I just love debugging with CI

* One directory higher this time

* Try with an upgraded Python install

* Fix version

* Rebreak

* Try setting it even earlier?

* Unbreak

* Try explicitly renaming the artifacts

* Fix

* I am about ready to start NAT hole punching for SSH

* Break things for logs

* Whoops

* Clean up

* Shellcheck
2022-06-15 14:35:49 -07:00
Jan Tattermusch 1bf8414630
build_and_run_docker.sh cleanup and simplification (#29468)
* unify DOCKER_TTY_ARGS in docker scripts

* improvements and cleanup in build_and_run_docker.sh

* fix shellcheck

* make sure python sdist artifact is readable
2022-04-22 06:02:18 +02:00
Lidi Zheng cd4261b946
Support musllinux binary wheels on x64 and x86 (#28092)
* Support musllinux binary wheels

* Skip aarach64 for now
* Consolidate the difference of mktemp
* Extend linux artifact building time && install bash for distribtest
* Stop using grpc.tools, use grpc_tools
* Update the README to use grpc_tools
* Force static link libc++ for alpine binaries
* Rebase recent build script changes

* Install ccache for musllinux distribtest images

* Revert timeout change to grpc_build_artifacts
2022-02-10 14:14:56 -08:00
Jan Tattermusch f23f1bb51f
Use ccache for selected C++ and python builds (with redis server as cache) (#28661)
* add cmake support for ccache

* cleanup: use --env-file for docker run invocations

* make python build compatible with using ccache

* enable building using ccache in selected kokoro jobs

* print ccache stats and the end of run_tests.py
2022-01-25 19:18:58 +01:00
Jan Tattermusch 782734a82f
python: move native debug symbol stripping to build_artifact phase (#26194) 2021-09-09 10:41:53 +02:00
Lidi Zheng 4729f6fdcc
Add Python 3.10 drop 3.5 (#26074)
* Add Python 3.10.0rc1 binary wheels

* Drop Python 3.5 artifacts

* Document the drop of 3.5

* Fix the wrong pip pointer

* Update manylinux2014 to a newer version, remove 3.5 distribtest

* Update manylinux aarch64 to see if the absl error go away

* Use the preferred alias

* Allow different wheel library to produce different tag order

* Remove unused shell var and log produced wheels

* Use copy instead of move

* Make bash happy about the wildcard

* Upgrade the debian image to use 3.5+ Python

* Polish the comments for the Dockerfiles
2021-09-02 14:02:53 -07:00
Lidi Zheng 25f5399b41
Add grpcio-admin Python package (#26166)
* Add grpcio-admin Python package

* Polish package content

* Make Linux artifact build happy

* Improve documentation
2021-05-05 13:20:50 -07:00
Lidi Zheng dc63d6a53e
Add CSDS API to Python (#26114)
* Add grpcio-csds pacakge

* Remove unused file

* Fix the proto import path issue

* Update the CSDS package and xds-protos for PY2

* Make tests happy

* Fix Bazel proto dependency

* Add Python2 tests for CSDS
2021-05-03 11:54:34 -07:00
Jan Tattermusch 0088dae36a
Use crosscompilation to build python armv7 wheels (#25704)
* removed unused DOCKER_BASE_IMAGE functionality

* remove legacy docker images for arm build

* build python armv7 wheel via crosscompilation

* add pyconfig.h hack

* improve the dockerfile

* yapf format code
2021-03-17 18:49:32 +01:00
Jan Tattermusch 1dce57f35f
Assorted python wheel build improvements (#25602)
* cleanup unnecessary deps from grpc_artifact_python_manylinux2014_aarch64

* cleanup in grpc_artifact_python dockerfiles

* enable boringssl assembly optimizations when crosscompiling aarch64 linux wheels

* pin manylinux2010 images to keep python27 build

* avoid pip install --upgrade cython when not necessary
2021-03-04 09:54:11 +01:00
Jan Tattermusch fcd43e9030
Crosscompile python aarch64 wheels with dockcross (#25418)
* build aarch64 python wheels via crosscompilation

* yapf format code

* fix shellcheck complaints

* fix python37 aarch64 wheel build

* build python wheels on linux aarch64 with static libstdc++

* yapf format code
2021-03-02 07:32:28 +01:00
Lidi Zheng db16440066 Ensure virtualenv is installed in new interpreters 2020-10-09 15:31:11 -07:00
Lidi Zheng 811a78f8fa Fix a typo in build_artifact_python 2020-09-30 10:26:27 -07:00
Lidi Zheng e242764d50 Remove enum34 from requirements.txt 2020-09-29 15:17:38 -07:00
Micah Kornfield b8b13cf70c dont remove .S and .asm file 2020-08-05 10:30:34 -07:00
Jan Tattermusch 751b1d04cf stop stripping .hpp files from python source packages 2020-07-21 15:01:38 +02:00
Lidi Zheng b2f72702c9 Pin virtualenv to 16.7.9 2020-02-11 11:05:23 -08:00
Lidi Zheng bf3a5c2478 Only install Cython early to satisfy different platforms 2019-12-11 18:14:32 -08:00
Lidi Zheng 151e5b72af Install required packages with --user 2019-12-11 16:28:27 -08:00
Lidi Zheng 28ca0c6b6a Install necessary packages earlier 2019-12-11 12:22:30 -08:00
Esun Kim 4dd753084a Fix the version of twine to 2.0 2019-11-20 09:41:54 -08:00
Esun Kim d4fd33e95b Update docker images for manylinux 2019-10-09 09:53:05 -07:00
Lidi Zheng 6d63d4413f Restrict the acceptable artifact tags to all existing uploadable combinations 2019-09-17 14:46:50 -07:00
Lidi Zheng bb76da06d6 Make the artifact check accepts both manylinux1 and manylinux2010 2019-09-17 14:20:13 -07:00
Esun Kim 5b1899160a Run auditwheel-show to python artifacts 2019-08-26 11:55:09 -07:00
Esun Kim 1069dee43a Excluded *.inc from python garbage cleanup 2019-08-08 15:00:02 -07:00
Srini Polavarapu ec640a53c6 Merge pull request #19105 from gnossen/twine_check_artifacts
Produce Python Wheels with a Valid long_description field
2019-05-28 10:11:34 -07:00
Lidi Zheng b9cb2459ea Include LICENSE in artifact 2018-12-13 18:07:52 -08:00
Lidi Zheng 45b3230ef2 Add grpcio-status extension package
* The new package has 2 API `from_call` and `to_status`
* Utilize the experimental API `abort_with_status`
* Add 5 unit test cases
2018-12-13 10:18:44 -08:00
Lidi Zheng 5584d58e6c Add LICENSE to grpcio-* packages
* Using the proprocess command to copy the LICENSE
2018-12-05 15:25:48 -08:00
Lidi Zheng 43599facf4 Channelz Python wrapper implementation
* Expose the C-Core API in Cython layer
* Handle the object translation
* Create a separate package for Channelz specifically
* Handle nullptr and raise exception if seen one
* Translate C++ Channelz unit tests
* Adding 5 more invalid query unit tests

Adding peripheral utility for grpcio-channelz package
* Add to `pylint_code.sh`
* Add to Python build script
* Add to artifact build script
* Add to Bazel
* Add to Sphinx module list
2018-11-27 17:27:39 -08:00
Jan Tattermusch 15451b5951 fix linux_extra python artifacts 2018-11-12 15:23:37 +01:00
Jan Tattermusch 185a0a7028 add python monkey-patch for parallel build_ext compilation 2018-10-31 09:01:01 +01:00
Mehrdad Afshari 258667cc1c Build grpcio_testing in Python artifact process 2018-06-20 10:06:27 -07:00
Mehrdad Afshari ac6aaa3f0b Install futures package only on Python 2 2018-05-14 17:02:03 -07:00
Eric Gribkoff 57414c7c51 Remove old environment variable from Python artifact build 2018-04-19 10:19:45 -07:00
Mehrdad Afshari fdddab5af1 Delete garbage from Python source packages 2018-02-26 21:50:56 -08:00
Mehrdad Afshari bcd91f835b Fix build_artifact_python.sh to pass shellcheck 2018-01-16 14:59:07 -08:00
Jan Tattermusch 5c74d90a33 improve python artifact building 2017-07-04 14:49:23 +02:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Jan Tattermusch 47c7521960 simplify building artifacts on a single machine 2017-05-12 10:18:49 +02:00
Jan Tattermusch 5c79a3199c cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00