Commit Graph

3379 Commits

Author SHA1 Message Date
Lidi Zheng 58beda2f73 Add try_connect API to StreamUnaryCall 2020-04-06 16:09:07 -07:00
Lidi Zheng c07520a350 Mark it as experimental 2020-04-06 16:09:07 -07:00
Lidi Zheng 41866c1250 Add try_connect API for UnaryStreamCall and StreamStreamCall 2020-04-06 16:09:07 -07:00
Donna Dionne c0c7f1dae3 Fix build and test failures
Including the following
All all needed BUILD changes to include new xdsRouting
Fixed TSAN errors
AllServerUnavailableFailFast may return UNKNOWN as oppose UNAVAILABLE
ChooseLastRoute modified into 2 tests
2020-04-06 16:05:04 -07:00
Lidi Zheng 6f00de087f Aggregate common statement in both branches 2020-04-03 15:13:26 -07:00
Lidi Zheng e00eb2fec2 Make pylint happy 2020-04-03 11:37:56 -07:00
Lidi Zheng 8b1a6c8f45 Accepts normal iterable of request messages 2020-04-03 11:37:56 -07:00
Richard Belleville 0ec32634fb
Merge pull request #22549 from gnossen/simple_stubs_3_6_and_up
Add version check for Python 3.6 to simple stubs
2020-04-02 14:08:36 -07:00
Lidi Zheng 006aafea85
Merge pull request #22541 from lidizheng/aio-poller-shutdown-error
[Aio] Fix AttributeError during deallocation of the completion queue
2020-04-02 13:09:23 -07:00
Richard Belleville c1953880f7 Modify tests accordingly 2020-04-02 10:23:26 -07:00
Richard Belleville f15a6bf6e4 Add version check for Python 3.6 to simple stubs 2020-04-01 23:34:14 -07:00
Lidi Zheng 386977ff41 Annotate metadata variable as Tuple instead of Sequence 2020-04-01 15:16:55 -07:00
Lidi Zheng 5cab833808 Make sanity tests happy 2020-04-01 15:11:26 -07:00
Lidi Zheng 2c24272bbd Cast the complete queue to sub class to avoid AttributeError 2020-04-01 14:30:15 -07:00
Lidi Zheng dc1d1e165d Add two more metadata tests 2020-04-01 13:38:39 -07:00
Lidi Zheng ee31a696ab Cast metadata to tuple 2020-04-01 13:25:33 -07:00
Mark D. Roth 03411d7be7 Second attempt: grpclb stabilization 2020-03-31 07:52:44 -07:00
Lidi Zheng cb5fdce2bf Improve readability and fix wording 2020-03-26 10:35:32 -07:00
Lidi Zheng 5182e9f07f Eliminates suspicious exceptions in test logs 2020-03-25 17:45:45 -07:00
Lidi Zheng 1e6c9b4c6d
Merge pull request #22482 from lidizheng/aio-no-info
[Aio] Eliminate info level logs
2020-03-25 17:16:36 -07:00
Lidi Zheng b5b47ce7c7 Upgrade the server stop log to warning 2020-03-25 16:00:50 -07:00
Lidi Zheng 0961c5de0b
Merge pull request #22306 from Skyscanner/issue-21953_type-of-metadata
[Aio] Initial modelling of the metadata abstraction
2020-03-25 15:10:51 -07:00
Lidi Zheng 79497f8059 Downgrade info logs to debug 2020-03-25 15:09:21 -07:00
Mariano Anaya a8ad4db3af [issue21953] Fix import in test
Import metadata from the canonical place.
2020-03-25 18:20:11 +01:00
Mariano Anaya 2be1ec9c6e [issue21953] Move tests to the aio part
* Export the new metadata type through the ``__init__.py``
* Move the tests from the old location to the new one for the
asynchronous stack.
2020-03-25 10:03:14 +01:00
Mariano Anaya 3bf67c4253 [issue21953] Fix typing in Metadata class definitions 2020-03-25 10:03:14 +01:00
Mariano Anaya 6891169b58 Apply PR feedback
* Fix the length of the object to account for all the keys it holds
(consider it's a multi-mapping)
* Add support for deleting items
* Make test stricter
2020-03-25 10:03:14 +01:00
Mariano Anaya 1f2d916386 [aio] Metadata type: Fix tests & __repr__ 2020-03-25 10:03:14 +01:00
Mariano Anaya 0be36ed606 Add mutability to the MetadataType 2020-03-25 10:03:14 +01:00
Mariano Anaya 7d88c61f57 Initial modelling of the metadata abstraction
Create the initial version for the abstraction for the Metadata based on
the discussion at https://github.com/grpc/grpc/issues/21953
2020-03-25 10:03:14 +01:00
Lidi Zheng 52634fb7be Correct the docstring and implementation of AuthMetadataPlugin 2020-03-24 15:59:10 -07:00
Lidi Zheng bc0aabc093
Merge pull request #22453 from lidizheng/aio-default-poller
[Aio] Change the default IO engine to POLLER
2020-03-23 12:38:43 -07:00
Lidi Zheng 5cd773731d Assert with public API instead of private API 2020-03-23 10:21:50 -07:00
Lidi Zheng b73b389dd1 Change the default IO engine to poller 2020-03-23 10:21:33 -07:00
Jan Tattermusch d439048b9c
Merge pull request #22390 from jiangtaoli2016/update_test_creds
Update test credentials to use 2048-bit RSA keys
2020-03-23 15:50:12 +01:00
jiangtaoli2016 951abee174 Revert "Append old ca.pem"
This reverts commit 13c6b6c612.
2020-03-20 16:49:15 -07:00
jiangtaoli2016 13c6b6c612 Append old ca.pem 2020-03-20 14:48:02 -07:00
Lidi Zheng 39c4fd7972
Merge pull request #22343 from lidizheng/async-unary-unary-credentials-tests
[Aio] Extend unit tests for async credentials calls
2020-03-19 14:53:21 -07:00
Lidi Zheng ae0dc69cb1 Fix the typo; I got the wrong branch and waited two hours 2020-03-19 13:19:41 -07:00
jiangtaoli2016 2620763fdd Update test creds for php, python, ruby 2020-03-18 16:48:22 -07:00
Lidi Zheng 69fa971183
Merge pull request #22405 from lidizheng/annotate-context-manager
Annotate channel context manager methods to make pytype happy
2020-03-18 13:30:21 -07:00
Richard Belleville 85d25bd990
Merge pull request #22104 from gnossen/xds-python-client
Implement Python xDS interop client.
2020-03-18 13:07:50 -07:00
Lidi Zheng 158a68f4f0 Annotate channel context manager methods to make pytype happy 2020-03-18 11:49:26 -07:00
Richard Belleville a82f8f3dd7 Ensure unit tests don't pick up interop client 2020-03-18 17:15:09 +00:00
Lidi Zheng 46bb3769a9 Override the auth plugin behavior 2020-03-18 10:13:05 -07:00
Lidi Zheng 621a281a0c
Merge pull request #22259 from lidizheng/aio-cq-2
[Aio] Use socket to synchronize between Cpp and Python
2020-03-17 18:25:56 -07:00
Lidi Zheng d6bd3c37b2 Use mutex to protect queue operations 2020-03-17 15:32:38 -07:00
Richard Belleville 7fd0c8fc1a Clean up client 2020-03-17 20:34:25 +00:00
Lidi Zheng 030b1b6a84 Update the pxd as well 2020-03-17 13:28:24 -07:00
Lidi Zheng 82050ae192 Initialize credentials after IO engine set 2020-03-17 13:23:11 -07:00
Richard Belleville 24e03778ea Revert "Merge pull request #22373 from gnossen/creds_threads_and_breads"
This reverts commit 61a0212539, reversing
changes made to 19d8e2c551.
2020-03-17 12:36:22 -07:00
Richard Belleville 34e320a439 Working client 2020-03-17 19:13:10 +00:00
Lidi Zheng 1a0655d75c Add comment about why we can't use cimport 2020-03-17 10:55:52 -07:00
Lidi Zheng 65930d4be9 Remove the socket reader in shutdown 2020-03-17 10:40:05 -07:00
Richard Belleville 61a0212539
Merge pull request #22373 from gnossen/creds_threads_and_breads
Stop Leak of one thread per call in case of reference cycle
2020-03-17 10:21:04 -07:00
Lidi Zheng 19d8e2c551
Merge pull request #22165 from lidizheng/aio-benchmark
Integrate existing gRPC Python stack benchmarks with Bazel
2020-03-17 10:18:46 -07:00
Lidi Zheng 7be8cef10a
Merge pull request #22369 from lidizheng/health-default
[Health Checking] Make the empty service default to SERVING state
2020-03-17 00:17:31 -07:00
Richard Belleville 59b040d3c4 Stop leaking threads 2020-03-16 16:14:03 -07:00
Lidi Zheng 3779b12203 Enable skipped tests 2020-03-16 16:09:36 -07:00
Mariano Anaya da698286e4 Fix tests.json
Remove tests from the old branch (conflict resolution leftover issue).
2020-03-16 16:09:36 -07:00
Mariano Anaya 963429864e Skip failing tests due to a regression
Reported at https://github.com/grpc/grpc/issues/22302
2020-03-16 16:09:36 -07:00
Mariano Anaya bd4679439c Add 'resources' to bazel build file 2020-03-16 16:09:36 -07:00
Mariano Anaya a8f7dfe4c5 Update exception used in test 2020-03-16 16:09:36 -07:00
Mariano Anaya dff4a30b6c Fix build & address review comments
Fixes https://github.com/grpc/grpc/issues/20532
2020-03-16 16:09:36 -07:00
Mariano Anaya 4d492d28a7 Add test for full-duplex call 2020-03-16 16:09:36 -07:00
Mariano Anaya 8165cc2d97 Extend with more tests 2020-03-16 16:09:36 -07:00
Mariano Anaya 33e15156bb [WIP] Feedback on the PR 2020-03-16 16:09:36 -07:00
Mariano Anaya a3459d371d Code cleanup 2020-03-16 16:09:36 -07:00
Mariano Anaya f2aad7e54c Extend tests for secure channels & credentials 2020-03-16 16:09:36 -07:00
Mariano Anaya a1bb0bc6f8 Set error description 2020-03-16 16:09:36 -07:00
Mariano Anaya 764be7ed92 Improve error message by including the error code 2020-03-16 16:09:36 -07:00
Mariano Anaya 4ec09a0a26 [WIP] test call credentials 2020-03-16 16:09:36 -07:00
Mariano Anaya 88e922c03f Make the server test use SSL credentials 2020-03-16 16:09:36 -07:00
Mariano Anaya f44e4e2138 Renames according to PR comments 2020-03-16 16:09:36 -07:00
Lidi Zheng d43ac68bf3 Make the empty service default to SERVING state 2020-03-16 15:48:08 -07:00
Lidi Zheng c82f28d428 Use socket to synchronize cq and asyncio 2020-03-16 15:42:31 -07:00
Lidi Zheng 562f3ca5f5 Add port needs a FQN 2020-03-16 11:21:07 -07:00
Lidi Zheng 5d1651ff65 Don't graceful shutdown cq to avoid the deadlock 2020-03-16 11:10:07 -07:00
Richard Belleville f26f80d532 Log TID 2020-03-14 02:33:52 +00:00
Lidi Zheng 7622a2de38 Improve readability & fix a deadlock issue in _test_base 2020-03-13 15:56:25 -07:00
Richard Belleville 651f850076 Merge remote-tracking branch 'origin/master' into peers_method 2020-03-13 20:31:27 +00:00
Richard Belleville 7a129dac1c Don't let threads die over timed out RPCs 2020-03-13 20:29:08 +00:00
Lidi Zheng 7a51ca3330 Plumb through loop object & pass daemon=Ture in constructor 2020-03-13 11:59:35 -07:00
Lidi Zheng d725a7dae8 Make buildifier happy 2020-03-13 11:47:31 -07:00
Lidi Zheng 8fc872ed2e Enforce one cq and support many-thread many-loop env
- Label channel_argument_test as flaky

- Add compatibility test

- Add many-loop test case
2020-03-13 11:47:30 -07:00
Lidi Zheng fda2111af7
Merge pull request #22258 from lidizheng/aio-cq
[Aio] Add an alternative mode for the AsyncIO Stack
2020-03-13 11:40:20 -07:00
Richard Belleville 9ef83ee539 Merge remote-tracking branch 'origin/master' into peers_method 2020-03-12 20:30:08 +00:00
Lidi Zheng 086297b1e9
Merge pull request #22290 from lidizheng/fix-time-remaining
[Aio] Fix the test_time_remaining test
2020-03-10 15:57:59 -07:00
Lidi Zheng 2c783d7905 Fix the test_time_remaining test 2020-03-10 13:46:06 -07:00
Lidi Zheng 4741da3a11 Remove unused variable 2020-03-10 10:26:46 -07:00
Richard Belleville df1761ce50
Merge pull request #22218 from gnossen/simple_stubs_codegen
Generate simple stubs code
2020-03-09 19:04:13 -07:00
Richard Belleville f27b7fea21 Format 2020-03-09 17:25:00 -07:00
Richard Belleville 4e2ad2444d Remove the default value for simple stubs 2020-03-09 17:03:55 -07:00
Lidi Zheng 5b1ecef47f Simplify the Cython code 2020-03-09 15:38:34 -07:00
Lidi Zheng 5246a7c8ff Link to a TODO issue 2020-03-09 15:20:06 -07:00
Lidi Zheng 231f9c0c94 Improve readability 2020-03-09 15:20:06 -07:00
Lidi Zheng ce68d53dd1 Make pytype happy 2020-03-09 15:20:06 -07:00
Lidi Zheng 57fa6ce33c Make pylint happy 2020-03-09 15:20:06 -07:00
Lidi Zheng 7b7c0ba5fc Fix the SEGFAULT caused by initialization ordering 2020-03-09 15:20:06 -07:00
Lidi Zheng 0ee33a4762 Confusing 2020-03-09 15:20:06 -07:00
Lidi Zheng 1d13ec88de Segfault while shutting down 2020-03-09 15:20:06 -07:00
Lidi Zheng 221a50bf87 Allow multiple asyncio engine 2020-03-09 15:20:06 -07:00
Lidi Zheng efd483311c Remove loggings 2020-03-09 15:20:06 -07:00
Lidi Zheng b2839c2bae Add assertion in grpc_call_soon_threadsafe 2020-03-09 15:20:06 -07:00
Lidi Zheng 464d41f4b8 Great. Everything seems working. 2020-03-09 15:20:06 -07:00
Lidi Zheng e00f8b3492 Use a poller thread to replace custom IO manager 2020-03-09 15:20:06 -07:00
Lidi Zheng d9c55675c4
Merge pull request #22234 from lidizheng/aio-iomgr-op
[Aio] Optimize some details of AsyncIO IO manager
2020-03-09 14:15:19 -07:00
Richard Belleville c0b9694e4f Fix windows 2020-03-06 16:22:51 -08:00
Lidi Zheng a05abc0939 Mark it correctly with a TODO 2020-03-06 14:12:47 -08:00
Lidi Zheng 08b028ab82 Update the comment about the expect life span of the hack 2020-03-06 13:53:12 -08:00
Lidi Zheng 0d785bf22a Resolve AttributeError from bpo-39764 2020-03-06 13:47:35 -08:00
Lidi Zheng b00fc59d29 Link the TODO issue & revert to call_later 2020-03-05 16:26:41 -08:00
Lidi Zheng 33a406e6a8 Restore 3.6 compatibility 2020-03-05 12:11:22 -08:00
Lidi Zheng f87149c967 Destroy server without gil 2020-03-05 12:11:22 -08:00
Lidi Zheng 43fe171683 Optimize some implementation of IO manager 2020-03-05 12:11:22 -08:00
Lidi Zheng 87d01bf9e5
Merge pull request #22032 from ZHmao/implement-server-interceptor-for-unary-unary-call
[Aio] Implement server interceptor for unary unary call
2020-03-05 10:26:56 -08:00
yang-g 976fff1797 Create a macro to allow custom dualstack socket 2020-03-04 16:07:35 -08:00
Zhanghui Mao 09168c534f fix type annotation 2020-03-04 23:50:08 +08:00
Richard Belleville db27226b3f Don't run under gevent 2020-03-03 16:23:25 -08:00
Richard Belleville c9d90e5c1b Use wait_for_ready in tests 2020-03-03 15:18:04 -08:00
Richard Belleville 6b42bcc03d Sanity tests make me lose my sanity 2020-03-03 14:30:28 -08:00
Richard Belleville f921f01262 Format 2020-03-03 13:50:13 -08:00
Richard Belleville b5d69d2cd1 Clean up test 2020-03-03 12:24:13 -08:00
Richard Belleville 0fe463b2d3 Don't run on Python 2 2020-03-03 11:51:29 -08:00
Richard Belleville 0fd0948bfa Generate simple stubs 2020-03-02 22:11:24 -08:00
Zhanghui Mao 701ec0be20 add type annotation 2020-02-29 19:22:49 +08:00
Mark D. Roth 19e28b1353 Refactor code for gracefully switching child LB policies. 2020-02-28 08:17:54 -08:00
Zhanghui Mao 26985fd722 fix sanity checks 2020-02-28 22:06:31 +08:00
Mark D. Roth 144adbc194
Merge pull request #22147 from markdroth/xds_overprovisioning_capability
xds: send no-overprovisioning client capability and populate user_agent fields
2020-02-27 15:02:53 -08:00
Lidi Zheng 05fa7c9255 Remove logging from qps_worker.py 2020-02-27 13:39:34 -08:00
Lidi Zheng 18a5fbeb93 Make Buildifier happy 2020-02-27 13:38:31 -08:00
Mark D. Roth 28b950e407 Merge remote-tracking branch 'upstream/master' into xds_overprovisioning_capability 2020-02-27 12:09:16 -08:00
Moiz Haidry 88096215a3 Merge with HEAD 2020-02-26 19:59:06 -08:00
Lidi Zheng d657d73565 Integrate existing gRPC Python stack benchmarks with Bazel 2020-02-26 16:56:12 -08:00
Richard Belleville 5ef379870d Regenerate projects 2020-02-26 10:39:34 -08:00
Mark D. Roth b68f813e54 xds: send envoy.lb.does_not_support_overprovisioning client capability 2020-02-26 08:23:27 -08:00
Moiz Haidry 67565b767d CallCredentials debug string API 2020-02-25 16:09:03 -08:00
Zhanghui Mao 99e26eb647 Merge branch 'implement-server-interceptor-for-unary-unary-call' of github.com:ZHmao/grpc into implement-server-interceptor-for-unary-unary-call 2020-02-22 22:38:05 +08:00
Zhanghui Mao 128d030cdc upate test 2020-02-22 22:37:31 +08:00
Richard Belleville 7adf2f5c65 Implement first pass at Python XDS interop client.
I discovered a couple of existing shortcomings while implementing this
client that mean this is *not yet ready for inclusion in CI*. I
nonetheless want to get an early review and integrate this to the master
branch, in the interest of small easily reviewable code changes.

The first problem was that the bazel build has apparently never pulled
roots.pem in as a data dependency. This appears not to have been a
problem until XDS enters into the mix. This has been added into the
Bazel build with a small change to the pyx_library rule.

The larger problem is that there is currently no public Python API to
get a peer's identity from the client side. This is crucial to
determining the correctness of an interaction of a client-server pair
under XDS. I intend to add such an method to the RpcContext interface in
an upcoming PR and use it in the interop client. For the moment, I
simply fake the peer details.

Finally, I add a knob to run_xds_tests.py allowing multiple instances of
this test to exist at once. Multiple instances forwarding to the same
port cannot exist on GCE, so this enables multiple people to run tests
at the same time.
2020-02-21 23:28:19 +00:00
apolcyn 17036c1452
Merge pull request #21698 from apolcyn/bump_g_stands_for
Bump g stands for
2020-02-21 10:53:47 -08:00
Zhanghui Mao 958fb08d0d
Merge branch 'master' into implement-server-interceptor-for-unary-unary-call 2020-02-21 22:43:51 +08:00
Esun Kim 5f41758a76 Replaced gpr_asprintf with absl::StrFormat 2020-02-20 13:44:35 -08:00
Lidi Zheng 2eeb22de65
Merge pull request #21904 from lidizheng/aio-benchmark-client
[Aio] Benchmark automation
2020-02-20 10:15:01 -08:00
Lidi Zheng bbcaca2d83 Add uvloop argument 2020-02-19 13:09:46 -08:00
Lidi Zheng 8aff9ec592
Merge pull request #21987 from lidizheng/aio-doc
[Aio] Generate gRPC AsyncIO API Reference
2020-02-19 10:52:38 -08:00
Lidi Zheng c0e1dbc445 Update method naming & use os.path.join 2020-02-18 18:04:17 -08:00
Richard Belleville 3ed237d4bb
Merge pull request #21954 from gnossen/simple_stubs
Experimental: Implement Top-Level Invocation Functions Not Requiring an Explicit Channel
2020-02-18 16:32:01 -08:00
Lidi Zheng dbdb2cc5c9 Fix the non-protobuf scenario 2020-02-18 16:28:19 -08:00
Lidi Zheng c22b161d4e Improve benchmark automations:
1. Use monotonic time;
2. Improve readabilities;
3. Add two more fields for number of processes.
2020-02-18 16:28:18 -08:00