Commit Graph

197 Commits

Author SHA1 Message Date
Matt Kwong 5aafb3b61c Handle timeouts when uploading ResultStore results 2018-05-11 16:19:53 -07:00
Jan Tattermusch 62861977f2 run_tests: keep longer logs from individual test cases 2018-05-10 11:30:11 +02:00
Matt Kwong 11fe61ebe6
Merge pull request #14736 from matt-kwong/resultstore-results
Add test result uploading for RBE builds
2018-05-02 11:32:19 -07:00
Matt Kwong b16fcf58e5 Query ResultStore for tests instead of targets 2018-04-05 15:00:58 -07:00
Jan Tattermusch f75ca1ac8a use ResultStore URL instead of Sponge for bigquery test results 2018-04-05 09:29:11 +02:00
Matt Kwong 90e98c16ea Add test result uploading for RBE builds 2018-03-21 09:22:37 -07:00
Mehrdad Afshari 87cd994b04 Upgrade yapf to 0.20.0
Upgrade yapf version to 0.20.0 and reformat Python files.
2018-01-02 14:40:00 -08:00
Matt Kwong 827c6e90e2 Pass KOKORO_BUILD_ID to Docker 2017-12-20 16:05:35 -08:00
ncteisen 0cd6cfefa0 yapf tools/run_tests/sanity 2017-12-11 16:56:44 -08:00
ncteisen 05687c3da9 yapf tools/run_tests/python_utils 2017-12-11 16:54:47 -08:00
Muxi Yan cd62e7d04c Exclude cronet restricted ports from port server pool 2017-12-07 14:16:39 -08:00
murgatroid99 38007753b0 Remove src/node and references to it
This removes all of the node code and tests from the repo, along with the
scripts for running Node unit tests, performance tests, and artifact builds.
The scripts for running tests from the grpc-node repository are untouched.
2017-10-25 13:21:57 -07:00
Craig Tiller 5110b8d23b Merge github.com:grpc/grpc into verify 2017-10-17 08:56:52 -07:00
Jan Tattermusch 3d1b6c1035 explain retries and jobset.max_time setting 2017-10-16 16:01:12 +02:00
Craig Tiller 642bdbea81 Merge github.com:grpc/grpc into verify 2017-10-12 08:48:46 -07:00
Craig Tiller 703d298521 Merge github.com:grpc/grpc into qps_failya 2017-10-10 20:42:18 -07:00
Craig Tiller 520e59f2fb test/core should trigger c++ suite nowadays 2017-10-07 17:34:41 -07:00
Matt Kwong a9712ba7ff Add uploading interop result to BQ 2017-10-06 15:00:48 -07:00
Craig Tiller a69912cb2c Fixes 2017-10-06 10:27:11 -07:00
Jan Tattermusch d059e1c43c Merge pull request #12841 from jtattermusch/report_elapsed_on_timeout
jobset.py: report elapsed time for jobs that time out
2017-10-06 10:06:18 +02:00
Jan Tattermusch 8dbc2364b3 report elapsed time for jobs that time out 2017-10-05 17:15:27 +02:00
Jan Tattermusch ac3d765041 retry when uploading results to bigquery 2017-10-05 15:27:01 +02:00
apolcyn ec9c592ccb Merge pull request #12777 from apolcyn/reduce_test_parrallelization
Put a safety limit on parallelization of tests
2017-10-04 00:00:33 -07:00
Alexander Polcyn dbfcd45af8 Limit max jobs cpu agnostic way, to avoid overloading the test
environment
2017-10-02 10:05:05 -07:00
Michael Lumish 38d089e9b9 Merge pull request #12596 from matt-kwong/node-testing
Add testing of grpc-node for Linux and MacOS
2017-09-28 17:35:44 -07:00
Matt Kwong e2e7cf42a4 Add testing of grpc-node for Linux and MacOS 2017-09-20 14:24:42 -07:00
Jan Tattermusch a29032fd32 test everything if internal_ci scripts change 2017-09-18 16:33:37 +02:00
Matt Kwong 8e53799f45 Merge pull request #12515 from matt-kwong/fix-perf2
Revert "Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand""
2017-09-15 15:44:37 -07:00
Matt Kwong bce6bcd1f8 Merge branch 'master' into kokoro_fil 2017-09-13 10:16:01 -07:00
Craig Tiller 2be06b43e7 Make unmeasured CPU costs be 1, not 0
Allows capturing 0 as a CPU cost, which we'll be able to leverage to
increase concurrency (once data has caught up in a few days)
2017-09-12 15:24:49 -07:00
Matt Kwong 69ce380ccc Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand"
This reverts commit 81ad19d4be, reversing
changes made to ed63aac195.
2017-09-12 13:30:51 -07:00
Craig Tiller 0852acd8b3 Revert "Let alarms trigger at end of jobset.py instead of clearing them" 2017-09-12 13:15:03 -07:00
Matt Kwong 6d11e90926 Add Kokoro test filtering for MacOS/Windows 2017-09-11 19:17:32 -07:00
Matt Kwong 738b1bb424 Get rid of have_alarm var in jobset.py 2017-08-29 12:45:53 -07:00
Matt Kwong 3da8c5defb Let alarms at end of jobset.py trigger isntead of clearing 2017-08-24 12:35:04 -07:00
Matt Kwong 5920abc535 Revert "Don't clear alarm in jobset when running performance tests"
This reverts commit c15d32bbe8.
2017-08-24 12:26:05 -07:00
Craig Tiller 7e813a2bc4 Remove bazel warning (we have owners now), set noparent on bazel/OWNERS 2017-07-13 08:58:49 -07:00
Matt Kwong 9a836ca37b Merge pull request #11670 from matt-kwong/perf_alarm
Don't clear alarm in jobset when running performance tests
2017-07-11 15:32:19 -07:00
Matt Kwong c15d32bbe8 Don't clear alarm in jobset when running performance tests 2017-07-10 17:10:27 -07:00
Yong Ni ef698b60cd Merge branch 'master' of github.com:grpc/grpc into matrix 2017-07-05 14:56:13 -07:00
Matt Kwong c87cbba379 Add return code as a field in BQ results uplaod 2017-07-05 13:09:00 -07:00
Yong Ni 5f32c517b1 Added timestamp to the xml report and minor changes to the API per review feedback. 2017-07-05 11:43:29 -07:00
Yong Ni b7ea4ab4d7 Created test driver to run matrix test against different docker images in GCR and generate a Junit like test result file. 2017-06-30 09:41:31 -07:00
Matt Kwong 60a672b87f Clear alarms in jobset.py when finished running jobs 2017-06-16 14:28:06 -07:00
Matt Kwong c1e1e1b720 Merge pull request #11248 from matt-kwong/part_tables
Upload Jenkins tests results to a partitioned BQ table
2017-06-14 16:25:47 -07:00
Matt Kwong ea1fa277f0 Add Kokoro metadata to BQ upload 2017-06-09 14:17:35 -07:00
Matt Kwong 68309b42d5 Add test to check if bazel subdirectory was modified 2017-06-09 08:21:10 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Matt Kwong 4e55bf1293 Merge pull request #11348 from matt-kwong/upload_windows
Enable uploading more test results to BQ
2017-05-31 15:16:31 -07:00
Matt Kwong d8543c4e0f Fix --measure_cpu_costs flag in run_tests.py on Windows 2017-05-31 10:40:07 -07:00
Craig Tiller 46356b72a0 Make jobset more eintr resilient 2017-05-26 15:22:08 +00:00
Matt Kwong d14c0ea1f5 Upload Jenkins tests results to a partitioned BQ table 2017-05-24 13:42:54 -07:00
Craig Tiller f09957bd04 Recover from more EINTRs 2017-05-15 08:39:17 -07:00
Craig Tiller 9d5d803bbf Small fixes 2017-05-15 07:54:54 -07:00
Matt Kwong d1f40bd3b3 Make --measure_cpu_costs flag Mac-friendly 2017-05-11 10:29:49 -07:00
Matt Kwong c7676a3d00 Merge pull request #10967 from matt-kwong/upload_results2
Add option to upload Jenkins test result to BQ
2017-05-09 15:38:31 -07:00
Matt Kwong 52ff986f94 Add option to upload Jenkins test result to BQ 2017-05-08 13:52:45 -07:00
Craig Tiller e21d2c1cd8 Bump version 2017-05-05 14:07:50 -07:00
Craig Tiller ddc8a8243d Fix port server on Windows 2017-05-05 14:02:35 -07:00
Jan Tattermusch 6815e414a4 Merge pull request #10985 from jtattermusch/internal_ci_failing_targets
Improve XML reports for internal_ci.
2017-05-05 10:54:25 +02:00
Craig Tiller e1f5302bc5 Port server fixes
- correct a couple of race conditions that could result in duplicated port assignments to different processes
- enhance detection code for 'is this port in use' to be much more robust
2017-05-04 19:53:19 +00:00
Jan Tattermusch 98ae39c121 show error details in internal_ci 2017-05-04 21:50:00 +02:00
Jan Tattermusch 883fe50140 add error and failure count to sponge log 2017-05-04 14:55:16 +02:00
Jan Tattermusch ac9c9f93b9 reports can create subdirs 2017-04-29 12:19:36 +02:00
Yong Ni 35ee7e7967 Added verbose option to run_interop_test to ease tracing the commands invoked 2017-04-26 17:46:32 -07:00
Craig Tiller 09ebed7bf4 Ensure port server can shutdown 2017-04-25 10:19:10 -07:00
Craig Tiller ec49524269 Add a mutex around allocate_port 2017-04-24 20:55:43 +00:00
Craig Tiller ea525ebd39 Threaded port_server 2017-04-24 17:50:32 +00:00
Craig Tiller a1ac2a1317 Allow specifying a maximum run time to run_tests 2017-04-21 07:20:38 -07:00
Matt Kwong 5eecba42c3 Add test filtering to performance pull requests 2017-04-06 19:08:14 -07:00
Craig Tiller 8a26aab8a2 fix 2017-03-29 14:01:32 -07:00
Craig Tiller 70abee2687 Missing import 2017-03-29 12:19:34 -07:00
Craig Tiller a61dce07a8 Syntax fix 2017-03-29 09:30:07 -07:00
Craig Tiller 5431f90960 Add python commenter module 2017-03-29 08:31:45 -07:00
Alexander Polcyn 50fdc8ab19 add http2 server test for unary calls that uses small frames and padding 2017-03-22 13:46:51 -07:00
Eric Gribkoff 2f59cf2dc3 move health check to just before running test cases 2017-03-17 00:46:01 -07:00
Eric Gribkoff 92a5d28a4c increase wait for healthy timeout 2017-03-17 00:46:01 -07:00
Eric Gribkoff d86a19efd0 check error for docker inspect 2017-03-17 00:46:01 -07:00
Eric Gribkoff 22afddf53c add health check for http2 server 2017-03-17 00:46:01 -07:00
Siddharth Shukla 8e64d901fd Modify shebang on python scripts
Change shebangs to `#!/usr/bin/env python` instead of
`#!/usr/bin/env python2.7`.
2017-03-12 19:53:12 +01:00
Siddharth Shukla d194f59939 Make testing scripts python3.x compatible
Update run_tests/*.py to use six based isomorphisms and print function
from __future__ module.
2017-03-12 17:47:53 +01:00
Jan Tattermusch d159af31fc return tuple from jobset.run when skipping tests 2017-03-10 10:08:53 +01:00
Craig Tiller fbedd676f7 Merge pull request #9769 from ctiller/always-use-port-server
Always use port server
2017-03-01 15:11:37 -08:00
David G. Quintas 16edd99975 Merge pull request #9812 from dgquintas/timestamp_logs
Timestamp test logs
2017-02-28 14:51:17 -08:00
Craig Tiller c2515d0c64 Merge github.com:grpc/grpc into always-use-port-server 2017-02-28 08:35:32 -08:00
Matt Kwong 28b0f2a0d1 Add tools/internal_ci/ to test filter 2017-02-27 00:52:47 -08:00
Adele Zhou 429e5607f7 Fix interop HTML report. 2017-02-24 10:49:50 -08:00
David Garcia Quintas e6e7b017dd PR comments 2017-02-22 17:13:53 -08:00
David Garcia Quintas c30b84e6f3 Timestamp test logs 2017-02-21 15:20:09 -08:00
Craig Tiller 5474c6b3d4 Merge branch 'traceback_port_server' of github.com:dgquintas/grpc into always-use-port-server 2017-02-17 10:29:40 -08:00
Craig Tiller cba864bfbe Eliminate port server env var, force its use always, consolidate code 2017-02-17 10:27:56 -08:00
David Garcia Quintas 46a1cca0ee Cleanup and better logging 2017-02-16 11:59:42 -08:00
Craig Tiller 37bfff35ee Fix port server 2017-02-14 22:35:39 -08:00
Craig Tiller 6911d08388 Fix platform_string() usage, cut temporary space usage 2017-02-07 10:30:44 -08:00
Craig Tiller 7dc4ea66f0 Make the microbenchmark profile gatherer run some in parallel 2017-02-02 16:08:05 -08:00
Matt Kwong c830eb5b6b Update interop html template location 2016-12-22 12:10:25 -08:00
Jan Tattermusch 5c79a3199c cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00