Matt Kwong
b2670fceb7
Add error handling for when a test result cannot be parsed
2018-07-09 14:22:04 -07:00
Matt Kwong
39ab59ff36
Enable uploading UNKNOWN results for RBE
2018-06-29 17:56:42 -07:00
Jan Tattermusch
f389e5267a
overhaul of top-level .md files
2018-06-20 20:35:04 +02:00
Matt Kwong
a4fd2d183a
Fix test failure detection when doing RBE uploads
2018-06-20 09:09:21 -07:00
Jan Tattermusch
5212dba112
really upload bq test results in batches
2018-06-13 09:34:35 +02:00
Jan Tattermusch
aa1aa4329f
Merge pull request #15705 from jtattermusch/bq_batch_upload
...
Upload test results to BQ in batches
2018-06-12 11:03:13 +02:00
Jan Tattermusch
cc42e6dba8
upload bq test results in batches
2018-06-11 11:53:49 -04:00
Jan Tattermusch
55178622eb
fix typo
2018-06-11 11:47:16 -04:00
Matt Kwong
9380e32b76
Switch RBE build_url from Sponge to ResultStore Bazel invocation
2018-06-04 16:54:10 -07:00
Jan Tattermusch
0e0cc1700f
display test suite names with dots correctly
2018-05-19 03:52:16 +02:00
Matt Kwong
77461d4597
Merge pull request #15345 from matt-kwong/rbe-upload
...
Handle timeouts when uploading ResultStore results
2018-05-14 10:46:53 -07:00
Matt Kwong
5aafb3b61c
Handle timeouts when uploading ResultStore results
2018-05-11 16:19:53 -07:00
Jan Tattermusch
62861977f2
run_tests: keep longer logs from individual test cases
2018-05-10 11:30:11 +02:00
Matt Kwong
11fe61ebe6
Merge pull request #14736 from matt-kwong/resultstore-results
...
Add test result uploading for RBE builds
2018-05-02 11:32:19 -07:00
Matt Kwong
b16fcf58e5
Query ResultStore for tests instead of targets
2018-04-05 15:00:58 -07:00
Jan Tattermusch
f75ca1ac8a
use ResultStore URL instead of Sponge for bigquery test results
2018-04-05 09:29:11 +02:00
Matt Kwong
90e98c16ea
Add test result uploading for RBE builds
2018-03-21 09:22:37 -07:00
Mehrdad Afshari
87cd994b04
Upgrade yapf to 0.20.0
...
Upgrade yapf version to 0.20.0 and reformat Python files.
2018-01-02 14:40:00 -08:00
Matt Kwong
827c6e90e2
Pass KOKORO_BUILD_ID to Docker
2017-12-20 16:05:35 -08:00
ncteisen
0cd6cfefa0
yapf tools/run_tests/sanity
2017-12-11 16:56:44 -08:00
ncteisen
05687c3da9
yapf tools/run_tests/python_utils
2017-12-11 16:54:47 -08:00
Muxi Yan
cd62e7d04c
Exclude cronet restricted ports from port server pool
2017-12-07 14:16:39 -08:00
murgatroid99
38007753b0
Remove src/node and references to it
...
This removes all of the node code and tests from the repo, along with the
scripts for running Node unit tests, performance tests, and artifact builds.
The scripts for running tests from the grpc-node repository are untouched.
2017-10-25 13:21:57 -07:00
Craig Tiller
5110b8d23b
Merge github.com:grpc/grpc into verify
2017-10-17 08:56:52 -07:00
Jan Tattermusch
3d1b6c1035
explain retries and jobset.max_time setting
2017-10-16 16:01:12 +02:00
Craig Tiller
642bdbea81
Merge github.com:grpc/grpc into verify
2017-10-12 08:48:46 -07:00
Craig Tiller
703d298521
Merge github.com:grpc/grpc into qps_failya
2017-10-10 20:42:18 -07:00
Craig Tiller
520e59f2fb
test/core should trigger c++ suite nowadays
2017-10-07 17:34:41 -07:00
Matt Kwong
a9712ba7ff
Add uploading interop result to BQ
2017-10-06 15:00:48 -07:00
Craig Tiller
a69912cb2c
Fixes
2017-10-06 10:27:11 -07:00
Jan Tattermusch
d059e1c43c
Merge pull request #12841 from jtattermusch/report_elapsed_on_timeout
...
jobset.py: report elapsed time for jobs that time out
2017-10-06 10:06:18 +02:00
Jan Tattermusch
8dbc2364b3
report elapsed time for jobs that time out
2017-10-05 17:15:27 +02:00
Jan Tattermusch
ac3d765041
retry when uploading results to bigquery
2017-10-05 15:27:01 +02:00
apolcyn
ec9c592ccb
Merge pull request #12777 from apolcyn/reduce_test_parrallelization
...
Put a safety limit on parallelization of tests
2017-10-04 00:00:33 -07:00
Alexander Polcyn
dbfcd45af8
Limit max jobs cpu agnostic way, to avoid overloading the test
...
environment
2017-10-02 10:05:05 -07:00
Michael Lumish
38d089e9b9
Merge pull request #12596 from matt-kwong/node-testing
...
Add testing of grpc-node for Linux and MacOS
2017-09-28 17:35:44 -07:00
Matt Kwong
e2e7cf42a4
Add testing of grpc-node for Linux and MacOS
2017-09-20 14:24:42 -07:00
Jan Tattermusch
a29032fd32
test everything if internal_ci scripts change
2017-09-18 16:33:37 +02:00
Matt Kwong
8e53799f45
Merge pull request #12515 from matt-kwong/fix-perf2
...
Revert "Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand""
2017-09-15 15:44:37 -07:00
Matt Kwong
bce6bcd1f8
Merge branch 'master' into kokoro_fil
2017-09-13 10:16:01 -07:00
Craig Tiller
2be06b43e7
Make unmeasured CPU costs be 1, not 0
...
Allows capturing 0 as a CPU cost, which we'll be able to leverage to
increase concurrency (once data has caught up in a few days)
2017-09-12 15:24:49 -07:00
Matt Kwong
69ce380ccc
Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand"
...
This reverts commit 81ad19d4be , reversing
changes made to ed63aac195 .
2017-09-12 13:30:51 -07:00
Craig Tiller
0852acd8b3
Revert "Let alarms trigger at end of jobset.py instead of clearing them"
2017-09-12 13:15:03 -07:00
Matt Kwong
6d11e90926
Add Kokoro test filtering for MacOS/Windows
2017-09-11 19:17:32 -07:00
Matt Kwong
738b1bb424
Get rid of have_alarm var in jobset.py
2017-08-29 12:45:53 -07:00
Matt Kwong
3da8c5defb
Let alarms at end of jobset.py trigger isntead of clearing
2017-08-24 12:35:04 -07:00
Matt Kwong
5920abc535
Revert "Don't clear alarm in jobset when running performance tests"
...
This reverts commit c15d32bbe8 .
2017-08-24 12:26:05 -07:00
Craig Tiller
7e813a2bc4
Remove bazel warning (we have owners now), set noparent on bazel/OWNERS
2017-07-13 08:58:49 -07:00
Matt Kwong
9a836ca37b
Merge pull request #11670 from matt-kwong/perf_alarm
...
Don't clear alarm in jobset when running performance tests
2017-07-11 15:32:19 -07:00
Matt Kwong
c15d32bbe8
Don't clear alarm in jobset when running performance tests
2017-07-10 17:10:27 -07:00
Yong Ni
ef698b60cd
Merge branch 'master' of github.com:grpc/grpc into matrix
2017-07-05 14:56:13 -07:00
Matt Kwong
c87cbba379
Add return code as a field in BQ results uplaod
2017-07-05 13:09:00 -07:00
Yong Ni
5f32c517b1
Added timestamp to the xml report and minor changes to the API per review feedback.
2017-07-05 11:43:29 -07:00
Yong Ni
b7ea4ab4d7
Created test driver to run matrix test against different docker images in GCR and generate a Junit like test result file.
2017-06-30 09:41:31 -07:00
Matt Kwong
60a672b87f
Clear alarms in jobset.py when finished running jobs
2017-06-16 14:28:06 -07:00
Matt Kwong
c1e1e1b720
Merge pull request #11248 from matt-kwong/part_tables
...
Upload Jenkins tests results to a partitioned BQ table
2017-06-14 16:25:47 -07:00
Matt Kwong
ea1fa277f0
Add Kokoro metadata to BQ upload
2017-06-09 14:17:35 -07:00
Matt Kwong
68309b42d5
Add test to check if bazel subdirectory was modified
2017-06-09 08:21:10 -07:00
Jan Tattermusch
7897ae9308
auto-fix most of licenses
2017-06-08 11:22:41 +02:00
Matt Kwong
4e55bf1293
Merge pull request #11348 from matt-kwong/upload_windows
...
Enable uploading more test results to BQ
2017-05-31 15:16:31 -07:00
Matt Kwong
d8543c4e0f
Fix --measure_cpu_costs flag in run_tests.py on Windows
2017-05-31 10:40:07 -07:00
Craig Tiller
46356b72a0
Make jobset more eintr resilient
2017-05-26 15:22:08 +00:00
Matt Kwong
d14c0ea1f5
Upload Jenkins tests results to a partitioned BQ table
2017-05-24 13:42:54 -07:00
Craig Tiller
f09957bd04
Recover from more EINTRs
2017-05-15 08:39:17 -07:00
Craig Tiller
9d5d803bbf
Small fixes
2017-05-15 07:54:54 -07:00
Matt Kwong
d1f40bd3b3
Make --measure_cpu_costs flag Mac-friendly
2017-05-11 10:29:49 -07:00
Matt Kwong
c7676a3d00
Merge pull request #10967 from matt-kwong/upload_results2
...
Add option to upload Jenkins test result to BQ
2017-05-09 15:38:31 -07:00
Matt Kwong
52ff986f94
Add option to upload Jenkins test result to BQ
2017-05-08 13:52:45 -07:00
Craig Tiller
e21d2c1cd8
Bump version
2017-05-05 14:07:50 -07:00
Craig Tiller
ddc8a8243d
Fix port server on Windows
2017-05-05 14:02:35 -07:00
Jan Tattermusch
6815e414a4
Merge pull request #10985 from jtattermusch/internal_ci_failing_targets
...
Improve XML reports for internal_ci.
2017-05-05 10:54:25 +02:00
Craig Tiller
e1f5302bc5
Port server fixes
...
- correct a couple of race conditions that could result in duplicated port assignments to different processes
- enhance detection code for 'is this port in use' to be much more robust
2017-05-04 19:53:19 +00:00
Jan Tattermusch
98ae39c121
show error details in internal_ci
2017-05-04 21:50:00 +02:00
Jan Tattermusch
883fe50140
add error and failure count to sponge log
2017-05-04 14:55:16 +02:00
Jan Tattermusch
ac9c9f93b9
reports can create subdirs
2017-04-29 12:19:36 +02:00
Yong Ni
35ee7e7967
Added verbose option to run_interop_test to ease tracing the commands invoked
2017-04-26 17:46:32 -07:00
Craig Tiller
09ebed7bf4
Ensure port server can shutdown
2017-04-25 10:19:10 -07:00
Craig Tiller
ec49524269
Add a mutex around allocate_port
2017-04-24 20:55:43 +00:00
Craig Tiller
ea525ebd39
Threaded port_server
2017-04-24 17:50:32 +00:00
Craig Tiller
a1ac2a1317
Allow specifying a maximum run time to run_tests
2017-04-21 07:20:38 -07:00
Matt Kwong
5eecba42c3
Add test filtering to performance pull requests
2017-04-06 19:08:14 -07:00
Craig Tiller
8a26aab8a2
fix
2017-03-29 14:01:32 -07:00
Craig Tiller
70abee2687
Missing import
2017-03-29 12:19:34 -07:00
Craig Tiller
a61dce07a8
Syntax fix
2017-03-29 09:30:07 -07:00
Craig Tiller
5431f90960
Add python commenter module
2017-03-29 08:31:45 -07:00
Alexander Polcyn
50fdc8ab19
add http2 server test for unary calls that uses small frames and padding
2017-03-22 13:46:51 -07:00
Eric Gribkoff
2f59cf2dc3
move health check to just before running test cases
2017-03-17 00:46:01 -07:00
Eric Gribkoff
92a5d28a4c
increase wait for healthy timeout
2017-03-17 00:46:01 -07:00
Eric Gribkoff
d86a19efd0
check error for docker inspect
2017-03-17 00:46:01 -07:00
Eric Gribkoff
22afddf53c
add health check for http2 server
2017-03-17 00:46:01 -07:00
Siddharth Shukla
8e64d901fd
Modify shebang on python scripts
...
Change shebangs to `#!/usr/bin/env python` instead of
`#!/usr/bin/env python2.7`.
2017-03-12 19:53:12 +01:00
Siddharth Shukla
d194f59939
Make testing scripts python3.x compatible
...
Update run_tests/*.py to use six based isomorphisms and print function
from __future__ module.
2017-03-12 17:47:53 +01:00
Jan Tattermusch
d159af31fc
return tuple from jobset.run when skipping tests
2017-03-10 10:08:53 +01:00
Craig Tiller
fbedd676f7
Merge pull request #9769 from ctiller/always-use-port-server
...
Always use port server
2017-03-01 15:11:37 -08:00
David G. Quintas
16edd99975
Merge pull request #9812 from dgquintas/timestamp_logs
...
Timestamp test logs
2017-02-28 14:51:17 -08:00
Craig Tiller
c2515d0c64
Merge github.com:grpc/grpc into always-use-port-server
2017-02-28 08:35:32 -08:00
Matt Kwong
28b0f2a0d1
Add tools/internal_ci/ to test filter
2017-02-27 00:52:47 -08:00
Adele Zhou
429e5607f7
Fix interop HTML report.
2017-02-24 10:49:50 -08:00
David Garcia Quintas
e6e7b017dd
PR comments
2017-02-22 17:13:53 -08:00
David Garcia Quintas
c30b84e6f3
Timestamp test logs
2017-02-21 15:20:09 -08:00