Commit Graph

197 Commits

Author SHA1 Message Date
Jan Tattermusch f268db6f33 yapf format code 2019-09-11 04:56:10 -04:00
Jan Tattermusch babb70705d fixup in report_utils.py 2019-09-11 10:05:54 +02:00
Jan Tattermusch 11222b78c2 only use multi_target report for selected languages 2019-09-11 09:27:59 +02:00
Jan Tattermusch 9e0eb19ca4 generate separate sponge target for each test suite 2019-09-11 09:02:54 +02:00
Jan Tattermusch 952ddb6a2b fix uploading bazel RBE results to bigquery 2019-04-29 12:06:34 -04:00
Lidi Zheng 6b437ca80f Increase the retry interval 2019-03-06 15:30:33 -08:00
Lidi Zheng cf70b744f1 Silent the check_on_pr failure 2019-03-06 15:02:29 -08:00
Bill Feng 987ac52ee2 formatting 2019-02-14 17:46:41 -08:00
Bill Feng 43277f83c8 filted out malformed resultstore data 2019-02-14 16:29:08 -08:00
Bill Feng 4564b78b27 more fields for filter 2019-02-14 15:29:19 -08:00
Bill Feng be55d61b64 more fields for filter 2019-02-14 15:07:04 -08:00
Bill Feng 5428bdeb83 more debug printouts 2019-02-14 11:09:55 -08:00
Bill Feng 1898e1be25 debug printouts 2019-02-14 10:39:47 -08:00
Bill Feng 95f3a99467
Merge pull request #18017 from billfeng327/hotfix/add-fieldmask-for-resultstore
added fieldmask to resultstore upload for RBE
2019-02-13 16:43:49 -08:00
Bill Feng 152626b13c removed debug printouts 2019-02-13 15:22:23 -08:00
Bill Feng 1709313023 changed fields 2019-02-13 12:02:43 -08:00
Lidi Zheng 684690c2d7 Adopt reviewers' advice 2019-02-12 16:04:21 -08:00
Lidi Zheng bf8bef9c78 Add retries for check_on_pr 2019-02-12 15:13:27 -08:00
Bill Feng ea3fd88eca debug printout for testing 2019-02-12 14:12:04 -08:00
Bill Feng 8fd9b02bec added fieldmask to resultstore upload for RBE 2019-02-12 10:06:12 -08:00
Jan Tattermusch d67009124f commenting on PRs is no longer used 2019-01-18 09:41:15 +01:00
Lidi Zheng 886a932a1a Use KOKORO_GITHUB_PULL_REQUEST_NUMBER instead of ghprbPullId 2018-12-18 14:24:58 -08:00
Lidi Zheng eafb1d527d Reorgnize dependencies and variables 2018-12-17 18:14:58 -08:00
Lidi Zheng 6692429f31 Download private key from KeyStore 2018-12-17 16:25:25 -08:00
Nicolas Noble a744221a2c
Editing appid and installation id
Created these from the grpc-bot account.
2018-12-14 14:14:46 -08:00
Lidi Zheng 5a38d1956f Make yapf happy 2018-12-14 10:08:22 -08:00
Lidi Zheng 0f0822d53f WIP: Utilize the GitHub Check Feature 2018-12-13 16:40:47 -08:00
Richard Belleville 96b9538e4e Yapf all the things 2018-11-05 11:25:47 -08:00
Richard Belleville 35c6e5541b Restore unnecessary 2to3 change 2018-11-05 09:40:59 -08:00
Richard Belleville 666fb1c5ee Make run_tests.py python-version agnostic 2018-11-02 14:18:58 -07:00
Jan Tattermusch ec36ca0df6 do not mention bazel_wrapper.py 2018-10-26 08:55:47 +02:00
Alex Polcyn e52d87b53d Add a grpclb-in-DNS interop test suite 2018-10-23 00:00:08 -07:00
Jan Tattermusch d8056c5906 rename _tempfile -> _logfile 2018-09-26 00:11:51 +02:00
Jan Tattermusch 2488dff74b address comments 2018-09-25 23:36:19 +02:00
Jan Tattermusch 87592fe9d9 support custom logfile name in jobset.py 2018-09-25 23:10:54 +02:00
Jan Tattermusch 1e69a21beb upload test duration for foundry tests 2018-09-12 11:09:10 -07:00
Jan Tattermusch af1966aa03 fixes to run_tests.py bq uploading 2018-08-30 22:26:56 +02:00
Jan Tattermusch cc3780eb50 refactor upload_to_bq functions 2018-08-26 20:30:28 +02:00
Jan Tattermusch 52e17d7d0b correctly set performance job metadata on kokoro 2018-08-14 10:37:13 +02:00
Matt Kwong b2670fceb7 Add error handling for when a test result cannot be parsed 2018-07-09 14:22:04 -07:00
Matt Kwong 39ab59ff36 Enable uploading UNKNOWN results for RBE 2018-06-29 17:56:42 -07:00
Jan Tattermusch f389e5267a overhaul of top-level .md files 2018-06-20 20:35:04 +02:00
Matt Kwong a4fd2d183a Fix test failure detection when doing RBE uploads 2018-06-20 09:09:21 -07:00
Jan Tattermusch 5212dba112 really upload bq test results in batches 2018-06-13 09:34:35 +02:00
Jan Tattermusch aa1aa4329f
Merge pull request #15705 from jtattermusch/bq_batch_upload
Upload test results to BQ in batches
2018-06-12 11:03:13 +02:00
Jan Tattermusch cc42e6dba8 upload bq test results in batches 2018-06-11 11:53:49 -04:00
Jan Tattermusch 55178622eb fix typo 2018-06-11 11:47:16 -04:00
Matt Kwong 9380e32b76 Switch RBE build_url from Sponge to ResultStore Bazel invocation 2018-06-04 16:54:10 -07:00
Jan Tattermusch 0e0cc1700f display test suite names with dots correctly 2018-05-19 03:52:16 +02:00
Matt Kwong 77461d4597
Merge pull request #15345 from matt-kwong/rbe-upload
Handle timeouts when uploading ResultStore results
2018-05-14 10:46:53 -07:00
Matt Kwong 5aafb3b61c Handle timeouts when uploading ResultStore results 2018-05-11 16:19:53 -07:00
Jan Tattermusch 62861977f2 run_tests: keep longer logs from individual test cases 2018-05-10 11:30:11 +02:00
Matt Kwong 11fe61ebe6
Merge pull request #14736 from matt-kwong/resultstore-results
Add test result uploading for RBE builds
2018-05-02 11:32:19 -07:00
Matt Kwong b16fcf58e5 Query ResultStore for tests instead of targets 2018-04-05 15:00:58 -07:00
Jan Tattermusch f75ca1ac8a use ResultStore URL instead of Sponge for bigquery test results 2018-04-05 09:29:11 +02:00
Matt Kwong 90e98c16ea Add test result uploading for RBE builds 2018-03-21 09:22:37 -07:00
Mehrdad Afshari 87cd994b04 Upgrade yapf to 0.20.0
Upgrade yapf version to 0.20.0 and reformat Python files.
2018-01-02 14:40:00 -08:00
Matt Kwong 827c6e90e2 Pass KOKORO_BUILD_ID to Docker 2017-12-20 16:05:35 -08:00
ncteisen 0cd6cfefa0 yapf tools/run_tests/sanity 2017-12-11 16:56:44 -08:00
ncteisen 05687c3da9 yapf tools/run_tests/python_utils 2017-12-11 16:54:47 -08:00
Muxi Yan cd62e7d04c Exclude cronet restricted ports from port server pool 2017-12-07 14:16:39 -08:00
murgatroid99 38007753b0 Remove src/node and references to it
This removes all of the node code and tests from the repo, along with the
scripts for running Node unit tests, performance tests, and artifact builds.
The scripts for running tests from the grpc-node repository are untouched.
2017-10-25 13:21:57 -07:00
Craig Tiller 5110b8d23b Merge github.com:grpc/grpc into verify 2017-10-17 08:56:52 -07:00
Jan Tattermusch 3d1b6c1035 explain retries and jobset.max_time setting 2017-10-16 16:01:12 +02:00
Craig Tiller 642bdbea81 Merge github.com:grpc/grpc into verify 2017-10-12 08:48:46 -07:00
Craig Tiller 703d298521 Merge github.com:grpc/grpc into qps_failya 2017-10-10 20:42:18 -07:00
Craig Tiller 520e59f2fb test/core should trigger c++ suite nowadays 2017-10-07 17:34:41 -07:00
Matt Kwong a9712ba7ff Add uploading interop result to BQ 2017-10-06 15:00:48 -07:00
Craig Tiller a69912cb2c Fixes 2017-10-06 10:27:11 -07:00
Jan Tattermusch d059e1c43c Merge pull request #12841 from jtattermusch/report_elapsed_on_timeout
jobset.py: report elapsed time for jobs that time out
2017-10-06 10:06:18 +02:00
Jan Tattermusch 8dbc2364b3 report elapsed time for jobs that time out 2017-10-05 17:15:27 +02:00
Jan Tattermusch ac3d765041 retry when uploading results to bigquery 2017-10-05 15:27:01 +02:00
apolcyn ec9c592ccb Merge pull request #12777 from apolcyn/reduce_test_parrallelization
Put a safety limit on parallelization of tests
2017-10-04 00:00:33 -07:00
Alexander Polcyn dbfcd45af8 Limit max jobs cpu agnostic way, to avoid overloading the test
environment
2017-10-02 10:05:05 -07:00
Michael Lumish 38d089e9b9 Merge pull request #12596 from matt-kwong/node-testing
Add testing of grpc-node for Linux and MacOS
2017-09-28 17:35:44 -07:00
Matt Kwong e2e7cf42a4 Add testing of grpc-node for Linux and MacOS 2017-09-20 14:24:42 -07:00
Jan Tattermusch a29032fd32 test everything if internal_ci scripts change 2017-09-18 16:33:37 +02:00
Matt Kwong 8e53799f45 Merge pull request #12515 from matt-kwong/fix-perf2
Revert "Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand""
2017-09-15 15:44:37 -07:00
Matt Kwong bce6bcd1f8 Merge branch 'master' into kokoro_fil 2017-09-13 10:16:01 -07:00
Craig Tiller 2be06b43e7 Make unmeasured CPU costs be 1, not 0
Allows capturing 0 as a CPU cost, which we'll be able to leverage to
increase concurrency (once data has caught up in a few days)
2017-09-12 15:24:49 -07:00
Matt Kwong 69ce380ccc Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand"
This reverts commit 81ad19d4be, reversing
changes made to ed63aac195.
2017-09-12 13:30:51 -07:00
Craig Tiller 0852acd8b3 Revert "Let alarms trigger at end of jobset.py instead of clearing them" 2017-09-12 13:15:03 -07:00
Matt Kwong 6d11e90926 Add Kokoro test filtering for MacOS/Windows 2017-09-11 19:17:32 -07:00
Matt Kwong 738b1bb424 Get rid of have_alarm var in jobset.py 2017-08-29 12:45:53 -07:00
Matt Kwong 3da8c5defb Let alarms at end of jobset.py trigger isntead of clearing 2017-08-24 12:35:04 -07:00
Matt Kwong 5920abc535 Revert "Don't clear alarm in jobset when running performance tests"
This reverts commit c15d32bbe8.
2017-08-24 12:26:05 -07:00
Craig Tiller 7e813a2bc4 Remove bazel warning (we have owners now), set noparent on bazel/OWNERS 2017-07-13 08:58:49 -07:00
Matt Kwong 9a836ca37b Merge pull request #11670 from matt-kwong/perf_alarm
Don't clear alarm in jobset when running performance tests
2017-07-11 15:32:19 -07:00
Matt Kwong c15d32bbe8 Don't clear alarm in jobset when running performance tests 2017-07-10 17:10:27 -07:00
Yong Ni ef698b60cd Merge branch 'master' of github.com:grpc/grpc into matrix 2017-07-05 14:56:13 -07:00
Matt Kwong c87cbba379 Add return code as a field in BQ results uplaod 2017-07-05 13:09:00 -07:00
Yong Ni 5f32c517b1 Added timestamp to the xml report and minor changes to the API per review feedback. 2017-07-05 11:43:29 -07:00
Yong Ni b7ea4ab4d7 Created test driver to run matrix test against different docker images in GCR and generate a Junit like test result file. 2017-06-30 09:41:31 -07:00
Matt Kwong 60a672b87f Clear alarms in jobset.py when finished running jobs 2017-06-16 14:28:06 -07:00
Matt Kwong c1e1e1b720 Merge pull request #11248 from matt-kwong/part_tables
Upload Jenkins tests results to a partitioned BQ table
2017-06-14 16:25:47 -07:00
Matt Kwong ea1fa277f0 Add Kokoro metadata to BQ upload 2017-06-09 14:17:35 -07:00
Matt Kwong 68309b42d5 Add test to check if bazel subdirectory was modified 2017-06-09 08:21:10 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Matt Kwong 4e55bf1293 Merge pull request #11348 from matt-kwong/upload_windows
Enable uploading more test results to BQ
2017-05-31 15:16:31 -07:00
Matt Kwong d8543c4e0f Fix --measure_cpu_costs flag in run_tests.py on Windows 2017-05-31 10:40:07 -07:00