Commit Graph

66 Commits

Author SHA1 Message Date
Jan Tattermusch 61c913531c fix windows performance benchmarks 2017-08-11 18:03:35 +02:00
Matt Kwong c15d32bbe8 Don't clear alarm in jobset when running performance tests 2017-07-10 17:10:27 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Siddharth Shukla 8e64d901fd Modify shebang on python scripts
Change shebangs to `#!/usr/bin/env python` instead of
`#!/usr/bin/env python2.7`.
2017-03-12 19:53:12 +01:00
Siddharth Shukla d194f59939 Make testing scripts python3.x compatible
Update run_tests/*.py to use six based isomorphisms and print function
from __future__ module.
2017-03-12 17:47:53 +01:00
Craig Tiller 6921820fab Ensure port server is running on remote hosts 2017-03-07 15:55:53 -08:00
Craig Tiller 0a3d5f90a9 Revert "Enable lto for performance testing" 2017-03-01 17:08:39 -08:00
Craig Tiller f9abb2921b Reserve opt for external builds, use lto for profiling 2017-03-01 13:38:37 -08:00
apolcyn cf7587e066 Merge pull request #9548 from apolcyn/improve_benchmark_worker_timeouts
shorten qps worker timeouts and run remote workers under timeout
2017-02-04 09:42:48 -08:00
Alexander Polcyn 41fe579c6d always render junit xml report after perf tests 2017-02-02 10:46:51 -08:00
Alexander Polcyn 76be306f9d shorten qps worker timeouts and run remote workers under timeout 2017-02-01 12:06:23 -08:00
apolcyn d9f5b230c1 Merge pull request #9038 from apolcyn/run_perf_on_benchmarks
add --perf_args usage to jenkins performance runner scripts
2017-01-13 17:37:09 -08:00
Yuxuan Li ac87a46225 enable uploading server cpu usage data from performance tests to big query 2017-01-11 10:01:16 +00:00
Jan Tattermusch 5c79a3199c cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00
Alexander Polcyn 66c6782751 add --perf_args usage to jenkins performance runner scripts 2016-12-20 13:29:58 -08:00
apolcyn c204647295 Merge pull request #8699 from apolcyn/run_perf_on_benchmarks
Add perf option to benchmark runner script, create text profiles and flamegraphs
2016-12-08 19:03:54 -08:00
Alexander Polcyn 9f08d110f8 add a "perf" option to benchmarks script, generate profile text reports and flamegraphs 2016-12-08 16:03:19 -08:00
Alex Polcyn ca5e92442f clean up scenario.workers length check 2016-12-06 04:21:37 +00:00
Alex Polcyn fcf09ea42e handle empty string for qps workers in driver and dont quit them on netperf 2016-12-06 04:00:05 +00:00
Jan Tattermusch 88818ae49a fix windows benchmarks and upload all 3 reports 2016-11-18 14:21:33 +01:00
Jan Tattermusch 94d40cbd5a make benchmarks create report.xml 2016-10-24 21:14:21 +02:00
apolcyn f89a4a189f Merge pull request #8397 from apolcyn/fix_performance_test_silent_failures
fail performance tests if any jobs fail or timeout
2016-10-22 17:43:08 -07:00
Alexander Polcyn 898a2e91f9 clean up error message 2016-10-22 17:41:23 -07:00
Jan Tattermusch 447548b9f2 show logs from qps workers 2016-10-22 10:50:53 +02:00
Alex Polcyn cac93f673e clean up error counting and reporting 2016-10-19 09:27:57 -07:00
Alexander Polcyn 497966787a fail performance tests if any jobs fail or timeout 2016-10-17 10:01:37 -07:00
Craig Tiller 677966a257 Be explicit as to which tests to run 2016-09-26 07:37:28 -07:00
Craig Tiller c36a736caa Merge github.com:grpc/grpc into outstanding_sweeps 2016-09-16 09:57:55 -07:00
Craig Tiller 025972d16d Fix more things 2016-09-15 09:26:50 -07:00
Craig Tiller c197ec1fe6 Fix typo 2016-09-15 09:19:33 -07:00
Craig Tiller d82fccc5ec Fix typo 2016-09-15 09:15:23 -07:00
Craig Tiller accf16b41e Missed import 2016-09-15 09:08:32 -07:00
Craig Tiller c1b54f2fab Run QPS workers just for the scenario that we want, to avoid interference 2016-09-15 08:57:14 -07:00
Craig Tiller b6df24765f Properly categorize tests to allow sweeps to be run by adhoc 2016-09-13 09:41:26 -07:00
Craig Tiller c2895d2fee Exclude sweep tests from the "full" suite 2016-09-09 15:22:21 -07:00
Craig Tiller 6388da5a1f Add missing flag option 2016-09-07 17:06:29 -07:00
Vijay Pai c23d33b29b Revert "Generate html report for perf tests" 2016-07-19 11:19:12 -07:00
Adele Zhou 7d4373bc6e Generate html report for perf tests 2016-07-15 13:06:56 -07:00
siddharthshukla 0589e533cd Make testing toolchain python 3.x compliant
six is necessary for making these scripts cross compatible
between python 2.x and 3.x

Changes:
Add six to python_deps.include
Include python_deps.include to all Dockerfile templates in test directory
Include python_deps.include to all Dockerfile templates in stress_test directory
Include python_deps.include to all Dockerfile templates in interop_test directory
Replace print statements with print function calls (from futute..)
Replace .iteritems() with .items() wherever necessary
use six.moves to import BaseHTTPServer
Generate new dockerfiles using generate_projects.sh
2016-07-12 01:35:53 +02:00
Craig Tiller 2e1a1fe56f Fixes 2016-06-23 16:18:31 -07:00
Jan Tattermusch d27888b6db mark unconstrained scenarios with scalable category 2016-05-19 16:15:01 -07:00
Jan Tattermusch 37a907e471 add support for CLIENT_LANGUAGE setting 2016-05-13 15:09:32 -07:00
Jan Tattermusch ad17bf704e propagate jenkins env variables to netperf client 2016-05-11 12:52:04 -07:00
Jan Tattermusch 4de2c3254b add support for running netperf scenario 2016-05-10 14:33:07 -07:00
Jan Tattermusch 427699b638 mark some scenarios as smoketest and add a cmdline flag 2016-05-05 18:10:35 -07:00
Jan Tattermusch a21c7e9207 add support for scenario categories 2016-05-05 18:10:35 -07:00
Jan Tattermusch 541d5d7ae2 increase qps_worker max lifetime 2016-05-05 16:16:12 -07:00
Jan Tattermusch b8c44438b3 Merge pull request #6298 from grpc/python_qps_tests
Python QPS Tests
2016-04-28 21:48:13 -07:00
Ken Payson 0482c1046b Python QPS Worker/initial scenarios 2016-04-28 20:01:06 -07:00
Jan Tattermusch 1408920ab9 get rid of local qpsworkers before starting the tests 2016-04-27 18:26:53 -07:00