Commit Graph

72 Commits

Author SHA1 Message Date
Matt Kwong 69ce380ccc Revert "Merge pull request #12513 from grpc/revert-12289-sig_hand"
This reverts commit 81ad19d4be, reversing
changes made to ed63aac195.
2017-09-12 13:30:51 -07:00
Matt Kwong 3c8f6dbffd Remove leftover instance of clear_alarms 2017-09-12 13:30:26 -07:00
Craig Tiller 0852acd8b3 Revert "Let alarms trigger at end of jobset.py instead of clearing them" 2017-09-12 13:15:03 -07:00
Matt Kwong e72255f011 Merge branch 'master' into sig_hand 2017-09-11 12:27:44 -07:00
Matt Kwong 5920abc535 Revert "Don't clear alarm in jobset when running performance tests"
This reverts commit c15d32bbe8.
2017-08-24 12:26:05 -07:00
Michael Darakananda f570fb2743 give run_performance_tests a main method
In this way, external users can add perf tests for other languages
by adding to scenario_config.LANGUAGES then calling
run_performance_tests.main.
2017-08-17 17:09:56 +10:00
Jan Tattermusch 61c913531c fix windows performance benchmarks 2017-08-11 18:03:35 +02:00
Matt Kwong c15d32bbe8 Don't clear alarm in jobset when running performance tests 2017-07-10 17:10:27 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Siddharth Shukla 8e64d901fd Modify shebang on python scripts
Change shebangs to `#!/usr/bin/env python` instead of
`#!/usr/bin/env python2.7`.
2017-03-12 19:53:12 +01:00
Siddharth Shukla d194f59939 Make testing scripts python3.x compatible
Update run_tests/*.py to use six based isomorphisms and print function
from __future__ module.
2017-03-12 17:47:53 +01:00
Craig Tiller 6921820fab Ensure port server is running on remote hosts 2017-03-07 15:55:53 -08:00
Craig Tiller 0a3d5f90a9 Revert "Enable lto for performance testing" 2017-03-01 17:08:39 -08:00
Craig Tiller f9abb2921b Reserve opt for external builds, use lto for profiling 2017-03-01 13:38:37 -08:00
apolcyn cf7587e066 Merge pull request #9548 from apolcyn/improve_benchmark_worker_timeouts
shorten qps worker timeouts and run remote workers under timeout
2017-02-04 09:42:48 -08:00
Alexander Polcyn 41fe579c6d always render junit xml report after perf tests 2017-02-02 10:46:51 -08:00
Alexander Polcyn 76be306f9d shorten qps worker timeouts and run remote workers under timeout 2017-02-01 12:06:23 -08:00
apolcyn d9f5b230c1 Merge pull request #9038 from apolcyn/run_perf_on_benchmarks
add --perf_args usage to jenkins performance runner scripts
2017-01-13 17:37:09 -08:00
Yuxuan Li ac87a46225 enable uploading server cpu usage data from performance tests to big query 2017-01-11 10:01:16 +00:00
Jan Tattermusch 5c79a3199c cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00
Alexander Polcyn 66c6782751 add --perf_args usage to jenkins performance runner scripts 2016-12-20 13:29:58 -08:00
apolcyn c204647295 Merge pull request #8699 from apolcyn/run_perf_on_benchmarks
Add perf option to benchmark runner script, create text profiles and flamegraphs
2016-12-08 19:03:54 -08:00
Alexander Polcyn 9f08d110f8 add a "perf" option to benchmarks script, generate profile text reports and flamegraphs 2016-12-08 16:03:19 -08:00
Alex Polcyn ca5e92442f clean up scenario.workers length check 2016-12-06 04:21:37 +00:00
Alex Polcyn fcf09ea42e handle empty string for qps workers in driver and dont quit them on netperf 2016-12-06 04:00:05 +00:00
Jan Tattermusch 88818ae49a fix windows benchmarks and upload all 3 reports 2016-11-18 14:21:33 +01:00
Jan Tattermusch 94d40cbd5a make benchmarks create report.xml 2016-10-24 21:14:21 +02:00
apolcyn f89a4a189f Merge pull request #8397 from apolcyn/fix_performance_test_silent_failures
fail performance tests if any jobs fail or timeout
2016-10-22 17:43:08 -07:00
Alexander Polcyn 898a2e91f9 clean up error message 2016-10-22 17:41:23 -07:00
Jan Tattermusch 447548b9f2 show logs from qps workers 2016-10-22 10:50:53 +02:00
Alex Polcyn cac93f673e clean up error counting and reporting 2016-10-19 09:27:57 -07:00
Alexander Polcyn 497966787a fail performance tests if any jobs fail or timeout 2016-10-17 10:01:37 -07:00
Craig Tiller 677966a257 Be explicit as to which tests to run 2016-09-26 07:37:28 -07:00
Craig Tiller c36a736caa Merge github.com:grpc/grpc into outstanding_sweeps 2016-09-16 09:57:55 -07:00
Craig Tiller 025972d16d Fix more things 2016-09-15 09:26:50 -07:00
Craig Tiller c197ec1fe6 Fix typo 2016-09-15 09:19:33 -07:00
Craig Tiller d82fccc5ec Fix typo 2016-09-15 09:15:23 -07:00
Craig Tiller accf16b41e Missed import 2016-09-15 09:08:32 -07:00
Craig Tiller c1b54f2fab Run QPS workers just for the scenario that we want, to avoid interference 2016-09-15 08:57:14 -07:00
Craig Tiller b6df24765f Properly categorize tests to allow sweeps to be run by adhoc 2016-09-13 09:41:26 -07:00
Craig Tiller c2895d2fee Exclude sweep tests from the "full" suite 2016-09-09 15:22:21 -07:00
Craig Tiller 6388da5a1f Add missing flag option 2016-09-07 17:06:29 -07:00
Vijay Pai c23d33b29b Revert "Generate html report for perf tests" 2016-07-19 11:19:12 -07:00
Adele Zhou 7d4373bc6e Generate html report for perf tests 2016-07-15 13:06:56 -07:00
siddharthshukla 0589e533cd Make testing toolchain python 3.x compliant
six is necessary for making these scripts cross compatible
between python 2.x and 3.x

Changes:
Add six to python_deps.include
Include python_deps.include to all Dockerfile templates in test directory
Include python_deps.include to all Dockerfile templates in stress_test directory
Include python_deps.include to all Dockerfile templates in interop_test directory
Replace print statements with print function calls (from futute..)
Replace .iteritems() with .items() wherever necessary
use six.moves to import BaseHTTPServer
Generate new dockerfiles using generate_projects.sh
2016-07-12 01:35:53 +02:00
Craig Tiller 2e1a1fe56f Fixes 2016-06-23 16:18:31 -07:00
Jan Tattermusch d27888b6db mark unconstrained scenarios with scalable category 2016-05-19 16:15:01 -07:00
Jan Tattermusch 37a907e471 add support for CLIENT_LANGUAGE setting 2016-05-13 15:09:32 -07:00
Jan Tattermusch ad17bf704e propagate jenkins env variables to netperf client 2016-05-11 12:52:04 -07:00
Jan Tattermusch 4de2c3254b add support for running netperf scenario 2016-05-10 14:33:07 -07:00