Commit Graph

56 Commits

Author SHA1 Message Date
Jan Tattermusch 1970a5b7de added C# to run_tests.py 2015-03-03 15:17:25 -08:00
murgatroid99 b7063f1416 Added python tests to .travis.yml 2015-02-27 16:12:24 -08:00
Nicolas Noble 21bcda3e1d Merge pull request #879 from murgatroid99/ruby_run_tests
Added ruby tests to run_tests.py
2015-02-27 16:04:33 -08:00
murgatroid99 6a4c4fabf3 Added ruby tests to run_tests.py 2015-02-27 12:08:57 -08:00
Craig Tiller 2cc2b84a13 Allow starting from non-root directory 2015-02-27 11:43:26 -08:00
Craig Tiller 86fa1c5541 Save makefile var clobbering 2015-02-27 09:57:58 -08:00
Craig Tiller 8451e87ced Extend timeouts for Travis 2x 2015-02-27 09:25:51 -08:00
Nicolas "Pixel" Noble 9db7c3b174 Adding flaky attribute for tests. 2015-02-27 06:50:16 +01:00
Nicolas "Pixel" Noble a7df3f9e2c Improving travis output. 2015-02-26 22:48:30 +01:00
Craig Tiller c1f1162787 Drastic speed up 2015-02-25 09:09:59 -08:00
Craig Tiller fe406ec601 Support taking a regex on test short name
Allows run_tests to focus on one particular test if necessary.
Useful in combination with runs_per_test.
2015-02-24 13:55:12 -08:00
Craig Tiller 1a305b1d9d Make valgrind a bit more useful 2015-02-18 13:37:06 -08:00
Craig Tiller c2c792113e Add copyrights to Python code 2015-02-16 12:00:01 -08:00
Craig Tiller 96bd5f6b76 Add ubsan support 2015-02-13 09:04:13 -08:00
Craig Tiller 6be5e587bd Merge pull request #480 from dklempner/runs_per_test
Disable test caching when runs_per_test > 1
2015-02-11 16:48:32 -08:00
David Klempner 2573958e84 Change TestCache to parameterize whether to skip running tests.
This allows caching results with --runs_per_test.
2015-02-11 15:57:32 -08:00
Nicolas Noble 0af000bfba Fixing valgrind's codepath in run_tests.py. 2015-02-11 14:48:04 -08:00
David Klempner 5e35b14094 Disable test caching when runs_per_test > 1
Otherwise the tests just stop once they succeed, or don't even run at
all if they passed in a previous run.
2015-02-11 14:27:14 -08:00
David Klempner 1d0302d03d Add a tsan suppression file with OPENSSL_cleanse and use it in run_tests 2015-02-04 16:08:01 -08:00
David Klempner f94838b0a3 Make several python scripts explicitly python2.7
I tried actually doing a build on my home desktop, and none of these
run with python 3.3, which is /usr/bin/python on my home desktop.
2015-02-02 17:03:14 -08:00
Craig Tiller 547db2b3ef Allow specifying environment variables.
Refactor the code a little to make this easier to munge around.
2015-01-30 14:08:39 -08:00
Craig Tiller eb272bc6ca Fix valgind 2015-01-30 13:13:14 -08:00
Craig Tiller 9977582850 Clean up formatting 2015-01-30 13:07:16 -08:00
Craig Tiller e68de0e4c9 Small tweaks
Run faster on smaller machines.

Don't watch '.' prefixed files for changes. These files don't typically contribute to builds, and are used as vim temp files.
2015-01-27 13:07:24 -08:00
murgatroid99 666450ef14 Updated comment 2015-01-26 13:03:31 -08:00
murgatroid99 c279165f72 Got run_tests.py and node tests working 2015-01-26 11:33:39 -08:00
murgatroid99 564b944b3c Started fixing php test runner 2015-01-26 11:07:59 -08:00
murgatroid99 2c8d5165a6 Added node test runner 2015-01-26 10:41:21 -08:00
Nathaniel Manista 840615ed27 Add Python to run-tests. 2015-01-22 20:31:47 +00:00
Craig Tiller 06b4ff2b71 Simplify Python code 2015-01-18 11:01:25 -08:00
Craig Tiller e9c959d78e Only run language specified tests
Add a template to generate a complete list of tests for C/C++, and use it to generate the list of binaries to run tests for.
2015-01-18 10:23:26 -08:00
Craig Tiller 261dd98e5e Use Python json module
Instead of third party simplejson module, to save a dependency.
2015-01-16 16:41:45 -08:00
Craig Tiller c7449166d2 PHP unit tests run with run_tests.py 2015-01-16 14:42:10 -08:00
Craig Tiller f1973b0652 Add support for building outside of the Makefile 2015-01-16 12:32:13 -08:00
Craig Tiller 1cc11dbf58 Fix run_test.py so it runs the first time 2015-01-15 22:50:50 -08:00
Craig Tiller b50d166634 Make run_tests.py pass lint 2015-01-15 17:28:21 -08:00
Craig Tiller 71735185a1 Cache for successful test runs
By default don't re-run tests that have already run successfully, to
reduce latency between making a change and seeing if it fixed the last
thing that you were trying to fix.
2015-01-15 17:12:04 -08:00
Craig Tiller 686fb26b30 Allow language to be specified to run_tests.py 2015-01-15 07:39:09 -08:00
Craig Tiller ec0b8f3f77 Compile OpenSSL differently for each config.
MSAN, TSAN, ASAN need to see all the code. Valgrind, MSAN want -DPURIFY.
2015-01-15 07:30:00 -08:00
Nicolas Noble b09078f202 Addressing pull request comments.
-) Fixing long line length.
 -) Changed the logic of the exit message.
2015-01-14 18:14:54 -08:00
Nicolas Noble 594ef6c3b3 Merge remote-tracking branch 'google/master' into tweaks
Conflicts:
	tools/run_tests/run_tests.py
2015-01-14 18:02:04 -08:00
Nicolas Noble 044db7422a Various cosmetic improvements to run_tests.py
-) Adding a new command line flag to be able to see which tests are passing.
  -) Adding more status when the tool is idle in forever mode.
  -) Adding a last status when the tool is finished so to avoid leaving the console in a weird state.
  -) Adding a status message in the forever mode if the previous run failed.
  -) Swapped the message and its explanation, so you don't have to scroll up to see which test failed.
  -) Fixed a race condition in the watch_dir.py code if a file is deleted during the loop.
2015-01-14 17:28:12 -08:00
Craig Tiller 2aa4d64947 Helgrind support for run_tests.py
Also allow maxjobs to be tweaked based upon which configs are being run,
to prevent memory starvation.
2015-01-14 16:32:45 -08:00
Nicolas Noble 42a1bab6a7 Merge pull request #27 from ctiller/faster_make
Build all targets for a config at once
2015-01-14 13:51:36 -08:00
Craig Tiller d86a394ce2 Fix return behavior of run_tools.py
If not running in forever mode, and a test fails, fail run_tests.py
also.

If running in forever mode and make fails, wait for the next run.
2015-01-14 12:50:10 -08:00
Craig Tiller be56a9684e Build all targets for a config at once 2015-01-14 11:34:09 -08:00
Craig Tiller 2e8ea781b4 Merge github.com:google/grpc into gcov 2015-01-13 12:45:27 -08:00
Craig Tiller be7b092e07 Merge github.com:ctiller/grpc into testcpp 2015-01-13 12:29:51 -08:00
Craig Tiller 934baa3bb1 Add tools/run_tests/run_lcov.sh
This is a tool for collecting coverage reports from our tests and
combining them with the open-source tool 'lcov'.
2015-01-12 18:19:45 -08:00
Craig Tiller 7c1d7f7a9a Run C++ tests and C tests 2015-01-12 17:08:33 -08:00