Questa è una vecchia versione del documento!
nostrils is a Python script written to easily compare the results of test suites across different git references (commits/branches/tags).
It will run the tests suite on the required commits, build any extension if needed (that is, run the
build_ext of the
setup.py) and print out a diff of the test results. This comes handy when the repo you are working on already has failing tests, possibly many of them, and you want to quickly isolate any regression caused by your modifications.
nostils runs tests for the two commits in parallel. Moreover, it caches test results, so if it is called again on some given ref (typically
master!), it will fetch them instead than rerunning the test suite (this behaviour can be overridden with the
This is the typical usage:
It will compare the results of
mybranch with the results on
You can specify a different benchmark commit as follows (this will compare with the previous commit in
nostrils mybranch~1 mybranch
You can also ask nostrils to run a different command than
notestests3 by setting the environmental variable
TESTCMD, as in:
TESTCMD=nosetests nostrils mybranch