The total number of tests that are expected to run when this Suite's run method is invoked.
The total number of tests that are expected to run when this Suite's run method is invoked.
a Filter with which to filter tests to count based on their tags
A List of this Suite object's nested Suites.
A List of this Suite object's nested Suites. If this Suite contains no nested Suites,
this method returns an empty List.
Runs this suite of tests.
Runs this suite of tests.
an optional name of one test to execute. If None, all relevant tests should be executed.
I.e., None acts like a wildcard that means execute all relevant tests in this Suite.
the Reporter to which results will be reported
the Stopper that will be consulted to determine whether to stop execution early.
a Filter with which to filter tests based on their tags
a Map of key-value pairs that can be used by the executing Suite of tests.
an optional Distributor, into which to put nested Suites to be executed
by another entity, such as concurrently by a pool of threads. If None, nested Suites will be executed sequentially.
a Tracker tracking Ordinals being fired by the current thread.
if any passed parameter is null.
Runs zero to many of this suite's nested suites.
Runs zero to many of this suite's nested suites.
the Reporter to which results will be reported
the Stopper that will be consulted to determine whether to stop execution early.
a Filter with which to filter tests based on their tags
a Map of key-value pairs that can be used by the executing Suite of tests.
an optional Distributor, into which to put nested Suites to be run
by another entity, such as concurrently by a pool of threads. If None, nested Suites will be run sequentially.
a Tracker tracking Ordinals being fired by the current thread.
if any passed parameter is null.
Runs a test.
Runs a test.
the name of one test to execute.
the Reporter to which results will be reported
the Stopper that will be consulted to determine whether to stop execution early.
a Map of key-value pairs that can be used by the executing Suite of tests.
a Tracker tracking Ordinals being fired by the current thread.
if any of testName, reporter, stopper, configMap,
or tracker is null.
Runs zero to many of this suite's tests.
Runs zero to many of this suite's tests.
an optional name of one test to run. If None, all relevant tests should be run.
I.e., None acts like a wildcard that means run all relevant tests in this Suite.
the Reporter to which results will be reported
the Stopper that will be consulted to determine whether to stop execution early.
a Filter with which to filter tests based on their tags
a Map of key-value pairs that can be used by the executing Suite of tests.
an optional Distributor, into which instances of this Suite class
that are responsible for executing individual tests contained in this Suite, or groups of this Suite's
tests, may be placed so as to be run
by another entity, such as concurrently by a pool of threads.
a Tracker tracking Ordinals being fired by the current thread.
if any of testName, reporter, stopper, groupsToInclude,
groupsToExclude, or configMap is null.
Suite style name.
Suite style name.
A Map whose keys are String tag names with which tests in this Suite are marked, and
whose values are the Set of test names marked with each tag.
A Map whose keys are String tag names with which tests in this Suite are marked, and
whose values are the Set of test names marked with each tag. If this Suite contains no tags, this
method returns an empty Map.
Subclasses may implement this method to define and/or discover tags in a custom manner, but overriding method implementations
should never return an empty Set as a value. If a tag has no tests, its name should not appear as a key in the
returned Map.
An Set of test names.
An Set of test names. If this Suite contains no tests, this method returns an empty Set.
Although subclass and subtrait implementations of this method may return a Set whose iterator produces String
test names in a well-defined order, the contract of this method does not required a defined order. Subclasses are free to
implement this method and return test names in either a defined or undefined order.
The time limit, in milliseconds, in which each test in a Suite that mixes in
TimeLimitedTests must complete.
The default Interruptor strategy used to interrupt tests that exceed their time limit.
The default Interruptor strategy used to interrupt tests that exceed their time limit.
This trait's implementation of this method returns ThreadInterruptor, which invokes interrupt
on the main test thread. Override this method to change the test interruption strategy.
a ThreadInterruptor
A stackable implementation of withFixture that wraps a call to super.withFixture in a
failAfter invocation.
A stackable implementation of withFixture that wraps a call to super.withFixture in a
failAfter invocation.
the test on which to enforce a time limit
Trait that when mixed into a suite class establishes a time limit for its tests.
This trait overrides
withFixture, wrapping asuper.withFixture(test)call in afailAfterinvocation, specifying a timeout obtained by invokingtimeLimitand anInterruptorby invokingdefaultTestInterruptor:failAfter(timeLimit) { super.withFixture(test) } (defaultTestInterruptor)Note that the
failAftermethod executes the body of the by-name passed to it using the same thread that invokedfailAfter. This means that the same thread will run thewithFixturemethod as well as each test, so no extra synchronization is required. A second thread is used to run a timer, and if the timeout expires, that second thread will attempt to interrupt the main test thread via thedefaultTestInterruptor.The
timeLimitfield is abstract in this trait. Thus you must specify a time limit when you use it. For example, the following code specifies that each test must complete within 200 milliseconds:If you run the above
ExampleSpec, the second test will fail with the error message:The test did not complete within the specified 200 millisecond time limit.If you prefer, you can mix in or import the members of
SpanSugarand place units on the time limit, for example:The
failAftermethod uses anInterruptorto attempt to interrupt the main test thread if the timeout expires. The defaultInterruptorreturned by thedefaultTestInterruptormethod is aThreadInterruptor, which callsinterrupton the main test thread. If you wish to change this interruption strategy, overridedefaultTestInterruptorto return a differentInterruptor. For example, here's how you'd change the default toDoNotInterrupt, a very patient interruption strategy that does nothing to interrupt the main test thread:Like the previous incarnation of
ExampleSuite, the second test will fail with an error message that indicates a timeout expired. But whereas in the previous case, theThread.sleepwould be interrupted after 200 milliseconds, in this case it is never interrupted. In the previous case, the failed test requires a little over 200 milliseconds to run. In this case, because thesleep(300)is never interrupted, the failed test requires a little over 300 milliseconds to run.