trait ConductorMethods extends TestSuiteMixin with Conductors
Trait that provides each test with access to a new Conductor
via methods.
Here's an example of the use of this trait to test the ArrayBlockingQueue
concurrency abstraction from java.util.concurrent:
import org.scalatest.FunSuite import org.scalatest.concurrent.ConductorMethods import org.scalatest.matchers.Matchers import java.util.concurrent.ArrayBlockingQueue
class ArrayBlockingQueueSuite extends FunSuite with ConductorMethods with Matchers {
test("calling put on a full queue blocks the producer thread") {
val buf = new ArrayBlockingQueue[Int](1)
thread("producer") { buf put 42 buf put 17 beat should be (1) }
thread("consumer") { waitForBeat(1) buf.take should be (42) buf.take should be (17) }
whenFinished { buf should be ('empty) } }
test("calling take on an empty queue blocks the consumer thread") {
val buf = new ArrayBlockingQueue[Int](1)
thread("producer") { waitForBeat(1) buf put 42 buf put 17 }
thread("consumer") { buf.take should be (42) buf.take should be (17) beat should be (1) }
whenFinished { buf should be ('empty) } } }
For an explanation of how these tests work, see the documentation for Conductors.
- Self Type
- ConductorMethods with TestSuite
- Source
- ConductorMethods.scala
- Alphabetic
- By Inheritance
- ConductorMethods
- Conductors
- PatienceConfiguration
- AbstractPatienceConfiguration
- ScaledTimeSpans
- TestSuiteMixin
- SuiteMixin
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- final case class PatienceConfig(timeout: Span = scaled(Span(150, Millis)), interval: Span = scaled(Span(15, Millis))) extends Product with Serializable
Configuration object for asynchronous constructs, such as those provided by traits
EventuallyandWaiters.Configuration object for asynchronous constructs, such as those provided by traits
EventuallyandWaiters.The default values for the parameters are:
Configuration Parameter Default Value timeoutscaled(150 milliseconds)intervalscaled(15 milliseconds)- timeout
the maximum amount of time to wait for an asynchronous operation to complete before giving up and throwing
TestFailedException.- interval
the amount of time to sleep between each check of the status of an asynchronous operation when polling
- Definition Classes
- AbstractPatienceConfiguration
- final class Conductor extends AnyRef
Class that facilitates the testing of classes, traits, and libraries designed to be used by multiple threads concurrently.
Class that facilitates the testing of classes, traits, and libraries designed to be used by multiple threads concurrently.
A
Conductorconducts a multi-threaded scenario by maintaining a clock of "beats." Beats are numbered starting with 0. You can ask aConductorto run threads that interact with the class, trait, or library (the subject) you want to test. A thread can call theConductor'swaitForBeatmethod, which will cause the thread to block until that beat has been reached. TheConductorwill advance the beat only when all threads participating in the test are blocked. By tying the timing of thread activities to specific beats, you can write tests for concurrent systems that have deterministic interleavings of threads.A
Conductorobject has a three-phase lifecycle. It begins its life in the setup phase. During this phase, you can start threads by invoking thethreadmethod on theConductor. Whenconductis invoked on aConductor, it enters the conducting phase. During this phase it conducts the one multi-threaded scenario it was designed to conduct. After all participating threads have exited, either by returning normally or throwing an exception, theconductmethod will complete, either by returning normally or throwing an exception. As soon as theconductmethod completes, theConductorenters its defunct phase. Once theConductorhas conducted a multi-threaded scenario, it is defunct and can't be reused. To run the same test again, you'll need to create a new instance ofConductor.Here's an example of the use of
Conductorto test theArrayBlockingQueueclass fromjava.util.concurrent:import org.scalatest.fixture.FunSuite import org.scalatest.matchers.Matchers import java.util.concurrent.ArrayBlockingQueue import org.scalatest.concurrent.Conductors
class ArrayBlockingQueueSuite extends FunSuite with Matchers with Conductors {
test("calling put on a full queue blocks the producer thread") {
val conductor = new Conductor import conductor._
val buf = new ArrayBlockingQueue[Int](1)
thread("producer") { buf put 42 buf put 17 beat should be (1) }
thread("consumer") { waitForBeat(1) buf.take should be (42) buf.take should be (17) }
whenFinished { buf should be ('empty) } } }When the test shown is run, it will create one thread named producer and another named consumer. The producer thread will eventually execute the code passed as a by-name parameter to
thread("producer"):buf put 42 buf put 17 beat should be (1)
Similarly, the consumer thread will eventually execute the code passed as a by-name parameter to
thread("consumer"):waitForBeat(1) buf.take should be (42) buf.take should be (17)
The
threadcalls create the threads and starts them, but they will not immediately execute the by-name parameter passed to them. They will first block, waiting for theConductorto give them a green light to proceed.The next call in the test is
whenFinished. This method will first callconducton theConductor, which will wait until all threads that were created (in this case, producer and consumer) are at the "starting line", i.e., they have all started and are blocked, waiting on the green light. Theconductmethod will then give these threads the green light and they will all start executing their blocks concurrently.When the threads are given the green light, the beat is 0. The first thing the producer thread does is put 42 in into the queue. As the queue is empty at this point, this succeeds. The producer thread next attempts to put a 17 into the queue, but because the queue has size 1, this can't succeed until the consumer thread has read the 42 from the queue. This hasn't happened yet, so producer blocks. Meanwhile, the consumer thread's first act is to call
waitForBeat(1). Because the beat starts out at 0, this call will block the consumer thread. As a result, once the producer thread has executedbuf put 17and the consumer thread has executedwaitForBeat(1), both threads will be blocked.The
Conductormaintains a clock that wakes up periodically and checks to see if all threads participating in the multi-threaded scenario (in this case, producer and consumer) are blocked. If so, it increments the beat. Thus sometime later the beat will be incremented, from 0 to 1. Because consumer was waiting for beat 1, it will wake up (i.e., thewaitForBeat(1)call will return) and execute the next line of code in its block,buf.take should be (42). This will succeed, because the producer thread had previously (during beat 0) put 42 into the queue. This act will also make producer runnable again, because it was blocked on the secondput, which was waiting for another thread to read that 42.Now both threads are unblocked and able to execute their next statement. The order is non-deterministic, and can even be simultaneous if running on multiple cores. If the
consumerthread happens to executebuf.take should be (17)first, it will block (buf.takewill not return), because the queue is at that point empty. At some point later, the producer thread will executebuf put 17, which will unblock the consumer thread. Again both threads will be runnable and the order non-deterministic and possibly simulataneous. The producer thread may charge ahead and run its next statement,beat should be (1). This will succeed because the beat is indeed 1 at this point. As this is the last statement in the producer's block, the producer thread will exit normally (it won't throw an exception). At some point later the consumer thread will be allowed to complete its last statement, thebuf.takecall will return 17. The consumer thread will execute17 should be (17). This will succeed and as this was the last statement in its block, the consumer will return normally.If either the producer or consumer thread had completed abruptbly with an exception, the
conductmethod (which was called bywhenFinished) would have completed abruptly with an exception to indicate the test failed. However, since both threads returned normally,conductwill return. Becauseconductdoesn't throw an exception,whenFinishedwill execute the block of code passed as a by-name parameter to it:buf should be ('empty). This will succeed, because the queue is indeed empty at this point. ThewhenFinishedmethod will then return, and because thewhenFinishedcall was the last statement in the test and it didn't throw an exception, the test completes successfully.This test tests
ArrayBlockingQueue, to make sure it works as expected. If there were a bug inArrayBlockingQueuesuch as aputcalled on a full queue didn't block, but instead overwrote the previous value, this test would detect it. However, if there were a bug inArrayBlockingQueuesuch that a call totakecalled on an empty queue never blocked and always returned 0, this test might not detect it. The reason is that whether the consumer thread will ever calltakeon an empty queue during this test is non-deterministic. It depends on how the threads get scheduled during beat 1. What is deterministic in this test, because the consumer thread blocks during beat 0, is that the producer thread will definitely attempt to write to a full queue. To make sure the other scenario is tested, you'd need a different test:test("calling take on an empty queue blocks the consumer thread") {
val conductor = new Conductor import conductor._
val buf = new ArrayBlockingQueue[Int](1)
thread("producer") { waitForBeat(1) buf put 42 buf put 17 }
thread("consumer") { buf.take should be (42) buf.take should be (17) beat should be (1) }
whenFinished { buf should be ('empty) } }In this test, the producer thread will block, waiting for beat 1. The consumer thread will invoke
buf.takeas its first act. This will block, because the queue is empty. Because both threads are blocked, theConductorwill at some point later increment the beat to 1. This will awaken the producer thread. It will return from itswaitForBeat(1)call and executebuf put 42. This will unblock the consumer thread, which will take the 42, and so on.The problem that
Conductoris designed to address is the difficulty, caused by the non-deterministic nature of thread scheduling, of testing classes, traits, and libraries that are intended to be used by multiple threads. If you just create a test in which one thread reads from anArrayBlockingQueueand another writes to it, you can't be sure that you have tested all possible interleavings of threads, no matter how many times you run the test. The purpose ofConductoris to enable you to write tests with deterministic interleavings of threads. If you write one test for each possible interleaving of threads, then you can be sure you have all the scenarios tested. The two tests shown here, for example, ensure that both the scenario in which a producer thread tries to write to a full queue and the scenario in which a consumer thread tries to take from an empty queue are tested.Class
Conductorwas inspired by the MultithreadedTC project, created by Bill Pugh and Nat Ayewah of the University of Maryland.Although useful, bear in mind that a
Conductor's results are not guaranteed to be accurate 100% of the time. The reason is that it usesjava.lang.Thread'sgetStatemethod to decide when to advance the beat. This use goes against the advice given in the Javadoc documentation forgetState, which says, "This method is designed for use in monitoring of the system state, not for synchronization." In short, sometimes the return value ofgetStateoccasionally may be inacurrate, which in turn means that sometimes aConductorcould decide to advance the beat too early. In practice,Conductorhas proven to be very helpful when developing thread safe classes. It is also useful in for regression tests, but you may have to tolerate occasional false negatives.- Definition Classes
- Conductors
Abstract Value Members
- abstract def expectedTestCount(filter: Filter): Int
The total number of tests that are expected to run when this
Suite'srunmethod is invoked.The total number of tests that are expected to run when this
Suite'srunmethod is invoked.- filter
a
Filterwith which to filter tests to count based on their tags
- Definition Classes
- SuiteMixin
- abstract def nestedSuites: IndexedSeq[Suite]
An immutable
IndexedSeqof thisSuiteMixinobject's nestedSuites.An immutable
IndexedSeqof thisSuiteMixinobject's nestedSuites. If thisSuiteMixincontains no nestedSuites, this method returns an emptyIndexedSeq.- Definition Classes
- SuiteMixin
- abstract def rerunner: Option[String]
The fully qualified name of the class that can be used to rerun this suite.
The fully qualified name of the class that can be used to rerun this suite.
- Definition Classes
- SuiteMixin
- abstract def run(testName: Option[String], args: Args): Status
Runs this suite of tests.
Runs this suite of tests.
- testName
an optional name of one test to execute. If
None, all relevant tests should be executed. I.e.,Noneacts like a wildcard that means execute all relevant tests in thisSuite.- args
the
Argsfor this run- returns
a
Statusobject that indicates when all tests and nested suites started by this method have completed, and whether or not a failure occurred.
- Definition Classes
- SuiteMixin
- Exceptions thrown
NullArgumentExceptionif any passed parameter isnull.
- abstract def runNestedSuites(args: Args): Status
Runs zero to many of this suite's nested suites.
Runs zero to many of this suite's nested suites.
- args
the
Argsfor this run- returns
a
Statusobject that indicates when all nested suites started by this method have completed, and whether or not a failure occurred.
- Attributes
- protected
- Definition Classes
- SuiteMixin
- Exceptions thrown
NullArgumentExceptionifargsisnull.
- abstract def runTest(testName: String, args: Args): Status
Runs a test.
Runs a test.
- testName
the name of one test to execute.
- args
the
Argsfor this run- returns
a
Statusobject that indicates when the test started by this method has completed, and whether or not it failed .
- Attributes
- protected
- Definition Classes
- SuiteMixin
- Exceptions thrown
NullArgumentExceptionif any oftestNameorargsisnull.
- abstract def runTests(testName: Option[String], args: Args): Status
Runs zero to many of this suite's tests.
Runs zero to many of this suite's tests.
- testName
an optional name of one test to run. If
None, all relevant tests should be run. I.e.,Noneacts like a wildcard that means run all relevant tests in thisSuite.- args
the
Argsfor this run- returns
a
Statusobject that indicates when all tests started by this method have completed, and whether or not a failure occurred.
- Attributes
- protected
- Definition Classes
- SuiteMixin
- Exceptions thrown
NullArgumentExceptionif eithertestNameorargsisnull.
- abstract def suiteId: String
A string ID for this
Suitethat is intended to be unique among all suites reported during a run.A string ID for this
Suitethat is intended to be unique among all suites reported during a run.The suite ID is intended to be unique, because ScalaTest does not enforce that it is unique. If it is not unique, then you may not be able to uniquely identify a particular test of a particular suite. This ability is used, for example, to dynamically tag tests as having failed in the previous run when rerunning only failed tests.
- returns
this
Suiteobject's ID.
- Definition Classes
- SuiteMixin
- abstract def suiteName: String
A user-friendly suite name for this
Suite.A user-friendly suite name for this
Suite.This trait's implementation of this method returns the simple name of this object's class. This trait's implementation of
runNestedSuitescalls this method to obtain a name forReports to pass to thesuiteStarting,suiteCompleted, andsuiteAbortedmethods of theReporter.- returns
this
Suiteobject's suite name.
- Definition Classes
- SuiteMixin
- abstract def tags: Map[String, Set[String]]
A
Mapwhose keys areStringnames of tagged tests and whose associated values are theSetof tag names for the test.A
Mapwhose keys areStringnames of tagged tests and whose associated values are theSetof tag names for the test. If a test has no associated tags, its name does not appear as a key in the returnedMap. If thisSuitecontains no tests with tags, this method returns an emptyMap.Subclasses may override this method to define and/or discover tags in a custom manner, but overriding method implementations should never return an empty
Setas a value. If a test has no tags, its name should not appear as a key in the returnedMap.- Definition Classes
- SuiteMixin
- abstract def testDataFor(testName: String, theConfigMap: ConfigMap): TestData
Provides a
TestDatainstance for the passed test name, given the passed config map.Provides a
TestDatainstance for the passed test name, given the passed config map.This method is used to obtain a
TestDatainstance to pass towithFixture(NoArgTest)andwithFixture(OneArgTest)and thebeforeEachandafterEachmethods of traitBeforeAndAfterEach.- testName
the name of the test for which to return a
TestDatainstance- theConfigMap
the config map to include in the returned
TestData- returns
a
TestDatainstance for the specified test, which includes the specified config map
- Definition Classes
- SuiteMixin
- abstract def testNames: Set[String]
A
Setof test names.A
Setof test names. If thisSuitecontains no tests, this method returns an emptySet.Although subclass and subtrait implementations of this method may return a
Setwhose iterator producesStringtest names in a well-defined order, the contract of this method does not required a defined order. Subclasses are free to implement this method and return test names in either a defined or undefined order.- Definition Classes
- SuiteMixin
- abstract val styleName: String
The
styleNamelifecycle method has been deprecated and will be removed in a future version of ScalaTest.The
styleNamelifecycle method has been deprecated and will be removed in a future version of ScalaTest.This method was used to support the chosen styles feature, which was deactivated in 3.1.0. The internal modularization of ScalaTest in 3.2.0 will replace chosen styles as the tool to encourage consistency across a project. We do not plan a replacement for
styleName.- Definition Classes
- SuiteMixin
- Annotations
- @deprecated
- Deprecated
(Since version 3.1.0) The styleName lifecycle method has been deprecated and will be removed in a future version of ScalaTest with no replacement.
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def beat: Int
Gets the current value of the clock.
Gets the current value of the clock. Primarily useful in assert statements.
- returns
the current tick value
- Attributes
- protected
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def interval(value: Span): Interval
Returns an
Intervalconfiguration parameter containing the passed value, which specifies the amount of time to sleep after a retry.Returns an
Intervalconfiguration parameter containing the passed value, which specifies the amount of time to sleep after a retry.- Definition Classes
- PatienceConfiguration
- def isConductorFrozen: Boolean
Check if the clock has been frozen by any threads.
Check if the clock has been frozen by any threads. (The only way a thread can freeze the clock is by calling withClockFrozen.)
- Attributes
- protected
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- implicit def patienceConfig: (ConductorMethods.this)#PatienceConfig
Implicit
PatienceConfigvalue providing default configuration values.Implicit
PatienceConfigvalue providing default configuration values.To change the default configuration, override or hide this
defwith another implicitPatienceConfigcontaining your desired default configuration values.- Definition Classes
- PatienceConfiguration → AbstractPatienceConfiguration
- final def scaled(span: Span): Span
Scales the passed
Spanby theDoublefactor returned byspanScaleFactor.Scales the passed
Spanby theDoublefactor returned byspanScaleFactor.The
Spanis scaled by invoking itsscaledBymethod, thus this method has the same behavior: The value returned byspanScaleFactorcan be any positive number or zero, including a fractional number. A number greater than one will scale theSpanup to a larger value. A fractional number will scale it down to a smaller value. A factor of 1.0 will cause the exact sameSpanto be returned. A factor of zero will causeSpan.ZeroLengthto be returned. If overflow occurs,Span.Maxwill be returned. If underflow occurs,Span.ZeroLengthwill be returned.- Definition Classes
- ScaledTimeSpans
- Exceptions thrown
IllegalArgumentExceptionif the value returned fromspanScaleFactoris less than zero
- def spanScaleFactor: Double
The factor by which the
scaledmethod will scaleSpans.The factor by which the
scaledmethod will scaleSpans.The default implementation of this method will return the span scale factor that was specified for the run, or 1.0 if no factor was specified. For example, you can specify a span scale factor when invoking ScalaTest via the command line by passing a
-Fargument toRunner.- Definition Classes
- ScaledTimeSpans
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def thread(f: => Any): Thread
Create a new thread that will execute the given function.
Create a new thread that will execute the given function. If the test is started, then the thread will run the function immediately. If it is not yet started, the Thread will wait to run the function until all threads are up and ready to go.
- f
the function to be executed by the thread
- Attributes
- protected
- def threadNamed(name: String)(f: => Unit): Thread
Create a new thread that will execute the given function.
Create a new thread that will execute the given function. If the test is started, then the thread will run the function immediately. If it is not yet started, the Thread will wait to run the function until all threads are up and ready to go.
- name
the name of the thread
- f
the function to be executed by the thread
- Attributes
- protected
- def timeout(value: Span): Timeout
Returns a
Timeoutconfiguration parameter containing the passed value, which specifies the maximum amount to wait for an asynchronous operation to complete.Returns a
Timeoutconfiguration parameter containing the passed value, which specifies the maximum amount to wait for an asynchronous operation to complete.- Definition Classes
- PatienceConfiguration
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def waitForBeat(beat: Int): Succeeded.type
Force the current thread to block until the thread clock reaches the specified value, at which point the current thread is unblocked.
Force the current thread to block until the thread clock reaches the specified value, at which point the current thread is unblocked.
- Attributes
- protected
- def whenFinished(fun: => Assertion): Assertion
Register a function to be executed after the simulation has finished.
Register a function to be executed after the simulation has finished.
- Attributes
- protected
- def withConductorFrozen[T](f: => T): T
Run the passed function, ensuring the clock does not advance while the function is running (has not yet returned or thrown an exception).
Run the passed function, ensuring the clock does not advance while the function is running (has not yet returned or thrown an exception).
- Attributes
- protected
- def withFixture(test: (ConductorMethods.this)#NoArgTest): Outcome
Creates and initializes a private instance variable with a new Conductor, ensuring it is visible to any thread, invokes the passed test function, and invokes
conducton theConductor, if it was not already invoked by the test.Creates and initializes a private instance variable with a new Conductor, ensuring it is visible to any thread, invokes the passed test function, and invokes
conducton theConductor, if it was not already invoked by the test.This trait is stackable with other traits that override
withFixture(NoArgTest), because instead of invoking the test function directly, it delegates responsibility for invoking the test function tosuper.withFixture(NoArgTest).- test
the no-arg test function to run with a fixture
- Definition Classes
- ConductorMethods → TestSuiteMixin