Model verification and validation (V&V) are critical aspects of every engineering modeling application. This activity focuses specifically on verification and validation of discrete-event simulation models constructed in systems simulation courses. Verification refers to the practice of making sure the model functions as intended (i.e., debugging). Validation refers to ensuring the model is an accurate representation of the actual system to the extent that reliable decisions about the actual system could be made based on the experimental results of the simulation model.

A virtual escape room concept is utilized as an entrepreneurial mindset learning (EML) activity to provide a hands-on experience for students apply verification and validation techniques to a set of simulation models. This activity parallels the format of a physical entertainment based escape room where a team of people work together to search for clues and solve a series of puzzles to unlock a door to escape a room within a specified time period. However, rather than a physical room, in the virtual escape room,  teams of students are provided a scenario with a series of “problematic” simulation models. The teams work to fix the simulation models applying verification and validation techniques to “escape” (achieve a goal) before time runs out.

Given the scenario with the ultimate goal, students are provided the first simulation model that contains V&V issues along information and a clue about the issues. Upon solving and documenting the results of the first model, students proceed to the next model where information about that model is provided. This process continues until the final model is solved.

Here is an overview of the EML activity implemented in the systems simulation course (please see the attached files for details of the complete activity):

Activity title: Simulation Escape Room: V&V is the Key, with a subtitle To Escape: Beat the Design Deadline.

The scenario given is as follows:

TSD is competing with other companies for a multi-million dollar contract to design and build a state-of-the-art bike production facility for the Innovative Bicycle Company (IBC). To win the contract, TSD must provide both the design concept and a dynamic simulation that demonstrates the capabilities of the design. TSD has a winning design; a simulation has been created; but… the SIMULATION IS NOT WORKING! Your team has been tasked with fixing, verifying, and validating the simulation model. However, THE DESIGN DEADLINE IS IN ONE HOUR!

Instructions to the teams prior to the start of the activity include:

• Each group must work independently. You may not share information between groups.
• Your team must verify and validate the models one at a time in the order provided.
• This file includes a section for each submodel that contains, the system description followed by information about the “issues” with the submodel.
• Your team must complete the V&V Activity Report and submit the report at the end of the activity.
• Your team must submit each corrected (verified and validated) model before proceeding to the next model.
• Each member of the team must submit an Activity Survey at the end of the activity.

 The students are provided with a series of simulation models and the corresponding information related to each model. For the bike production systems, there is a series of six models:

1. Order submodel
2. Frame subassembly
   
3. Handlebar/brake subassembly
4. Crank/Pedals subassembly
5. Wheels/Gear subassembly
6. Final assembly

As an example, in the order submodel, only the demand of bike orders is considered. Given the “broken” model along with information describing the demand distribution, product mix, etc., students, clues about the submodel issues are provided. These include: (a) the number of arrivals is different than expected; and (b) the resulting mix of bike orders is different than expected.

Students apply V&V techniques to determine and correct the errors in the model. For each model, students submit the corrected model and complete a V&V report with consists of the question:

1. Before making changes, what do you observe that indicates the model is not verified/valid?
2. What action was taken to correct the model?
3. After making changes, what do you observe that indicates the model is now correct/valid?

After completing the Order submodel task, students move on to the Frame subassembly task, and so on until completing the Final assembly model and achieving the goal and “escaping”.