Loading...
1449
 29 Favorites
 2 Times Used
 3 Shares
 1110 Downloads
General Card #2441
EM Learning Outcomes and Direct Assessment Rubrics
Updated: 10/14/2022 1:00 PM by Michael Johnson
Reviewed: 10/17/2022 8:28 AM by Becky Benishek
Summary
View Ohio State University's 14 3C's learning outcomes and their rubrics for direct assessment.
Description

This card is a formal publication of 14 custom Entrepreneurial Mindset Learning Outcomes for the 3C's and corresponding rubrics for direct assessment being used at The Ohio State University. Developing students' entrepreneurial mindset is not only about integrating EM into their courses but also measuring the impact and effectiveness of the changes. While KEEN has defined 6 such educational outcomes for the Entrepreneurial Mindset 3C's, we sought to further define these 6 outcomes and add additional outcomes to develop a comprehensive list for use in our courses across our curriculum.

Need & Preliminary Work

We began this process with a review of the learning outcomes published by KEEN or universities in KEEN, including the first iteration of objectives created by our own team at Ohio State. We then identified possible shortcomings of these sets, as described in our ASEE 2020 paper and corresponding Card: Comparing EM Course Learning Objectives. Based on this preliminary work, we discovered a need for learning outcomes that were more specifically defined and measurable.

Our next step was to survey students and faculty on what learning objectives they found important for students to learn. Twenty-five senior level students in a multidisciplinary capstone course were surveyed. The following figure shows the results from the student survey.

Figure 1: Student survey Likert results identifying the importance of the learning objective in their undergraduate career. (n=25)

 

Development Process

After our preliminary work, we sought to develop a new set of outcomes, called the Entrepreneurial Mindset Learning Objectives (EMLO), that combined the best aspects of the existing sets and attempted to overcome some of their shortcomings. We selected the most relevant 14 learning outcomes, including the 6 defined by the KEEN framework. Beyond the 6 outcomes defined in the KEEN framework, many of the remaining learning outcomes were also inspired by the KEEN framework's Engineering Skillset. After selecting 14, we further defined all of them into Beginner, Intermediate, and Advanced levels. These three levels help to define the outcomes into more measurable and manageable tasks. Once the learning outcomes were refined, a direct assessment rubric for each outcome at each level was developed. These rubrics were designed to be very specific and measurable, and are a unique aspect of this set of outcomes.

 

Both the EMLOs and their corresponding rubrics can be found in the Outcome Materials Folder at the bottom of this card.

 

Mapping to the 3C's

The following table maps each outcome to the 3C category it best corresponds to.

Learning Outcome

Curiosity

Connections

Creating Value

1. Demonstrate Curiosity*

X

 


2. Analyze Accepted Solutions*

X

  
3. Integrate Information Through Making Connections* 

X

 
4. Evaluate Social, Economic, and Environmental Risks and Benefits* 

X

 
5. Identify Opportunities to Create Value*  

X

6. Learn From Failure*  

X

7. Define Problem  

X

8. Define User Needs 

X

 
9. Develop Concepts and Visual Representations  

X

10. Analyze Solutions and Develop Design Requirements  

X

11. Perform Detailed Design  

X

12. Test and Validate Solutions  

X

13. Identifying and Utilizing Resources and Expertise 

X

 
14. Consider How to Protect Intellectual Property  

X

* Indicates a KEEN objective from the Framework Spread

Log In to View More