Loading...
365 Views
 19 Favorites
 0 Shares
Mapping the VALUE Rubrics for Application to the KEEN Framework
Updated: 9/8/2021 10:34 AM by Becky Benishek
Description
In an educational setting it is vital that we as educators are able to assess our learning outcomes and effectively measure student progress towards those objectives. With that being said, what can educators do when they trying to instill a characteristic that they don’t know how to asses? The engineering entrepreneurship community is tackling this issue head on, as the increasing popularity of injecting an entrepreneurial mindset into the engineering curriculum has brought some of these “hard-to-assess” traits into the spotlight. 

While the KEEN framework has provided a valuable communication tool around which to organize discussion and facilitate action incorporating entrepreneurship into engineering curricula, it has also raised significant questions around assessment of the framework elements. The constructs captured by the framework are beyond the scope of what engineering faculty are accustomed to teaching and assessing. The abstracted and conceptually overlapping nature of the framework elements further worsens this discomfort. Having a fully vetted example of how the framework might be digested into defined, assessable pieces would be of tremendous value to the network. The purpose of this work is, therefore, to address the need for applied assessment of the KEEN Entrepreneurial Mindset and to explore how the Association of American Colleges and Universities (AAC&U) VALUE Rubrics might fill these gaps.

The first goal for this work was to review the applicability of VALUE rubrics. The guiding research question for this phase was: Are the VALUE Rubrics applicable in regards to assessing the Entrepreneurial Mindset that KEEN promotes? Secondly, after this initial review, the rubric components deemed most applicable were extracted and the goal shifted to answering the question: How might the components of the VALUE Rubrics be reorganized around the elements of the KEEN Framework? Finally, after a thorough review of the resulting rubrics, the question again shifted to: How might these reorganized rubrics be modified and/or appended to better evaluate the KEEN Framework?

A set of three rubrics has been developed based on a modification of the sixteen VALUE rubrics, reframed to fit the KEEN Framework. As previously stated, there are gaps in each of the three rubrics, some with more than others. Work is still needed to distribute, revise, and polish the text of the rubric rows, as well as to evaluate gaps in the rubric coverage. Additionally, while direct application of these exemplars is not the intended use case, there are some faculty who may opt to do so. Significant work remains in terms of validation of the rubrics. While they have been developed from highly reliable and validated source material, some revalidation is necessary to ensure good reliability and applicability of the rubrics as redesigned. 

This work was initially presented at ASEE 2019, as part of the ENT division.
Learning Objectives
After reviewing this card and the included rubrics, adopting faculty will have a better understanding of how the 3C's can be digested in the form of rubric-level assessment criteria.
Instructor Tips
The direct use of these rubrics is not intended. Instead, faculty are encouraged to borrow pieces, entire rows, or simply draw inspiration from the provided examples. Direct assessment is, by necessity, contextualized within the specific course and assignment being assessed. As such, development of a silver bullet EM rubric is not practical. However, by providing examples of how the process of developing an EM rubric might be undertaken, it is hoped that faculty will be better prepared to develop (and share) their own rubrics.
Curiosity
  • Demonstrate constant curiosity about our changing world
  • Explore a contrarian view of accepted solution
Connections
  • Integrate information from many sources to gain insight
  • Assess and manage risk
Creating Value
  • Identify unexpected opportunities to create extraordinary value
  • Persist through and learn from failure
  • Aerospace Engineering
  • Agricultural Engineering
  • Architectural Engineering
  • Arts & Sciences
  • Biomedical Engineering
  • Business, Economics, & Law
  • Chemical Engineering
  • Chemistry
  • Civil Engineering
  • Computer Science
  • Electrical & Computer Engineering
  • Engineering Education
  • Engineering Management
  • Engineering Science/Physics
  • Environmental Engineering
  • General Engineering
  • Health Sciences & Medical
  • Industrial & Manufacturing Engineering
  • Mathematics
  • Mechanical Engineering
  • Metallurgical & Materials Engineering
  • Mining Engineering
  • Nuclear Engineering
  • Petroleum Engineering
  • Physics
  • Technical Communications
Groups
This project was supported by the Kern Family Foundation
Folders
Description
Title Type Ext Date Size
Connections Rubric.pdf Assessment / Rubric .pdf 6/21/2019 84.6 KB
Curiosity Rubric.pdf Assessment / Rubric .pdf 6/21/2019 78.2 KB
Creating Value Rubric.pdf Assessment / Rubric .pdf 6/21/2019 33 KB
Description
Title Type Ext Date Size
VALUE Rubrics Development - Print Copy.pdf Journal / Article .pdf 6/21/2019 291.5 KB
ASEE 2019 Presentation - VALUE Rubrics.pdf Presentation .pdf 6/21/2019 386.3 KB
KEEN Reception Poster.pdf Presentation .pdf 6/21/2019 380.8 KB