Show simple item record

dc.contributor.authorSavoie, Troy B.
dc.contributor.authorFrey, Daniel
dc.date.accessioned2014-06-09T15:22:53Z
dc.date.available2014-06-09T15:22:53Z
dc.date.issued2011-11
dc.date.submitted2011-08
dc.identifier.issn0934-9839
dc.identifier.issn1435-6066
dc.identifier.urihttp://hdl.handle.net/1721.1/87699
dc.description.abstractThis paper presents the results of an experiment with human subjects investigating their ability to discover a mistake in a model used for engineering design. For the purpose of this study, a known mistake was intentionally placed into a model that was to be used by engineers in a design process. The treatment condition was the experimental design that the subjects were asked to use to explore the design alternatives available to them. The engineers in the study were asked to improve the performance of the engineering system and were not informed that there was a mistake intentionally placed in the model. Of the subjects who varied only one-factor-at-a-time, fourteen of the twenty-seven independently identified the mistake during debriefing after the design process. A much lower fraction, one out of twenty-seven engineers, independently identified the mistake during debriefing when they used a fractional factorial experimental design. Regression analysis shows that relevant domain knowledge improved the ability of subjects to discover mistakes in models, but experimental design had a larger effect than domain knowledge in this study. Analysis of video tapes provided additional confirmation as the likelihood of subjects to appear surprised by data from a model was significantly different across the treatment conditions. This experiment suggests that the complexity of factor changes during the design process is a major consideration influencing the ability of engineers to critically assess models.en_US
dc.description.sponsorshipCharles Stark Draper Laboratoryen_US
dc.description.sponsorshipSUTD-MIT International Design Centreen_US
dc.language.isoen_US
dc.publisherSpringer-Verlagen_US
dc.relation.isversionofhttp://dx.doi.org/10.1007/s00163-011-0120-yen_US
dc.rightsCreative Commons Attribution-Noncommercial-Share Alikeen_US
dc.rights.urihttp://creativecommons.org/licenses/by-nc-sa/4.0/en_US
dc.sourceFreyen_US
dc.titleDetecting mistakes in engineering models: the effects of experimental designen_US
dc.typeArticleen_US
dc.identifier.citationSavoie, Troy B., and Daniel D. Frey. “Detecting Mistakes in Engineering Models: The Effects of Experimental Design.” Research in Engineering Design 23, no. 2 (April 2012): 155–175.en_US
dc.contributor.departmentMassachusetts Institute of Technology. Department of Mechanical Engineeringen_US
dc.contributor.approverFrey, Danielen_US
dc.contributor.mitauthorFrey, Danielen_US
dc.relation.journalResearch in Engineering Designen_US
dc.eprint.versionAuthor's final manuscripten_US
dc.type.urihttp://purl.org/eprint/type/JournalArticleen_US
eprint.statushttp://purl.org/eprint/status/PeerRevieweden_US
dspace.orderedauthorsSavoie, Troy B.; Frey, Daniel D.en_US
dc.identifier.orcidhttps://orcid.org/0000-0002-9886-7512
mit.licenseOPEN_ACCESS_POLICYen_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record