Leveraging End-User Data for Enhanced Design Concept Evaluation: A Multimodal Deep Regression Model
- 9 September 2021
- journal article
- research article
- Published by ASME International in Journal of Mechanical Design
- Vol. 144 (2), 1-20
- https://doi.org/10.1115/1.4052366
Abstract
Design concept evaluation is a key process in the new product development process with a significant impact on the product's success and total cost over its life cycle. This paper is motivated by two limitations of the state-of-the-art in concept evaluation: (1) The amount and diversity of user feedback and insights utilized by existing concept evaluation methods such as quality function deployment are limited. (2) Subjective concept evaluation methods require significant manual effort which in turn may limit the number of concepts considered for evaluation. A Deep Multimodal Design Evaluation (DMDE) model is proposed in this paper to bridge these gaps by providing designers with an accurate and scalable prediction of new concepts' overall and attribute-level desirability based on large-scale user reviews on existing designs. The attribute-level sentiment intensities of users are first extracted and aggregated from online reviews. A multimodal deep regression model is then developed to predict the overall and attribute-level sentiment values based on the features extracted from orthographic product images via a fine-tuned ResNet-50 model and from product descriptions via a fine-tuned BERT model, and aggregated using a novel self-attention-based fusion model. The DMDE model adds a data-driven, user-centered loop within the concept development process to better inform the concept evaluation process. Numerical experiments on a large dataset from an online footwear store indicate a promising performance by the DMDE model with 0.001 MSE loss and over 99.1% accuracy.Keywords
Funding Information
- Directorate for Engineering (2050052)
This publication has 78 references indexed in Scilit:
- A PROMETHEE-based approach to portfolio selection problemsComputers & Operations Research, 2012
- Reuse of ideas and concepts for creative stimuli in engineering designJournal of Engineering Design, 2011
- An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing MethodsJournal of Mechanical Design, 2011
- A survey on sentiment detection of reviewsExpert Systems with Applications, 2009
- Analyzing consensus approaches in fuzzy group decision making: advantages and drawbacksSoft Computing, 2009
- A hybrid approach to concept selection through fuzzy analytic network processComputers & Industrial Engineering, 2009
- Classification model for product form design using fuzzy support vector machinesComputers & Industrial Engineering, 2008
- An integrated computational intelligence approach to product concept generation and evaluationMechanism and Machine Theory, 2006
- Integrating Target Costing Into Perception-Based Concept Evaluation of Complex and Large-Scale Systems Using Simultaneously Decomposed QFDJournal of Mechanical Design, 2006
- Applying a hybrid approach based on fuzzy neural network and genetic algorithm to product form designInternational Journal of Industrial Ergonomics, 2005