Deep neural networks for choice analysis: Extracting complete economic information for interpretation
Name
DNN_for_Choice_Analysis_Extracting_Economic_Information.pdf
Description
Submitted version
Size
2.92 MB
Format
Adobe PDF
Checksum (MD5)
435c64ddd5c4a59435c8cc5894eba76b
Author(s)
Wang, Shenhao
Wang, Qingyi
Zhao, Jinhua
Date Issued
September 2020
Journal
Transportation Research Part C: Emerging Technologies
Publisher
Elsevier BV
Citation
Wang, Shenhao, Qingyi Wang and Jinhua Zhao. “Deep neural networks for choice analysis: Extracting complete economic information for interpretation.” Transportation Research Part C: Emerging Technologies, 118 (September2020): 102701 © 2020 The Author(s)
Version
Original manuscript
Abstract
While deep neural networks (DNNs) have been increasingly applied to choice analysis showing high predictive power, it is unclear to what extent researchers can interpret economic information from DNNs. This paper demonstrates that DNNs can provide economic information as complete as classical discrete choice models (DCMs). The economic information from DNNs includes choice predictions, choice probabilities, market shares, substitution patterns of alternatives, social welfare, probability derivatives, elasticities, marginal rates of substitution, and heterogeneous values of time. Unlike DCMs, DNNs can automatically learn utility functions and reveal behavioral patterns that are not prespecified by domain experts, particularly when the sample size is large. However, the economic information obtained from DNNs can be unreliable when the sample size is small, because of three challenges associated with the automatic learning capacity: high sensitivity to hyperparameters, model non-identification, and local irregularity. The first challenge is related to the statistical challenge of balancing approximation and estimation errors of DNNs, the second to the optimization challenge of identifying the global optimum in the DNN training, and the third to the robustness challenge of mitigating locally irregular patterns of estimated functions. To demonstrate the strength and challenges, we estimated the DNNs using a stated preference survey from Singapore and a revealed preference data from London, extracted the full list of economic information from the DNNs, and compared them with those from the DCMs. We found that the economic information either aggregated over trainings or population is more reliable than the disaggregate information of the individual observations or trainings, and that larger sample size, hyperparameter searching, model ensemble, and effective regularization can significantly improve the reliability of the economic information extracted from the DNNs. Future studies should investigate the requirement of sample size, better ensemble mechanisms, other regularizations and DNN architectures, better optimization algorithms, and robust DNN training methods to address DNNs three challenges to provide more reliable economic information for DNN-based choice models.
MIT Department
Massachusetts Institute of Technology. Department of Urban Studies and Planning
Terms of Use
Creative Commons Attribution-NonCommercial-NoDerivs License
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1016/j.trc.2020.102701
