Can you see what you feel? Color and folding properties affect visual–tactile material discrimination of fabrics
Name
Adelson_Can you see.pdf
Size
1.14 MB
Format
Adobe PDF
Checksum (MD5)
78679f1bb81549ba7a0cc0102848ba71
Author(s)
Xiao, Bei
Bi, Wenyan
Jia, Xiaodan
Wei, Hanhan
Adelson, Edward H
Date Issued
February 2016
Journal
Journal of Vision
Publisher
Association for Research in Vision and Opthalmology
Citation
Xiao, Bei et al. “Can You See What You Feel? Color and Folding Properties Affect Visual–tactile Material Discrimination of Fabrics.” Journal of Vision 16.3 (2016): 34. © 2015 Association for Research in Vision and Ophthalmology
Version
Final published version
Abstract
Humans can often estimate tactile properties of objects from vision alone. For example, during online shopping, we can often infer material properties of clothing from images and judge how the material would feel against our skin. What visual information is important for tactile perception? Previous studies in material perception have focused on measuring surface appearance, such as gloss and roughness, and using verbal reports of material attributes and categories. However, in real life, predicting tactile properties of an object might not require accurate verbal descriptions of its surface attributes or categories. In this paper, we use tactile perception as ground truth to measure visual material perception. Using fabrics as our stimuli, we measure how observers match what they see (photographs of fabric samples) with what they feel (physical fabric samples). The data shows that color has a significant main effect in that removing color significantly reduces accuracy, especially when the images contain 3-D folds. We also find that images of draped fabrics, which revealed 3-D shape information, achieved better matching accuracy than images with flattened fabrics. The data shows a strong interaction between color and folding conditions on matching accuracy, suggesting that, in 3-D folding conditions, the visual system takes advantage of chromatic gradients to infer tactile properties but not in flattened conditions. Together, using a visual–tactile matching task, we show that humans use folding and color information in matching the visual and tactile properties of fabrics.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Terms of Use
Creative Commons Attribution-NonCommercial-NoDerivs License
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1167/16.3.34
