Design Optimizations for Action Recognition Applications
Name
Perez-bperez-meng-eecs-2022-thesis.pdf
Description
Thesis PDF
Size
1.4 MB
Format
Adobe PDF
Checksum (MD5)
80a5b847f4915095791945d98c271fea
Author(s)
Perez, Brandon
Advisor(s)
Oliva, Aude
Martie, Lee
Date Issued
May 2022
Publisher
Massachusetts Institute of Technology
Abstract
There are many problems that exist within the relatively new field of action recognition that make it difficult for the immediate use of existing models for specific applications. My work at the MIT-IBM Watson lab revolved around utilizing existing assets and optimizing performance for achieving action detection in construction-centric videos. There were several pretrained general action recognition models at our disposal, each one with its own limitations. In addition to fine-tuning, there are other computer vision methods and processing techniques that were explored for performance optimization including background subtraction, optical flow, and frame selection algorithms. Though raw accuracy score gains through adopting these modalities were marginal, other improvements like faster training time and the potential for faster prediction time were observed. The process of building this experimental pipeline and the results obtained offered insight into what was feasible and effective with current technology in this unique problem space. This includes proof of concept with regards to a real-time action detection tool as well as potential modifications to optimize the tool's performance in this context.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
