Propositional and Activity Monitoring Using Qualitative Spatial Reasoning
Name
MIT-CSAIL-TR-2016-016.pdf
Size
3.25 MB
Format
Adobe PDF
Checksum (MD5)
44e303d8134425fac29cacb823f7da2b
Download all files submitted through automated deposit
Author(s)
Lane, Spencer Dale
Advisor(s)
Brian Williams
Date Issued
December 14, 2016
Series/Report no.
MIT-CSAIL-TR-2016-016
Abstract
Communication is the key to effective teamwork regardless of whether the team members are humans or machines. Much of the communication that makes human teams so effective is non-verbal; they are able to recognize the actions that the other team members are performing and take their own actions in order to assist. A robotic team member should be able to make the same inferences, observing the state of the environment and inferring what actions are being taken. In this thesis I introduce a novel approach to the combined problem of activity recognition and propositional monitoring. This approach breaks down the problem into smaller sub-tasks. First, the raw sensor input is parsed into simple, easy to understand primitive semantic relationships known as qualitative spatial relations (QSRs). These primitives are then combined to estimate the state of the world in the same language used by most planners, planning domain definition language (PDDL) propositions. Both the primitives and propositions are combined to infer the status of the actions that the human is taking. I describe an algorithm for solving each of these smaller problems and describe the modeling process for a variety of tasks from an abstracted electronic component assembly (ECA) scenario. I implemented this scenario on a robotic testbed and collected data of a human performing the example actions.
Description
SM thesis
Subjects
hybrid systems, filtering, activity recognition, qualitative spatial relations
Persistent DSpace Link
