<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Albertus Extra Bold";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
h2
{mso-style-priority:9;
mso-style-link:"Heading 2 Char";
margin:0in;
margin-bottom:.0001pt;
text-align:center;
page-break-after:avoid;
font-size:16.0pt;
font-family:"Albertus Extra Bold";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.Heading2Char
{mso-style-name:"Heading 2 Char";
mso-style-priority:9;
mso-style-link:"Heading 2";
font-family:"Albertus Extra Bold";
font-weight:bold;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><o:p> </o:p></p><h2><span style='font-family:"Tahoma","sans-serif"'>PhD Dissertation Defense<o:p></o:p></span></h2><p class=MsoNormal><b><span style='font-family:"Tahoma","sans-serif"'><o:p> </o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:14.0pt;font-family:"Tahoma","sans-serif";text-transform:uppercase'>DECISION-MAKING FOR AUTONOMOUS SYSTEMS IN PARTIALLY OBSERVABLE ENVIRONMENTS<o:p></o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><o:p> </o:p></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:14.0pt;font-family:"Tahoma","sans-serif"'>Henry I. Ibekwe<o:p></o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'><o:p> </o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'>Date: Friday, May 3<sup>rd</sup> 2013<o:p></o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'><o:p> </o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'>Location: </span></b><span style='font-size:12.0pt'>INDE Conference Room, Engr Bldg 2 – Room E214<b><o:p></o:p></b></span></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'> Time: </span></b><span style='font-size:12.0pt'>10:00 – 11:00 am <b><o:p></o:p></b></span></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'><o:p> </o:p></span></b></p><p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:12.0pt'>Committee Chair: </span></b><span style='font-size:12.0pt'>Dr. Ali Kamrani<b><o:p></o:p></b></span></p><p class=MsoNormal><span style='font-size:12.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:12.0pt'><o:p> </o:p></span></p><p class=MsoNormal>Decision-making for autonomous systems acting in real world domains are complex and difficult task to formalize. For instance, consider the task of autonomously navigating a mobile robot in an automated manufacturing facility. Its task is to transport hazardous material from a collection site to a disposal site. This is a navigation problem where the robot has to consider numerous variables such as collision avoidance, recognition of goal locations, accurate selection of the desired material, and knowledge of its location within the facility. The difficulty is often to reliably model the uncertainties and dynamics of the robot-environment interaction when the robot can only partially observe the states of the environment.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Therefore a principal problem in designing mobile robots that can efficiently navigate indoor domains to achieve a desired task autonomously is to construct robust models for efficient planning and motion control in stochastic domains. This is still a difficult and open problem despite significant advances. The robot must generate efficient <i>policies</i> to reliably accomplish its tasks while accounting for uncertainties in both its action and perception. In this dissertation we model the uncertainties in action selection and perception using a sequential decision-making model. The mathematical formalism adopted is the <i>Partially Observable Markov Decision Process </i>(POMDP), a generalization of the well-known <i>Markov Decision Process </i>(MDP). Though POMDPs represent a robust formalism for the modeling agent-based decision making, it is still very difficult and often intractable to compute optimal solutions for problems with large state space due the high dimensionality of the underlying belief space. We propose a technique called <i>Goal-Specific Representation </i>(GSR) that exploits domain structure and generates policies over a subset of the state space given a map of the domain, a starting location and a goal location. We solve the resulting POMDP model using a <i>Point-Based Value Iteration</i> (PBVI) solver and apply the generated policies for navigation on an autonomous robot. We anticipate that the results from this work can be applied in manufacturing facilities to enhance automation and healthcare domains for assisted care. <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>