|
|
|
Learning from natural tutorial instruction
|
|
Description
|
The aim of this project is to develop an electronic student that can learn from instruction that is increasingly more natural (i.e. instruction that increasingly resembles the instruction that a human teacher provides a human student).
More-->
|
Status
|
We are currently focusing on two aspects of this work:
- Learning Procedures from Tutorial
Instruction, where we extend the Wings
Workflow System to enable users to teach new procedures using
natural language instructions. We have run formative user studies.
- A Framework for Combining
Instruction and Demonstration, where we investigate the formal
requirements and possibilities for combining these two instruction
methods to teach more effectively. We have implemented a prototype
of the formal framework we have developed and tested it on a
number of example instructions together with demonstrations for
teaching new game playing procedures on a real-time strategy
game.
More-->
|
Research
|
Natural instruction is inherently error prone and
incomplete. Human teachers regularly omit important details,
either because for a human such details might be obvious, or
because they simply forgot about them. We are developing a
system that is able to semantically reason about the consistency
of instruction, capable of hypothesizing ways to correct errors
or fill gaps in instructions, and rank such hypotheses in terms
of their likelihood.
More -->
|
Publications
|
- A Formal Framework for Combining Natural Instruction and Demonstration for End-User Programming., Christian Fritz, Yolanda Gil. To appear in Proceedings of the ACM International Conference on Intelligent User Interfaces, Palo Alto, CA. 2011
- TellMe: Learning Procedures from Tutorial Instruction, Yolanda Gil, Varun Ratnakar, Christian Fritz. To appear in Proceedings of the ACM International Conference on Intelligent User Interfaces, Palo Alto, CA. 2011
- Towards the Integration of Programming by Demonstration and Programming by Instruction using Golog., Christian Fritz, Yolanda Gil. In AAAI Workshop on Plan, Activity, and Intent Recognition (PAIR), Atlanta, GA, July 2010
More publications -->
|
Demo
|
See a demo -->
|
People
|
Group Members:
Alumni and Former Members:
More -->
|
Funding
|
- DARPA / Bootstrapped Learning
More -->
|
Links
|
More links
-->
|