Skip to main navigation Skip to search Skip to main content

Frame semantics in text-to-scene generation

  • Bob Coyne
  • , Owen Rambow
  • , Julia Hirschberg
  • , Richard Sproat
  • Columbia University
  • Oregon Health and Science University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Scopus citations

Abstract

3D graphics scenes are difficult to create, requiring users to learn and utilize a series of complex menus, dialog boxes, and often tedious direct manipulation techniques. By giving up some amount of control afforded by such interfaces we have found that users can use natural language to quickly and easily create a wide variety of 3D scenes. Natural language offers an interface that is intuitive and immediately accessible by anyone, without requiring any special skill or training. The WordsEye system (http://www.wordseye.com) has been used by several thousand users on the web to create over 10,000 scenes. The system relies on a large database of 3D models and poses to depict entities and actions. We describe how the current version of the system incorporates the type of lexical and real-world knowledge needed to depict scenes from language.

Original languageEnglish
Title of host publicationKnowledge-Based and Intelligent Information and Engineering Systems - 14th International Conference, KES 2010, Proceedings
Pages375-384
Number of pages10
EditionPART 4
DOIs
StatePublished - 2010
Event14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, KES 2010 - Cardiff, United Kingdom
Duration: Sep 8 2010Sep 10 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 4
Volume6279 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, KES 2010
Country/TerritoryUnited Kingdom
CityCardiff
Period09/8/1009/10/10

Fingerprint

Dive into the research topics of 'Frame semantics in text-to-scene generation'. Together they form a unique fingerprint.

Cite this