Semantics in Experiential Computing

 

 

Ramesh Jain

Department of Computer Science

University of California, Irvine

Irvine, CA 92697

jain@ics.uci.edu

 

 

Computing is increasingly used as underlying technology for communicating experiences.  Advances in technology are enabling and enhancing more natural experiential communication.  Semantics is essential for communication.  Most techniques in semantics have focused more on understanding of text.  Much natural communication is non-textual.  Visual and aural communication played dominant role in human society.  The next major frontier in computing is facilitating experiential communication for the society, including for those 80% who do not use computing today.  This poses interesting challenges for computing in general, and for researchers interested in semantics in particular.  In this talk we will explore how semantics is inherent in all stages of data creations and communication.  We will explore challenges in representation and utilization of emerging approaches to semantics by considering Semantic Eco System and discuss an event-based approach to deal with semantics in multimedia systems.  We will demonstrate role of semantic processes in all aspects of experiential computing and communication systems considering two concrete projects in digital photo management and telepresence.