CHAMELEON and the IntelliMedia WorkBench: integrating research from
the humanities, science, and engineering
Paul Mc Kevitt
Center for PersonKommunikation (CPK)
Institute of Electronic Systems (IES)
Fredrik Bajers Vej 7-A5, DK- 9220, Aalborg, DENMARK.
Intelligent MultiMedia (IntelliMedia) focusses on the computer processing
and understanding of signal and symbol input from at least speech, text
and visual images in terms of semantic representations.We have developed
a general suite of tools in the form of a software and hardware
platform called CHAMELEON that can be tailored to conducting IntelliMedia
in various application domains. CHAMELEON has an open distributed processing
architecture and currently includes ten agent modules: blackboard,
dialogue manager, domain model, gesture recogniser, laser system, microphone
array, speech recogniser, speech synthesiser, natural language processor,
and a distributed Topsy learner. Most of the modules are programmed in
C and C++ and are glued together using the DACS communications system.
In effect the blackboard, dialogue manager and DACS form the kernel
of CHAMELEON. Modules can communicate with each other and the blackboard
which keeps a record of interactions over time via semantic representations
in frames. Inputs to CHAMELEON can include synchronised spoken dialogue
and images and outputs include synchronised laser pointing and spoken dialogue.
An initial prototype application of CHAMELEON is an IntelliMedia WorkBench
where a user will be able to ask for information about things (e.g.
2D/3D models, pictures, objects, gadgets, people, or (whatever) on a physical
table. The current domain is a Campus Information System for 2D building
plans which provides information about tenants, rooms and routes and can
answer questions like ``Whose office is this?'' and ``Show me the
route from Paul Mc Kevitt's office to Paul Dalsgaard's office?''
in real time. CHAMELEON and the IntelliMedia WorkBench are ideal
for testing integrated signal and symbol processing of language and vision
for the future of SuperinformationhighwayS.
More details on CHAMELEON and its respective IntelliMedia 2000+ umbrella
initiative can be found in Broendsted et al. (1998) and Mc Kevitt (1998)
Note: Paul Mc Kevitt is also a British Engineering and
Physical Sciences Research Council (EPSRC) Advanced Fellow at the Department
of Computer Science, University of Sheffield, for five years under grant
B/94/AF/1833 for the Integration of Natural Language, Speech and
Vision Processing. This abstract was completed whilst Paul Mc Kevitt was
a Visiting Professor at LIMSI-CNRS, Orsay, France.
We take this opportunity to acknowledge support from the
Faculty of Science and Technology, Aalborg University, Denmark and from
the European Union (EU) under the ESPRIT (OPEN-LTR) Project 24 493. Paul
Mc Kevitt would also like to acknowledge the British Engineering and Physical
Sciences Research Council (EPSRC) for their generous funded support under
grant B/94/AF/1833 for the Integration of Natural Language, Speech and
Vision Processing (Advanced Fellow) and LIMSI-CNRS, Orsay, France where
he was a Visiting Professor whilst completing this abstract.
Broendsted, T., P.Dalsgaard, L.B. Larsen, M. Manthey, P.
Mc Kevitt, T.B.Moeslund, K.G. Olesen (1998) A platform for developing
Intelligent MultiMedia applications. Technical Report R-98-1004, Center
for PersonKommunikation (CPK), Institute for Electronic Systems (IES),
Aalborg University, Denmark, May. Mc Kevitt, Paul (1998) SuperinformationhighwayS
and IntelliMedia 2000+: bringing together humanities, science, and engineering
In WWW and printed Proceedings of the International Conference on
The Future of the Humanities in the Digital Age: problems and perspectives
for humanities education and research. University of Bergen, Bergen,
Norway, September. (http://www.hd.uib.no/AcoHum/abs/McKevitt.htm)