Progress on Medical Interfaces for Multimodal Accessibility

Multimodal sensory interfaces display information content (and perhaps controls) in more than one sensory mode. It relates to accessibility, and clearly has implications for future interfaces for accessible medical insturmentation. For more information, see our review of some of the ongoing national and international activities in this area, especially as related to the W3C's Multimodal Interaction Activity and the V2 Standard for "Universal Remote Consoles" (URCs) for "Target" devices and services.

One target for D3.2 has been on D3 technical reports. The specific targets will be refined based on the results of Program R.1/Needs Analyses. In the interim, the focus has been on the development of technological reports in targeted areas related to the objectives of this project, produced by students and staff as adjunct to their primary project. There are two types of reports: 1) areas related to evolving or emerging standards (e.g., HL7, V2), and 2) areas where the focus is on creation of product tables. To date, activity has primarily been during the summer 2003 and summer 2004. Reports are expected to be placed on the web for most of these areas during October 2004.

The primary target of D3.1 development activities has been the V2 standard. The V2 standard for Universal Remote Consoles. International Committee for Information Technology Standards (INCITS) is a suite of emerging standards that allows operation of device/service through intermediate devices and intelligent agents. V2 standards build on existing network and communication standards, adding components and capabilities as necessary to allow for user interface descriptions that are standardized flexible and versatile. They are network neutral, and work with diverse networking and control technologies including Universal Plug and Play (UPnP), etc. The standards describe methods in which a device/service (called a Target in the V2 standards) can be used to provide user interface information for any remote console, which in the V2 standard is called a URC (Universal Remote Console), or intelligent agent. This information intended to be sufficient to dynamically construct a full function user interface for the device/service; the intent is to enable any of visual, audio or natural language interfaces to be constructed, given the appropriate describing documents .Along with three other RERCs, we are a member of INCITS-V2.

• V2 as Device: This project addresses control/display interfaces for three classes of common medical “target” devices, all of which build on available student technical reports: home medical “vital sign” monitors, exercise monitors, and exam table/bed controls.
• V2 as Service: This project addresses how UniTherapy, a telerehabilitation platform primarily for computer-assisted motivating rehabilitation applications, is being turned into an accessible service. This process has involved transformation to a service-oriented universal access infrastructure that supports intelligent context-awareness user interface generation that is dependent on current and emerging standards such as the V2 standard. The V2 infrastructure, expanded by non-V2 components specific to UniTherapy is shown in the diagram below, which borrows from the work of the Trace Center and the "myurc" web site dedicated to V2, describes the approach.

The V2 diagram shown above for the overall framework (in an enclosed black box) comes from http://www.myurc.com/, authored by Zimmermann and Vanderheiden. This diagram extends this V2 conceptualization by UniTherapy specific components. The discovery and control session between target and URC is connected by Target-URC Network. Out of band, the lower blocks in line with the “direct link” are specific to UniTherapy in order to provide a high-speed connection for performance session; a Target Intelligent Agent will be used to optimize the Target functionalities based on user’s performance data and context information such as loaded protocol; also, the User Accessibility Resources (top right) are supplemental resources needed by a URC to customize user interface design when using UniTherapy.

An outgrowth of this work is our MUPad software tool, which was designed by Xin "Tyre" Feng and provides an interface for generating V2-compliant xml documents.