Speech Technology Magazine


Biographical Information

James A. Larson
Vice President
Larson Technical Services

James A. Larson, Ph.D., is co-chair of the W3C Voice Browser Working Group and chair of the authoring subgroup of the W3C Multimodal Interaction Working Group. He writes the Forward Thinking column for Speech Technology magazine, and teaches courses in the user interface design and implementation at the Portland State University and the Oregon Health and Sciences University. He is Vice President of Larson Technical Services, a speech application consulting and training company.

Articles By James A. Larson

Machine Learning and Innovative Speech Applications Dominate Conversational Interaction Conference

The 2019 Conversational Interaction Conference emphasized innovative applications using the latest speech technologies, alternative architectures to ease the creation of conversational apps, and best practices for designing speech dialogs.
Posted 20 Mar 2019 - - by James A. Larson

Is App Development Moving Toward User Interface Management Systems?

App developers' jobs might be getting less complicated, again
Posted 26 Nov 2018 - Fall 2018 Issue - by James A. Larson

8 Ways Advances in Speech Recognition Will Affect Our Lives

From karaoke assistance to talking robots, here's a roundup of speech industry developments you'll be hearing about soon
Posted 30 Jul 2018 - Spring 2018 Issue - by James A. Larson

Intelligent Agents Are Poised to Change the Conversation

These apps can already understand what you say; soon they'll understand who you are and how you're feeling
Posted 10 Nov 2017 - Winter 2017 Issue - by James A. Larson

What Will Future User Interfaces Look Like?

As we enter the 'immersive age,' we need to prepare for a whole new way of interacting
Posted 24 Apr 2017 - Summer 2017 Issue - by James A. Larson

Interactive Text Response: A Smart Update of IVR

ITR systems let callers blend texting and talking
Posted 10 Nov 2016 - Winter 2016 Issue - by James A. Larson

In a Mobile World, Voice and Graphical User Interfaces Need to Blend

Developers have to design both visual and voice experiences for today's devices
Posted 14 Jun 2016 - Summer 2016 Issue - by James A. Larson

Many Gadgets, One Interface

In the smart home of the (near) future, a unified user interface—letting you touch, type, or speak—will control all of your systems and devices
Posted 09 Nov 2015 - Winter 2015 Issue - by James A. Larson

Role-Play Apps Star in New Technologies

It's time to leverage developers' know-how to improve lives
Posted 08 May 2015 - Summer 2015 Issue - by James A. Larson

With Product Companion Apps, the Mobile Future Looks Even Brighter

Up-and-coming tools add new accessibility to product information.
Posted 10 Nov 2014 - Winter 2014 - by James A. Larson

Voice XML Brings IVR into the Future

Continuing demand gives these applications an impetus for improvement.
Posted 30 Apr 2014 - Summer 2014 - by James A. Larson

Eyes-Busy, Hands-Busy Computing

What we all have in common with an HVAC repairman.
Posted 15 Nov 2013 - Winter 2013 - by James A. Larson

Assessing Speech-Enabled Help Apps

Users seeking voice-enabled service and support have several choices.
Posted 01 May 2013 - Summer 2013 - by James A. Larson

A New Age for Computer Interactions

Advances emphasize the role of the human mind.
Posted 10 Nov 2012 - November/December 2012 - by James A. Larson

Job Descriptions for Personal Assistants

Radar O'Reilly is a tough act to follow.
Posted 10 Jul 2012 - July/August 2012 - by James A. Larson

Balancing Content and Control

When consumers use multiple devices, give help where it's needed.
Posted 01 Mar 2012 - March/April 2012 - by James A. Larson

IVR Has a Black Eye

Stop using frugal policies and start satisfying customers.
Posted 01 Nov 2011 - November/December 2011 - by James A. Larson

Multimodal User Interfaces Supplanting Voice-Only Apps

Trend driven by statistical language models, speaker verification, video clips, and multilingual apps
Posted 01 Jul 2011 - July/August 2011 - by James A. Larson

Combining IVR and Smartphones

Take advantage of today's visual displays and develop consumer product apps
Posted 01 Mar 2011 - March/April 2011 - by James A. Larson

Speech in My Pocket

With the smartphone's growing popularity comes a slew of new speech apps.
Posted 01 Nov 2010 - November/December 2010 - by James A. Larson

Adding a Voice to Tweets

Social media can incorporate voice to better engage users.
Posted 01 Jul 2010 - July/August 2010 - by James A. Larson

Grammatically Speaking

Setting the standard for determining what a caller wants
Posted 05 Mar 2010 - March/April 2010 - by James A. Larson

Legal Issues Surrounding Speech

Who will get the ball rolling on creating the rules?
Posted 01 Nov 2009 - November/December 2009 - by James A. Larson

Beyond Speech Recognition

User property extraction systems pull more information.
Posted 27 Aug 2009 - September 2009 - by James A. Larson

On-Demand Services and Mashups

Both allow for greater use of voice on mobile devices
Posted 01 Jun 2009 - June 2009 - by James A. Larson

Avoid the "Old-Folks' Home" with a Speech-Enabled House

Technology exists to help the elderly live on their own.
Posted 02 Apr 2009 - March/April 2009 - by James A. Larson

Tomorrow's Technologies, Today's Applications

We need to look beyond basic processing to fuller understanding.
Posted 01 Nov 2008 - November/December 2008 - by James A. Larson

Who Will Win the GUI-VUI Race?

Multimodal applications present a new type of user interface.
Posted 22 Aug 2008 - September 2008 - by James A. Larson

The Evolution of IVR Systems

The next phases of IVR development centers on multimodality and faster transactions.
Posted 01 Jun 2008 - June 2008 - by James A. Larson

The Expanding Speech Tech Universe

New stars present opportunities for using speech technologies.
Posted 01 Apr 2008 - April 2008 - by James A. Larson

Escaping from Directed Dialogues

Creating and implementing automatic classifiers is not as easy as it sounds.
Posted 25 Jan 2008 - January/February 2008 - by James A. Larson

Extending VoiceXML's Impact to New Markets

Technology is available to handle many of the more mundane translation tasks
Posted 01 Oct 2007 - October 2007 - by James A. Larson

SISR: The Standard Semantic Interpretation Language

Speech vendors should support SISR for easier porting of grammars and applications between platforms
Posted 09 Jul 2007 - July/August 2007 - by James A. Larson

Multimodal Mobile Apps Will Thrive

Electronic companions are the wave of the future in consumer electronics
Posted 01 May 2007 - May 2007 - by James A. Larson

Policies and Technologies for Improving the Customer Experience

The customer experience isn't about completion rates and ROI; it's about achieving an intended task easily, efficiently, and even enjoyably
Posted 01 Mar 2007 - March 2007 - by James A. Larson

Toward Natural Language Processing

When many people hear the words, "natural language," they immediately think of Star Trek's android, Data, who speaks and understands everyday English. Some software vendors claim anything beyond discrete speech recognition (in which users must pause between speaking each word) as "natural."
Posted 09 Nov 2006 - November/December 2006 - by James A. Larson

Speaking and Listening to the World Wide Web

Developing and sharing content is a growing activity on the Internet. In addition to passively observing Internet content, users are actively adding to it by uploading their pictures to flickr.com, and sharing their thoughts in blogs and wikis. Readers rate books on amazon.com, and teens post real and fantasy personas on the extremely popular myspace.com, hoping to attract the attention of other teens.
Posted 12 Sep 2006 - September/October 2006 - by James A. Larson

Rolling Out High-Value Applications Services in Record Time

Case study by PIKA Technologies>

NuVoxx focuses on developing and marketing advanced IVR (Interactive Voice Response) services, which it  provides on a hosted model on a pay-per-use basis. The company also builds productivity solutions for call centers, and recently developed and deployed an advanced call recording and monitoring solution for NuComm International, its sister company and the largest privately-held Canadian provider of customer relationship and contact center services.>

Posted 13 Jun 2006 - - by James A. Larson

Mom and Pop Shops Gain a Voice

Three trends that enable IVR systems for mom and pop shops without costing an arm and a leg include prepackaged applications, free starter VoiceXML platforms, and reusable dialog components.
Posted 08 May 2006 - May/June 2006 - by James A. Larson

Improve the User Experience

Graphical user interfaces have been the standard user interface for computer users for over 20 years. It's time to up-level the user's computing experience by voice-enabling applications.
Posted 01 Mar 2006 - March/April 2006 - by James A. Larson

Metalanguages and AJAX

Because many telephones do not have hardware that supports speech processing, a voice server is placed in the network to act as a client on behalf of telephones.
Posted 01 Jan 2006 - January/February 2006 - by James A. Larson

VoiceXML on Steroids

Researchers and practitioners are extending VoiceXML using various techniques to provide new functionality. These include the RDC library tags, xHMI meta language, and a prototype implementation of VoiceXML which supports dictation speech recognition. RDC Tag Library – Developers frequently use Struts1 or other application frameworks to generate HTML. The goal of the Reusable Dialog Component (RDC) project is to provide a similar framework for VoiceXML. Like Struts, RDC has a tag library that hides the…
Posted 07 Nov 2005 - November/December 2005 - by James A. Larson

Ten Criteria for Measuring Effective Voice User Interfaces

A Toolkit of Metrics for Evaluating VUIsInvestors use standard metrics such as stock price and projected revenue per share to choose investment opportunities. Likewise, consumers use standard metrics such as floor space, number of bedrooms, or number of bathrooms when purchasing houses. This paper presents a toolkit containing some specific metrics for evaluating voice user interfaces (VUIs). The speech industry should use criteria from this toolkit to: Judge the most efficient of several VUIs for…
Posted 07 Nov 2005 - November/December 2005 - by James A. Larson

Consistent User Input Options and Instructions Across Multiple User Interfaces

Many Web developers use XML to represent data and a transformation language, such as XSLT, ASP, or ColdFusion, to transform the XML data to an HTML user interface. Developers change the values of the XML data without having to manually recode the HTML user interface.
Posted 20 Jun 2005 - July/August 2005 - by James A. Larson

Regaining Consumer IVR Confidence: Companies Draw on Different Tools to Save IVR/Speech Interaction

Michael Chavez, vice president of client services at ClickFox, explains that "by leveraging a strategic combination of customer behavior intelligence, customer service interviews and surveys, organizations can reduce customer frustration with IVR systems, which will result in drastic savings, while also improving customer satisfaction."
Posted 01 May 2005 - - by James A. Larson

Synthetic Interviews: Beyond History Calls

Matt Nickerson describes how mobile phones enable callers to speak and listen to virtual agents. Using the same device to speak with family, friends and business associates, callers speak with software agents that enable synthetic interviews with individuals in photographs of historical events in a museum. This represents a new way of interacting with objects that are usually only viewed.
Posted 26 Apr 2005 - May/June 2005 - by James A. Larson

Ten Guidelines for Designing a Successful Voice User Interface

At SpeechTEK 2004, a group of leading VUI designers attended the Voice User Interface (VUI) workshop directed by Dr. James A. Larson. Taking the lead for an article on the best practices in VUI, Dr. Larson collected and coordinated this team of VUI specialists to compile the Ten Guidelines for Designing a Successful Voice User Interface. Speech Technology Magazine would like to thank the authors for their contributions to this article and Dr. Larson for…
Posted 06 Jan 2005 - January/February 2005 - by James A. Larson

MRCP Enables New Speech Applications

Have you ever wished you could change your VoiceXML platform to use a speech synthesizer or speech recognizer from a different vendor? Have you ever wanted to move your speech synthesizer or speech recognizer to a different server? The Internet Engineering Task Force is proposing a new standard that will provide this flexibility.
Posted 23 Nov 2004 - November/December 2004 - by James A. Larson

Balancing Customer Service Support Options

Customers often ask questions about products, services, delivery dates and account information, as well as, offer suggestions and complaints. If customers do not receive satisfactory answers to their questions, they become disillusioned with the company and take their business elsewhere. In short, good customer service support is the key to repeat business. …
Posted 23 Nov 2004 - November/December 2004 - by James A. Larson

Beyond XML 2.0

The W3C Voice Browser Working Group reviewed more than 700 requests for change to VoiceXML 1.0. After careful deliberation, many of these were adopted, resulting in VoiceXML 2.0 which became a recommendation in March 2004. The VBWG is now working on two efforts to make VoiceXML even better.
Posted 08 Jul 2004 - July/August 2004 - by James A. Larson , Scott McGlashan

Profiles for Speech Application Users

A user profile contains information that describes how to personalize a speech user interface to meet the needs for a specific user.
Posted 24 May 2004 - May/June 2004 - by James A. Larson

VoiceXML 2.0: A Real Standard for a Real World

New technology will change the way people interact with computers. PCs enabled users to use a keyboard and screen rather than review printed reports. The Xerox Star and Apple Macintosh introduced Graphical User Interfaces (GUIs) which made the mouse and other pointing devices popular. Now, we are on the verge of a revolution in technology that makes computing portable. Separating user interface devices from the computing device will dramatically change how people interact with computers.
Posted 08 Mar 2004 - March/April 2004 - by James A. Larson

Help Users Speak

A speech application does not work if users do not speak when prompted with a question.
Posted 09 Jan 2004 - January/February 2004 - by James A. Larson

EMMA: W3C’s Extended Multimodal Annotation Markup Language

Recently, the W3C Multimodal Working Group published a first working draft of EMMA — the Extended MultiModal Annotation markup language — EMMA (www.w3.org/TR/emma/). EMMA’s intended use is to represent the semantics for information entered via various input modalities and the resulting integrated information.
Posted 25 Nov 2003 - November/December 2003 - by James A. Larson

InkML and Speech

Have you ever been in a place where speaking to a VoiceXML application on a cell phone is impractical? As you know, not all locations or situations are suitable for using speech-enabled handheld devices.
Posted 25 Aug 2003 - September/October 2003 - by James A. Larson

Controlled Languages and Speech Prompts

"Welcome to the Ajax speech application. It is possible to perform any of several actions at any time during this application, including the common actions of asking for help, transferring the call to an operator, stopping the application and returning to the main menu." This sample prompt is too long and confusing for most users. However, by using a controlled language, you can improve the prompt for your customers.
Posted 30 Jun 2003 - July/August 2003 - by James A. Larson

State of Speech Standards

Speech standards include terminology, languages and protocols specified by committees of speech experts for widespread use in the speech industry. Speech standards have both advantages and disadvantages. Advantages include the following: developers can create applications using the standard languages that are portable across a variety of platforms; products from different vendors are able to interact with each other; and a community of experts evolves around the standard and is available to develop products and services based on the standard.
Posted 30 Jun 2003 - July/August 2003 - by James A. Larson

Speech Wars—Round Two

The Voice Browser Working Group has finished the technical work on the three major languages in the W3C Speech Interface Framework—VoiceXML 2.0, the Speech Recognition Grammar Specification, and the Speech Synthesis Markup Language. These languages will soon become “check-off items” in a list of features provided by the leading speech platforms.
Posted 05 May 2003 - May/June 2003 - by James A. Larson

The W3C Speech Interface Framework

In the past three years, the World Wide Web Consortium Voice Browser Working Group has produced several reports that define languages in the W3C Speech Interface Framework. Developers use the W3C Speech Interface Framework languages to create speech applications.
Posted 06 Mar 2003 - March/April 2003 - by James A. Larson

Uniform Basic Function Commands

Information processing and the Internet are merging with the telecommunications industry to develop mobile devices using interactive services with global access. Speech recognition offers the most natural way for consumers to use new communication devices and services.
Posted 14 Jan 2003 - January/February 2003 - by James A. Larson

Developing Verbal, Visual, and Multimodel User Interfaces for the Same Application

PC users access the World Wide Web using a graphical user interface (GUI) that is commonly specified with HTML. Telephone and cell phone users access the Web using a verbal user interface (VUI) often specified with VoiceXML.
Posted 21 Nov 2002 - November/December 2002 - by James A. Larson

The What, Why and How of Usability Testing

As the cartoon illustrates, users become frustrated when speech applications don’t work. Testing minimizes this frustration by detecting and resolving many speech application problems before they cause user frustration.
Posted 10 Sep 2002 - September/October 2002 - by James A. Larson

Telephony Enable Your Web Site

VoiceXML has revolutionized the development of telephony applications, in that telephone users can call Web sites and converse with VoiceXML applications. The system uses a TTS synthesizer or prerecorded voice and users can respond by speaking answers to the questions. Currently VoiceXML is weak in telephony controls. About all you can do in VoiceXML is and , which are powerful enough for many applications, but not powerful enough for many others, such as event notification and conferencing. However, with the coming of new call control capabilities, many of these restrictions will be overcome.
Posted 11 Jul 2002 - July/August 2002 - by James A. Larson

VoiceXML and SALT

VoiceXML and SALT are both markup languages that describe a speech interface. However, they work in very different ways, largely due to two reasons: (i) they have different goals, (ii) they have different Web heritages.
Posted 21 May 2002 - May/June 2002 - by James A. Larson , Stephen Potter

Students Develop Innovative Prototype Speech Applications

Student teams are very creative when asked to design and implement speech applications of their choice. Here are some of the prototype speech applications recently implemented by students at Georgia Institute of Technology, Washington State University, Portland State University and Oregon Health and Sciences University.
Posted 21 May 2002 - May/June 2002 - by James A. Larson

Building User Interfaces for Multiple Devices

Users can choose from among several devices to access the World Wide Web. These devices include PCs with a visual Web browser, such as Netscape's Navigator or Microsoft's Internet Explorer, to interpret HTML files downloaded from a Web server and executed on the PC; telephones and cell phones with a verbal browser to interpret VoiceXML files downloaded from a Web server and executed on a voice server; and WAP phones with a visual browser to interpret WML files downloaded from a server and executed on the WAP phone.
Posted 29 Mar 2002 - March/April 2002 - by James A. Larson

IBM’s New Toolkit Connects with a Family of Developers

The goal of speaking to your computer, and having it do what you say, has been a goal of IBM’s speech recognition research team for over 25 years.