Models of Attention in Computing and Communication: From Principles to Applications

Communications of the ACM 46 |

Published by ACM

Over the last five years, our team at Microsoft Research has explored, within the Attentional User Interface (AUI) project, opportunities for enhancing computing and communications systems by treating human attention as a central construct and organizing principle. We introduced to the research community a broad array of AUI challenges and opportunities, including (1) the treatment of attention as a rare commodity and critical currency in sensing and reasoning about the information awareness versus disruption of users, (2) the use of attentional cues as an important source of rich signals about goals, intentions, and topics of interest, and (3) the triaging of computation, bandwidth, and rendering resources in guiding precomputation and prefetching with forecasts of future attention. We shall first describe several principles and methodologies centering on integrating models of attention into human-computer interaction. Then, we shall review representative efforts that illustrate how we can harness these principles in attention-sensitive messaging and mixed-initiative interaction applications.

Information Agents: Directions and Futures (2001)

In this internal Microsoft video, produced in 2001 and released publicly in 2020, research scientist Eric Horvitz provides glimpses of a set of research systems developed within Microsoft’s research division between 1998 and 2001. Projects featured in the video include Priorities, Lookout, Notification Platform, DeepListener, and Bestcom. The projects show early uses of machine learning, perception, and reasoning aimed at supporting people in daily tasks and at making progress on longer-term missions of augmenting human intellect. The efforts are thematically related in their pursuit of broader understandings of people and context, including a person’s attention, goals, activities, and location, via multimodal signals, involving the analysis of multiple streams of information. Several of the prototype systems were built within the Attentional User Interface (AUI) project, which…

Demonstration of Priorities & Notification Platform (2001)

Eric Horvitz with Bill Gates at Envision 2001 In this 2001 video, Bill Gates hosts Eric Horvitz at the Envision 2001 meeting. Eric demonstrates the Priorities and Notification Platform systems. Priorities, fielded internally at Microsoft in 1998, demonstrated the use of machine learning to control email prioritization, alerting, and routing. Priorities is the first system to prioritize email by urgency. The system was an ancestor of the Outlook Mobile Manager and Outlook’s Focus Inbox. Priorities sorts incoming email by assigning a measure of the “expected cost of delayed review” to each incoming email message. The system learns by observing users interact with email or via direct input from users. In a mobile messaging function, Priorities selectively routes the most urgent messages to users’ cellphones via…