Despite the widespread use of mobile devices, details of mobile technology use ‘in the wild’ have proven difficult to collect. In this talk I discuss using video data to gain new insight into the use of mobile computing devices. Our new method combines screen-capture of iPhone use with video recordings from wearable cameras. I use this data to analyse how mobile device use is threaded into other co- present activities, and how interaction with others is managed simultaneously with device use. Close analysis reveals novel aspects of gestures on touch screens, how they serve ‘double duty” - both as interface gestures but as resources for ongoing joint action. In conclusion, I argue that mobile devices - rather than pushing us away from the world around us - are instead just another thread in the complex tapestry of everyday interaction.(more...)
Computer-based graphical user interfaces tend to trap users in a 'beginner mode' of operation. While user interface design guidelines advocate the provision of shortcut facilities for experts, it is known that most users persistently fail to adopt these methods, consequently
impairing their productivity for months, years, and decades of use.
I will introduce four domains for potential performance improvement: intramodal improvement within a single interface method; intermodal improvement that occurs between methods; vocabulary extension, in which the user broadens their knowledge of the range of functions available; and task mapping, which examines how users perform their tasks, including task learning and strategies. I will also review several of our research systems that demonstrate promising approaches for facilitating transitions to expert performance.(more...)
Displays for computers increase in both physical size and resolution. Whereas these increases improve much human-computer interaction, it is not clear how to design information visualizations that benefit from large, high-resolution displays. In this talk, I will present ongoing work on University of Copenhagen to adapt visualizations for large displays and to evaluate their usefulness.(more...)
The importance of emotional expression as part of human communication has been understood since the seventeenth century, and has been explored scientifically since Charles Darwin and others in the nineteenth century. Recent advances in Psychology have greatly improved our understanding of the role of affect in communication, perception, decision-making, attention and memory. At the same time, advances in technology mean that it is becoming possible for machines to sense, analyse and express emotions. We can now consider how these advances relate to each other and how they can be brought together to influence future research in perception, attention, learning, memory, communication, decision-making and other applications.
This talk will survey recent advances in theories of emotion and affect, their embodiment in computational systems, the implications for general communications, and broader applications. The combination of new results in psychology with new techniques of computation on new technologies will enable new applications in commerce, education, entertainment, security, therapy and everyday life. However, there are important issues of privacy and personal expression that must also be considered.(more...)