Blog

Gesture visualization in Blek (2013) and Yellowtail (1998)

Recently I came across the iOS game Blek, since it won a 2014 Apple Design Award: https://developer.apple.com/design/awards/2014/Blek/ I found Blek interesting due to its emphasis on gestural patterns and gesture visualization. The gesture visualiza... Read More


Interaction models and taxonomies

(to be developed with more references and notes) Diefenbach, S., Lenz, E. & Hassenzahl, M., 2013. An Interaction Vocabulary. Describing the How of Interaction. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems. CHI EA ’13.... Read More


Sonic Interaction Design (SID) and related concepts

Sonic Interaction Design (SID) is one of several concepts related to sonification of data or interaction. SID “explores ways in which sound can be used to convey information, meaning and aesthetic and emotional qualities in interactive context... Read More


“Classic” artistic models of sound visualisation

In his book Analysing Musical Multimedia, Nicholas Cook reviews "classic" artistic models of sound and music visualisation, by: Kandinsky, Messianen, Skriabin, Schoenberg, Eisenstein, Eisler, adding his own model. Cook, N., 2000. Analysing ... Read More


Back to the “classics” of interaction design

For developing AVUI, it is useful to go back to some "classics" of interaction design: Buxton, B., 2007. Sketching User Experiences: Getting the Design Right and the Right Design, San Francisco: Morgan Kaufmann. Gaver, W.W., 1991. Technology Affo... Read More


Papers on programming libraries and tools

Roberts, C., Wakefield, G. & Wright, M., 2013. The Web Browser As Synthesizer And Interface. In Proceedings of New Interfaces for Musical Expression (NIME). Daejeon, Seoul. Available at: https://www.mat.ucsb.edu/Publications/WebBrowser-as-Synth... Read More


An analytical framework for facilitating interactivity

From: Her, J.-J., 2013. An analytical framework for facilitating interactivity between participants and interactive artwork: case studies in MRT stations. Digital Creativity, 0(0), pp.1–13. Analytical framework containing five engaging char... Read More


Identifying related research within the community

For the purpose of identifying potential partnerships and building a research network, I've been meeting researchers conducting similar research within the Goldsmiths / University of London community. Below are some of the projects and groups I've be... Read More


Research proposal – literature review on HCI and AV feedback

Audiovisual relationships have been explored in Human-Computer Interaction (HCI) to enhance the user experience and usability, and facilitate content generation. Among the application fields for this exploration, focusing on sound visualization:... Read More


Doctoral thesis – Contextualization: sound, image and interaction

Reviewing the contextualization section of my doctoral thesis (PDF available here): 2.1 Historical context and main influences in audiovisual art 42 2.2 Related concepts 48 2.2.1 Visual music and audiovisual 48 2.2.2 VJing 48 2.2.3 Synesthesia 50 2.... Read More