Blog
Gesture visualization in Blek (2013) and Yellowtail (1998)
Recently I came across the iOS game Blek, since it won a 2014 Apple Design Award: https://developer.apple.com/design/awards/2014/Blek/ I found Blek interesting due to its emphasis on gestural patterns and gesture visualization. The gesture visualiza... Read More
Interaction models and taxonomies
(to be developed with more references and notes) Diefenbach, S., Lenz, E. & Hassenzahl, M., 2013. An Interaction Vocabulary. Describing the How of Interaction. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems. CHI EA ’13.... Read More
Sonic Interaction Design (SID) and related concepts
Sonic Interaction Design (SID) is one of several concepts related to sonification of data or interaction. SID “explores ways in which sound can be used to convey information, meaning and aesthetic and emotional qualities in interactive context... Read More
“Classic” artistic models of sound visualisation
In his book Analysing Musical Multimedia, Nicholas Cook reviews "classic" artistic models of sound and music visualisation, by: Kandinsky, Messianen, Skriabin, Schoenberg, Eisenstein, Eisler, adding his own model. Cook, N., 2000. Analysing ... Read More
Back to the “classics” of interaction design
For developing AVUI, it is useful to go back to some "classics" of interaction design: Buxton, B., 2007. Sketching User Experiences: Getting the Design Right and the Right Design, San Francisco: Morgan Kaufmann. Gaver, W.W., 1991. Technology Affo... Read More
Papers on programming libraries and tools
Roberts, C., Wakefield, G. & Wright, M., 2013. The Web Browser As Synthesizer And Interface. In Proceedings of New Interfaces for Musical Expression (NIME). Daejeon, Seoul. Available at: https://www.mat.ucsb.edu/Publications/WebBrowser-as-Synth... Read More
An analytical framework for facilitating interactivity
From: Her, J.-J., 2013. An analytical framework for facilitating interactivity between participants and interactive artwork: case studies in MRT stations. Digital Creativity, 0(0), pp.1–13. Analytical framework containing five engaging char... Read More
Identifying related research within the community
For the purpose of identifying potential partnerships and building a research network, I've been meeting researchers conducting similar research within the Goldsmiths / University of London community. Below are some of the projects and groups I've be... Read More
Research proposal – literature review on HCI and AV feedback
Audiovisual relationships have been explored in Human-Computer Interaction (HCI) to enhance the user experience and usability, and facilitate content generation. Among the application fields for this exploration, focusing on sound visualization:... Read More
Doctoral thesis – Contextualization: sound, image and interaction
Reviewing the contextualization section of my doctoral thesis (PDF available here): 2.1 Historical context and main influences in audiovisual art 42 2.2 Related concepts 48 2.2.1 Visual music and audiovisual 48 2.2.2 VJing 48 2.2.3 Synesthesia 50 2.... Read More