Ian here—
The following is the spoken presentation version of my talk from DiGRA’s 2014 conference in Snowbird, UT. The full paper, as drafted up for the conference’s proceedings, is available here. You can follow along with the visual presentation for this spoken version here.
Today, I’d like to address a cluster of game user interface design options that I have lumped together under the category of synesthetic interfaces. By this, I’m referring to interfaces that perform a sensory substitution, translating the information normally associated with one sense modality into the phenomenal forms normally associated with another. This is part of a larger interest of mine of examining approaches within game UI design in terms of the epistemic strategies they enact when establishing the relation of players to their avatars, and avatars to their worlds.