Pitch and timbre manipulations using cortical representation of sound

TitlePitch and timbre manipulations using cortical representation of sound
Publication TypeConference Papers
Year of Publication2003
AuthorsZotkin DN, Shamma SA, Ru P, Duraiswami R, Davis LS
Conference NameMultimedia and Expo, IEEE International Conference on
Date Published2003///
PublisherIEEE Computer Society
Conference LocationLos Alamitos, CA, USA
ISBN Number0-7803-7965-9

The sound receiver at the ears is processed by humans using signal processing that separate the signal along intensity, pitch and timbre dimensions. Conventional Fourier-based signal processing, while endowed with fast algorithms, is unable to easily represent signal along these attributes. In this paper we use a cortical representation to represent the manipulate sound. We briefly overview algorithms for obtaining, manipulating and inverting cortical representation of sound and describe algorithms for manipulating signal pitch and timbre separately. The algorithms are first used to create sound of an instrument between a guitar and a trumpet. Applications to creating maximally separable sounds in auditory user interfaces are discussed.