Gestural Control of a Real-Time Model of a Bowed String Instrument

Authors

Stefania Serafin, Richard Dudas, Marcelo M. Wanderley, Xavier Rodet

Abstract

In this paper we discuss the real-time simulation of a physical model of a bowed string instrument by means of alternative gestural controllers. We focus on the model’s behaviour when submitted to different bow strokes performed on a graphical tablet using different types of transducers. The tablet was chosen because it allows a performer to reproduce most of the basic physical gestures of bow strokes in a natural way.

Download the entire paper in PDF format

Published in:

Where this paper has been cited:

• Van Nort, D.,  Wanderley, M., Depalle, P., “Mapping Control Structures for Sound Synthesis: Functional and Topological Perspectives”, Computer Music Journal, Volume 38 Issue 3, MIT Press, 2014.

• Seipel, F., X&M: A digital Musical Instrument Using Three-Dimensional Gesture Recognition, Bachelor’s Thesis, Hochschule Darmstadt University of Applied Sciences, 2014.

• Gualtieri, Jean-Sébastien, Application de réseaux de capteurs sans fils : apprentissage de chants polyphoniques corses, Doctoral Thesis, Université de Corse – Pascal Paoli, 2013.

• Carrillo, A. P. et al., “Performance Control Driven Violin Timbre Model Based on Neural Networks”, IEEE Transactions on Audio, Speech, and Language Processing, Vol. 20 No.3, 2012.

• Young, Diana, “Measurement of bowed string dynamics”, U.S. Patent No. 8,109,146, 2012.

• Murphy, Ben, The electronic sensor bow: a new gestural control interface, Master of Arts (Research) thesis, Faculty of Creative Arts, University of Wollongong, Australia 2011.

• Saitis, Charalampos, “On the use of force-feedback haptics for gestural control of sound synthesis by physical modelling”, MUMT620 / Final Project Report, McGill University, Quebec, Canada, 2010.

• Sinclair, S., Florens, J-L., Wanderley, M. M., “A haptic simulator for gestural interaction with the bowed string”, 10ème Congrès Français d’Acoustique, Lyon, France, 2010.

• Demoucron, M, Rasamimanana, N., “Score-based real-time performance with a virtual violin”, Proceedings of the 12th International Conference on Digital Audio Effects (DAFx), Como, Italy, 2009.

• Demoucron, Matthias, On the control of virtual violins – Physical modeling and control of bowed string instruments, Doctoral Thesis, KTH School of Computer Science and Communication, Stockholm, Sweden, 2008.

• Pimenta, M. S. et al, “O Theremin Virtual: Usando Dispositivos de Realidade Virtual em Experimentos Musicais”, 11th Brazilian Symposium on Computer Music, University of São Paulo, Brazil, 2007.

• Sinclair, Stephen, Force-feedback hand controllers for musical interaction, MA Dissertation, McGill University, Montreal, Quebec, Canada, 2007.

• Young, Diana, A Methodology for Investigation of Bowed String Performance Through Measurement of Violin Bowing Technique, Ph.D. Dissertation, Massachusetts Institute of Technology, 2007.

• Momeni, A., Henry, C., “Dynamic Independent Mapping Layers for Concurrent Control of Audio and Video Synthesis”, Computer Music Journal, Volume 30 Issue 1, MIT Press, 2006.

• Haidenko, Igor,  Роль музыкальных компьютерных технологий в современной композиторской практике [The Role of Computer Music Technology in Modern Compositional Practice], Doctoral Dissertation, Kharkiv State University of Arts named after I.P. Kotlyarevsky, Ukraine, 2005. (alternate Ukranian translation with English abstract can be found here, although it is missing the references)

• Harvey, Ryan B., “A Survey of Research on the Use and Development of Physical Models and Nonlinear Dynamics for Music and Sound Synthesis”, MS degree Scholarly paper, Applied Mathematics and Scientific Computing, University of Maryland, 2004.

• Jordà, Sergi, “Instruments and Players: Some thoughts on digital lutherie”, Journal of New Music Research, 33.3, Taylor & Francis, 2004.

• Serafin, Stefania, The Sound of Friction: Real-Time Models, Playability and Musical Applications, PhD Dissertation, Stanford University, 2004.

• Wanderley, M. M., Depalle, P., “Gestural control of sound synthesis”, Proceedings of the IEEE, Vol. 92 Issue 4, 2004.

• Peiper, C.,  Warden, D., Garnett, G., “An interface for real-time classification of articulations produced by violin bowing”, Proceedings of the 3rd International Conference on New Interfaces for Musical Expression (NIME), Montreal, Canada, 2003.

• Strange, P., Strange, A., The Contemporary Violin: Extended Performance Techniques, Scarecrow Press, 2003.

• Young, D., Serafin, S., “Playability evaluation of a virtual bowed string instrument”, Proceedings of the 3rd International Conference on New Interfaces for Musical Expression (NIME), Montreal, Canada, 2003.

• Arfib, D., Couturier, J. M. et al., “Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces”, Organised Sound, Volume 7, Issue 02, August 2002, Cambridge University Press, UK, 2002.

• Kessous, Loïc, “Bi-manual mapping experimentation, with angular fundamental frequency control and sound color navigation”, Proceedings of the 2nd International Conference on New Interfaces for Musical Expression (NIME), Dublin, Ireland, 2002.

• Wanderley, M. M., Orio, N., “Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI”, Computer Music Journal, Fall 2002, Vol. 26, No. 3, MIT Press, 2002.

• Strange, P., Strange, A., The Contemporary Violin: Extended Performance Techniques, First Edition, University of California Press, 2001.

• Wanderley, Marcelo M. “Gestural control of music”, International Workshop Human Supervision and Control in Engineering and Music, 2001.

• Wanderley, M. M., Serra, M.-H. et al., “Gestural control at IRCAM”, Proceedings of the International Computer Music Conference (ICMC), Havana, Cuba, 2001.

• Serafin, S., Dudas, R., “An alternative controller for a virtual bowed string instrument”, M.M. Wanderly and M. Battier, eds., Trends in Gestural Control of Music (CD-ROM), IRCAM, Paris, France 2000.

• Takala, T., Hiipakka, J. et al., “An Expressive Synthesis Model for Bowed String Instruments”, Proceedings of the International Computer Music Conference (ICMC), Berlin, Germany, 2000.

• Wanderley, M. M., Viollet, J.-P. et al., “On the Choice of Transducer Technologies for Specific Musical Functions”, Proceedings of the International Computer Music Conference (ICMC), Berlin, Germany, 2000.

• Serafin, S., Vergez, C., Rodet, X., “Friction and Application to Real-Time Physical Modeling of a Violin”, Proceedings of the International Computer Music Conference (ICMC), Beijing, China, 1999.