Bradley Vines' Gesture Movie Clips with descriptions.



  Description 56k 100k DSL
Performer R, Significant Region

During this temporal region of the performance, the visual image served to significantly dampen the experience of tension for those who could both hear and see the musician. A functional F-test was used to compare the Auditory only judgments with the Auditory+Visual judgments to determine when seeing the performer had a significant impact. Note that the calm and controlled movements of the performer contrasted with the fast moving notes and wide pitch range.

56k Clip 100k Clip Highspeed Clip
Performer R, Transition

1) During this segment of the performance, a major transition occurred between sections one and two of the piece. The clarinetist's posture extended beyond the sound (which lead to a lengthening of the sense of phrasing for those who could see the musician) and certain gestures, like a short breath, cued the new section after the pause (which lead to an earlier sense of phrasing for those who could see the musician). 

2) We also found that the Auditory+Visual judgments differed significantly from the Auditory only judgments just before the new section began, as determined by a functional F-test; the Auditory+Visual tension judgments dropped before the Auditory only judgments. Changes in the clarinetist's facial expression and posture anticipated an approaching change in the mood of the piece. We posit that these visual stimuli lead to the divergence of the Auditory+Visual group from the Auditory only group.

56k Clip 100k Clip Highspeed Clip
Performer W, Significant Region

During this temporal region of the performance, the visual image served to significantly increase the experience of tension for those who could both hear and see the musician. A functional F-test was used to compare the Auditory only judgments with the Auditory+Visual judgments to determine when seeing the performer had a significant impact. Note that the emotional and expressive gestures of the clarinetist contrasted with the soft, slow moving notes with low pitch height.

56k Clip 100k Clip Highspeed Clip
Performer W, Transition

1) During this segment of the performance, a major transition occurred between sections one and two of the piece. The clarinetist's gestures extended beyond the sound (which lead to a lengthening of the sense of phrasing for those who could see the musician)  and certain movements, like the swooping clarinet, cued the new section after the pause (which lead to an earlier sense of phrasing for those who could see the musician).

2) We focused upon this performance segment to demonstrate the usefulness of phase-plane plotting, differential calculus and analogies to physics for music cognition research. Based upon that analysis we posit that events in the music can influence affective acceleration directly and with little delay, and we may conclude that the theoretical techniques that we introduced are useful for comparing different sets of judgments: The phase-plane plot revealed how the temporal dynamics of the Auditory+Visual, Auditory only and Visual only judgments differed.

56k Clip 100k Clip Highspeed Clip