MoSound: An Interactive Tool for Generative Sound Design in Motion Graphics

Volume:

(A) User Interface with multiple audio events (B) Mapping x to stereo panning (C) Mapping v to volume Figure 1: Generating effects sounds from motion graphics videos via MoSound. Given a motion graphics video, our interactive system extracts the key events and generates the corresponding sound effects. (A) The user interface of our system, which includes views of the automatically extracted visual events, their timing, and descriptions of the graphics and motions. From there, the user can choose how to map the visual events to the sound effects, preview the generated sound effects, and export the final audio. (More details are in Figure 3.) (B,C) Several keyframes of an example video, along with the corresponding guide sounds from the extracted motions, suggested prompts, and final effect sounds generated by MoSound. Please see the accompanying video for animation and sound effects. Water video © Alejandro Imondi.