For my final I decided to create an apartment building where clicking each window opens the blinds and displays a hand drawn, animated scene. Each scene has a unique audio track and the user can turn the windows on and off to layer the sound and videos. Certain scenes are linked to create a more varied interaction: the trumpet playing makes the dog start barking, one tenant arguing makes the other argue back, and the household chores (cooking, cleaning, practicing the trumpet) will only go on for a limited period of time before they need to be restarted. The fairly untidy code can be seen here.

I have a couple of thoughts that I still haven't completely decided between for the final.

Idea one) using two potentiometers control a series of audio tracks (shuffle through them) and a series of video clips (a scene from Seinfeld, the nightly news, home movie, nature doc, etc) - thus combining different audio tracks to varying effect with the video.

Idea two) involves a kind of animation where a cutaway of a building's interior (or possibly just small elements are visible through windows) allows the user to trigger different animated and sound elements based on where they click. (ex: clicking a home radio triggers music, clicking a window triggers the family's audio, clicking this window makes a couple dance across the frame). I'm drawn to a silhouetted style like the image below.

word counter in the final presidential debate.
click for code

Using the built in webcam, when your highlighter is raised a video of bird flight is triggered. It will continue to loop as long as the highlighter is visible to the camera.

Link to video


Click image for code.

pinwheel test, click for code.