Phillip and Patricia Frost Museum of Science Immersive Media Wall

In 2014 we were contracted by local South African company Formula-D to help produce a Virtual Gulf Stream for the new high-tech Phillip & Patricia Frost Museum of Science in Miami.

The interactive wall spanned 90 feet with 4K projection and 12 channel dynamic audio. Watch the video to see a timelapse of the configuration and testing prior to opening.

Combining 3D renders and real time schooling (flocking) behaviour interweaved with pre-produced video created an all-in immersive experience. The entire project was built in OpenFrameworks - just another testament to this visual coding framework.

For the audio we built a bespoke communication between OpenFrameworks and Ableton Live to control the 12-channel directional audio. Videos with audio would be spawned when a person is close to the wall giving the sense that the visitor has interacted with the on-screen fish all the while ambient audio would be dynamically altered to enhance this sense.

This was a challenging project with lots of curve balls but a great achievement for Formula-D and for us.