Interactive Digital Experience

Monday, 12 October 2015

Presentation (Way-finding)

Upon entrance to Te Papa, the visitors will get issued a tablet with a pre-installed app that will be used throughout their journey to enhance their Te Papa’s experience. They will also have an option to get issued headphones to listen to the audio that plays throughout different sections of the app. The main feature of this app uses augmented reality and ibeacon to make way finding in a museum a more innovative and interactive experience. The app is not downloadable on outside devices making it exclusively unique to Te Papa.

So the first thing that the users will see are a list of icons
and it will just help clarify what each of the icons mean when the users come across them on the app.

(Click to the Photo Feed)

My allocated persona was family so I wanted to cater to both parents and children, allowing a child mode and a parent mode that will be the default. The photo feed uploaded by Te Papa’s visitors allows the family to easily pick and build their tour according to their interest saving valuable time. These photos are constantly updated every week to ensure visitors are able to keep up with the latest and most popular exhibits.

(Click Search Exhibit)

Users will also be able to use the search option to find exhibitions that they specifically want to see by typing on the search bar or using the filter option below. Afterwards the app will generate all the exhibits that links to what you put in.

So this is an example using the colossal squid and when we select the image that we like, it will take you to the tour page and from there you can add or remove tours or see what is coming up next.

(Click Map)

The augmented reality map forms a track that easily guides the user to their exhibit. There is also audio playing as it guides the user, which is optional if they decide to use their headphones. There are also certain touch points throughout the exhibit that lets the visitors take photos with augmented reality creatures displayed in Te Papa. Animals that were once extinct will come to life through your camera and the audience will be able to hear the sounds they make and how they move.

(Click Overview Map)

There is also a directory map that you can click on the side to see an overview of the floor you're on.
If the visitor wants to find the closest toilet or cafe they can click the icons on the bottom and it should pop up on the map.

(Click to the Child Mode)

On child mode, an I Spy narrative game encourages kids to look and engage with the displays for a longer amount of time. iBeacon is used here to sense these objects, making the screen glow either blue or red to indicate how far the object is.

(Read instructions)

Kids will need to use this app to help guide them around the exhibition and they will have to take a photo of the object once they have found it. Once they have all the photos taken, they can then proceed to Tepapa's information desk where they can receive their prize.

This will encourage kids to use the app and get something at the end of it making them feel more accomplished. Linking back to the photo feed, the family has the option to share these photos which will be all automatically saved in the app's gallery.

Presentation (Moa)

Moa were large, flightless birds that lived in New Zealand until about 500 years ago. They belong to a flightless bird group, which also includes emus and kiwis. They are as tall as 3.5m and weighed roughly around 200kg. Moa were hunted to extinction by Māori, who found them easy targets. Their flesh was eaten, their feathers and skins were made into clothing. The bones were used for fish hooks and pendants.

What makes the Moa interesting is that it's already extinct. So I wanted to recreate an experience allowing the visitors to rediscover the Moa and the environment that it lived in. I wanted to create an immersive space that lets the visitors feel like they are in the environment when they first step into the exhibition. There will be a forest of interactive screens allowing visitors to interact with the space, transforming the space into a forest of discovery using parabolic speakers, interactive floors and light that will be triggered by motion sensors.

So when the visitor first enter the space, they will hear the Moa's call. There will be parabolic speakers that will mimic the Moa’s sound to really bring the exhibition to life. Since the Moa has a very distinct and interesting call, I think using sound will really generate interest.

(Next Slide - Spotlight)

The visitors are then invited to move around the space. Once the visitor is detected by the motion sensors, the screen will illuminate (similar to a spotlight) to reveal the Moa and environment where the person is standing. This is similar to a hide and seek game that really gets the visitors to interact and take notice of the Moa. When you stand still for about 10 seconds, the screen will slowly uncover to reveal the full environment and the two Moas.

So this is when the users walk around the space. The motion detectors will detect the visitor and forms a spotlight on the screen which will follow the person around the space, as it reveals the environment and the Moa.

(Next Slide - Uncover)

This one shows when the visitor has stood still for around 10 seconds and the darkness will uncover the entire screen to show both of the moa displays and the environment.

(Next Slide - Tree)

There will also be a digital tree panel that becomes an interactive touchscreen to bring out further information about the Moa. The whole tree will act as an interactive screen so that people from different heights could reach and get information, making it more inclusive to kids and people on wheelchairs. There will also be an option to adjust text sizes and change languages so that elderlies tourists from different countries can understand. The tree will hang from the ceiling and descend into the space as a source of light, creating a immersive glow since the space is quite dark itself. There will also be seats located near the outside for elderlies and other people who just wants to sit and listen, and really take in the experience.

(Next Slide - Technology)

The main technologies featured in this exhibit are motion sensors, transparent oled screen and parabolic speakers. These technologies will work together to bring an immersive interactive experience for everyone to enjoy and take in the narrative. Motion sensors will allow the visitors to interact with the exhibit while the transparent oled screen and parabolic speakers will make the space come to life so that visitors can feel like they are in the actual environment with the moa.

Sunday, 11 October 2015

Presentation Slides

So when the visitor first enter the space, they will hear the Moa's call. There will be parabolic speakers that will mimic the Moa’s sound to really bring the exhibition to life. It makes you feel like you're really in the space with the moa lurking around. Since the Moa has a very distinct and interesting call, I think using sound will really generate interest.

This one shows when the visitor has stood still for around 10 seconds and the darkness will uncover the entire screen to show both of the moa displays and the environment.

Friday, 9 October 2015

Refinements

Monday, 5 October 2015

Transparent OLED & Intel RealSense Camera

Mirror and Transparent OLED display panels

See displays from an extremely realistic, customized perspective.

A visually compelling, interactive experience that allows the audience to engage with the display.

Enhancing museum experience.

Intel Real sense camera:

Description: The revolutionary Intel® RealSense™ Camera uses depth-sensing technology so your PC sees more like you do. Use the added dimension to scan 3D objects, control your PC with gestures, or create a more lifelike video chat environment. Reinvented video chat lets you customize your background, and share content with friends as if you're in the same room together.