“My Goodness” – exploring what your digestive and immune system looks, sounds and feels like

Oh My Goodness!  *(My Goodness Me)

In celebration of National Science Week 2021, the United Nations International Year of Fruit and Vegetables and the International Year of Creative Economy for Sustainable Development, Monash University is launching a multisensory book and exhibition titled ‘My Goodness’ – a tactile and interactive exploration of the science behind gut health, nutrition, and immunity.

Designed for low vision, blind and general audiences alike, the books will read to you and also entertain.

Described as an ‘entire multisensory art exhibition in a single book’, they  are stationed on interactive reading benches using optical scanning technology (fiducials) and webcams enabling the wonderful world of the gut biota to come alive.

Through tactile artworks, audio sonifications, braille-inspired protein molecules, large print, audio narration, and braille supplements, audiences can explore the Books against a backdrop of synthesised music evoking molecular protein foldings and the sounds of the gut biota.

The books have been created by Dr Erica Tandori, legally blind Sensory Science Artist in Residence at the Rossjohn Lab, Monash University Biomedicine Discovery Institute, in collaboration with Stu Favilla, Musician and Lecturer in Interaction Design at Swinburne University of Technology, School of Design and Architecture.

They contain contributions by some of Monash University’s most eminent and world-renowned experts in the field of gut health, nutrition and immunity.

“So much more can be expressed when you add sounds,” says Dr Tandori.  “It really does help to support what’s happening from the visual and tactile level when you can listen to the sounds of a protein or the way microbes are interacting while you are feeling the sculptures and exploring the artworks.

“Stu has brought an amazing plethora of audio design skills to this project including sonification of the artworks, 3D audio and beautiful modular synthesis music evoking the inner universe and machinations of human digestion!”

Mr Favilla adds: “Erica’s tactile artworks are not 3D prints but rather reference a language of touch that we are all familiar with.  Her artworks comprise food grains, clothing materials, wools and many other fascinating textures and multisensory experiences.

“They are driven by her desire to communicate the wonders of molecular biology through her unique artistic understanding and perceptions. The books reference a legacy of prior exhibition knowledge but the exhibition itself is now spatially encapsulated, all in one neat package.”

The Books have also inspired the creation of a pop song called “My Goodness”, co-written by Erica and Stu with Erica singing vocals and Stu performing all instrumentation, rapping and producing the track.

“We hope we can get kids of all ages to sing about the wonders of the gut biota. My Goodness is possibly the greatest song ever written about the gut biota, immunity, fruit and vegetables,” Dr Tandori said.

Following the Launch event, the books are intended for roving exhibitions across metropolitan and regional schools, community groups and disability educational centres in Victoria.

An online version of the books is also proposed as a COVID-19 contingency plan with a range of virtual activities to support the exhibition.

The My Goodness: Interactive Multisensory Science Book Launch and Exhibition is a free online event that will be held on Friday August 20  from 9 am.

This initiative is supported by the National Science Week Inspiring Australia Grant.


About the Monash Biomedicine Discovery Institute at Monash University

Committed to making the discoveries that will relieve the future burden of disease, the newly established Monash Biomedicine Discovery Institute at Monash University brings together more than 120 internationally-renowned research teams. Spanning six discovery programs across Cancer, Cardiovascular Disease, Development and Stem Cells, Infection and Immunity, Metabolism, Diabetes and Obesity, and Neuroscience, Monash BDI is one of the largest biomedical research institutes in Australia.  Our researchers are supported by world-class technology and infrastructure, and partner with industry, clinicians and researchers internationally to enhance lives through discovery.

For media enquiries please contact:

Wendy Smith

Media and Communications Manager

Monash University


T: +61 (0) 425 725 836

For more Monash media stories, visit our news and events site

ASBMB Today: Unravelling the mind’s eye — science through a novel lens

Erica’s story and our Sensory Science initiative is featured on page 33 of the April issue of ASBMB Today: Science & Art.


View PDF 

View article online

Original story by Kamalika Saha in ASBMB Today : Science & Art 

Congrats Erica on the award of the National Science Week grant ‘My Goodness: Interactive multisensory science books’

Get a taste for science in National Science Week!

Our $500 000 grant round for 2021 has just been announced with great projects from around the country preparing to celebrate science. Many of the projects took inspiration from the National Science Week school theme of Food – Different by Design, including Food – Now and into the Future which is all about making healthy food choices and will be presented by the Wesley Mission in Logan City just south of Brisbane.

STEAM Ahead – Foodlovers is an exploration of traditional Indigenous food and modern food production techniques at the Western Sydney Parkland. If you’re thirsty for more, four boutique brewers will conjure special brews for ExBEERimental Science in Hobart and share their techniques and tastes with both live and virtual audiences.

And while they may not be delicious, the Donut Shooting Robots in Adelaide will fight it out as 15 teams go head to head in a design – build – program competition.

Minister for Industry, Science and Technology Karen Andrews said the Australian Government was proud to support inspiring, innovative and accessible projects as part of National Science Week.

“Science is everywhere, and National Science Week is for everyone,” Minister Andrews said.

“Even in the midst of last year’s lockdowns, more than one million Australians took part in events across every state and territory. This year, we’re looking to boost those numbers even higher.

“From concerts to VR tours and everything in between, this year’s National Science Week grant recipients have something to offer every Australian.”

The grant recipients are:


My Goodness: Interactive multisensory science books
Monash University

Read about immune system cells through your sense of touch or learn about food and nutrition through a 3D soundscape. ‘My Goodness’, a Rossjohn Sensory Science Multisensory Science Book, is an exhibition of 10 interactive ‘books’ designed for low-vision, blind, hearing-impaired, deaf, and non-disabled audiences.

The Books explore the relationship between infection, immunity, food, and nutrition. They make science accessible to more people by using large print text, braille, tactile artworks, haptic and 3DAudio, visual tracking and tactile sensor interaction technologies.

Original article

National Science Week 2021 will run from 14-22 August. Watch this space for further details.

Erica’s interview with Center for Data Innovation on how she uses AI in the Sensory Science artworks

(Centre for Data Innovation) ‘5Q’s for Erica Tandori, an Artist, Researcher, and Academic at Monash University

The Center for Data innovation spoke with Erica Tandori, an artist in residence at Monash University in Australia, who has low vision and is using AI to create multi-sensory art experiences that showcase the wonders of biological life. Tandori discussed how data-driven technologies are helping her create art exhibitions that explore science and biomedicine, enabling greater inclusion, accessibility, and education for low vision, blind, and diverse audiences.

Hodan Omaar: What challenges do people with low vision or blindness face in accessing science, and how are you using artificial intelligence to better communicate scientific ideas?

Erica Tandori: People with low vision or blindness face the challenges of comprehending a  predominantly vision-driven world. In science and biomedicine, reliance on data derived from particle accelerators, X-ray crystallography, and microscopes is critically dependent on the ability to see. But this dependence on vision may be unnecessarily limiting. For instance, the sonification of data, which uses non-speech audio to convey information or perceptualize data, may be an opportunity for those with low vision or blindness to access meaningful information through hearing, and has also been useful for those without impairments.

A multisensory approach to scientific information through art presents new opportunities and possibilities for data representation, even in fields such as astronomy. A recent example of incorporating data in a multisensory way I’ve worked on is the HIV Capsid Data Projection Project, a work created with interaction designer and video artist Stu Favilla. This 5-foot interactive sculpture (shown on the left below) is made up of individual hexagonal and pentagonal tiles smothered in tiny foam balls, simulating the structure and surface of the viral HIV protein. We projected computer-generated molecular structures onto the sculpture as a way to present and express information about the virus itself. To incorporate the fact that HIV virus evolves rapidly, we mutated the HIV RNA protein set (the compound that carries genetic code) based on the Markov chain model, a stochastic model that describes a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. We then color-coded the HIV RNA protein set for projection. I was inspired by the classic Horton-Conway game Life, a simulation where cells form various patterns throughout the course of the game based on the initial conditions of the cells, and used a two-dimensional array of artificial mutating RNA to seed an algorithmic life pattern into the piece. This was intended to represent a flow of synonymous gene mutations and the viral transmission from one host to the next. Finally, we set the stage for these rhythms of light and dynamic mutations to a pulsating dance beat, as though this giant viral capsid was taking to a dance floor, for an online exhibition. We took a little poetic licence with the music given we were holed up on strict lockdowns due to COVID-19. For future exhibitions we intend to align data sonification of the viral mutations with the visual data projections on the surface of the sculpture.

Images by Erica Tandori and Stu Favilla. On the left is 5 foot interactive sculpture of an HIV capsid and on the right is an image of SARS-CoV-2 RNA producing colour coded renderings on top of fractal video shaders, incorporating data into Sleeping Pangolin and other sculptures.

The Sleeping Pangolin sculpture is another work we are incorporating AI and data into, with screens that show mutating viruses created by Stu Favilla. Here, the SARS-CoV-2 RNA is producing color-coded renderings atop of fractal video shaders (visualization is shown above on the right). The work is high-resolution, creating multiple displays from an initial 6K video rendering. This way, a single video rendering is distributed to a series of sculptures including a pangolin (shown on the right below), bat, and civet cat. We are exploring the use of 3D sound sonification in this work also.

If we can create works that explore data projection in new ways free from the screen, we may also be able to heighten accessibility to data, creating new understandings and new meaning.

I have marvelled at the way making science accessible to those with low vision and blindness has also made science more accessible to everyone, no matter what their age or scientific literacy. Imagining a world in which there are no obstacles to information and knowledge access could significantly improve people’s ability to pursue careers that they might have thought impossible for them. If we can represent information and data in new ways, we may be able to reconsider notions of disability altogether. Inclusion and diversity in our workplace and in the scientific arena creates both equal opportunity and innovation. This has been a driving idea behind our Monash Sensory Science initiative, an exhibition program specifically designed for those with low vision, blindness, and other disabilities. Professor Jamie Rossjohn of the Rossjohn Laboratory where I work as artist in residence, was well aware of the limitations for those with low vision and blindness, and the lack of university science research outreach programs catering to this demographic.

Our exhibitions have been travelling across Australia since 2018 and we have engaged audiences of all ages and scientific backgrounds in the hopes of creating community awareness about biomedical research, and fostering the idea in young students that they too can pursue careers in science no matter what their perceived limitations might be. We have created these exhibitions to enable people to access information, ideas, and research around biomedicine in multisensory ways that include visual, tactile, and audio approaches. In our technology driven world, so much is screen-based. This presents both a problem and an opportunity for those with low vision or blindness. Vision-based data is devoid of any other sensory experience apart from sound, as screens are not very interesting to touch, hold, or interact with. On the other hand, screens with zoom functionality enable those with low vision to see data at greater magnification, as well as access text-to-speech functions. If we can release data from this screen-bound environment, utilizing AI and multimodal delivery, we may be able to further eliminate obstacles to data access in myriad ways with enormous implications for diverse needs.

Omaar: Many applications intended to assist people who experience blindness or low vision are not trained on data created by people with these disabilities. For instance, some algorithms that assist people with disabilities (PWD) to identify objects in photographs are trained only on photographs taken by people without disabilities. Why is it important for these types of AI systems to be trained on pictures taken by PWD?

Tandori: This is an excellent question and one that touches on so many issues around low vision, blindness, and the lived experience of disability. This is really a question about how much we allow those with disabilities to speak about their lived experience, their needs, and their self determination.

My PhD focused on the lived experience of how blindness looks. It was, as far as possible, an eyewitness account of vision loss and how the world appears from my perspective. How many of those in the medical profession know what vision loss or blindness actually looks like? Far from the blackness we might imagine, macular degeneration and other conditions of the retina can cause an absence of vision, flashing lights, metamorphopsia (a perceptual distortion that causes linear objects, such as lines on a grid, to look curvy or rounded), or a myriad of entoptic visual artifacts caused by the interaction between disease, the environment, and the brain. In medical texts, journals, and the wider media, my type of vision loss is portrayed as a static black spot at the centre of a perfectly defined visual field. But my vision loss is dynamic and ever-changing. At times, the visual field resembles a cross between a softly focused, light-filled Monet painting and the writhing, explosive brushstrokes of a van Gogh. The centre of the field in the scotoma (a partial loss of vision or blind spot in an otherwise normal visual field) is an experience of absence, where cortical completion fills the area of nothingness with surrounding color (yes, color!) and pattern.

In my piece Invisible Mona Lisa (shown on the left below), you can see the processes of cortical completion taking place—the area of the face is concealed by the scotoma , and the area where her head should be is filled with background color. My brain is working hard to make sense of the blind spot, actively completing the picture for me. This is largely how I see others, their faces obscured as though partially camouflaged.

On the left is Erica's "Invisible Mona Lisa," an artwork exploring cortical completion and absence at the scotoma, and on the right is an interactive sculpture of a sleeping pangolin incorporating data screens.

Medical technologies have been unable to determine how entoptic symptoms of macular disease appear. It is by listening to the voices of those with lived experience of disability that we can come to better understand their perspective. If those voices are included in all aspects of society, from the medical, technological, and cultural aspects, we may find more effective solutions and innovative approaches that create suitable environments to minimize the impact of disability. Weaving the voices and lived experience of those with disability into the loop of AI systems would be hugely beneficial.

As an aside, some of the artworks I have created have completely confounded object recognition software, which has resulted in some hilarious outcomes, and may have implications in regard to AI, accessibility, and art for people who are blind. AI completely misrecognized my Sleeping Pangolin sculpture (shown above on the right), for example.

Omaar: Throughout your artistic and PhD career, you have explored ideas surrounding the dualism of vision: what it means to see as opposed to what it means to have vision. Is it fair to say that the work you do is augmenting people’s vision, i.e. using digital tools to help people imagine things in their mind’s eye?

Tandori: I have used digital tools to help people imagine how things look from my perspective and tried to give an eyewitness account of my own macular dystrophy as accurately as I possibly can. However, there is a conundrum in this that is completely unresolvable.

If I look at the artwork I create, I am always looking at it through the lens of a diseased retina. It is always going to look like an accurate portrayal of vision loss to me because I am seeing it through my own vision loss. The only way to really know if I am accurate is if I take out my eyes and put in a healthy pair, which we know is completely impossible. I have to work around this conundrum, utilizing my peripheral vision and zoom technologies on my computer screen to see as much as possible of what I have created.

There are many dualities in this task, from exploring the loss of vision through the visual language of art, the inescapability of creating works about vision loss through the prism of vision loss, observing my own observing and my diminished ability to observe, and the duality of creating images that look at “normal” vision and comparing it to “diseased” vision. Moreover, we have the dichotomy of seeing and vision, of the mind’s eye and the retina.

During my PhD (see some of the artworks here), I tried to create as accurately as possible, a vision of my vision loss. Using a digital camera, I took images that might convey how something looks to those with “normal” vision. Sometimes the camera became the “perfect eye,” able to catch the scenes that I was unable to see by myself. I would then take these digital images and augment them using Photoshop and After Effects, to simulate my eye disease. In this way, I was trying to explore the gap between seeing and non-seeing. To my surprise, this could not be done with one single method. Digital tools could not express all the complexity of deteriorating vision. I needed to employ traditional methods of art-making in combination with digital technologies to fully articulate the range of symptoms. Moving back and forth between traditional and digital methods created a dialogue between analogue and digital ways of understanding the phenomena of vision loss. Oil paint, canvas, paper, and pencil create texture and visceral qualities which are absent in the digital image. Oil painting and drawing seem to articulate more about an experience, whereas digital images seem to be more about data. This was a fascinating interaction for me as an oil painter who was now discovering digital media techniques.

Omaar: Some people are better at learning visually, others may prefer reading aloud, yet others may need hands-on experience. How do different tools address different people’s educational needs? Do different modalities work better in different contexts?

Tandori: People learn in different ways and sometimes utilizing more than one way of learning can be highly effective. Although my vision has deteriorated, I am sure I still learn best with the remaining vision that I have, and I don’t know if this is because I grew up learning and practicing art, or that I am simply a visual learner. I know that if I see a word on a printed page it seems to soak into my memory more effectively than if I see it on a computer screen or hear it spoken out loud.

The notion of different modalities and memory retention is also interesting. Engaging a variety of modalities to convey information could be highly effective. So much of our brains are dedicated to visual processing, but if that vision is limited, what happens to all that grey matter? Can it be accessed differently? Recently I had an interview with Neil Sahota of IBM on the AI for Good 2020 Global Summit podcast where we discussed “artistic intelligence” and how it could combine with artificial intelligence to produce innovative ways of accessing data and solving problems. Why can we not all be fabulous at art? Is there something in the creative approach that can be useful as an educational tool and in technology to help us think outside the box (or computer screen)?

Hopefully, utilizing multisensory modes of data delivery, whether for education, research, or engagement with audiences at our Sensory Science exhibitions can promote deeper and more dynamic levels of understanding.

Omaar: Looking to the future, where do you think the greatest need for additional research is, if we are to enhance access and use of new technologies for PWD?

Tandori: Including those with the lived experience of disability would be an amazing place to start to enhance access and use of new technologies for these very same people. To include those with disabilities in discourses around science, technology, art, medicine, and everything else would be empowering and would change the world for the better. We can only understand the needs of those who have different needs if we ask them and engage as equals in developing more accessible, adaptable, user-friendly technologies and environments.

It is possible that if we focus research in this area, we may help to eliminate many of the barriers that PWD face, and if we can do that then we eliminate the word disability. Can you imagine how this might affect the prospects of those who currently face a life of unemployment as a result of their disabilities? How this might empower them to be independent or pursue educational goals and careers they might never have thought attainable? Moreover, we need to make sure that these technologies are accessible to everyone across the globe, irrespective of their socio-economic position, and that these technologies are cost-effective.

Original article 

Our artist in residence, Erica featured in Monash Life

Placing microscopic life into people’s hands.

Dr Erica Tandori, a legally blind artist, is working with biomedical researchers to scale up microscopic life and place it, literally, into people’s hands.

Dr Erica Tandori may be legally blind, but as an artist she’s honed her skills to help people experience and touch the invisible world of molecular biology.

Her most recent work deals with the minutiae that form the focus of biomedical research in the realm of viruses and antibodies.

In her hands, science’s near-incomprehensible, two-dimensional images are transformed into marvellously detailed, three-dimensional sculptures or Braille-like glyphs that can be held, felt and explored.

The goal is to create access to the world of molecular biology for blind and vision-impaired people, says Tandori, who is artist-in-residence at the Rossjohn Laboratory within Monash University’s Biomedicine Discovery Institute (BDI). This position was created by Professor Jamie Rossjohn, former head of the BDI’s Infection and Immunity Program, to empower people with a disability to pursue careers in science.

“Viruses blow my mind. The way they break apart yet retain the ability to reassemble themselves – it’s cunning, it’s intelligent.”

Drawing on her awe and wonder of the subject matter, Tandori has created pieces that thrill the vision impaired youngsters she most wants to inspire. Reactions to her work shown at Rossjohn Lab’s 2018-19 Sensory Scientific Exhibition and Discovery Days are testament to that.

Image: Erica Tandori with her model of HIV. Photo: Stephen Blake.

Yet there’s something about how Tandori bridges the art-science divide that allows her to concurrently engage the public and inspire scientists.

“There is this amazing potential to open up dialogues by bringing other senses into the experience of understanding science,” she says. “That means we can explore whether art has a role achieving a deeper understanding of molecular structures. I find that a delicious challenge.”

Anchoring the production of these pieces was her visceral reaction to a central concept in molecular biology – the idea that the three-dimensional form attained by clusters of atoms dictates that molecule’s higher-order biological functions.

Art gone viral

As an alumna of Monash Art, Design and Architecture (MADA), Tandori sees in this ‘form-function’ relationship a sculptural principle familiar to her from art. It’s proven an expansive source of inspiration and wonder that leaks into her work, and is especially apparent in her latest pieces.

As the recipient of a Victorian Government Creators Fund grant, she’s using sculptural techniques to explore a subject that has brought the world to a standstill – viruses. The work is due to be exhibited at the UN AI for Good Global Summit. “Viruses blow my mind,” she says. “The way they break apart yet retain the ability to reassemble themselves – it’s cunning, it’s intelligent.”

With these pieces, the entities best-known for their smallness are transformed into enormous 3D sculptures that allow people to clamber inside and become, as she says, the virion’s RNA.

In classic Tandori style, there’s an Alice in Wonderland kind of intrigue to the size reversal in which it’s humans that infect and invade the body of the virus. Included is a sculpture of COVID-19.

“To be able to hold a mitochondrion and feel its inner working, or to step into a virus – it amounts to an immersion into tactile forms that are imbued with scientific meaning. That does something to blind people,” she says.

Life model

Underlying these achievements is Tandori’s experience of sight loss that began at age 22. The diagnosis – an incurable form of juvenile macular dystrophy called Stargardt’s disease – has, over several years, shattered all but the cells in her retina responsible for black and white peripheral vision.

There was terror at the diagnosis back in 1988, and exasperation at how little medicine knew or cared about the patient’s inner experience of going blind. It’s a subject she explored in her PhD thesis on art and ophthalmology.

But in hindsight, it was her encroaching blindness that pushed Tandori to embrace the artistic talent she had disdained as a fully sighted woman pursuing undergraduate studies in journalism, English literature and philosophy.

She got over the terror of being an artist who had lost her sight, and she leant on the ability of her brain to compensate and her mind to adapt.

“I’m blind, big whoop,” she says. “I can use it. Humans have more sensory awareness than just retinas, including something deeper and wonderful that feels like being hooked up to a larger life force. Even incapacitated, we are still part of this wonderful thing called life.”

Original article

Further information about her artwork and Monash Sensory Science can be found here.