Mario in Real Time

Mario in Real Time (more commonly known as MIRT) is an interactive system developed by SimGraphics and introduced in 1991, and has since been used by Nintendo across various promotional events. Thought up by SimGraphics CTO Mike Fusco, MIRT is notable for being Charles Martinet's first role as Mario (prior to his video game debut in Mario Teaches Typing).

The system, based on Fusco's VActor and AI-VActor technology, allows an actor (almost always Martinet), as well as Artificial Intelligence, to communicate with passerbys as Mario, alongside other characters, such as Luigi, and formerly Wario and Donkey Kong.

MIRT has been repeatedly used by Nintendo throughout the years for promotional events all the way up to present day, modern examples including San Diego Comic-Con 2012 and the Nintendo New York Luigi's Mansion: Dark Moon launch event in 2013 (the former having featured Martinet (as Mario) answering questions from fans, while the latter involved Luigi welcoming fans to the Dark Moon launch event.

History
Developed by Mike Fusco, SimGraphics' VActor technology was pitched to multiple companies as a form of promotion, including Nintendo, who quickly took interest and contracted them to create a system featuring Mario based on the technology. Auditions were overseen by the producer who ran the events MIRT would appear in, in tandem with Don James, executive vice president of operations for Nintendo of America. As the audition was ending it was crashed by Charles Martinet, who managed to convince the producer to let him try out. According to Martinet the producer was seemingly annoyed by his performance by the time he left, but purportedly called James immediately to urge him that only Martinet's audition be sent to Japan.

He was very quickly hired, and flown out to do shows through MIRT, It was quickly found that the incredibly long shifts were too much, so by Charles' suggestion Stevie Coyle was hired as a voice match for several early shows. At this time the system had Mario, and later Wario and Donkey Kong, who were added after the release of Wario Land: Super Mario Land 3 and Donkey Kong Country, respectively. Both were performed by Martinet solely as Coyle retired from acting not long after starting MIRT.

Around 2000, Donkey Kong was removed from the system, and Mario and Wario were updated to their current designs. More notably however, expressions and mouth movement became automatized, which meant face tracking equipment was no longer needed, allowing the characters' full bodies to be rendered, and Martinet to perform from anywhere in the world. Mario and Wario remained as the sole characters until 2012, when Wario was removed but Luigi was added (first appearing at the aforementioned San Diego Comic-Con 2012), along side another overhaul of the system.

In 2021, an updated version of MIRT was introduced utilizing AI-VActor technology, which allows for an AI duplicate of Martinet (or rather, Mario) to fill in when he is not avaliable. So far, no unique duplicate has been shown off or announced for Luigi.

As of today MIRT's been retired from event appearances, and is used exclusively for promotion at Nintendo New York, originally most commonly during the holiday season. , however with AI-VActor technology, MIRT is now avaliable 6 days a week at Nintendo New York.

Overview
MIRT is engaged through its display, which shows either Mario or Luigi in front of a background. People would interact with them through a hidden camera and microphone, however modern displays place the mic in clear view.

Formerly, the system required a headset rig, which would transpose the actors' expressions using roller balls into a model of the character. The system also formerly required everything to be connected together, likely caused by the limits of computing power at the time. With the first overhaul of the system around 2000, however, expressions and mouth movements became automatized, which allowed for Martinet to perform remotely.

Under most circumstances both characters can not be seen at the same time. Previously this was a technical limitation, as each character need their own display, with computer and headset rig, however today it is purely as Martinet plays both characters. Despite this however certain transitions between the characters do show them both on screen, to which Charles uses as an opportunity to voice them both, going back and forth between them.

The AI-VActor model is trained on data from Martinet's more recent MIRT performances and can preform all the same actions he can, all though again, no unique duplicate has been shown off or announced for Luigi.