Mario in Real Time

Mario in Real Time (more commonly known as MIRT) is an interactive system developed by SimGraphics and introduced in 1991, and it has since been used by Nintendo across various promotional events. Conceived by SimGraphics CTO Mike Fusco, the system allows for passersby at conventions, tradeshows, and other promotional events to interact with Mario, and on occasion other characters as well.

MIRT is notable for being Charles Martinet's first role as Mario (prior to his video game debut in Mario Teaches Typing), first appearing at conventions and tradeshows, and later during events at Nintendo New York following the installation of multiple kiosks, and later a massive 23-foot-wide display. In the lead-up to Martinet's retirement, the system was overhauled to be fully automated with the use of directable AI, or "AI-VActor" technology, becoming available six days a week rather than being locked to events for which Martinet was available.

MIRT has been repeatedly used by Nintendo for promotional events throughout the years, examples including 2012 and the Nintendo New York Luigi's Mansion: Dark Moon launch event in 2013. Despite this, following MIRT's establishment as permanent fixture of Nintendo New York and the introduction of AI-VActor technology, it has since been retired from event appearances.

History
Developed by Mike Fusco, SimGraphics' VActor technology was pitched to multiple companies as a form of promotion, including Nintendo, who quickly took interest and contracted SimGraphics to create a system featuring Mario based on the technology. Auditions were overseen by the producer who ran the events MIRT would appear in, in tandem with Don James, executive vice president of operations for Nintendo of America. As the audition was ending, it was crashed by Charles Martinet, who managed to convince the producer to let him try out. According to Martinet, the producer was seemingly annoyed by his performance by the time he left, but purportedly called James immediately afterwards to urge him that only Martinet's audition be sent to Japan.

Martinet was very quickly hired, and he was flown out to be fitted. Due to the long shifts, by Martinet's suggestion, Stevie Coyle was hired as a voice match for several early shows. At this time, the system had Mario, and later Wario and Donkey Kong, who were added after the release of Wario Land: Super Mario Land 3 and Donkey Kong Country, respectively. Both were performed solely by Martinet, as Coyle retired from acting not long after starting MIRT. Around 2000, Donkey Kong was removed from the system, and Mario and Wario were updated to their current designs. More notably, however, expressions and mouth movement became automatized, which meant face tracking equipment was no longer needed, allowing the characters' full bodies to be rendered and Martinet to perform from anywhere in the world. Mario and Wario remained as the sole characters until 2012, when Wario was removed but Luigi was added (first appearing at the aforementioned San Diego Comic-Con 2012), alongside another overhaul of the system.

In 2021, an updated version of MIRT was introduced utilizing AI-VActor technology, which allows for an AI duplicate of Martinet (or, rather, Mario) to fill in when he is not available. So far, no unique duplicate has been shown off or announced for Luigi. As of the present, MIRT has been retired from event appearances and is used exclusively for promotion at Nintendo New York, originally most commonly during the holiday season. However, with AI-VActor technology, MIRT is now available six days a week.

Overview
MIRT is engaged through its display, which shows either Mario or Luigi in front of a background. People would interact with them through a hidden camera and microphone, though modern displays place the mic in clear view. Formerly, the system required a headset rig, which transposed the actors' expressions using roller balls onto a model of the character. The system also formerly required everything to be connected together, likely caused by the limits of computing power at the time. With the first overhaul of the system around 2000, however, expressions and mouth movements became automatized, which allowed for Martinet to perform remotely.

Under most circumstances, both characters cannot be seen at the same time. Previously, this was a technical limitation, as each character would need their own display, with a computer and headset rig, though today it is purely Martinet playing both characters. Despite this, however, certain transitions between the characters do show them both onscreen, which Martinet uses as an opportunity to voice them both, going back and forth between them. The AI-VActor model is trained on data from Martinet's more recent MIRT performances and can perform all the same actions he can.