Silent videos in public spaces, from museums to train stations, are a familiar sight. However, their impact is often diminished without audio. Traditional solutions like headsets pose hygiene challenges and require costly maintenance. Nubart Sync, a revolutionary technology, overcomes these issues by streaming perfectly synchronised audio directly to a user’s smartphone, without any additional hardware or apps, and with zero latency.
Visitors can effortlessly access audio in their preferred language via Wi-Fi or mobile data by simply scanning a QR code, making exhibitions, digital signage, and cultural experiences more immersive than ever.
With organisations like Museum Sydøstdanmark already implementing this cutting-edge solution, Nubart Sync is poised to redefine how audiences engage with audiovisual content. To learn more, we speak to Nubart’s chief executive officer, Rosa Sala and chief technology officer, Simon Effing.
Easy audio with Nubart Sync
Nubart Sync is the latest patented innovation from Nubart, a market leader in creating browser-based PWA visitor experiences, producing audio guide solutions that require no special devices or apps.
Nubart Sync is a seamless solution for delivering perfectly synchronised audio to videos in public spaces. It does not require special hardware, apps, or expensive infrastructure.
The system works by placing a QR code near the video screen or embedding it within the video itself. Visitors can easily scan the code with their smartphone. This then directs them to an audio stream that plays directly in their browser.
Using advanced synchronisation technology, Nubart Sync ensures that the audio aligns perfectly with the video, automatically adjusting for network latency and device-specific differences to maintain flawless lip-sync playback.
This feature, along with the ability for users to select their preferred language, makes Nubart Sync an ideal tool for engaging multilingual audiences in museums, exhibitions, and cultural institutions.
Although the internet (Wi-Fi or mobile data) is required for synchronisation, the video file can be played locally in any resolution. The soundtrack can be preloaded in Nubart’s offline mode if there are problems with internet coverage.
The system only transmits timestamp data via the server, requiring minimal internet bandwidth.
Meeting a need
Public video displays in museums often face significant limitations due to sound constraints. Loud audio can be distracting in shared spaces, leading to videos being played on low volume or muted entirely. Traditional solutions, such as headsets, require frequent maintenance and hygiene measures, making them cumbersome and expensive.
Furthermore, existing synchronisation systems for multilingual audio require complex hardware installations beyond many institutions’ budgets.
Nubart Sync provides a seamless, cost-effective alternative that enables delay-free audio synchronisation directly through visitors’ smartphones. By removing the logistical challenges of physical headsets and dedicated audio systems, Nubart Sync provides a cost-effective, low-maintenance, and hygienic way to enhance audiovisual experiences in public spaces.
Until Nubart Sync was invented, syncing audio on one device with video on another was theoretically impossible without dedicated hardware, due to inevitable latency, says Sala:
“Our invention makes this possible. The video plays locally—either from an SD card or a local hard drive. The only requirement is that the screen has an internet connection to send us minor updates at regular intervals. This ensures everything stays synced.”
What sets Nubart Sync apart is that it simplifies a problem traditionally solved by complex and expensive systems like infrared or dedicated devices.
“Instead, we offer a software-as-a-service solution that works over the internet, providing perfect lip sync. Some of our customers even use it for talking-head videos, with flawless synchronisation. This invention has been patented across multiple countries and continents, making us the only company offering this technology.”
A solution developed for museums reveals more possibilities
Nubart initially developed digital audio guides as web apps. However, it found that museums frequently asked if it was possible to sync audio with on-site videos.
“As audiovisual content became more important, we saw a challenge that seemed impossible to solve, until Simon had the breakthrough idea to make it work. Once we solved it, we realised the potential extended far beyond museums,” says Sala.
“With Nubart Sync, any public video—whether in a shop window, on a billboard, or in an airport—can have synchronised audio accessed simply by scanning a QR code. This is particularly valuable in public spaces where loud sound isn’t allowed. So, it is ideal for digital advertising, corporate environments, and immersive exhibitions.”
“In addition, the system supports multiple languages. This is crucial for places like immigration centres where people may struggle with the local language but always have a smartphone that they could use to listen to video explanations, for example, in a government waiting room.”
Accessibility is another key application, especially with the European Accessibility Act coming into effect. Many institutions must provide audio descriptions for public video content, and Nubart Sync makes this easy.
“Instead of relying on distracting subtitles, which are limited to one or two languages at most, users can access perfectly synchronised audio in their preferred language without disrupting the immersive experience,” says Sala.
The possibilities are vast. Even outdoor cinema festivals could use this technology to broadcast sound to large audiences without disturbing residents.
Effing adds: “And because our system scales effortlessly, there’s no limit to the number of users. Everyone can enjoy high-quality, latency-free audio directly on their own devices.”
How Nubart Sync works
The core idea behind Nubart Sync is to keep the audio separate from the video rather than transmitting it directly. This would introduce latency and limit scalability.
“Instead, our system synchronises the two streams in real-time using server- and client-side algorithms that measures and compensate for latency,” says Effing.
“Every device behaves slightly differently—smartphones, browsers, and media players all introduce small delays. Our system includes a learning algorithm that adapts to each user’s device, accounting for these variations and ensuring near-zero latency playback. This breakthrough allows perfectly synced audio without the need for special hardware or complex infrastructure.”
Using a Progressive Web App (PWA) instead of a native app eliminates the need for users to download anything, making the experience seamless and hassle-free.
“Native apps were traditionally advantageous, but their benefits have diminished. For an application like this, a native app would only add unnecessary complexity,” says Effing.
Sala adds:
“People often experience ‘app fatigue’ and don’t want to install an app for a one-time event. With a PWA, they can simply scan a QR code, select their language, and listen instantly. The system is always up to date and works intuitively for all users, even those less tech-savvy. It also avoids the frustration of app installations. Especially in museums and attractions, keeping things simple and accessible is key.”
“Since the pandemic, nearly everyone is familiar with scanning QR codes, with data showing that 99% of internet users now do so without issue,” says Effing
Creating the right solution
During the development of Nubart Sync, one unexpected challenge was the varying behaviour of different devices and browsers.
“Each one processes audio and video differently, influenced by factors like hardware and network conditions. We had to account for these differences, especially since Safari tends to be the slowest,” says Effing.
“It wasn’t just about knowing where the video was. We also had to ensure the browser or device started playback at exactly the right position. The solution was a learning algorithm that runs on each user’s device, adapting to its unique behaviour and compensating for any delays in real-time.”
Nubart Sync in action
Museum Sydøstdanmark, a leading cultural history institution in Denmark, has successfully integrated Nubart Sync into its multimedia guide system. This allows it to offer perfectly synchronised lip-sync audio for public video presentations in multiple languages.
Thanks to this technology, Museum Sydøstdanmark can ensure that all visitors, regardless of their device, can experience high-quality, multilingual audio without latency issues. Since 2021, the museum has successfully deployed Nubart Sync across multiple locations, including Køge Museum, Danmarks Borgcenter (Danish Castle Centre), and Holmegaards Vaerk special exhibitions.
Regarding the project, Carl-Henrik Hansen, CTO of Museum Sydøstdanmark, said:
“No matter which device our visitors use – there is no problem with latency provided there is a stable internet connection.”
The solution works within existing museum infrastructure without requiring new hardware investments. The museum’s exhibition media runs on Brightsign players. The implementation process involves setting up a video instance in the Nubart platform and storing an HTML file provided by Nubart alongside the video track in Brightsign.
Front of house, visitors experience seamless audio playback without realising the technological complexity behind the system.
Museum Sydøstdanmark’s adoption of Nubart Sync demonstrates how innovative digital solutions can revolutionise visitor engagement in cultural institutions. By leveraging a simple yet powerful audio synchronisation technology, the museum has significantly improved the accessibility, efficiency, and impact of its multimedia presentations.
The trend for hybrid experiences: digital meets physical
Nubart’s bread and butter is still its audio guide PWAs, which are mostly made available via printed cards with a unique, non-transferable QR code. Visitors cannot share these audio guides, but can keep the card and access the content whenever they want.
Being non-transferable, they have commercial value and allow the museum to sell them. It also reflects the fact that visiting an attraction is inherently a physical experience, even in digital-based exhibitions.
“Whether it’s a museum where you observe original artefacts or an immersive installation that requires your physical presence, the sector is fundamentally tied to real-world engagement,” says Sala.
“We originally created our system to replace physical audio guides, which generate electronic waste and are logistically difficult to maintain. Museums often deal with issues like storage, battery replacements, repairs, and even fire safety concerns.”
While apps seemed like an alternative, they have an extremely low adoption rate, even when free.
“Our solution bridges the gap between physical and digital by offering a system that allows museums to sell access through non-transferable digital cards, providing revenue without app store commissions while eliminating the logistical burden of devices.
“It’s a perfect blend of the benefits of both physical and digital solutions.
“In terms of trends, it’s clear that attractions are increasingly merging physical and digital experiences in innovative ways. Our technology naturally aligns with this shift, enabling seamless integration of audio, networking, and real-time engagement.”
What’s next?
Looking ahead, Nubart plans to evolve the technology so visitors can activate multiple videos in a museum directly from the browser of their smartphones.
“Beyond museums, I’d love to see our technology become more widespread in culture at large—especially in public spaces. Audio-visual content is becoming increasingly important in every sector, and it’s an ideal way to engage today’s digital generation, who are so accustomed to video as a form of communication.
“Making this technology multilingual and accessible in any public setting is an exciting goal. I’d like to see Nubart Sync expand beyond museums and reach new markets, where we’re still primarily focused but see great growth potential.”
“We’re also working on Nubart Live, a tour guide system that also works with QR codes and web apps. Our slogan is ‘No devices, no apps,’ meaning we focus on eliminating the need for native apps.”
With Nubart Live, the company aims to integrate simultaneous translation to allow the guide to keep speaking without interruptions. “Most existing systems require the guide to pause after each sentence for translation, but our system will capture the flow of conversation, offering real-time translation with minimal latency.”
Nubart Sync is set to revolutionise how we experience audio-visual content, offering a seamless, cost-effective solution that enhances engagement in museums, public spaces, and beyond. Leveraging QR codes and smartphone web apps eliminates the need for dedicated devices or apps, making them more accessible and user-friendly.
As the technology evolves, the potential for multilingual, immersive experiences and real-time translations opens exciting new possibilities for digital storytelling and visitor engagement across diverse industries.
