The evolution of the video-media format

  • 🤨

  • 😀

Incumbent video formats are inherently limited; able only to render a singular perspective and from a singular location, which can skew information, perspective, and a viewer’s reaction to the content.

Happaning is proposing a step-change to advance video drastically through the introduction of a new media format, namely ViiVids (or Multi-Vantage-Videos). ViiVid Technology synchronises multiple video feeds by time, location, and audio/visual cues, with a proprietary real-time codec. The viiVid player allows the viewer to seamlessly navigate between the multiple videos within a viiVid by gesturing in the direction they wish to move in as if they were there.

Like google street view… but with video.

Happaning’s ViiVid technology isn’t just the next significant innovation in media engagement, because by encouraging multiple viewpoints, it also serves to establish the truth of an event, with multiple point-of-views/vantages, whilst helping users better understand each other’s perspectives, particularly important in an age of “fake news” and opinion intolerance.

Happaning suggests this step-change be accompanied by the advances in Augmented-Reality/Virtual-Reality (AR/VR) technology using digital overlays (marking alternative vantages and POIs) and/or virtually re-created environments to offer an immersive experience real-time or retrospectively. ViiVids go further, creating an AR system accessible from mobile devices to navigate the real world in ways they cannot usually. The benefit of real-time and retrospective vantage panning offers the ability to consume more immersive content and to tell more engaging stories.

ViiVids Desktop
ViiVids

Words < Pictures < Videos < ViiVids

ViiVids demonstrate the potential for videos, similar to the birth of moving images from its less engaging and less complete predecessor, the static photo.  Leveraging the widely available mobile phone, to deliver an experience previously only achievable with specialist and expensive AV hardware/software, democratising content with intuitively simple finger gestures, and innovative augmented reality. Given the commercial reach of the generic video format, the disruptive potential of viiVid technology is game-changing.

ViiVid Technology

The mesh-network (recording network) over which data is transmitted and received can be expanded by routers/hubs, cell networks, and other IP uplinks. Mobile and static recording devices can include any recording device capable of transmitting over a network, including professional broadcasting systems, phones, cameras, etc. During a live recording, the footage is transmitted live to other viewers via a content delivery network, where it is transcoded for live consumption. 

Capturing

When captured, ViiVid data streams (including audio/visual output, time signatures, locational/positional information, metadata, status heartbeats, etc.) are continuously generated and broadcasted over a decentralised, P2P mesh network of recording devices, mobile and static. The pertinent data is synchronised and logged by each device within the network. Employing blockchain style principles, the network protocol has no single point of failure or corruptibility. It comprises direct (e.g. Bluetooth etc), local (e.g. Wi-Fi), and cellular networks simultaneously, allowing co-located individuals (including those with no cellular data) or remote viewers (transcoded via Content-Delivery-Network), to dynamically pan, in a given direction between vantages within the recording network in space/time synchronised manner. Unintrusive AR markers indicate the relative location and position (distance, altitude, and/or direction) of other available vantage points within the current field of view, and periphery markers indicating those out of frame.

Storage & Synchronisation

Once the recording concludes, the media artifacts (coupled with checksums and a timeline of pertinent synchronisation data) are later sent for server-side, post-production processing to corroborate, merge and prepare the vantages for on-demand retrospective ViiVid playback. Alongside traditional audio/visual enhancements and transcoding, more sophisticated methods (audio isolation, ML-enabled visual object recognition, with temporal parallax, depth perception, and trigonometric synchronisation) can then be performed to better calculate the relative position between vantage points by triangulating between multiple points of interest within a shared field of vision where possible.

  • The diagram below demonstrates the data flows through the Viivid platform, demonstrating how content to viewer interchanges as well as how the server infrastructure acts within the multiple content and viewers. These data flows are split between types of content as a live recording, post-production processed content, and retrospective playback are different as each requires different data loads and permissions.

    This will be refined during the project to include secure APIs for Happaning to run natively within existing social media apps such as Instagram/TikTok/Facebook/Twitch/Youtube.

Projects using ViiVid® Tech

Like google street view but with video, Happaning utilises Viivids by letting users broadcast and watch an event from multiple perspectives in one immersive navigable experience

– switching perspectives like they were there!

Contact us to discuss investments, b2b opportunities, or your app idea – using ViiVids®