Overview
Digital augmented video streams are becoming increasingly important in the world of sports. Applications like VAR (Video Assistant Referee) in football, digital line judges in tennis, analysis of player movements and tactical positioning in sports studios or as part of competition preparation, and the display of optimal racing lines in skiing or motorsports are already commonplace in the sports industry. With technological advancements, the required equipment for recording raw video data is becoming more affordable, making entry into video streaming more accessible, especially for less popular sports and smaller clubs.
Meanwhile, videos of tournaments or competitions from almost all sports can be accessed online. However, this doesn't automatically mean that they are consumed. The democratization of sports aims to make a greater diversity of sports, including those at lower performance levels, accessible to a lay audience. One fundamental requirement for the attractiveness of such content is its presentation in the form of commentary, reports, and background stories.
The goal of this project is to employ state-of-the-art AI technology to overlay a video stream of a sports event with live commentary and digitally generate speech, all tailored to the preferences of the viewers. Imagine being able to have the football match of your local favorite team in the third Swiss league commented on by Rainer-Maria Salzgeber, as if he were a superfan. With our technology, this should become possible.
