2019 Archive - AWS Elemental Blog

Video Processing Perspectives

2019 Archive - AWS Elemental Blog
2019 Archive - AWS Elemental Blog
Submitted by Alyssa on May 15, 2019

With consumer adoption of OTT services and viewing of live sporting events on mobile devices at an all-time high, content creators and distributors are working hard to fine-tune their infrastructures and workflows to meet demand. For many, this has meant leveraging the flexibility and scalability of cloud-based computing and artificial intelligence (AI)-powered services, which require less capital cost and facilitate experimentation with new channels and mobile-first services.

At the recent 2019 NAB Show, a keynote panel, “Beyond the Field: How Sports Pioneers are Powering the 360 Audience Experience in the Cloud” brought together several leading media companies to discuss their strategies for servicing sports fans across multiple delivery platforms.

Moderated by Cynthia Frelund, the NFL’s first analytic expert, the panel included Stephanie Lone, Senior Vice President, Engineering, CBS Sports Digital; Rafael Soltanovich, Vice President, Software Development, Hulu; Scott Sonnenberg, Chief Global Partnerships Officer, L.A. Clippers; and Mark Kramer, Vice President, Engineering & Technology, Pac-12 Networks. These leaders share a key and common goal: provide fans a great experience driven by reliable and highly targeted content delivery—giving customers access to video and data services on their terms.

Frelund kicked off the discussion, reflecting on how a lot of professional sports teams in the U.S. now use cloud-based analytics and AI to help them better understand their own team’s tendencies -- and how they can use that to do better against their opponents. This same data-driven concept has swept the content world as well, helping media companies produce and deliver content more efficiently and with better accuracy.

“The NFL pioneered next-gen stats with AWS, so it's pretty cool to see these relational GPS data points being put together that help us tell deeper stories,” Frelund said, adding that she writes her own code using AWS tools. “For me, it’s all about the why and the storytelling. We’re starting to get deeper and deeper answers and the reason why is because we are looking at data in new and interesting ways.”

CBS Sports Digital’s Lone, who is in charge of engineering for all of the network’s online sports platforms (including the newly launched CBS Sports HQ streaming service), talked about CBS Sports’ live stream of Super Bowl LIII on February 3, 2019. She said the digital stream set viewership records, including 7.5 million unique devices, which was 20 percent higher than last year, with viewers consuming more than 560 million total minutes of live game coverage, up 19% from last year. The average minute audience of 2.6 million viewers during the game window was also up 31% year-over-year.  

“CBS only gets to stream the Super Bowl every three years,” she said. “In 2017, the focus was on the desktop experience. This time we had the rights to mobile. We looked at all of our platforms and made sure they had failover options so that they were as reliable as the linear broadcast. Consumers don't care about packets or how they get the feed; they only care that they don’t want to miss a touchdown. Period.”

To make this experience a great one for fans, Lone and her team created an entirely new playbook which incorporated AWS services, including AWS Elemental MediaStore, a storage service optimized for media that provides the performance, consistency, and low latency required to deliver live streaming video content.

“We stream 35,000 live events per year and we would not be able to do that without the AWS Cloud and its ability to scale,” Lone said. “We also have 24/7 live channels that we need to support. In the beginning of 2018 we basically started from scratch and said ‘we’re going to build everything natively in the cloud, because there’s no way to buy that much hardware and infrastructure to keep up with that many events.’ And, by the way, we had to have it all done in seven months with a limited budget.”

Her team took a step-by-step approach and created a hybrid cloud/on-premise infrastructure for the Super Bowl, applying cloud services everywhere it made sense.

“We worked with AWS and their (AWS) Elemental encoders … they made an HLS output-locking feature for us so we could have multiple redundant streams,” Lone said. “And we could literally seamlessly switch from stream to stream and the consumer would never see any latency, lag or buffering.” CBS Sports Digital also employed the AWS Direct Connect service, as Lone notes, “…we had ‘direct connects’ from (AWS) Elemental Live encoders into multiple MediaStore regions, and this is where AWS features like disaster recovery really helped make the consumer experience so good.”

As Vice President, Software Development for Hulu, Rafael Soltanovich is responsible for all of the services and technology that power consumer experiences. The OTT service provider added live sports content in 2017 and, according to Soltanovich, it has seen subscribers increase significantly.

“No TV service is complete without live sports,” he said. “And we can't compete in sports without the cloud.”

Soltanovich spoke about the importance of AWS in allowing them to easily and predictably scale up capacity for large sporting events, particularly NFL football, then scale back down when the demand subsides.

“The cloud shines for scaling,” he said. “The thing we have learned about live services is that fans like live sports, but they love football. Our concurrent peak streams during football games are the most we experience for any event. So, we had to get good at serving up the games live in a hurry. It’s one thing to run a live event online that you can prepare for and scale. It’s another thing entirely to run a linear channel where you may have a program where only 10 or 50,000 people are watching and then you switch to a Super Bowl where millions are watching in a split second. It’s a challenge.”

So, how do you plan for that? At Hulu they use mathematical analysis and AWS to forecast what the usage of an upcoming live event is going to be. The company now does that on a weekly basis and, Soltanovich said, can reliably predict what the viewership is going to be for any one event.

“We’ve gotten good enough that in the last year that we typically come within five percent of determining the actual concurrent usage that occurs,” he said. “Beyond that, working closely with AWS and our systems, we’re able to pressure test them on a weekly basis so that at any given time we are able to scale to five times the peak or ten times the peak. And the numbers have been growing significantly. If you compare the Super Bowl, the number of concurrent users we saw was four times what it was last year. And we expect that number to continue to increase.”

Scott Sonnenberg said that the L.A. Clippers’ owner, Steve Ballmer, is “all-in” on using AWS and Amazon artificial intelligence services to give fans an exclusive experience within the basketball arena and at home. In an L.A. Clippers video shown during the panel discussion, Ballmer noted: “There’s such an opportunity to change the way people experience sports by using technology. What if we could actually diagram what plays are going on because they can recognize it in real time? What if we could show the probability of a shot going in?”

The team recently launched Clippers CourtVision, powered by AWS technology, which allows fans to do just that and a lot more. Clippers CourtVision lets viewers switch between different cameras angles and audio options, watch three Modes with different and unique live, augmented graphical overlays and access on-demand content. Fans can personalize their experience on their mobile device or computer via Mascot Mode, which features animated graphics and pop-ups; Coach Mode, which shows plays diagrammed on their screen in real time and Player Mode, which overlays statistics and real-time probabilities over live game action. These features are made possible by cameras that have been installed in the ceiling of all NBA arenas that capture the action from above. AWS machine learning and data analytics services advance the analyses and drive the Clippers CourtVision experience.

“We rely on AWS to help guide us as to what our fans are interested in,” Sonnenberg said. “We believe Clippers CourtVision will change the way sports will be watched. It gives you a lot of options. We have an owner that challenges us to improve the experience both inside the stadium and for consumers at home or on the go. We’re starting with the Clippers but a lot of teams are interested in this technology because it helps tell the story of the game in much more detail.”

Finally, Mark Kramer of Pac-12 Networks spoke about the use of AWS services for reducing his content creation and delivery costs, and providing new kinds of viewing experiences across a wide range of collegiate sports. Pac-12 Networks has pioneered the “At-Home” remote production model, in which much of the signal processing happens in the cloud.

“Our mission is to connect fans to the universities and sports that they love,” Kramer said. “And we do that by broadcasting 850 live events each year on our seven linear networks and in our TV everywhere Pac-12 Now app. We also do hundreds of digital-only events. It’s a lot more sports than football.”

Using AWS services allows Pac-12 Networks to turn channels or events on and off without having to worry about capital expense, he said. Along with traditional video production equipment on the ground, Pac-12 Networks currently uses a number of AWS services to package and distribute content to conference fans. These include Amazon Simple Storage Service (Amazon S3), AWS Elemental MediaTailor, AWS Elemental MediaLive, AWS Elemental MediaPackage, and AWS Elemental MediaConnect (which Kramer said he really likes because it allows them to push one mezzanine stream to multiple end points, thus getting more content to more people faster).

Kramer added: “We don’t see video as video. We see video as data.”

Submitted by Alyssa on May 9, 2019

Technological innovations have taken sports performance analytics into a new stratosphere. Sports organizations, coaches, and players can now easily access a host of tools to more effectively evaluate and improve player and team performance. Leading sports performance software provider iSportsAnalysis addresses some of the most pressing analytics challenges that sports clubs face today.

The iSports Analysis service creates a synchronized set of XML data along with a video asset to provide sports organizations with a robust game analysis toolset. Recently, iSportsAnalysis moved its solution from on premises to the cloud with Amazon Elastic Compute Cloud (Amazon EC2), electing to also use AWS Media Services for video transcoding and Amazon Simple Storage Service (S3) for greater efficiency and elasticity.

With a background in corporate streaming, iSportsAnalysis quickly garnered interest from sports organizations looking to analyze performance during games and matches. As analytics fever caught on in sports, more of the company’s clients began asking for a way to combine live footage with analysis. Working closely with universities and sports clubs, the company developed a tool to tag possessions and other stats called “Sports Performance Analysis” which was designed to integrate with third-party analysis tools. 

iSportsAnalysis CEO Anadi Taylor then began to envision a more cost-effective solution to meet the increasing demand. Drawing on his background in programming and live streaming, he studied existing solutions, identified gaps in functionality, and interviewed coaches, sport scientists, and analysts to uncover their specific needs. The resulting solution, iSportsAnalysis, has been used in real-time matches since 2017. Since then, Taylor and his team have continued to refine the solution, adding an online messaging system, synchronized video and analysis, filtering options, playlist generation, and more.  

Taylor migrated iSportsAnalysis into the AWS Cloud from a rented server. Commenting on the experience, he shared, “Transferring to running Amazon EC2 instances was easy and super-fast; I was ready to go in a few hours. We even moved our transcoding over to AWS Elemental MediaConvert and I’ve never looked back. I also love that AWS tools give us the ability to regularly bring new features to our clients.”

iSportsAnalysis also migrated from a MySQL database service, hosted on Amazon EC2, to using Amazon Aurora. “The transition was incredibly smooth and the backup functionality, failure detection, and scalability has proved invaluable, let alone the time savings," Taylor added.

Today, iSportsAnalysis clients—whether coaches, players, or other sports professionals—log into an online administrative dashboard to get a customized view of their video footage and associated data. They can easily upload new videos, which are then stored in an S3 bucket.  From there, content is transcoded to a unified video file format and specified resolution using AWS Elemental MediaConvert. Users can then tag or code the video and generate an in-depth data set that is linked back to the processed asset. The way in which the technology pairs data with video makes it simpler for users to search each video and identify key moments that may provide insight as to how players and teams can improve their performance.

Looking to the future, iSportsAnalysis plans to increase the use of AWS Media Services, along with the Amazon CloudFront content delivery network (CDN) to allow coaches and players to stream game footage with analytics to any connected device, making it faster and easier to improve game strategy as well as individual performance.

Submitted by James on April 18, 2019

With more than 90,000 attendees from 160 countries, the 2019 NAB Show again attracted media and entertainment professionals from across the world to interact with the people and tools that will propel the industry forward. AWS was there to share insights, strategies, and technologies to help content providers create innovation and opportunity from their broadcast and streaming video workflows. Among the highlights:

New solutions in action

The AWS booth hosted more than 20 demonstrations spanning the media supply chain from content creation through content distribution. Among the most requested demos was Accelerated Transcoding, a new feature in AWS Elemental MediaConvert that increases the processing speed of file-based video encoding jobs by up to 25 times. The demo also incorporated Quality-Defined Variable Bitrate (QVBR) control to visualize how AWS helps lower storage and transfer costs for VOD workflows while delivering consistent video quality.

Another new demo showed how AWS can reduce live video latency to ultra-low, better-than-broadcast levels. Taking advantage of new chunked object transfer functionality, AWS Elemental MediaStore and Amazon CloudFront anchored an end-to-end live streaming workflow that achieved consistent sub-four-second latency from source to screen.

Also demonstrated at NAB was SPEKE, the Secure Packager and Encoder Key Exchange developed by AWS as an open standard that simplifies content protection for video. AWS Elemental on-premises and cloud solutions at NAB employed SPEKE to enable seamless integration with DRM key servers.

On-demand conference sessions

AWS participated in a number of educational sessions at NAB, some of which are available for on demand viewing:

In Beyond the Field: How Sports Pioneers are Powering the 360 Audience Experience in the Cloud, NFL.com analytics expert Cynthia Frelund and an expert panel discussed how next-generation media workflows can create enhanced, customized experiences for sports fans. Sharing insights are sports media leaders Stephanie Lone, Senior Vice President, Engineering, CBS Sports Digital; Rafael Soltanovich, Vice President, Software Development, Hulu; Scott Sonnenberg, Chief Global Partnerships Officer, LA Clippers; and Mark Kramer, Vice President, Engineering and Technology, Pac-12 Networks. Watch on demand.

On the NAB Live Stage, Jason Fotter, co-founder and CTO of FuseFX joined Thomas Phariss of AWS Thinkbox to discuss the rapidly evolving state of the art in visual effects and the speed and scale afforded by cloud-based rendering solutions. To watch the AWS Thinkbox session, start the video at 05:01:25. 

A plethora of partners

Twelve technology partners set up demo stations in the AWS booth with solutions that help create, protect, distribute, and monetize media streaming video content, joined by more than 40 Amazon Partner members across the NAB show floor. Featured partners were AccedoArc PublishingAccurate Player by CodemillDeluxeGrabyoGrayMetaReach Engine by Levels BeyondMetaPikselOvercast HQVeset, and Vidispine.

Industry recognition

AWS was honored to receive three awards during NAB: Video Edge recognized AWS Elemental MediaConnect and SPEKE with Best of Show awards, and TV Technology also awarded MediaConnect with Best of Show. SPEKE was also recognized as a finalist by IABM in the Publish category as a part of the Broadcast and Media (BaM) awards presented at NAB Show.

4K 4Charity breaks the million dollar mark

More than 500 participants from across the industry started their Tuesday at Sunset Park in Las Vegas for the fifth annual 4K 4Charity Fun Run benefiting global non-profit Girls Who Code. With participant and sponsor support, 4K 4Charity surpassed $1 million in lifetime funds raised for its non-profit partners!