AI technology is improving at an amazing rate. However, video is still a significant challenge. Wired reported on a development that may improve things, whilst also using less processing power.
A group from MIT and IBM developed an algorithm capable of accurately recognizing actions in videos while consuming a small fraction of the processing power previously required, potentially changing the economics of applying AI to large amounts of video. The method adapts an AI approach used to process still images to give it a crude concept of passing time. The work is a step towards having AI recognize what’s happening in video, perhaps helping to tame the vast amounts now being generated. On YouTube alone, over 500 hours of video were uploaded every minute during May 2019. Companies would like to use AI to automatically generate detailed descriptions of videos, letting users discover clips that haven’t been annotated. And, of course, they would love to sell ads based on what’s happening in a video.