Interesting AI models can remove moving objects from videos

Artificial intelligence is one of the fastest growing and most powerful fields in the technology world today, with a series of newly announced achievements almost constantly, promising to make significant changes. told in many different areas of life.

Previously, we have seen how effective developers exploit the power of artificial intelligence (AI) in editing, post-production tasks to turn blurry photos into light, dark into colorful, bright pictures, or images that are often animated . with high accuracy and incredible truth. However, AI is now able to do much more than that: remove moving objects in videos.

1. The AI ​​knows how to play poker, beating the best in the world in a 6-player game

Accordingly, this AI-assisted software can help video editors easily remove moving objects from a video recording without having to resort to special skills or complicated operations. All you need to do to remove an object from the scene is just to enclose the object and the software (or rather, AI) will take care of the rest to help you.

Here are a few examples of this AI model's ability to erase moving objects:

The object will be zoned before deleting

The moving object has been removed

As you can see in the above animation, the algorithm generally eliminates the image of a man crossing the road quite convincingly, but it will still leave some unusual traces, not difficult. to realize if you pay close attention. But basically, the entire image of the object has been completely removed.

In other cases, the process of removing moving objects still leaves unusual signs in the video, but it doesn't seem as obvious as the example above.

1. Chinese startups experimenting with projects tracking lost dogs through 'nose marks'

The sail has been erased, but the bottom wave remains

The object was removed very thoroughly but still left some unusual details easily recognizable

This interesting software was built by a developer with the zllrucky nickname, and was also uploaded to GitHub.

The author of the software said he relied on two different training models, called SiamMask and Deep Video Inpainting to build this software. SiamMask is used to track moving objects in the video, while Deep Video Inpainting has the task of removing them from the video.

In fact, this is not the first software to support moving objects in the video, but the difference is that the physical processing of the zllrucky software is done automatically. through the help of AI, instead of manual editing, relatively complicated and time consuming as on some current software.

1. AI models use aerial and ground data to navigate areas that are difficult to observe

A little while ago, researchers from Nanyang Technological University in Singapore have also experimented with a fun algorithm that can perform the same function, but the deleted object is not very thorough, as you can see in the video below:

The object removal software of Nanyang Technological University research team gave quite good results

Another big name in post-editing software development Adobe also demonstrated a similar feature in the After Effects video editing application in early 2019 as follows:

Adobe physical removal software requires users to perform some manual operations

However, unlike After Effects, the zllrucky author's software is open source, meaning that you can freely browse its code and edit it to suit your needs, it will be interesting!