Rotoscoping Video to Pixel Art with AI Assistance from Roboflow

Eric Jacobus recently uploaded some excellent source video of him performing various moves, and asked his community of subscribers if anyone was interested in helping convert it to pixel art.

I thought this might be a good time to experiment with some machine-learning techniques to see if I could use ML to speed up the process. So far I haven't (yet) successfully trained a model to automatically rotoscope the video, but Roboflow's tools are so excellent that I almost don't mind just using those to do the rotoscoping directly within their annotation tool. Ever since they added Facebook's Segment Anything Model (SAM) into their GUI, annotating data has been a dream. I love the keyboard shortcuts -- data entry is always painful, but this makes it as smooth and seamless as I could ever imagine it being!

All of the code for this is up on Github, and the project on Roboflow is public so that anyone else is free to download the code and dataset to play with it yourself.

Enjoy!

Original post by Eric Jacobus:
https://www.youtube.com/post/UgkxmmbPy3G8TwTVE3U9PY3QnocjConqO9NE

Source code on Github:
https://github.com/HanClinto/JacobusHoliday

Project on Roboflow:
https://universe.roboflow.com/ecosystem/jacobus-cop-on-holiday