Page 3 of 5

Re: Technology Thread

Posted: Tue Dec 31, 2019 11:50 pm
by Garrett Gilchrist

Re: Technology Thread

Posted: Sun Jan 05, 2020 4:12 pm
by Garrett Gilchrist

Re: Technology Thread

Posted: Sun Jan 12, 2020 8:53 pm
by Garrett Gilchrist
RunwayML is an app (for computers) that provides a user-friendly way to interact with 'AI' without code. One of the modules it makes available is DeOldify, a neural network for colouring black and white photos.

https://runwayml.com/
https://twitter.com/runwayml

Try some processes here, just drag and drop in the browser : http://try.market-place.ai.ovh.net (choose colorisation in the drop down menu).

Re: Technology Thread

Posted: Tue Jan 21, 2020 11:44 pm
by Garrett Gilchrist
3DBuzz has shut down, releasing its tutorials for free to those who want to learn 3D graphics, programming and so on.

https://www.3dbuzz.com/

Re: Technology Thread

Posted: Wed Jan 22, 2020 12:32 am
by Garrett Gilchrist
How to copyright claim your own Youtube video
https://www.youtube.com/watch?v=ieErnZA ... e=youtu.be

Re: Technology Thread

Posted: Wed Jan 22, 2020 2:47 pm
by Garrett Gilchrist
Here is version 2 of colorization tool DeOldify. V3 is currently unreleased.
https://deepai.org/machine-learning-model/colorizer

Re: Technology Thread

Posted: Mon Jan 27, 2020 4:13 am
by Garrett Gilchrist
DAIN video slow motion interpolation with occlusion-spotting AI. I have often (almost constantly!) needed video slow motion interpolation better than what AfterEffects CS6 can do. (I'm sure current After Effects is somewhat better in that regard.)

https://sites.google.com/view/wenbobao/dain
https://github.com/baowenbo/DAIN


Restoring and upscaling videos with EDVR.
https://github.com/btahir/deoldify_and_edvr

Re: Technology Thread

Posted: Tue Feb 04, 2020 9:52 pm
by Garrett Gilchrist
Bit of a summary:


There is now a frame interpolator called DAIN which takes depth and occlusion into account when slowing down footage, and Topaz AI Gigapixel, which upscales photos, has been in alpha with a video upscaler which is coming out this month. That should give appropriate results. (Another photo/video upscaler, Waifu2x, is not as good but free to the public. Its more basic upscaling is occasionally preferable to Topaz' AI guesses, but only rarely. Topaz' upscaling also destroys noise and grain in an intelligent way.)

You can stabilize the footage in After Effects (based on landmarks) or I think VirtualDub based on the frame generally. Neatvideo can remove grain as necessary. AfterEffects can indeed interpolate new frames (as can Twixtor), but only if there isn't significant or fast motion. (It's more primitive.)

DeOldify can add color, especially the unreleased third commercial version which is much better. EBSynth can take a color keyframe and animate it based on the video motion, allowing for more complete colorization, and DeepRemaster can also do that, if given a bunch of color keyframes to learn from. (I've done a Youtube tutorial about the last three, since I was developing the use of these together as a new technique.)

EBSynth can also match the quality of frames if you're switching from a high quality source to a lower quality one (or even including new CGI). Neither of these were its intended use, but as a film restorationist I'm starting to use it a whole lot.

Spleeter can separate vocals and voice from a music track. It used to be a very light program but now seems to be a resource hog. Still works though, and has come in handy on many edits.

Re: Technology Thread

Posted: Wed Feb 05, 2020 10:00 am
by Garrett Gilchrist
https://colab.research.google.com/githu ... eter.ipynb

Here is an in-browser solution for Spleeter, the tool which separates vocals and voice from music.

Which is good, because Spleeter used to be a light program and is now a resource hog. Doing it in the cloud removes that annoyance and risk.

I run DeOldify and DeepRemaster, the colorization tools, in the same sort of environment.

There is a Files button at left where you can upload your files, and download them when done.

Just run each command in order, altering the filenames to yours, and it should work. It's set up to produce two stems here. 4 and 5 stems is also an option, although I'm not sure what I'd type for that here.

(normally something like Spleeter separate -i [path to song] -o [output folder] -p Spleeter:[2, 4, or 5]Stems )

(Keep in mind that Chrome will block multiple downloads with a little red error in your URL bar, so keep clicking that and redownloading until it works.)

Re: Technology Thread

Posted: Fri Feb 14, 2020 4:17 pm
by Garrett Gilchrist
Face swapping with Reflect Tech.
https://www.youtube.com/watch?v=ghkq7I_28yM