Technology Thread

A forum for creative people.


User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10438Post Garrett Gilchrist
Sun Jan 12, 2020 8:53 pm

RunwayML is an app (for computers) that provides a user-friendly way to interact with 'AI' without code. One of the modules it makes available is DeOldify, a neural network for colouring black and white photos.

https://runwayml.com/
https://twitter.com/runwayml

Try some processes here, just drag and drop in the browser : http://try.market-place.ai.ovh.net (choose colorisation in the drop down menu).

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10452Post Garrett Gilchrist
Tue Jan 21, 2020 11:44 pm

3DBuzz has shut down, releasing its tutorials for free to those who want to learn 3D graphics, programming and so on.

https://www.3dbuzz.com/

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10453Post Garrett Gilchrist
Wed Jan 22, 2020 12:32 am

How to copyright claim your own Youtube video
https://www.youtube.com/watch?v=ieErnZA ... e=youtu.be

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10455Post Garrett Gilchrist
Wed Jan 22, 2020 2:47 pm

Here is version 2 of colorization tool DeOldify. V3 is currently unreleased.
https://deepai.org/machine-learning-model/colorizer

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10460Post Garrett Gilchrist
Mon Jan 27, 2020 4:13 am

DAIN video slow motion interpolation with occlusion-spotting AI. I have often (almost constantly!) needed video slow motion interpolation better than what AfterEffects CS6 can do. (I'm sure current After Effects is somewhat better in that regard.)

https://sites.google.com/view/wenbobao/dain
https://github.com/baowenbo/DAIN

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10471Post Garrett Gilchrist
Tue Feb 04, 2020 9:52 pm

Bit of a summary:


There is now a frame interpolator called DAIN which takes depth and occlusion into account when slowing down footage, and Topaz AI Gigapixel, which upscales photos, has been in alpha with a video upscaler which is coming out this month. That should give appropriate results. (Another photo/video upscaler, Waifu2x, is not as good but free to the public. Its more basic upscaling is occasionally preferable to Topaz' AI guesses, but only rarely. Topaz' upscaling also destroys noise and grain in an intelligent way.)

You can stabilize the footage in After Effects (based on landmarks) or I think VirtualDub based on the frame generally. Neatvideo can remove grain as necessary. AfterEffects can indeed interpolate new frames (as can Twixtor), but only if there isn't significant or fast motion. (It's more primitive.)

DeOldify can add color, especially the unreleased third commercial version which is much better. EBSynth can take a color keyframe and animate it based on the video motion, allowing for more complete colorization, and DeepRemaster can also do that, if given a bunch of color keyframes to learn from. (I've done a Youtube tutorial about the last three, since I was developing the use of these together as a new technique.)

EBSynth can also match the quality of frames if you're switching from a high quality source to a lower quality one (or even including new CGI). Neither of these were its intended use, but as a film restorationist I'm starting to use it a whole lot.

Spleeter can separate vocals and voice from a music track. It used to be a very light program but now seems to be a resource hog. Still works though, and has come in handy on many edits.

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10474Post Garrett Gilchrist
Wed Feb 05, 2020 10:00 am

https://colab.research.google.com/githu ... eter.ipynb

Here is an in-browser solution for Spleeter, the tool which separates vocals and voice from music.

Which is good, because Spleeter used to be a light program and is now a resource hog. Doing it in the cloud removes that annoyance and risk.

I run DeOldify and DeepRemaster, the colorization tools, in the same sort of environment.

There is a Files button at left where you can upload your files, and download them when done.

Just run each command in order, altering the filenames to yours, and it should work. It's set up to produce two stems here. 4 and 5 stems is also an option, although I'm not sure what I'd type for that here.

(normally something like Spleeter separate -i [path to song] -o [output folder] -p Spleeter:[2, 4, or 5]Stems )

(Keep in mind that Chrome will block multiple downloads with a little red error in your URL bar, so keep clicking that and redownloading until it works.)

User avatar
Garrett Gilchrist
Site Admin
Posts: 6864
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10478Post Garrett Gilchrist
Fri Feb 14, 2020 4:17 pm

Face swapping with Reflect Tech.
https://www.youtube.com/watch?v=ghkq7I_28yM

Post Reply