Technology Thread

A forum for creative people.
User avatar
Garrett Gilchrist
Site Admin
Posts: 7077
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10509Post Garrett Gilchrist
Thu Mar 26, 2020 5:35 pm

PIFu: Single-View Full Body 3D Digitization, including Clothing from a single input image.
https://shunsukesaito.github.io/PIFu/

https://twitter.com/akanazawa/status/12 ... 7186869248




User avatar
Garrett Gilchrist
Site Admin
Posts: 7077
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10537Post Garrett Gilchrist
Sat Apr 18, 2020 4:44 am

https://www.youtube.com/watch?v=y3B8YqeLCpY

Automated lip sync.

As he notes at the end, in theory a lot of these programs already have auto lip sync.

In practice I've never gotten it to work and it would be much more limited than what I've done with my art anyway, only using a few basic mouth positions, and lacking the quality and variety I put into all my work.

In theory code could be written to better match what I'm actually going for, as he did with his - although his was also much more limited than my intentions, so the code would need to be more complex and randomized.

And would it be so bad to just suck it up and do the editing myself? It's not THAT hard but it was hard enough that I never did vast amount of work with my Doctor Who faces, or later my Adam Adamant faces.

An automated system written for more perfect compatibility with my work (including variations) and exporting to Premiere would be wild.



User avatar
Garrett Gilchrist
Site Admin
Posts: 7077
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10558Post Garrett Gilchrist
Fri Apr 24, 2020 9:46 pm

DeOldify competitor: auto colorization.
https://9may.mail.ru/restoration/?lang=en

User avatar
Garrett Gilchrist
Site Admin
Posts: 7077
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10560Post Garrett Gilchrist
Sat Apr 25, 2020 3:58 am

Running in real time, NVIDIA RTX Voice removes microphone background sounds: knocks, sirens, fans, everything but voices.

It also cleans up other people's mics if run on *all* audio. Leave it running and TV and YouTube become a strange soundtrack-free experience.

https://www.nvidia.com/en-us/geforce/gu ... tup-guide/

User avatar
Garrett Gilchrist
Site Admin
Posts: 7077
Joined: Tue Feb 12, 2013 1:23 am

Re: Technology Thread

Post: # 10570Post Garrett Gilchrist
Sat Apr 25, 2020 8:34 am

Face Tracking in After Effects.
https://www.youtube.com/watch?v=x7T5jiUpUiE

Post Reply