Parabolica #8 - 3 New Video AI Tools 97.5% of Marketers Don't Know About
Gen-1 by RunwayML, Genmo.ai, and Text2Live
It has been less than a month since I published my original post on Generative AI for Paid Social where I covered text2video(t2v) and video2video (v2v) AI.
Since then, three more options popped on my radar and have expanded into the space:
RunwayML, a well-known player in the AI video space
Genmo.ai, a brand-new t2v tool
Text2Live, a new t2v research paper released with code
I believe we are quickly reaching the early adopter stage because the tools are easier to use. The amount of available options are going to accelerate in this AI gold rush.
This piece by a16z provides a great overview of the generative AI happenings:
https://a16z.com/2023/01/19/who-owns-the-generative-ai-platform/
Below, I am going to cover the three tools’ capabilities, ease-of-use, and frame their use cases related to growth marketing.
Gen-1 by Runway ML
https://research.runwayml.com/gen1
Runway has a ton of cutting edge AI features built into their platform to adopt for the broader market. Gen-1 doesn’t have temporal coherence like the closed access AI that Meta and Google are working on. To get around that, you can use a source video apply a style to it.
“It's like filming something new, without filming anything at all.” - RunwayML
You can train your own model as well with a handful of images. This is a fun idea to play around with. Let’s say you sell handbags. You can upload several images of your handbags into RunwayML to create a custom model. This lets you generate images or videos of your handbag in scenes like:
handbag, high-quality product shoot
handbag on top of a horse, in the style of Pixar or Studio Ghibli
model holding handbag strutting down the catwalk in outer-space, realistic, cinematic
If you want a robust platform use RunwayML. You get three free projects. At the time of writing, Gen-1 is still behind close doors. I joined their waitlist and Discord so I’m waiting to play with it. Once I get my hands on it, I’ll write a post about Gen-1 if there is enough interest.
Genmo.ai
Genmo is a simple but effective t2v tool where you can convert your text prompt into an animation. It doesn’t have temporal coherence either but you can string together animation prompts with keyframes to transition scenes.
If you want to test out t2v, try Genmo for free. It’s a good way to understand how this technology works with prompting and keyframes.
Text2Live
https://text2live.github.io/sm/index.html
Text2Live is a paper released last month that lets you edit images and videos with prompts. So, you can achieve similar stylistic effects to your source video through Text2Live that Gen-1 has teased.
However, Text2Live doesn’t have an easy GUI for the mainstream market to access this AI. The tech-savvy can follow their steps on Github and test this now to find your optimal use-case.
So what?
These tools are great for lean growth marketing teams that need to supplement their creative velocity. Marketers can teach themselves how to concept, think about composition and styles, to 10x their creative output.
Performance marketing success relies on creative velocity and engaging content. Generative AI videos allow marketers to have the best of both worlds. I covered using AI to create visual hooks in a previous post:
I’ve also started to upload my AI videos onto YouTube as an example of what’s possible:
To succeed, you simply need to follow a testing framework and bucket your AI generated visuals accordingly. I wrote about my testing framework in this post on AI Influencers:
https://mansonchen.substack.com/i/97510955/creative-testing-framework
The AI video space is accelerating with new developments and players are quickly adopting them into broader market appeal.
Tasks that could only be done by a designer can increasingly be done with AI. What I was only able to do with Deforum on a Jupyter Notebook can soon be done with a GUI on Gen-1 by Runway. Adapt!
played with runway a few months back but wasn't able to make it useful for creating ads....but i want to add this to my toolkit so badly.
not technical enough to even understand what a jupyter notebook is - so will give runway another crack.