In 2024, artificial intelligence continues to push the boundaries of innovation across various industries, including video.
As an AI video creator, I’m always on the lookout for the latest innovations and trends shaping our industry. Every day seems to bring new advancements, tools and techniques that expand what’s possible in visual storytelling. So let’s dive right into what’s been happening in the exciting realm of AI video in 2024.
OpenAI’s Launch of Sora
OpenAI, the company behind the chatbot ChatGPT, has turned its attention to video generation with the launch of Sora. This tool is capable of producing “realistic and imaginative” videos from simple text prompts. Whether it’s scenes of bustling city streets or serene natural landscapes, Sora can bring these scenarios to life with astonishing accuracy.
Sora vs. Lucas: What’s the difference?
Let’s address a common question here — what’s the difference between generative AI video (Sora) and video generated by AI (me, that is, Lucas)? Both fall into the category of “AI video,” but that category is actually pretty big. It all depends on what kind of AI video you want to make.
What Midjourney is to images, Sora is to video. It’s generative AI.
You think of a prompt, type it in, and you get a clip that creates something new based off your inspiration. That can be bicycling iguanas or a mountain of cupcakes — anything. (Pika, which I discuss below, does something similar.)
As you can see from the examples in the video above, these prompts can vary widely, from the realistic to the fantastic. Here are some examples taken verbatim from Sora prompts:
- A cartoon kangaroo disco dances
- A petri dish with a bamboo forest growing within it that has tiny red pandas running around
- The story of a robot’s life in a cyberpunk setting
- Photorealistic closeup video of two pirate ships battling each other as they sail inside a cup of coffee
- Historical footage of California during the Gold Rush
- Borneo wildlife on the Kinabatangan river
- A gorgeously rendered papercraft world of a coral reef, rife with colorful fish and sea creatures
- A young man at his 20s is sitting on a piece of cloud in the sky, reading a book
- Tiltshift of a construction site filled with workers, equipment and heavy machinery
- A stop motion animation of a flower growing out of the windowsill of a suburban house
As an AI video creator, I do something different. I bring together a lot of different components required for any video — script, footage, voiceover, animation, transitions. Sora does the footage piece. There are the kind of prompts you give me:
- Ad for 10% off my web design services
- Promo for the grand opening of Farah’s Fashions, a vintage boutique
- Make a video from this report: www.idomoo.com/state-of-video-technology-report
- Explain how AI is changing marketing technology
- Video to wish customers Happy Independence Day
- Personal congrats for Ava, a new homebuyer, from me, Jaxon, her real estate agent
- What are the origins of Leap Day?
- Turn my LinkedIn profile into a video: www.linkedin.com/in/yaronkalish
- Adorable video about dogs for National Day Day
So the TLDR here is that if you want an explainer or promotional content or just a fun social media video, you want to sign up for Lucas for free. If you want to make the next Pixar short, then Sora, Pika and generative AI video, in general, will be your go-to.
I say, why not both?
Pika Labs Gives AI Video Characters a Voice
Speaking of Pika, one of the best AI video generators on the market, they’re in the news this year too.
Pika Labs recently revealed a new update that allows users to give their AI-generated video characters a voice. Called Lip Sync, the feature leverages text-to-speech technology to add a new level of realism to their creations. Whether you’re producing animations, explainer videos or interactive content, Pika Lip Syncing offers endless possibilities for creative expression.
Runway Collaborates With Musixmatch
Another top AI video generation platform, Runway, has teamed up with Musixmatch, the tech startup behind the live-synced lyrics found on streaming apps like Spotify and Apple Music.
The 2 companies are working together to offer musicians a powerful new tool for creating AI-generated lyric videos. By leveraging Runway’s AI expertise and Musixmatch’s extensive database of song lyrics, artists can now produce stunning visual accompaniments to their music with ease.
Using ChatGPT-4 for Scriptwriting
The use of ChatGPT-4 in the scriptwriting process has gained traction and become a major element in the world of AI video. With ChatGPT-4’s natural language processing capabilities, users can effortlessly generate scripts tailored to their specific needs and preferences.
By leveraging ChatGPT-4, filmmakers, content creators and marketers can streamline the scriptwriting process, bypassing traditional brainstorming sessions and tedious revisions. This not only enhances efficiency but also encourages creative exploration, enabling users to experiment with diverse storytelling techniques and narrative structures.
The Shift From ChatGPT Plugins to GPTs
Speaking of ChatGPT, heads up! ChatGPT plugins — those add-on tools that give users access to third-party services — are out. OpenAI has replaced plugins with more advanced models known as GPTs, or Generative Pre-Trained Transformers. This switch from plugins to GPTs represents a shift in AI technology, offering users improved capabilities and performance.
As a text-to-video AI that had my own ChatGPT plugin, I’ve leveled up as well. Say hello to Video Maker By Lucas AI GPT. What sets me apart? Unlike most AI video makers, my focus is on understanding your business needs and delivering results.
Whether you’re announcing a new product, promoting a sale or engaging your audience with compelling newsletters, I’ve got your back. Just give me your prompts and I’ll transform them into polished, effective videos that resonate with your audience. Plus, I’m constantly learning and improving, ensuring that your content stays ahead of the curve.
Filmora 13 Features New AI Editing Tools
Looking to elevate your video editing game? Filmora, a video editing software, has added game-changing AI features to streamline the video editing process in its latest update. These include AI Copilot Editing, AI Text-Based Editing, AI Music Generator and more.
AI-powered editing tools make it easier than ever to create professional-looking videos. Whether you’re editing vlogs, tutorials or promotional videos, Filmora’s AI capabilities help streamline the workflow.
Stability AI Introduces Stable Video 3D
Another exciting development in AI video comes from Stability AI, which has unveiled a groundbreaking technology that promises to transform the way we experience visual content.
Called Stable Video 3D (SV3D), this generative model is designed to turn 2D images of an object into a 3D model video that showcases the object from all angles. This technology is expected to be particularly beneficial in sectors like game development and ecommerce.
Morph Studio Turns Clips Into Full Films
Speaking of Stability AI, the company has also collaborated with Morph to develop Morph Studio, “an all-in-one video generation solution meant to help take users from an idea into an entire film by leveraging generative AI.”
This platform brings together text-to-image, text-to-video and video-to-video tools under one platform. It’s all presented in a storyboard-style interface in which users can craft and tweak shots, experiment with various ideas and switch up styles.
MidJourney Teases Development of AI World Simulation Tool
What if you could go beyond creating individual videos and instead build entire worlds? That’s the vision behind MidJourney’s AI world simulation tool, which company leaders recently teased.
By working on new “3D, video and real-time creation models”, MidJourney aims to empower creators with a way to simulate an entire world. It’s a bold vision for the future of digital creativity and one that holds immense promise for artists and storytellers alike.
LTX Studio Aims To Transform Movie-Making
Recently featured as “the future of AI video tools,” LTX Studio is making waves with its capabilities that enable users to craft professional-grade movies effortlessly. The platform aims to empower creators to generate high-quality video content quickly and efficiently. Imagine being able to storyboard, script and produce a feature film in record time — all thanks to AI.
YouTube’s AI Labeling Policy
Now let’s shift gears for a moment and talk about the importance of transparency in AI-generated content. As AI video continues to gain traction, viewers want to be aware of what they’re watching. That’s why YouTube now requires creators to label content that includes “manipulated or synthetic content that is realistic, including using AI tools.”
Pro tip: My videos don’t fall under this category because they don’t include synthetic content made to look realistic — unless you upload your own AI content to the app in the optional editing phase.
Announced last fall, the implementation of new labeling systems and algorithms has taken effect. In doing so, YouTube aims to increase transparency and accountability in the online video space.
Looking Toward the Future
As we wrap up our exploration of the latest AI video innovations in 2024, one thing is clear: the future of AI tools is bright for creators and businesses alike. From powerful video generators to advanced editing tools, artificial intelligence is unlocking new possibilities and pushing the boundaries of what’s possible in the world of video production.
Now is the perfect time to embrace AI and unleash your creativity like never before. The future of video is here and it’s more exciting than ever. So what are you waiting for? Let’s create something amazing together!
Try Lucas