Watch this: Adobe shows how AI and OpenAI’s Sora will change Premiere Pro and video editing forever

OpenAI's Sora gave us a glimpse earlier this year of how generative AI is going to change video editing – and now Adobe has shown off how that's going to play out by previewing of some fascinating new Premiere Pro tools.

The new AI-powered features, powered by Adobe Firefly, effectively bring the kinds of tricks we've seen from Google's photo-focused Magic Editor – erasing unwanted objects, adding objects and extending scenes – to video. And while it isn't the first piece of software to do that, seeing these tools in an industry standard app that's used by professionals is significant.

For a glimpse of what's coming “this year” to Premiere Pro and other video editing apps, check out the video below. In a new Generative panel, there's a new 'add object' option that lets you type in an object you want to add to the scene. This appears to be for static objects, rather than things like a galloping horse, but it looks handy for b-roll and backgrounds.

Arguably even more helpful is 'object removal', which uses Firefly's AI-based smart masking to help you quickly select an object to remove then make it vanish with a click. Alternatively, you can just combine the two tools to, for example, swap the watch that someone's wearing for a non-branded alternative.

One of the most powerful new AI-powered features in photo editing is extending backgrounds – called Generative Fill in Photoshop – and Premiere Pro will soon have a similar feature for video. Rather than extending the frame's size, Generative Extend will let you add frames to a video to help you, for example, pause on your character's face for a little longer. 

While Adobe hasn't given these tools a firm release date, only revealing that they're coming “later this year”, it certainly looks like they'll change Premiere Pro workflows in a several major ways. But the bigger AI video change could be yet to come… 

Will Adobe really plug into OpenAI's Sora?

A laptop screen showing AI video editing tools in Adobe Premiere Pro

(Image credit: Adobe)

The biggest Premiere Pro announcement, and also the most nebulous one, was Adobe's preview of third-party models for the editing app. In short, Adobe is planning to let you plug generative AI video tools including OpenAI's Sora, Runway and Pika Labs into Premiere Pro to sprinkle your videos with their effects.

In theory, that sounds great. Adobe showed an example of OpenAI's Sora generating b-roll with a text-to-video prompt, and Pika powering Generative Extend. But these “early examples” of Adobe's “research exploration” with its “friends” from the likes of OpenAI are still clouded in uncertainty.

Firstly, Adobe hasn't committed to launching the third-party plug-ins in the same way as its own Firefly-powered tools. That shows it's really only testing the waters with this part of the Premiere Pro preview. Also, the integration sits a little uneasily with Adobe's current stance on generative AI tools.

A laptop screen showing AI video editing tools in Adobe Premiere Pro

(Image credit: Adobe)

Adobe has sought to set itself apart from the likes of Midjourney and Stable Diffusion by highlighting that Adobe Firefly is only trained on Adobe Stock image library, which is apparently free of commercial, branded and trademark imagery. “We’re using hundreds of millions of assets, all trained and moderated to have no IP,” Adobe's VP of Generative AI, Alexandru Costin, told us earlier this year.

Yet a new report from Bloomberg claims that Firefly was partially trained on images generated by Midjourney (with Adobe suggesting that could account for 5% of Firefly's training data). And these previews of new alliances with generative video AI models, which are similarly opaque when it comes to their training data, again sits uneasily with Adobe's stance.

Adobe's potential get-out here is Content Credentials, a kind of nutrition label that's also coming to Premiere Pro and will add watermarks to clarify when AI was used in a video and with which model. Whether or not this is enough for Adobe to balance making a commercially-friendly pro video editor with keeping up in the AI race remains to be seen.

You might also like

TechRadar – All the latest technology news

Read More

OpenAI’s Sora will one day add audio, editing, and may allow nudity in content

OpenAI’s Chief Technology Officer Mira Murati recently sat down with The Wall Street Journal to reveal interesting details about their upcoming text-to-video generator Sora.

The interview covers a wide array of topics from the type of content the AI engine will produce to the security measures being put into place. Combating misinformation is a sticking point for the company. Murati states Sora will have multiple safety guardrails to ensure the technology isn’t misused. She says the team wouldn’t feel comfortable releasing something that “might affect global elections”. According to the article, Sora will follow the same prompt policies as Dall-E meaning it’ll refuse to create “images of public figures” such as the President of the United States. 

Watermarks are going to be added too. A transparent OpenAI logo can be found in the lower right-hand corner indicating that it's AI footage. Murati adds that they may also adopt content provenance as another indicator. This uses metadata to give information on the origins of digital media. That's all well and good, but it may not be enough. Last year, a group of researchers managed to break “current image watermarking protections”, including those belonging to OpenAI. Hopefully, they come up with something tougher.

Generative features

Things get interesting when they begin to talk about Sora's future. First off, the developers have plans to “eventually” add sound to videos to make them more realistic. Editing tools are on the itinerary as well, giving online creators a way to fix the AI’s many mistakes. 

As advanced as Sora is, it makes a lot of errors. One of the prominent examples in the piece revolves around a video prompt asking the engine to generate a video where a robot steals a woman’s camera. Instead, the clip shows the woman partially becoming a robot. Murati admits there is room for improvement stating the AI is “quite good at continuity, [but] it’s not perfect”.

Nudity is not off the table. Murati says OpenAI is working with “artists… to figure out” what kind of nude content will be allowed.  It seems the team would be okay with allowing “artistic” nudity while banning things like non-consensual deep fakes. Naturally, OpenAI would like to avoid being the center of a potential controversy although they want their product to be seen as a platform fostering creativity. 

Ongoing tests

When asked about the data used to train Sora, Murati was a little evasive. 

She started off by claiming she didn’t know what was used to teach the AI other than it was either “publically available or license data”. What’s more, Murati wasn’t sure if videos from YouTube, Facebook, or Instagram were a part of the training. However she later admitted that media from Shutterstock was indeed used. The two companies, if you’re not aware, have a partnership which could explain why Murati was willing to confirm it as a source.

Murati states Sora will “definitely” launch by the end of the year. She didn’t give an exact date although it could happen within the coming months. For now, the developers are safety testing the engine looking for any “vulnerabilities, biases, and other harmful results”.

If you're thinking of one day trying out Sora, we suggest learning how to use editing software. Remember, it makes many errors and might continue to do so at launch. For recommendations, check out TechRadar's best video editing software for 2024.

You might also like

TechRadar – All the latest technology news

Read More

Apple working on a new AI-powered editing tool and you can try out the demo now

Apple says it plans on introducing generative AI features to iPhones later this year. It’s unknown what they are, however, a recently published research paper indicates one of them may be a new type of editing software that can alter images via text prompts.

It’s called MGIE, or MLLM-Guided (multimodal large language model) Image Editing. The tech is the result of a collaboration between Apple and researchers from the University of California, Santa Barbara. The paper states MGIE is capable of “Photoshop-style [modifications]” ranging from simple tweaks like cropping to more complex edits such as removing objects from a picture. This is made possible by the MLLM (multimodal large language model), a type of AI capable of processing both “ text and images” at the same time.

VentureBeat in their report explains MLLMs show “remarkable capabilities in cross-model understanding”, although they have not been widely implemented in image editing software despite their supposed efficacy.

Public demonstration

The way MGIE works is pretty straightforward. You upload an image to the AI engine and give it clear, concise instructions on the changes you want it to make. VentureBeat says people will need to “provide explicit guidance”. As an example, you can upload a picture of a bright, sunny day and tell MGIE to “make the sky more blue.” It’ll proceed to saturate the color of the sky a bit, but it may not be as vivid as you would like. You’ll have to guide it further to get the results you want. 

MGIE is currently available on GitHub as an open-source project. The researchers are offering “code, data, [pre-trained models]”, as well as a notebook teaching people how to use the AI for editing tasks. There’s also a web demo available to the public on the collaborative tech platform Hugging Face. With access to this demo, we decided to take Apple’s AI out for a spin.

Image 1 of 3

Cat picture new background on MGIE

(Image credit: Cédric VT/Unsplash/Apple)
Image 2 of 3

Cat picture lightning background on MGIE

(Image credit: Cédric VT/Unsplash/Apple)
Image 3 of 3

Cat picture on MGIE

(Image credit: Cédric VT/Unsplash/Apple)

In our test, we uploaded a picture of a cat that we got from Unsplash and then proceeded to instruct MGIE to make several changes. And in our experience, it did okay. In one instance, we told it to change the background from blue to red. However, MGIE instead made the background a darker shade of blue with static-like texturing. On another, we prompted the engine to add a purple background with lightning strikes and it created something much more dynamic.

Inclusion in future iPhones

At the time of this writing, you may experience long queue times while attempting to generate content. If it doesn’t work, the Hugging Face page has a link to the same AI hosted over on Gradio which is the one we used. There doesn't appear to be any difference between the two.

Now the question is: will this technology come out to a future iPhone or iOS 18? Maybe. As alluded to at the beginning, company CEO Tim Cook told investors AI tools are coming to its devices later on in the year but didn’t give any specifics. Personally, we can see MGIE morph into the iPhone version of Google’s Magic Editor; a feature that can completely alter the contents of a picture. If you read the research paper on arXiv, that certainly seems to be the path Apple is taking with its AI.

MGIE is still a work in progress. Outputs are not perfect. One of the sample images shows the kitten turn into a monstrosity. But we do expect all the bugs to be worked out down the line. If you prefer a more hands-on approach, check out TechRadar's guide on the best photo editors for 2024.

You might also like

TechRadar – All the latest technology news

Read More

Wondershare Filmora 13 releases update with a better video editing experience for users at all levels

Creating content and sharing our lives online has become the norm, but not everybody can just sit down at their computer and put together high-quality video footage. Editing can be complicated even for advanced users. With Wondershare Filmora, it doesn’t have to be. Filmora 13.1.0, the latest update to the video editing suite from Wondershare, was designed to make content creation accessible to all, regardless of skill level. Ease of use doesn’t mean lacking in functionality, though, and Filmora is packed with useful features to give your videos an extra kick. 

AI Music Generator and Text-to-Speech 

Wondershare Filmora 13.1.0 update

(Image credit: Wondershare)

Sometimes we just want to create and share videos about our day-to-day lives, but we want to make those videos more interesting with background music. If you’ve taken an incredible vacation and want to share video footage of your adventure, you’re going to need music to accompany that, even if you’re just planning to share the footage with family and friends. However, finding the right music for your videos can be time-consuming. 

Filmora offers a solution with their AI Music Generator tools that can help you create soundtracks for your videos that fit your vibe and are safe to commercialize. With Filmora you can easily make those shareable moments in your life look and sound good without worry. Filmora’s latest slate of enhancements makes it even easier to use, as well, allowing you to utilize Text-to-Speech to add voice-overs to your vlogs with natural-sounding tones that are categorized by scene type. 

Vlogs are not the only content that can benefit from these new features, either. Many of us have taken our educational endeavors online in recent years. Teachers and professors have had to find new ways to engage their students via video, becoming content creators in the process. Soundtracks created with Filmora’s AI Music Generator can help set the tone for your lectures. Text-To-Speech to translate your lesson, giving your students clear, natural-sounding audio that is easy for them to understand and easy for you to create.

Special effects for everybody 

Some stories are too good not to be told, but not everybody has the backing of a major motion picture studio at their disposal. Filmora 13.1.0 features improved professional caliber tools that allow you to easily create short films and music videos with ease, regardless of skill level (or production teams.)

Special effects have traditionally been thought of as an extremely skill-dependent part of content creation and cinematography. Filmora demystifies special effects. With just a few clicks of your mouse, your video’s action sequences can be taken up a notch with realistic motion blur that can be customized to suit your specific needs. Want to draw extra attention to a particular element in a scene? Filmora features a Lens Zoom Effect to simulate camera zoom, giving you creative freedom to hone in on a part of a scene and further enhance your storytelling. Get ready for your close-up, a well-timed zoom-in can set the scene and change the tone of your video. 

With the ability to digitally zoom also comes the option for digital magnification. The Magnifying Glass Tool in Filmora makes it easy for you, as an editor, to examine a scene in your video by getting up close and personal with it. Zoom in, make adjustments, correct your footage as necessary, and then return the frame to its proper size with the corrections intact. That’s professional-quality editing with no more effort than a few clicks of your mouse.

Create with the power of the cloud 

Whether you’re creating with the power of a production team or you’re a personal creator looking to share your life, one thing remains true: video content is a resource hog. If you’re working on projects that involve others, you may find that harnessing the power of the creative cloud can streamline the process and make it more accessible for everybody involved. 

Filmora 13 features improvements to Cloud Resource Management and Beautification tools, making it easier to enable migration of custom LUTs to cloud storage. Seamless synchronization allows you and your collaborators to color-grade assets across multiple devices, streamlining remote work and improving your workflow. Custom LUTs can even allow for the direct import of media files from cloud storage. If your video content features episodic content and color grading is important, the cloud-based custom LUT feature of Filmora 13 can streamline that process by allowing you to enhance and color grade your footage with the power of the cloud.

Every day editing at a professional scale 

With Filmora from Wondershare, creators of all skill levels can create professional quality videos and content with ease. From the DIY homemaker creating short content for YouTube to full-scale production teams working on episodic content, Filmora’s suite of tools can help you put out the best content with less work. Wondershare continues to work and improve Filmora with each upgrade so that you can spend less time editing and more time creating.  

TechRadar – All the latest technology news

Read More

Google wants to help provide faster AI photo editing for all

Top AI photo editng app PhotoRoom has formed a new partnership with Google Cloud that it says could seriously speed up image generation while keeping costs down. 

The software, dubbed “the fastest generative AI provider in the commerce space” by the company, is designed to let businesses create and edit product images for ecommerce platforms.

Announcing its intention to power-up AI performance with Google’s A3 ‘supercomputers’, the company said the pairing will cut product photography production times for small businesses and entrepreneurs “from days to less than an hour – without compromising accuracy or quality.”  

Product, production & photo editing 

Like most commercial content creation, product photography demands high-quality visuals produced at high velocity. Not only do items need to look their best, websites need to cover variations from color to size if it’s to be added to a shopper’s basket.   

It’s a process that takes time – and the space that PhotoRoom, founded in 2019, occupies. The photo editor streamlines image manipulation, letting firms enhance product shots and add unique, AI-generated backgrounds, while free photo editor tools include a background remover and object remover. 

Highlighting the major growth in genAI usage, Matthieu Rouif, PhotoRoom CEO,.said “We're already processing 2 billion images per year, and we expect that to double in 2024, as more businesses adopt PhotoRoom's generative AI technology. Google Cloud provides the ideal foundation for our continued success with its capacity to scale, its flexibility, and its sustainable infrastructure.” 

The use of Google Cloud A3 instances is a compelling choice. Unveiled in May 2023, the next-generation GPU supercomputers are designed to train and deliver what Google called “the most demanding AI models” for generative AI and LLMs. However, the partnership benefits Google as much as PhotoRoom, strengthening the search giant’s clear B2B focus when it comes to rolling artificial intelligence to the masses. 

“We're thrilled to offer Google Cloud's industry leading infrastructure, foundation models and AI tooling to PhotoRoom so the company can build, train, and deploy AI creatively, reliably and at scale,” said  Mark Lohmeyer, vice president and general manager of Google Cloud. 

TechRadar – All the latest technology news

Read More

Our favorite free video editing software gets unexpected performance boost from new macOS Sonoma

One of the big announcements at Apple’s WWDC 2023 was macOS Sonoma (we looked it up; it means “Valley of the Moon”). 

Apple claims the new operating system has a sharp focus on productivity and creativity. It says “the Mac experience is better than ever.” To prove it, the company revealed screensavers, iPhone widgets running on Macs, a gaming mode, and fresh video conferencing features. 

But the new macOS has another surprising feature for users of our pick for best free video editing software.  

The final cut 

Beyond WWDC’s bombshell reveal – yes, Snoopy is an Apple fan now – the event served up more than enough meat to keep users happy. There’s a new Macbook Air 15-inch on the way, said to be the “world’s thinnest.” The watchOS 10 beta countdown has started. And the Vision Pro is dividing opinion. Is the VR headset the future or will it lose you friends?

The reveal of the new Mac operating system, meanwhile, feels quieter somehow. Muted. Perhaps new PDF editor functionalities and a host of “significant” updates to the Safari browser aren’t as eye-catching as a pair of futuristic AR/VR ski goggles.  

However, Craig Federighi, Apple’s senior vice president of Software Engineering, said, “macOS is the heart of the Mac, and with Sonoma, we’re making it even more delightful and productive to use.” 

What he didn’t say, but the company later revealed, is that Sonoma adds an extra bonus for video editors. 

Designed for remote and hybrid in-studio workflows, the operating system brings a high-performance mode to the Screen Sharing app. Taking advantage of the media engine in Apple silicon, users are promised responsive remote access with low-latency audio, high frame rates, and support for up to two virtual displays. 

According to Apple, “This mode empowers pros to securely access their content creation workflows from anywhere – whether editing in Final Cut Pro or DaVinci Resolve, or animating complex 3D assets in Maya.” It also enables remote colour workflows that previously demanded the best video editing Macs and video editing PCs

It seems Final Cut Pro is getting a lot of attention lately. May saw the launch of Final Cut Pro for iPad – how did it take so long? – and now better support in the operating system. What next? Perhaps that open-letter from film & TV professionals pleading for improved support really did focus minds at Apple Park.  

TechRadar – All the latest technology news

Read More

This video maker’s new AI editing tool picks your best takes for you

Artificial intelligence may already be a staple in the best video editing software, but now Veed is launching what it calls an “industry-first editing tool” for its video maker platform. 

Every second counts when making online video, especially on platforms like TikTok and Instagram, where brands only have a few seconds to capture the audience. Presumably, Veed thinks our “umms” and “aahs” are wasting valuable time – with Magic Cut set to clean up content. 

The AI tool streamlines one of the most time-consuming (read: soul-destroying) parts of video editing – removing all the filler words and pauses. At the touch of a button, users can chop out all hesitation, deviation, or repetition. It’s joined by several other video editing tools aimed at polishing up post-production.

Critical content creation 

With its video maker service, Veed is no stranger to simplifying content editing. Unlike even the best free video editing software and video editing software for beginners, these services let businesses create a lot of content fast. It’s not Emmy award-winning material. But the videos are professional enough for social media channels. 

The arrival of AI tools like Magic Cut hardly comes as a surprise as developers streamline production processes in the drive for total accessibility. 

According to Veed's own research, over a third of consumers struggle with editing videos. It’s those users without the time or experience that tools like Magic Cut are really pitched at – an easy way to automatically clip the best takes for TikTok, Shorts, and Reels. 

“Magic Cut means people don’t have to worry about getting the perfect take or spend hours trying to cut out the bits they don’t want. This allows people to spend more time on the creative, fun parts of content creation,” said Veed CEO and co-founder Sabba Keynejad. 

The AI editor isn’t the only tool to find its way onto the platform. Generating subtitles, scripts, and images, removing background noise, and converting text to audio are all now featured. 

Veed’s toolset was one of the few areas we thought the platform really shone for us during our review. Green screen keying and a free screen recorder were two highlights. So, we’ll be interested to see how well Magic Cut performs in the line-up, especially once the fuller featured Clean Edit drops. Users can try it out for themselves by signing up for early access.  

TechRadar – All the latest technology news

Read More

More features for editing PDF files finally arrive to Adobe Creative Cloud Express

In what is being boldly referred to as “the new way to PDF”, Adobe is treating users of Creative Cloud Express with new tools for working with the ubiquitous file type. When the cloud tool launched in December 2021, it included two 'quick actions' for creating and converting PDF files, but Adobe has announced three additional actions to help manage a PDF file.

One will allow you to edit the text within a PDF file, alongside the ability to resize and rotate images.

The remaining new actions will make it possible to easily combine multiple files into one document and also the ability to rearrange pages of an existing PDF file.

The ability to join several files into one is not only a great way to consolidate documents obtained from different sources, but also to ensure that different types of content are saved in a cross-platform, portable format.

While the page organization's quick action makes it possible to change the order in which pages appear in a document, it goes further than what you expect. The same quick actions also enable you to delete pages that are not needed and rotate any which are not correctly oriented. Adobe stresses that modifying PDFs in this way will not interfere with the formatting or design of the original files, so you can be sure that pages will look precisely as intended.

But wait, there's more

Creative Cloud Express PDF features

(Image credit: Adobe)

While both of these quick actions will be welcomed by Adobe Creative Cloud Express users, it is the third new addition that is likely to generate the most interest. The “Edit text & images” quick action does very much what you would expect from the name, making it possible to change and add text to existing PDFs.

It can also be used to rotate and resize images so there is no need to re-create pages from scratch if a minor tweak is needed.

Adobe states that the latest quick actions came as the result of listening to the feedback of creators. The company is keen to continue to give its users what they need and is looking for more suggestions via the Creative Cloud Express UserVoice page.

Via Adobe Blog

TechRadar – All the latest technology news

Read More

Google Docs is finally solving this major editing pain

Google is currently working on a new update for its office software that will make customizing tables in Google Docs more intuitive and easier to do.

While Google Workspace includes its own spreadsheet software in Sheets, many people prefer to use Docs to add inline tables to their documents.

According to a new post in the Google Workspace blog, the search giant is adding several new ways to customize tables in Google Docs to give users more ways to present information to their readers. 

This new update is rolling out now and will be available to all Google Workspace customers as well as G Suite Basic and Business customers and even those with personal Google Accounts.

Customizing and editing tables in Docs

First off, Google is adding a new sidebar to Docs to make it easier for users to manage a table's rows, columns, alignment and other properties. Just like when editing an image in Docs, all of these edits are “reflected in your document in real time”.

At the same time, the company is adding a new, intuitive button for creating new rows or columns in a table that will appear as an overlay as you hover over a table in Docs.

When it comes to pages, Google Docs users can now pin a table header row to repeat on each page to make it easier to see column headers for long tables while navigating a document as well as designate that a row should not be split across pages.

Finally, Google is making it possible to sort the rows of a table in either an ascending or descending order. However, any pinned table headers will still remain at the top of your tables.

Now that Google is making it easier to use tables in Docs, we'll likely see more users incorporating them into their documents to present information as opposed to linking to a separate spreadsheet in Sheets.

We've also rounded up the best free office software and best online collaboration tools

Via 9To5Google

TechRadar – All the latest technology news

Read More

Editing Microsoft Excel files online could finally get a lot simpler

Editing spreadsheets on the go or at work should soon be easier than ever thanks to a significant update to the web version of Microsoft Excel.

Microsoft has revealed a number of spreadsheet softwareupgrades that it says will help close the gap with its desktop-based sibling, including better support for larger files, as well as those with legacy features.

“We are excited to share that you can now open and edit more files on the web and complete your job anywhere, in the browser of your choice,” Microsoft noted in an Excel blog post announcing the news.

Excel for Web upgrade

Going forward, Microsoft Excel for the Web will now allow users to open and edit large files from SharePoint up to 100MB in size. This will expand possible files to thousands of rows of data, and means users will not have to switch to the Desktop version of Excel to finish work.

Users can also now edit files containing what Microsoft calls Legacy Art objects and SmartArt objects – including the likes of Form Controls, ActiveX Controls, Camera Tools, and OLE objects. The company says this will allow users to access and interact with any such workbooks but not with the objects themselves. 

Elsewhere, users can now also access password-protected workbooks on Excel for the Web, meaning there's no need to switch back to a desktop in order to open & interact with secured files. Similarly, users can now also edit files which are protected for editing using a password to modify, meaning you'll be able to access and interact with different types of protected workbooks on the browser itself. 

That's not all, as Microsoft also noted that more features will also be added soon, including support for Microsoft 365 subscribers to edit large files up to 100 MB from OneDrive, and further support for editing workbooks with legacy shared features and data wizard connections.

The news comes shortly after Microsoft revealed it will be bringing support for smoother scrolling to the Excel Desktop app, hopefully resulting in a much better user experience.

TechRadar – All the latest technology news

Read More