Google Photos gains generative AI: Now move around subjects within images

With the Magic Editor, you can edit specific parts of a photo, such as the background and foreground, or move the subject around the frame to bring it into focus. The tool generates new content to fill in the gaps left after resetting your subject.

During the I/O event, Google demonstrated how to use Magic Editor to enhance footage of a person standing in front of a waterfall. Although the shot tries to capture the individual in the way they ‘capture’ the waterfall, they are not positioned correctly. Magic Editor fixed that nicely by moving the person to the right of the frame.

The display also helped remove the bag strap from the subject’s shoulder (Image: Google)

The device works in a similar way to the image cropping feature that Apple introduced with iOS 16 last year, which cuts out the subject at the front of the photo. However, unlike iOS 16, which allows you to copy and paste the title into other photos/apps, Magic Editor allows you to move them around within the same photo, filling in any gaps that may result from this.

A second display showed a boy sitting on a bench holding balloons. Because the bench was too far to the left, many balloons were out of frame. Magic Eraser not only drew the bench to the center, but created a more balanced image by imagining what the cut balloons would look like. Then, as a final touch, the device lit up the sky and ‘corrected’ the weather.

Note how Magic Editor thinks what the missing balloons should look like (Image: Google)

While Google says it will release Magic Editor as early access for Pixel phones this year, it warns that the tool may not always deliver the results you’d expect. Of course, after some time of beta testing, the tool will be expanded to support more devices. But Google hasn’t shared a timeline suggesting when we can expect this to happen.

It’s also unclear whether the feature is locked behind a Google One subscription like Magic Eraser. Still, if you have a Pixel phone, you can enjoy it for free.