The new iOS 27 photos reframe feature experience

Eric

Eric

Mama's lil stinker
Joined
Aug 10, 2020
Posts
16,068
Solutions
18
Main Camera
Sony
TBH I'm not a fan of this feature, we're losing everything organic about the art of photography with all of these gimmicks.

In iOS 27, Apple Intelligence introduces a powerful Spatial Reframing feature to the Photos app. It lets you literally change the perspective, angle, and framing of a picture after it has been taken, while generative AI seamlessly fills in the background space.
Click to expand...

 
I tried it out yesterday. Interestingly, I had difficulty finding a photo where it was able to do much of anything. It turns out that if you have already properly framed your photo, there’s little it can do - as you try and drag and rotate, it sort of pulls back against you. It seems like this usually happens when your subject covers most of the frame. You can rotate in 3D just a bit in those cases, and if you shrink the subject you can recover just a tiny bit of artificial background.

When I eventually found a shot where I had my daughter in front of a fence, landscape orientation, wide-angle so she was fairly small, it was able to do quite a bit. The result was fine, but i can’t see me using this much.

Of the three tools (reframe, extend, and remove object), I am surely going to use remove object the most, and it seems to have improved quite a bit from my limited testing. Saves me from having to open photoshop.

I can’t imagine i will ever use reframe, since I frame the photo before I take it.
 
If I remember correctly, they claimed this would work with any older iPhone photo and any 3rd party camera photo. Hope they get the bugs out, because it looks like it just doesn't work.
 
rdrr said:
If I remember correctly, they claimed this would work with any older iPhone photo and any 3rd party camera photo. Hope they get the bugs out, because it looks like it just doesn't work.
Click to expand...
In my testing it does “work” with old photos and photos taken by my Sony camera, but it’s not magic - it needs enough visual information to be able to infer the full 3d shape of a person or what’s in the background. So in both the reframe and extend tools, when you try to drag things around, sometimes it only lets you go a tiny amount before it stops you. And when you try to zoom out, again, it only lets you go a tiny bit, sometimes. It seems to depend on the composition of the photograph, not on its source.

In the extend tools, you grab the sides of the rectangle and drag. I found the same issues there. In one case, I got a message that said something like “I can only extend upward.” It was a portrait, and I have no idea why it decided it could go left/right in that case.
 
Here is an example of reframing. Again, I was limited in how much it let me reframe, and the new image is framed much worse, but I picked it to see what would happen; the netting in the foreground, and the complicated background (including text on the scoreboard, irregular structures, etc.) seemed like it should be challenging.

Before:

IMG_0016.jpeg


After:

IMG_0018.jpeg


Interesting that it saw a foot to the right of Mr. Met and turned it into an entire dude
 
Next I asked image playground to add another mascot sneaking up on Mr. Met. Lots of artifacts, but still a hell of a lot better than the old image playground.

Image.png


Then I asked it to give me a pixel art version of a family photo from the game.

IMG_0015.png
 
Cmaier said:
Next I asked image playground to add another mascot sneaking up on Mr. Met. Lots of artifacts, but still a hell of a lot better than the old image playground.

View attachment 39203

Then I asked it to give me a pixel art version of a family photo from the game.

View attachment 39204
Click to expand...
Unfortunately for you, it made you into a Mets fan.
 
Eric said:
TBH I'm not a fan of this feature, we're losing everything organic about the art of photography with all of these gimmicks.
Click to expand...

Same here. One of the aspects of photography being interesting/challenging for me is deciding which elements I want to be in the frame (and what should not be in the frame) when I'm making a photo And being sure elements with vertical lines (like buildings, etc) are truly vertical. Ditto with horizontal elements being truly horizontal.

That's why I always use the phrase making photos instead of taking photos when I talk about photography.
 
Eric said:
TBH I'm not a fan of this feature, we're losing everything organic about the art of photography with all of these gimmicks.



Click to expand...

We're almost at the point where the camera is optional: "Create a photo of me and my daughter at the summit of Mt. Everest." May as well be a brain in a vat.
 
Cmaier said:
Then I asked it to give me a pixel art version of a family photo from the game.
Click to expand...
There where already apps doing similar art from a photo, before AI : watercolour, oil paint etc etc
 
Katbel said:
There where already apps doing similar art from a photo, before AI : watercolour, oil paint etc etc
Click to expand...
sure, but it’s nice that I can make these silly throw-away images without any apps. I mean, if I’m doing it on my phone instead of in photoshop, it’s because it’s not worth the effort for me to find, download, and potentially pay a subscription for some app I may use once to make a goofy gif to text my daughter or something.
 
Cmaier said:
sure, but it’s nice that I can make these silly throw-away images without any apps. I mean, if I’m doing it on my phone instead of in photoshop, it’s because it’s not worth the effort for me to find, download, and potentially pay a subscription for some app I may use once to make a goofy gif to text my daughter or something.
Click to expand...
Sure, but in case I need it I still stick with the apps.
But I have to admit I used AI to recognize some flowers ...
 
Cmaier said:
Interesting that it saw a foot to the right of Mr. Met and turned it into an entire dude
Click to expand...
That dude must be AI-generated. Because there's no way for the AI to know what the person behind Mr. Met's head looked like.
 
Cmaier said:
Yeah, but I’m also a Knicks fan.
Click to expand...
As a retro Celtics fan (Bird and McHale), I have found myself rooting for the Knicks. East Coast always. They would have had a chance to sweep it if it weren't for our fearless sleeper showing up to game 3.
 
rdrr said:
As a retro Celtics fan (Bird and McHale), I have found myself rooting for the Knicks. East Coast always. They would have had a chance to sweep it if it weren't for our fearless sleeper showing up to game 3.
Click to expand...
Yeah, 86 that guy.
 
Notice in the original photo, the extraneous dude is facing towards the mascot, and the AI created a dude facing away.
 
Back
Top