How to use Structure Reference and Style Reference in Adobe Firefly

Adobe Firefly (the AI ​​technology that powers Photoshop's Generative Fill) has a great new feature in its text-to-image module called Structure Reference (aka Structure Match) that lets you control the layout of your AI-generated images by using an existing image as a reference.

'Structure' refers to the size, shape, and arrangement of different elements in an image. Firefly looks for contours and depth in the reference image and matches them to the new image to keep the layout similar.

Additionally, Firefly's text-to-image module includes Style Reference (or Style Match) that can match the visual style of a reference image (color, lighting, texture, mood, and theme). By combining Structure Reference and Style Reference with prompts in Adobe Firefly, you can reduce the annoying randomness of turning text into images and have much more control over the results. Here's how it works.

How to use Structure Reference in Adobe Firefly

Let's start by using Structure Reference to control the layout of the AI-generated image. Then we'll use Style Reference to control the visual style.

Step 1: Type prompt and click Generate

First, you need to enter prompt and let Adobe Firefly generate the initial output.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 1

Then click the Generate button .

How to use Structure Reference and Style Reference in Adobe Firefly Picture 2

After a few seconds, Adobe Firefly generates 4 initial results based on your prompt alone, meaning you should get what you want. Now we can use Structure Reference to get more control over the layout.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 3

Step 2: Upload structural reference image

Find the new Structure category in the left column and click the Upload image button . Then, select the image you want to use as a reference.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 4

This image was used because the author wanted Adobe Firefly to match the same position, size, and pose as the man in the photo.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 5

Firefly will ask you to confirm that you have permission to use the image. Next, click Continue .

How to use Structure Reference and Style Reference in Adobe Firefly Picture 6

Back in the Structure option, the uploaded image will appear in the Reference thumbnail.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 7

Additionally, the Structure reference tag will appear in the prompt area below. Hovering over the tag will display the image being used as a reference.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 8

Step 3: Adjust the Strength section

Use the Strength slider to adjust how well the generated image matches the structure of the reference image. There are 3 settings (Low, Medium and High).

Medium is the default but the example will choose High.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 9

The example will also change a few other settings before continuing.

1. In General Settings , change the Aspect ratio from Square (default) to Landscape (4:3) .
2. In Content Type , select Photo for a more realistic and less photorealistic result.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 10

Step 4: Click Generate

Click the Generate button in the Prompt section to create 4 new versions of the image.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 11

This time, thanks to Structure Reference, Adobe Firefly was able to match the layout of the reference image in all four generated results.

So far so good. But now, let's take it a step further with Style Reference.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 12

How to use Style Reference in Adobe Firefly

We've matched the layout using Structure Reference, but the image still doesn't have the classic sci-fi art style we want. So let's use Style Reference and another reference image to fix that.

Step 1: Upload style reference image

In the Styles section on the left (just below Structure ), click the Upload image button .

Then, select the image you want to use as your style reference.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 13

This retro futuristic image on Adobe Stock could work well. The image will be used as a visual style so layout is not important.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 14

Firefly will ask you to confirm again that you have permission to use the image. Click Continue .

How to use Structure Reference and Style Reference in Adobe Firefly Picture 15

Once uploaded, the image will appear in the Reference thumbnail.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 16

And the Style reference tag appears in the Prompt section below. Now, we are using both structural references and style references.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 17

Step 2: Adjust the Strength and Visual Intensity of the image

The Styles section includes the Visual intensity and Strength sliders . They sound similar, but they control two different things.

Visual intensity controls how detailed, dramatic, or complex the resulting original image will look (before applying the style from the reference image). Drag the slider to the right for a stronger visual intensity, or to the left for a more subtle version.

Strength determines how closely the generated image must match the style of the reference image, as well as any effects you may have added.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 18

Step 3: Click Generate

Click the Generate button in the Prompt section to generate 4 new results.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 19

Thanks to the Style Reference image, the new results are closer to the desired sci-fi look.

But while the colors and lighting look good, the detail isn't. So let's adjust the Style settings and try again to see if Firefly can do better.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 20

Step 4: Change settings and try again

Increase Visual intensity and Strength by dragging both sliders all the way to the right.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 21

Then click Generate again.

And this time, the results look fantastic. Firefly is combining the layout from the Structure Reference image and the art style from the Style Reference image (along with prompts, of course) to create the desired classic sci-fi look.

How to use Structure Reference and Style Reference in Adobe Firefly Picture 22

The days of relying solely on prompts to create text into images are over. Structure Reference and Style Reference are two easy yet powerful ways to control the look of your images in Adobe Firefly.

Micah Soto

Update 01 October 2024