AI video generation
What is image to video?
Image to video is AI video generation that starts from a still picture and generates the motion that follows from a prompt. Your picture becomes the first frame, exactly as it is, or a reference that keeps a subject recognizable, and the model adds the movement: a person turning, waves breaking, a camera moving in.
By the DreamBench team. Updated .
Image to video at a glance
At a glance
- Input
- One picture and a prompt; on some models, a last frame too.
- Output
- A short clip, usually 4 to 15 seconds per shot, often with sound.
- Fixed by you
- The first frame, exactly as your picture.
- The model decides
- Everything after it: the motion, the camera, what comes into view.
- Struggles with
- Faces that turn away and back, hands, text, and big changes from the picture.
How image to video works
Image to video works by placing your picture as the first frame of a clip that is otherwise noise, marking it as a frame to keep, and generating the rest beside it. A second encoder reads the picture’s content so its look carries into frames it never showed. The prompt steers only the motion.
The picture fixes how the clip opens, so the model has much less to invent than in text to video. What it still invents is everything the picture doesn’t show: the back of a head, the rest of a room, what happens next.
Under the hood: how the picture steers the model
The open Wan model documents one common design. The picture is compressed by the same encoder as the video and placed as the first frame, with empty frames after it. A mask marks that frame as one to keep, and the model generates the rest from noise beside it.
A second encoder reads the picture’s content and feeds it in as well, so its look carries into frames the picture never showed. Marking a last frame to keep with the same mask is how the method extends to first and last frame.
How to write an image-to-video prompt
Describe what moves and how the camera moves, not the scene: the picture already fixes the subject, light and style. “She turns to the window; slow push in; curtains lift in a breeze” is enough.
First frame, last frame or reference
A picture can play three parts in a video. Which one you choose decides how much of the clip is yours and how much the model makes.
First
Made
Made
Made
Made
Last
You fix both ends. The model invents a path between them that respects the prompt, so the further apart the two frames, the more it has to invent.
| The clip | What you fix | Good for | |
|---|---|---|---|
| First frame | Opens on your picture exactly | The opening | Animating a photo, a product shot or a frame you designed |
| First and last frame | Starts on one picture and ends on another | Both ends | Transitions, reveals, before and after |
| Reference | A new shot with your subject in it | Who or what appears | The same character or product across many shots |
Which video models take a first and last frame
Video models differ in how they use a picture: some can be told where to end as well as where to start, others can’t. This table is read from the same settings the DreamBench composer uses:
| Model | Sound | First and last frame | Resolutions | Aspect ratios |
|---|---|---|---|---|
| Seedance 2.5 | On or off | Yes | 480p, 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| Seedance 2.0 | On or off | Yes | 720p, 1080p, 4K | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| Veo 3.1 | Always on | Yes | 720p, 1080p, 4K | 16:9 · 9:16 |
| Kling 4.0 | Always on | Yes | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| Kling 3.0 | On or off | Yes | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| Wan 3.0 | Always on | Yes | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 |
| Wan 2.7 | On or off | Yes | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 |
| Grok Imagine 1.5 | Always on | First frame only | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 |
| MiniMax H3 | Always on | Yes | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| HappyHorse 1.1 | Always on | First frame only | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 · 21:9 |
| LTX-2.3 | On or off | Yes | 720p, 1080p, 4K | 16:9 · 9:16 |
| Vidu Q2 | On or off | First frame only | 720p, 1080p | 1:1 · 16:9 · 9:16 · 4:3 |
“First frame only” means the model starts from your picture but can’t be told where to end. Pick a model with first and last frame for transitions and reveals.
Ways to make a still picture move
| What moves | What it keeps | |
|---|---|---|
| Image to video | The subject, the scene and the camera, all newly generated | The first frame; after that, only what the model holds on to |
| Pan and zoom (the Ken Burns effect) | Only a virtual camera, gliding over the photo | Every pixel: nothing new is made |
| Talking photo | A face, matched to speech | Most of the picture, which stays still |
Where people use image to video
- Bringing old family photos to life.
- Turning product photos into short ads.
- Animating a logo for an intro or an outro, with the clip made to end on the logo as uploaded.
- Animating a character or a scene made with an image model.
- Social posts that move instead of standing still.
- Opening a film on a frame you designed, then generating the rest of the shot.
What image to video can’t do
- It invents the motion: what happened after a photo was taken was never recorded.
- A face that turns away and back can come back slightly different: a failure of temporal consistency.
- The further the clip moves from the picture, the less of the picture is left to keep it on track.
- Some models refuse some photos. On DreamBench, Seedance won’t accept a reference image that shows a real person’s face.
- Only animate photos you have the right to use, and ask before animating someone else’s picture.
Why is my photo cropped in the video? In the composer the frame is chosen first, and a start frame is scaled to fill it and cropped at the center, so a 4:3 photo in a 16:9 clip loses its top and bottom. Crop the photo to the clip’s shape first, or grow it to that shape with the AI image expander. The one-photo tool keeps the photo’s own shape; a soft or small photo animates better after the AI photo enhancer.
How DreamBench turns an image into video
The image-to-video tool animates a single photo into a short clip that opens on it, and animate old photos is set up for family pictures.
Any DreamBench result can also open in the composer as a reference image: a cutout, a restored photo, a frame grown with the AI image expander. DreamBench writes the scenes and renders them on the video model you pick, such as Seedance 2.5, Veo 3.1 or Kling 3.0.
| The image-to-video tool | The composer | |
|---|---|---|
| Input | One photo up to 40 MB, JPEG, PNG, WebP or any format your browser opens, scaled to 2048 pixels on its long edge before the run | Up to 8 reference pictures on a film, a first frame and, on models that take one, a last frame |
| Length | Five seconds | 4 to 300 seconds, capped by the plan: 30 seconds on Starter, 2 minutes on Plus, 5 minutes on Ultra and Studio |
| Resolution | About 720p, whatever the photo’s size | 720p or 1080p on every model, 4K on Seedance 2.0, Veo 3.1 and LTX-2.3 |
| Frame | The photo’s own shape: a vertical photo gives a vertical clip | 1:1, 16:9, 9:16, 4:3 or 21:9, chosen first; a start frame is scaled to fill it and cropped at the center |
| Sound | The quiet sound of the place, with nobody speaking | Dialogue, effects and ambience on models that generate sound; the table above shows which |
| Faces | A photo of a person never goes to Seedance, Veo or Grok Imagine; if the first model declines it, a second tries once | Seedance refuses a reference that shows a real face, so such a film renders on another model |
Questions
What is the difference between image to video and text to video?
Text to video starts from words alone, so the model decides how everything looks. Image to video starts from a picture, so the subject, the light and the style come from your image and the prompt describes the motion.
How long can an image-to-video clip be?
Most models make one shot of about 4 to 15 seconds from a picture. Longer videos are built from several shots, which is how the DreamBench composer makes a film.
Can I set the last frame too?
Yes, on models that support first and last frame: you give two pictures and the model generates the motion between them. Some models take a first frame only.
Can AI animate a photo?
Yes. An image-to-video model takes your photo as the first frame and generates the motion that follows from a short prompt: a person turning, waves breaking, a camera moving in. The clip is usually 4 to 15 seconds and opens on your picture exactly. A sharp photo with one clear subject, even light and room around it for movement animates best; DreamBench’s tool keeps the photo’s own shape, so crop it first if the clip needs another.
Why does the face in my video look different from my photo?
The face changes because only the first frame is your photo; every later frame is generated, and a face that turns away and back is redrawn from the model’s memory. Keep the camera and head movement small, keep the clip short, and start from a sharp, well-lit photo with the face large in frame.
Can image to video add sound?
On models that generate sound, yes: the clip opens on your picture and the model generates effects, ambience or dialogue with the motion. The table above shows which models always, optionally or never make sound.
Can I use more than one picture?
Yes, in two ways: a first and a last frame on models that support both, or several reference pictures of a character or product that keep them recognizable across the shots of a film in the DreamBench composer.
Can I turn a photo into a video on my phone?
Yes. DreamBench’s image-to-video tool works in a phone browser, with nothing to install: choose the photo from your camera roll and the clip downloads as an MP4.
Can I animate a photo of a real person?
With some models. On DreamBench, Seedance refuses reference images that show a real person’s face, so a video made from such a photo uses another model. Only animate photos you have the right to use.
Does image to video cost anything?
It depends on the app. On DreamBench you create a free account and choose a plan before the first clip, and each clip uses credits from the plan.
Does image to video keep my photo’s aspect ratio, or crop it?
Image to video keeps your photo’s aspect ratio on DreamBench’s one-photo tool: a vertical photo gives a vertical clip and a landscape photo a landscape one, at about 720p. In the composer you choose the clip’s frame first, and a start frame is scaled to fill it and cropped at the center, so crop the photo to that shape yourself, or expand it with the AI image expander, before you start.
What size and format of photo works for image to video?
A photo for image to video on DreamBench can be a JPEG, PNG, WebP or any format your browser opens, up to 40 MB; it is scaled to 2048 pixels on its long edge before the run, so a larger file adds nothing. What matters more than pixels is a sharp, well-lit picture with one clear subject kept clear of the edges, since the clip opens on it exactly and every later frame is invented from it.
How long does image to video take?
Image to video takes a few minutes for one five-second clip on DreamBench’s tool, and the page shows the clip as soon as it is ready. If the first model declines your photo, a second tries once, which adds a little time; if that one declines too, the credits for the run come back. In the composer a shot takes from under a minute to several minutes, by model, length, resolution and sound.
What happens to the photo I upload for image to video?
The photo you upload for image to video stays in your browser until you make a clip. Then it is used to make that clip and nothing else, and removed from the tool’s storage after 7 days along with the result; a result you keep in your library stays as long as you keep it. The MP4 carries a label in its file data saying it was made with AI on DreamBench, with nothing drawn over the picture.
Related
DreamBench tools
- AI image to videoOne photo becomes a five-second clip with natural motion and sound, every face asked to stay.
- Old photo animatorAn old family photo comes gently to life in a five-second clip: a blink, a breath, a slight smile.
- Product video makerA product photo becomes a five-second clip with sound: a turn, a push-in, an orbit or a sweep of light.
- Logo animatorA five-second animation of your logo that ends on the logo itself, clean: twelve styles, three shapes, HD with sound.
Model pages
- Seedance 2.5Tell a short story in one clip of up to 30 seconds, cut into linked shots, with sound made with the picture.
- Veo 3.1Shape realistic widescreen or vertical scenes with dialogue and sound, on Veo 3.1, Fast or Lite.
- Kling 3.0Make movement the focus, from sport and dance to vehicles, with lip-synced dialogue in 5 languages.
Terms
Sources
- Wan: Open and Advanced Large-Scale Video Generative Models, §5.1 Image-to-Video GenerationarXiv, read on
DreamBench is an independent platform and isn’t affiliated with or endorsed by the companies named on this page.