RepoApache-2.0Video models6 min read

LTX-Video: open-source video model with depth, pose and edge control

Repo · picked by ReelMe Academy

Lightricks' open video model (v0.9.x): animate a still or a prompt, extend clips forward or backward, and make a new video follow another clip's depth, pose or edges.

A surfer rides a cyan wave under sunlit mountains: the result of LTX-Video's depth-control example
Get it

Run one command.

Paste it in your terminal. That's it.

git clone https://github.com/Lightricks/LTX-Video.git
The full write-up

LTX-Video: open-source video model with depth, pose and edge control, in detail

Give LTX-Video a prompt or a still and it makes a moving shot. Give it a guide clip and it can copy that clip's motion, from a depth map, a pose skeleton or an edge outline, into a completely new scene. It is Lightricks' open model, described in the paper LTX-Video: Realtime Video Latent Diffusion. This page covers the original v0.9.x models: the repo is now marked legacy, and Lightricks recommends LTX-2.5 for new projects.

Depth control, from the README: a depth map of someone sandboarding down a dune becomes a surfer on a wave, moving the same way.

How it works

LTX-Video is a DiT-based video model (a diffusion transformer). You write what happens, and you can pin images or short clips to frame numbers in the video, each with its own strength; the model fills in the motion around them.

WhatFrom the README
ModesText to video, image to video, multiple keyframes, extending a video forward or backward, video to video, and any mix of these
LengthUp to 60 seconds with the 13B v0.9.8 models, through the ComfyUI long-shot workflow
Default size1216 × 704 at 30 FPS since v0.9.6; other sizes and frame rates still work
SpeedThe v0.9.7 13B distilled model: HD video in 10 seconds, low-res preview after 3 seconds, on an H100
Models13B and 2B, each with distilled and FP8 versions

One still in, a moving shot out

These are the README's image-to-video examples: each clip starts from a single image, and LTX-Video makes the motion, the camera move and the light change. Need a still to start from? Make one in ReelMe Image.

Characters with personality

A raccoon at a tennis court fence turns its head.Two rabbits in leather jackets, one in sunglasses, fold their arms.

Everyday moments

A woman checks her phone in a forest as the sun breaks through.Two children start waving at the camera.

Action and atmosphere

A night drive past city lights, the camera riding in the car.Low-angle running shot, dust kicking up from every step.

More from the repo's docs folder

Two earlier clips the repo keeps next to the README examples. They are smaller (384 × 256), so they look softer here.

A green river between rocky banks and pine trees.Looking down over a dense city of towers.

The model page and online demos are linked from the LTX-Video README.

Make a new video move like another one

Three control models (Depth, Pose and Canny edges) take a guide video and make a new scene that moves the same way. Each example stacks the source clip, the guide the model sees, and the result. The workflows live in ComfyUI-LTXVideo, and with LTX-Video-Trainer you can train your own control or effect LoRAs. To copy a person's moves without a GPU, try Motion Control in ReelMe.

Edges. Top to bottom: a fencing bout, its edge outline, and two older men duelling on a lawn.Pose. The same bout as stick figures, turned into two dancers with glowing blades.
Depth. Top to bottom: sandboarding down a dune, its depth map, and a surfer on a wave.Depth. Left to right: boots on dirt, the depth map, and the same steps in snow.

Pose. Left to right: a woman dancing at home, her pose skeleton, and the same dance as a swirling painting.

Long shots, fast drafts

With the 13B v0.9.8 models, the ComfyUI long-shot workflow makes videos of up to 60 seconds. The distilled models trade a little quality for speed: on an H100 the v0.9.7 13B distilled model makes HD video in 10 seconds and shows a low-res preview after 3. You can also extend an existing clip forward or backward.

ModelREADME note
ltxv-13b-0.9.8-devHighest quality, requires more VRAM
ltxv-13b-0.9.8-distilledFaster, less VRAM usage, slight quality reduction compared to 13b. Ideal for rapid iterations
ltxv-2b-0.9.8-distilledSmaller model, slight quality reduction compared to 13b distilled. Ideal for fast generation with light VRAM usage
FP8 versionsQuantized versions of the 13B and 2B models

Image to video from the README: a mallard on a court looks around, filmed from ground level.

Write the prompt like a shot list

The README's advice: one flowing paragraph, in order, literal and precise, under 200 words. Think like a cinematographer describing a shot list, and build it in this order:

  • Main action in a single sentence
  • Movements and gestures, in detail
  • Appearance of characters and objects, precisely
  • Background and environment
  • Camera angles and movements
  • Lighting and colours
  • Changes or sudden events

Settings that work for the dev models: guidance scale 3 to 3.5; 40 or more steps for quality, 20 to 30 for speed. The distilled models need no guidance scale and work in 8 steps. Width and height divisible by 32, frame counts of a multiple of 8 plus 1 (like 257), and best results under 720 × 1280 and below 257 frames.

A camera change in one shot, from the README: the focus pulls from a bee on blue fabric to a boy in a blue sweater.

Quick start

The command under Get it downloads the repo. Then go into its folder, make a Python environment and install the inference extras (below). Tested with Python 3.10.5 and CUDA 12.2; on a Mac, MPS was tested with PyTorch 2.3.0. For the best quality the README recommends the ComfyUI workflows over its own inference.py, and the Diffusers library supports LTX-Video too. To try it without installing, the README links hosted demos on LTX-Studio, fal.ai and Replicate.

Set up and install:
cd LTX-Video
python -m venv env
source env/bin/activate
python -m pip install -e .\[inference\]

Image to video (replace the capitals with your own values):
python inference.py --prompt "PROMPT" --conditioning_media_paths IMAGE_PATH --conditioning_start_frames 0 --height HEIGHT --width WIDTH --num_frames NUM_FRAMES --seed SEED --pipeline_config configs/ltxv-13b-0.9.8-distilled.yaml

Requirements and license

  • NVIDIA GPU with CUDA: tested with CUDA 12.2 and Python 3.10.5, PyTorch 2.1.2 or later.
  • Or a Mac: MPS was tested with PyTorch 2.3.0 and should support 2.3 or 2.6 and later.
  • Graphics memory: the 13B dev model needs the most; the distilled, 2B and FP8 models use less.
  • Optional FP8 kernels: a speed boost on NVIDIA cards from the Ada generation onward.

The code is open source under Apache-2.0. Model weights are licensed separately, so check the licence on the model's Hugging Face page and ltx.io/model/license before commercial use. The repo is legacy and no longer under active development; for new projects Lightricks points to LTX-2.5 in the LTX-2 repo.

No GPU? Make it in ReelMe

LTX-Video needs a CUDA graphics card or a Mac, plus the model download. To do the same jobs in your browser, open ReelMe Video (reelme.ai/video?mode=t2v): in Create Video, choose Text to Video to start from a prompt, or Image to Video, add your picture, then switch on First frame. To make a person in your video move like the one in another clip, as the pose examples above do, use the Motion Control tab; to make a clip longer, Extend Video. The shot-list prompt advice on this page works there too.

Credits

Media: LTX-Video by Lightricks (code Apache-2.0). Every clip and still on this page comes from the LTX-Video repo: the README's example GIFs and two clips from its docs folder, re-encoded as MP4. The opening clip and the cover are cropped from the result panel of a depth-control example. Paper: arXiv 2501.00103.

Nov 13, 2026

How it works

3 steps

  1. Start from a still

    Pick one image to start from. No image? Describe it in ReelMe: reelme.ai/video?mode=t2v

  2. Write a shot list

    One paragraph under 200 words: action, look, setting, camera, light.

  3. Add a guide clip

    Optional: a depth, pose or edge video makes the result move the same way.

  • Video models · Repo · picked by ReelMe Academy

    Tencent Hunyuan Community License

    Tencent's open video model with over 13 billion parameters: write a prompt, get a cinematic 720p clip. It runs on a big NVIDIA GPU (45 to 80 GB) under Tencent's own community license.

    1. Clone and install: Linux, conda, PyTorch for CUDA 12.6 or 11.8, then the requirements.
    2. Download the weights: Follow ckpts/README.md. You need a GPU with 45 GB or more.
    3. Prompt and render: Run sample_video.py. No 80 GB GPU? Try text-to-video in ReelMe: reelme.ai/video?mode=t2v
  • Video models · Repo · picked by ReelMe Academy

    Apache-2.0

    Open-source image-to-video that runs on your own NVIDIA GPU: one picture and a short prompt become a minute-long video, and you watch the frames arrive as it renders.

    1. Install FramePack: Windows: one-click package, then update.bat and run.bat. Linux: pip install.
    2. Add image and prompt: Upload one picture and say who moves and how, e.g. dances gracefully.
    3. Watch it grow: Watch frames arrive. No GPU? Try image-to-video in ReelMe: reelme.ai/video?mode=i2v
  • Video models · Repo · picked by ReelMe Academy

    MIT (models non-commercial)

    Open-source portrait animation from Kuaishou: a still picture copies the face in a driving video, every blink, smile and head turn. Works on paintings, 3D characters, cats and dogs.

    1. Install LivePortrait: Clone the repo, pip install the requirements, download the weights.
    2. Pick two inputs: A portrait to animate, and a frontal, neutral-start video of a face.
    3. Animate and tune: Press Animate and tune. Whole body? Use ReelMe Motion Control: reelme.ai/video?tab=motion

Want it step by step? From Zero to AI Creator