# AI Gateway Text-to-Video Generation

Generate videos from text prompts. Describe what you want to see and the model creates a video matching your description.

Every model here also runs as a background job instead of one long-lived request. See [asynchronous generation](/content/docs/ai-gateway/modalities/video-generation/text-to-video#asynchronous-generation/index.html) below.

## [Google Veo](/content/docs/ai-gateway/modalities/video-generation/text-to-video#google-veo/index.html)

Google's Veo models generate high-quality videos with optional audio.

[Browse the latest Veo video models](/content/ai-gateway/models?capabilities=video-generation&providers=vertex/index.html) on the AI Gateway Models page.

### [Veo parameters](/content/docs/ai-gateway/modalities/video-generation/text-to-video#veo-parameters/index.html)

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `prompt` | `string` | Yes | Text description of the video to generate |
| `aspectRatio` | `string` | No | Aspect ratio (`'16:9'`, `'9:16'`). Defaults to `'16:9'` |
| `duration` | `4` \| `6` \| `8` | No | Video length in seconds. Defaults to 8 |
| `resolution` | `string` | No | Resolution (`'720p'`, `'1080p'`). Defaults to `'720p'` |
| `generateAudio` | `boolean` | No | Generate audio alongside the video. |
| `providerOptions.vertex.enhancePrompt` | `boolean` | No | Use Gemini to enhance prompts. Defaults to `true` |
| `providerOptions.vertex.negativePrompt` | `string` | No | What to discourage in the generated video |
| `providerOptions.vertex.personGeneration` | `'dont_allow'` \| `'allow_adult'` \| `'allow_all'` | No | Whether to allow person generation. Defaults to `'allow_adult'` |
| `providerOptions.vertex.compressionQuality` | `'optimized'` \| `'lossless'` | No | Compression quality. Defaults to `'optimized'` |
| `providerOptions.vertex.sampleCount` | `number` | No | Number of output videos (1-4) |
| `providerOptions.vertex.seed` | `number` | No | Seed for deterministic generation (0-4,294,967,295) |
| `providerOptions.vertex.gcsOutputDirectory` | `string` | No | Cloud Storage URI to store the generated videos |
| `providerOptions.vertex.referenceImages` | `array` | No | Reference images for style or asset guidance |
| `providerOptions.vertex.pollIntervalMs` | `number` | No | How often to check task status. Defaults to `5000` |
| `providerOptions.vertex.pollTimeoutMs` | `number` | No | Maximum wait time. Defaults to `600000` (10 minutes) |

### [Veo example](/content/docs/ai-gateway/modalities/video-generation/text-to-video#veo-example/index.html)

```typescript
import { experimental_generateVideo as generateVideo } from 'ai';
import fs from 'node:fs';

const result = await generateVideo({
  model: 'google/veo-3.1-generate-001',
  prompt: 'A pangolin curled on a mossy stone in a glowing bioluminescent forest',
  aspectRatio: '16:9',
  resolution: '1920x1080',
  generateAudio: true,
});

fs.writeFileSync('output.mp4', result.videos[0].uint8Array);
```

## [KlingAI](/content/docs/ai-gateway/modalities/video-generation/text-to-video#klingai/index.html)

KlingAI offers text-to-video with standard and professional quality modes. Audio generation requires v2.6+ models. Duration is 5-10 seconds.

[Browse the latest KlingAI video models](/content/ai-gateway/models?capabilities=video-generation&providers=klingai/index.html) on the AI Gateway Models page.

### [KlingAI parameters](/content/docs/ai-gateway/modalities/video-generation/text-to-video#klingai-parameters/index.html)

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `prompt` | `string` | Yes | Text description of the video to generate. Max 2500 characters. |
| `aspectRatio` | `string` | No | Aspect ratio (`'16:9'`, `'9:16'`, `'1:1'`). Defaults to `'16:9'`. |
| `duration` | `number` | No | Video length in seconds. 5 or 10 for v2.x, 3-15 for v3.0. Defaults to `5`. |
| `providerOptions.klingai.mode` | `'std'` \| `'pro'` | No | `'std'` for standard quality. `'pro'` for professional quality. Defaults to `'std'`. |
| `providerOptions.klingai.negativePrompt` | `string` | No | What to avoid in the video. Max 2500 characters. |
| `generateAudio` | `boolean` | No | Generate audio. Defaults to `false`. Requires v2.6+. |
| `providerOptions.klingai.cfgScale` | `number` | No | Prompt adherence (0-1). Higher = stricter. Defaults to `0.5`. Not supported on v2.x. |
| `providerOptions.klingai.voiceList` | `array` | No | Voice IDs for speech. Max 2 voices. Requires v3.0+ with `generateAudio: true`. |
| `providerOptions.klingai.multiShot` | `boolean` | No | Enable multi-shot generation. Requires v3.0+. |
| `providerOptions.klingai.watermarkInfo` | `object` | No | Set `{ enabled: true }` to generate watermarked result. |
| `providerOptions.klingai.pollIntervalMs` | `number` | No | How often to check task status. Defaults to `5000`. |
| `providerOptions.klingai.pollTimeoutMs` | `number` | No | Maximum wait time. Defaults to `600000` (10 minutes). |

### [KlingAI example](/content/docs/ai-gateway/modalities/video-generation/text-to-video#klingai-example/index.html)

```typescript
import { experimental_generateVideo as generateVideo } from 'ai';
import fs from 'node:fs';

const result = await generateVideo({
  model: 'klingai/kling-v3.0-t2v',
  prompt: 'A chicken flying into the sunset in the style of 90s anime',
  aspectRatio: '16:9',
  duration: 5,
  providerOptions: {
    klingai: {
      mode: 'std',
    },
  },
});

fs.writeFileSync('output.mp4', result.videos[0].uint8Array);
```

### [KlingAI camera control](/content/docs/ai-gateway/modalities/video-generation/text-to-video#klingai-camera-control/index.html)

Control camera movement during video generation.

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `providerOptions.klingai.cameraControl.type` | `string` | Yes | Camera movement type. See options below. |
| `providerOptions.klingai.cameraControl.config` | `object` | No | Movement configuration. Required when `type` is `'simple'`. |

Camera movement types:

| Type | Description | Config required |
| --- | --- | --- |
| `'simple'` | Basic movement with one axis | Yes |
| `'down_back'` | Camera descends and moves backward | No |
| `'forward_up'` | Camera moves forward and tilts up | No |
| `'right_turn_forward'` | Rotate right then move forward | No |
| `'left_turn_forward'` | Rotate left then move forward | No |

`simple` camera configuration options (use only one, set others to 0):

| Config | Range | Description |
| --- | --- | --- |
| `horizontal` | \[-10, 10\] | Camera translation along x-axis. Negative = left. |
| `vertical` | \[-10, 10\] | Camera translation along y-axis. Negative = down. |
| `pan` | \[-10, 10\] | Camera rotation around y-axis. Negative = left. |
| `tilt` | \[-10, 10\] | Camera rotation around x-axis. Negative = down. |
| `roll` | \[-10, 10\] | Camera rotation around z-axis. Negative = counter-clockwise. |
| `zoom` | \[-10, 10\] | Focal length change. Negative = narrower FOV. |

### [KlingAI multi-shot](/content/docs/ai-gateway/modalities/video-generation/text-to-video#klingai-multi-shot/index.html)

Generate videos with multiple storyboard shots, each with its own prompt and duration. Requires Kling v3.0+ models.

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `providerOptions.klingai.multiShot` | `boolean` | Yes | Set to `true` to enable multi-shot generation |
| `providerOptions.klingai.shotType` | `string` | No | Set to `'customize'` for custom shot durations |
| `providerOptions.klingai.multiPrompt` | `array` | Yes | Array of shot configurations |
| `providerOptions.klingai.multiPrompt[].index` | `number` | Yes | Shot order (starting from 1) |
| `providerOptions.klingai.multiPrompt[].prompt` | `string` | Yes | Text description for this shot |
| `providerOptions.klingai.multiPrompt[].duration` | `string` | Yes | Duration in seconds for this shot |

### [Wan](/content/docs/ai-gateway/modalities/video-generation/text-to-video#wan/index.html)

Wan (by Alibaba) offers text-to-video with native audio generation and prompt enhancement. Use `resolution` parameter (e.g., `'1280x720'`), not `aspectRatio`.

[Browse the latest Wan video models](/content/ai-gateway/models?capabilities=video-generation&providers=alibaba/index.html) on the AI Gateway Models page.

### [Wan parameters](/content/docs/ai-gateway/modalities/video-generation/text-to-video#wan-parameters/index.html)

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `prompt` | `string` | Yes | Text description of the video to generate |
| `resolution` | `string` | No | v2.6: `'1280x720'` or `'1920x1080'`. v2.5: also supports `'848x480'` |
| `duration` | `number` | No | v2.6: 2-15s. v2.5: 5s or 10s only. Defaults to 5 |
| `generateAudio` | `boolean` | No | Generate audio. `wan-v2.6-t2v` generates native audio and defaults to `true` |
| `providerOptions.alibaba.promptExtend` | `boolean` | No | Enhance prompt for better quality. Defaults to `true` |
| `providerOptions.alibaba.negativePrompt` | `string` | No | What to avoid in the video. Max 500 characters |
| `providerOptions.alibaba.audioUrl` | `string` | No | URL to audio file for audio-video sync (WAV/MP3, 3-30s, max 15MB). v2.5 only |
| `providerOptions.alibaba.shotType` | `'single'` \| `'multi'` | No | `'multi'` enables multi-shot cinematic narrative. v2.6 only |
| `providerOptions.alibaba.watermark` | `boolean` | No | Add watermark to the video. Defaults to `false` |
| `providerOptions.alibaba.pollIntervalMs` | `number` | No | How often to check task status. Defaults to `5000` |
| `providerOptions.alibaba.pollTimeoutMs` | `number` | No | Maximum wait time. Defaults to `600000` (10 minutes) |

### [Grok Imagine Video](/content/docs/ai-gateway/modalities/video-generation/text-to-video#grok-imagine-video/index.html)

Grok Imagine Video (by SpaceXAI) generates videos from text prompts with support for multiple aspect ratios and resolutions. Duration ranges from 1-15 seconds.

[Browse the latest Grok video models](/content/ai-gateway/models?capabilities=video-generation&providers=spacexai/index.html) on the AI Gateway Models page.

### [Grok parameters](/content/docs/ai-gateway/modalities/video-generation/text-to-video#grok-parameters/index.html)

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `prompt` | `string` | Yes | Text description of the video to generate |
| `aspectRatio` | `string` | No | Aspect ratio (`'16:9'`, `'9:16'`, `'1:1'`, `'4:3'`, `'3:4'`, `'3:2'`, `'2:3'`). Defaults to `'16:9'` |
| `duration` | `number` | No | Video length in seconds (1-15) |
| `resolution` | `string` | No | Resolution (`'854x480'` for 480p, `'1280x720'` for 720p). Defaults to 480p |
| `providerOptions.spacexai.resolution` | `'480p'` \| `'720p'` | No | Native resolution format. Alternative to standard `resolution` parameter |
| `providerOptions.spacexai.pollIntervalMs` | `number` | No | How often to check task status. Defaults to `5000` |
| `providerOptions.spacexai.pollTimeoutMs` | `number` | No | Maximum wait time. Defaults to `600000` (10 minutes) |

### [ByteDance Seedance](/content/docs/ai-gateway/modalities/video-generation/text-to-video#bytedance-seedance/index.html)

ByteDance's Seedance models generate high-quality videos from text prompts with optional synchronized audio and a draft mode for low-cost previews. All models output MP4 at 24fps. Seedance 2.5 generates up to 30 seconds, where the v1.x models top out at 12.

[Browse the latest Seedance video models](/content/ai-gateway/models?capabilities=video-generation&providers=bytedance/index.html) on the AI Gateway Models page.

### [Seedance parameters](/content/docs/ai-gateway/modalities/video-generation/text-to-video#seedance-parameters/index.html)

| Parameter | Type | Required | Description |
| --- | --- | --- | --- |
| `prompt` | `string` | Yes | Text description of the video to generate |
| `aspectRatio` | `string` | No | Aspect ratio (`'16:9'`, `'4:3'`, `'1:1'`, `'3:4'`, `'9:16'`, `'21:9'`) |
| `resolution` | `string` | No | Resolution (`'854x480'`, `'1280x720'`, `'1920x1080'`) |
| `duration` | `number` | No | Video length in seconds. 2.5: 4-30s. v1.5: 4-12s. v1.0: 2-12s |
| `providerOptions.bytedance.watermark` | `boolean` | No | Add a watermark to the video |
| `generateAudio` | `boolean` | No | Generate audio. Seedance v1.5 Pro and the Seedance 2.x series only |
| `providerOptions.bytedance.cameraFixed` | `boolean` | No | Fix the camera position during generation |
| `providerOptions.bytedance.draft` | `boolean` | No | Generate a 480p preview for fast iteration. Seedance v1.5 Pro only |
| `providerOptions.bytedance.serviceTier` | `'default'` \| `'flex'` | No | `'default'` for online inference. `'flex'` for offline at 50% cost, higher latency |
| `providerOptions.bytedance.pollIntervalMs` | `number` | No | How often to check task status. Defaults to `3000` |
| `providerOptions.bytedance.pollTimeoutMs` | `number` | No | Maximum wait time. Defaults to `300000` (5 minutes) |

### [Asynchronous generation](/content/docs/ai-gateway/modalities/video-generation/text-to-video#asynchronous-generation/index.html)

Pass a `webhook` factory and the SDK registers your URL with the job instead of polling for it. The factory returns that URL and a `received` promise it waits on, then it fetches the videos itself.

```typescript
const result = await generateVideo({
  model: gateway.videoModel('klingai/kling-v3.0-t2v'),
  prompt: 'A chicken flying into the sunset in the style of 90s anime',
  aspectRatio: '16:9',
  duration: 5,
  webhook: async () => ({
    url: callbackUrl,
    received: waitForDelivery(token),
  }),
  poll: { timeoutMs: 10 * 60 * 1000 },
});
```

`token`, `callbackUrl`, and `waitForDelivery` come from [webhook-driven completion](/content/docs/ai-gateway/modalities/video-generation#webhook-driven-completion/index.html), which also covers the receiver, signature verification, and the payload shape.