AI Gateway Text-to-Video Generation
AI Gateway Text-to-Video Generation
Generate videos from text prompts. Describe what you want to see and the model creates a video matching your description.
Every model here also runs as a background job instead of one long-lived request. See asynchronous generation below.
Google Veo
Google's Veo models generate high-quality videos with optional audio.
Browse the latest Veo video models on the AI Gateway Models page.
Veo parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string |
Yes | Text description of the video to generate |
aspectRatio |
string |
No | Aspect ratio ('16:9', '9:16'). Defaults to '16:9' |
duration |
4 | 6 | 8 |
No | Video length in seconds. Defaults to 8 |
resolution |
string |
No | Resolution ('720p', '1080p'). Defaults to '720p' |
generateAudio |
boolean |
No | Generate audio alongside the video. |
providerOptions.vertex.enhancePrompt |
boolean |
No | Use Gemini to enhance prompts. Defaults to true |
providerOptions.vertex.negativePrompt |
string |
No | What to discourage in the generated video |
providerOptions.vertex.personGeneration |
'dont_allow' | 'allow_adult' | 'allow_all' |
No | Whether to allow person generation. Defaults to 'allow_adult' |
providerOptions.vertex.compressionQuality |
'optimized' | 'lossless' |
No | Compression quality. Defaults to 'optimized' |
providerOptions.vertex.sampleCount |
number |
No | Number of output videos (1-4) |
providerOptions.vertex.seed |
number |
No | Seed for deterministic generation (0-4,294,967,295) |
providerOptions.vertex.gcsOutputDirectory |
string |
No | Cloud Storage URI to store the generated videos |
providerOptions.vertex.referenceImages |
array |
No | Reference images for style or asset guidance |
providerOptions.vertex.pollIntervalMs |
number |
No | How often to check task status. Defaults to 5000 |
providerOptions.vertex.pollTimeoutMs |
number |
No | Maximum wait time. Defaults to 600000 (10 minutes) |
Veo example
import { experimental_generateVideo as generateVideo } from 'ai';
import fs from 'node:fs';
const result = await generateVideo({
model: 'google/veo-3.1-generate-001',
prompt: 'A pangolin curled on a mossy stone in a glowing bioluminescent forest',
aspectRatio: '16:9',
resolution: '1920x1080',
generateAudio: true,
});
fs.writeFileSync('output.mp4', result.videos[0].uint8Array);
KlingAI
KlingAI offers text-to-video with standard and professional quality modes. Audio generation requires v2.6+ models. Duration is 5-10 seconds.
Browse the latest KlingAI video models on the AI Gateway Models page.
KlingAI parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string |
Yes | Text description of the video to generate. Max 2500 characters. |
aspectRatio |
string |
No | Aspect ratio ('16:9', '9:16', '1:1'). Defaults to '16:9'. |
duration |
number |
No | Video length in seconds. 5 or 10 for v2.x, 3-15 for v3.0. Defaults to 5. |
providerOptions.klingai.mode |
'std' | 'pro' |
No | 'std' for standard quality. 'pro' for professional quality. Defaults to 'std'. |
providerOptions.klingai.negativePrompt |
string |
No | What to avoid in the video. Max 2500 characters. |
generateAudio |
boolean |
No | Generate audio. Defaults to false. Requires v2.6+. |
providerOptions.klingai.cfgScale |
number |
No | Prompt adherence (0-1). Higher = stricter. Defaults to 0.5. Not supported on v2.x. |
providerOptions.klingai.voiceList |
array |
No | Voice IDs for speech. Max 2 voices. Requires v3.0+ with generateAudio: true. |
providerOptions.klingai.multiShot |
boolean |
No | Enable multi-shot generation. Requires v3.0+. |
providerOptions.klingai.watermarkInfo |
object |
No | Set { enabled: true } to generate watermarked result. |
providerOptions.klingai.pollIntervalMs |
number |
No | How often to check task status. Defaults to 5000. |
providerOptions.klingai.pollTimeoutMs |
number |
No | Maximum wait time. Defaults to 600000 (10 minutes). |
KlingAI example
import { experimental_generateVideo as generateVideo } from 'ai';
import fs from 'node:fs';
const result = await generateVideo({
model: 'klingai/kling-v3.0-t2v',
prompt: 'A chicken flying into the sunset in the style of 90s anime',
aspectRatio: '16:9',
duration: 5,
providerOptions: {
klingai: {
mode: 'std',
},
},
});
fs.writeFileSync('output.mp4', result.videos[0].uint8Array);
KlingAI camera control
Control camera movement during video generation.
| Parameter | Type | Required | Description |
|---|---|---|---|
providerOptions.klingai.cameraControl.type |
string |
Yes | Camera movement type. See options below. |
providerOptions.klingai.cameraControl.config |
object |
No | Movement configuration. Required when type is 'simple'. |
Camera movement types:
| Type | Description | Config required |
|---|---|---|
'simple' |
Basic movement with one axis | Yes |
'down_back' |
Camera descends and moves backward | No |
'forward_up' |
Camera moves forward and tilts up | No |
'right_turn_forward' |
Rotate right then move forward | No |
'left_turn_forward' |
Rotate left then move forward | No |
simple camera configuration options (use only one, set others to 0):
| Config | Range | Description |
|---|---|---|
horizontal |
[-10, 10] | Camera translation along x-axis. Negative = left. |
vertical |
[-10, 10] | Camera translation along y-axis. Negative = down. |
pan |
[-10, 10] | Camera rotation around y-axis. Negative = left. |
tilt |
[-10, 10] | Camera rotation around x-axis. Negative = down. |
roll |
[-10, 10] | Camera rotation around z-axis. Negative = counter-clockwise. |
zoom |
[-10, 10] | Focal length change. Negative = narrower FOV. |
KlingAI multi-shot
Generate videos with multiple storyboard shots, each with its own prompt and duration. Requires Kling v3.0+ models.
| Parameter | Type | Required | Description |
|---|---|---|---|
providerOptions.klingai.multiShot |
boolean |
Yes | Set to true to enable multi-shot generation |
providerOptions.klingai.shotType |
string |
No | Set to 'customize' for custom shot durations |
providerOptions.klingai.multiPrompt |
array |
Yes | Array of shot configurations |
providerOptions.klingai.multiPrompt[].index |
number |
Yes | Shot order (starting from 1) |
providerOptions.klingai.multiPrompt[].prompt |
string |
Yes | Text description for this shot |
providerOptions.klingai.multiPrompt[].duration |
string |
Yes | Duration in seconds for this shot |
Wan
Wan (by Alibaba) offers text-to-video with native audio generation and prompt enhancement. Use resolution parameter (e.g., '1280x720'), not aspectRatio.
Browse the latest Wan video models on the AI Gateway Models page.
Wan parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string |
Yes | Text description of the video to generate |
resolution |
string |
No | v2.6: '1280x720' or '1920x1080'. v2.5: also supports '848x480' |
duration |
number |
No | v2.6: 2-15s. v2.5: 5s or 10s only. Defaults to 5 |
generateAudio |
boolean |
No | Generate audio. wan-v2.6-t2v generates native audio and defaults to true |
providerOptions.alibaba.promptExtend |
boolean |
No | Enhance prompt for better quality. Defaults to true |
providerOptions.alibaba.negativePrompt |
string |
No | What to avoid in the video. Max 500 characters |
providerOptions.alibaba.audioUrl |
string |
No | URL to audio file for audio-video sync (WAV/MP3, 3-30s, max 15MB). v2.5 only |
providerOptions.alibaba.shotType |
'single' | 'multi' |
No | 'multi' enables multi-shot cinematic narrative. v2.6 only |
providerOptions.alibaba.watermark |
boolean |
No | Add watermark to the video. Defaults to false |
providerOptions.alibaba.pollIntervalMs |
number |
No | How often to check task status. Defaults to 5000 |
providerOptions.alibaba.pollTimeoutMs |
number |
No | Maximum wait time. Defaults to 600000 (10 minutes) |
Grok Imagine Video
Grok Imagine Video (by SpaceXAI) generates videos from text prompts with support for multiple aspect ratios and resolutions. Duration ranges from 1-15 seconds.
Browse the latest Grok video models on the AI Gateway Models page.
Grok parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string |
Yes | Text description of the video to generate |
aspectRatio |
string |
No | Aspect ratio ('16:9', '9:16', '1:1', '4:3', '3:4', '3:2', '2:3'). Defaults to '16:9' |
duration |
number |
No | Video length in seconds (1-15) |
resolution |
string |
No | Resolution ('854x480' for 480p, '1280x720' for 720p). Defaults to 480p |
providerOptions.spacexai.resolution |
'480p' | '720p' |
No | Native resolution format. Alternative to standard resolution parameter |
providerOptions.spacexai.pollIntervalMs |
number |
No | How often to check task status. Defaults to 5000 |
providerOptions.spacexai.pollTimeoutMs |
number |
No | Maximum wait time. Defaults to 600000 (10 minutes) |
ByteDance Seedance
ByteDance's Seedance models generate high-quality videos from text prompts with optional synchronized audio and a draft mode for low-cost previews. All models output MP4 at 24fps. Seedance 2.5 generates up to 30 seconds, where the v1.x models top out at 12.
Browse the latest Seedance video models on the AI Gateway Models page.
Seedance parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string |
Yes | Text description of the video to generate |
aspectRatio |
string |
No | Aspect ratio ('16:9', '4:3', '1:1', '3:4', '9:16', '21:9') |
resolution |
string |
No | Resolution ('854x480', '1280x720', '1920x1080') |
duration |
number |
No | Video length in seconds. 2.5: 4-30s. v1.5: 4-12s. v1.0: 2-12s |
providerOptions.bytedance.watermark |
boolean |
No | Add a watermark to the video |
generateAudio |
boolean |
No | Generate audio. Seedance v1.5 Pro and the Seedance 2.x series only |
providerOptions.bytedance.cameraFixed |
boolean |
No | Fix the camera position during generation |
providerOptions.bytedance.draft |
boolean |
No | Generate a 480p preview for fast iteration. Seedance v1.5 Pro only |
providerOptions.bytedance.serviceTier |
'default' | 'flex' |
No | 'default' for online inference. 'flex' for offline at 50% cost, higher latency |
providerOptions.bytedance.pollIntervalMs |
number |
No | How often to check task status. Defaults to 3000 |
providerOptions.bytedance.pollTimeoutMs |
number |
No | Maximum wait time. Defaults to 300000 (5 minutes) |
Asynchronous generation
Pass a webhook factory and the SDK registers your URL with the job instead of polling for it. The factory returns that URL and a received promise it waits on, then it fetches the videos itself.
const result = await generateVideo({
model: gateway.videoModel('klingai/kling-v3.0-t2v'),
prompt: 'A chicken flying into the sunset in the style of 90s anime',
aspectRatio: '16:9',
duration: 5,
webhook: async () => ({
url: callbackUrl,
received: waitForDelivery(token),
}),
poll: { timeoutMs: 10 * 60 * 1000 },
});
token, callbackUrl, and waitForDelivery come from webhook-driven completion, which also covers the receiver, signature verification, and the payload shape.