The Information Machine

@rainisto @DavidmComfort agree!! i quite like the idea of procedural code for storyboarding and control, and then video …

Andrej Karpathy Twitter · Andrej Karpathy (@karpathy) · 2026-08-02

Andrej Karpathy endorses a hybrid video generation workflow combining procedural code for storyboard control with video-to-video diffusion models for final visual rendering and quality enhancement.

Open original ↗

Appears in

Extraction

Topics: ai-video-generationprocedural-generationvideo-diffusionstoryboarding

Claims

  • Procedural code provides effective structure and control for storyboarding in AI video generation pipelines.
  • Video-to-video diffusion models can be applied downstream to add visual texture and quality to procedurally defined scenes.
  • A hybrid approach combining code-based control with generative video models is a promising direction for AI video production.

Key quotes

i quite like the idea of procedural code for storyboarding and control, and then video to video models for texturing and looksmaxxing.