Video to Game
/video-to-game
Treat a short gameplay video as the design document: study its frames, palette and cuts, build one playable Three.js game around its one mechanic, then prove it with side-by-side frames and a recorded keyboard playtest. GameSkill tested the whole loop with code-made assets; the author's fal asset step is optional and paid.
- License
- MIT
- By
- By GameSkill
Tested by GameSkill
42/42 checks passed on video-to-game scripts (Python 3, ffmpeg, Node 22) + three.js r160 in headless Chrome (2026-11-03): trigger, a runnable example, a screenshot and self-check, one job per skill, and English + Chinese docs. Trigger checks match prompts against skill descriptions; they are not a live agent run.
Test reportWhat this skill does
When it triggers
js whose every image, 3D model, sound and music track is generated with fal, then proves it: side-by-side frames of the video and the game, and a scenario that plays the game with the keyboard and films its best seconds. …
GameSkill's tested copy
GameSkill's tuned build of this skill: the skill files from commit d1a24fd8a475, plus our runnable example, test report, self-check list and Chinese guide, put through our skill process.
License: based on lovisdotio/video-to-game by lovisdotio, under MIT. The ZIP keeps the license files (LICENSE) and lists everything GameSkill added in CHANGES.md.
Self-check
- 视频必须是原创概念和原创玩法，不出现现有游戏的角色、标志、名字或关卡 / The clip is an original concept: no characters, logos, names or levels from existing games
- 先跑 study_video.py，写完规格（机位、主角、一个核心机制、调色板、光照）再写代码 / Run study_video.py and write the spec before any code
- 游戏有完整循环：操作、目标、反馈、结束、重开，并暴露 window.__game / A full loop (controls, goal, feedback, end, restart) and window.__game
- 每次改画面都在同样三个时间点出 side_by_side 对比图 / Every look change is checked on side-by-side pairs at the same three times
- 录一段键盘试玩：0 个控制台错误、不掉出地图、没有空白秒 / A recorded keyboard take: zero console errors, no fall, no dead second
- 如实列出和视频不一样的地方；用了 fal 就列出每次调用和费用 / List honestly what differs from the video; list every fal call and its cost if fal was used
Install
Tell your AI
Install the skill from https://gameskill.dev/skills/video-to-game/install.md
GameSkill's tested copy
mkdir -p .claude/skills
curl -fsSL https://gameskill.dev/dl/skills/video-to-game.zip -o /tmp/gameskill-video-to-game.zip
unzip -oq /tmp/gameskill-video-to-game.zip -d .claude/skills
rm /tmp/gameskill-video-to-game.zipWhat you get
- study_video.py: a frame every 0.25 s, a contact sheet, the palette and the cuts of a clip
- templates/game.html: a Three.js skeleton with post-processing, keyboard and gamepad input, ?autostart, ?seed and a window.__game state contract
- record_play.mjs and templates/play.mjs: a keyboard playtest filmed at the real frame rate
- best_window.py and side_by_side.py: the liveliest seconds of a take and video-versus-game frame pairs
- References on studying a video, the game loop, matching the look and playtesting
Good fit
- Turning an AI-generated or hand-made concept clip into a playable browser game
- Checking a game's look against a target with picture pairs instead of adjectives
- Playtesting your own web game by script and finding dead seconds
Not for
- Unity, Unreal or Godot projects
- Copying existing commercial games: the skill and GameSkill both require original worlds
About this skill
Video to Game turns the hardest part of AI game making, deciding what the game looks and feels like, into an input: a short gameplay clip. The agent cannot watch video, so the skill gives it scripts to study one (a frame every quarter second, a contact sheet, the palette, the cuts), a rule to write the spec before any code, a Three.js template with a state contract, and two ways to prove the result: frame pairs of video and game at the same moments, and a keyboard playtest recorded at the real frame rate.
The author generates every asset with fal, a paid service. GameSkill added two disclosed notes: without a key the agent falls back to code-made assets and says so, and the prompt file ships in upstream-support/. Everything else is the author's text. Our example is an original concept, a paper lantern that keeps sinking and rides warm air from glowing vents down a night valley. It was rendered as a 12-second clip in code and then taken through the whole loop: study, palette, the template game, a keyboard playtest filmed at about 60 fps with zero console errors, the best window, and three side-by-side pairs.
Related
- One sentence to game when you start from words instead of a clip.
- Playtesting for structured playtest feedback.
Requirements
- Python 3.9+, ffmpeg and ffprobe
- Node.js 18+ with playwright-core and a Chromium-family browser for the recorder
- Optional, paid: a fal account (FAL_KEY and pip install fal-client) for the author's generated assets
Topics
FAQ
Based on lovisdotio/video-to-game by lovisdotio (MIT). The author's LICENSE and NOTICE files ship in the ZIP; ATTRIBUTION.md and CHANGES.md list the source commit and what GameSkill added.
Works well with
Skills the author points to as related or as the better fit for neighbouring tasks.
One Sentence to Game (prompt, iterate, check)
A GameSkill original for any model: a round-1 prompt that turns one sentence into a small finished browser game, a one-change-per-round loop with a creation log, a reusable spec template, and a headless checker that reports console errors, blank frames and dead controls as PASS or FAIL. It does not promise one-shot.
Three.js Game Skills
Nine Agent Skills for Codex and Claude Code that build playable Three.js browser games, with a director skill, a Vite scaffold and Playwright QA.
Playtesting
Structure playtest sessions and sort responses into UX friction, difficulty calibration and feature signal.
Similar skills
Awesome Gamedev Agent Skills
77 portable SKILL.md skills across 12 engines (Godot, Unity, Unreal, Phaser, PixiJS, three.js, Bevy, pygame, LÖVE, Roblox, Defold, Ebitengine), with a router.
FunPlay Skill
14 MIT agent skills for game development with scripts and tests: sprite-sheet slicing, normal maps, audio conversion, game concept briefs, browser game slices, Unity MCP workflow and Cocos/WeChat minigame rules.
open-game-skills
An MIT pack of about 190 SKILL.md agent skills for game design: combat feel, camera, traversal, world, validation, 2D/Spine and art pipeline, with a dispatcher and adapters for Three.js, PixiJS, Phaser, Cocos, Godot, Unity and Unreal.
Image to 3D Hero (one picture to a playable rigged GLB, free open-source route, three.js WASD)
A GameSkill original that takes one character image to a third-person hero you can walk with WASD, using free tools only: TripoSR or TRELLIS.2 for the mesh, UniRig or Blender for the rig, Quaternius CC0 clips, then a headless Blender fix step and a GLB check for scale, feet, facing and clip names. Meshy, Tripo and Mixamo are listed as alternatives only. Tested on Bram, a made-up stand-in hero.