梅隆多技能AI助手框架

简介

Overview

A macOS multi-agent system driven by Claude Code. Latest tag is v0.4.0. Two production skills ship today; both are agentskills.io-spec compliant so they drop into Claude Code, Cursor, Goose, Gemini CLI, and the rest of the compatible-runtime set unmodified. Skill #1 — music-video. Music file in, 60-second 9:16 vertical short out. Per-genre color grade (six profiles) shapes generic Pexels B-roll into a genre-coded look; 23 ffmpeg shaders + phrase-aware structure (cuts on aubiotrack beats, glitch micro-edits on aubioonset drum hits, restraint gated per preset) compose on top. The demo above is a noir-detective render; the grid further down shows six genre profiles side by side. Implementation under agents/missions/music-video/run.sh — the skill routes through the 5-agent mission pipeline (orchestrator + planner / resourcer / editor / qa) so re-rendering tuning flows into both surfaces. Skill #2 — job-hunt. Single seed keyword in, deduplicated markdown digest out. --seed "Problem Solver" expands to the 24-synonym role family companies actually use (FDE / Applied AI Engineer / Generalist / Founding Engineer / Forward Deployed / …) before fetching from 11 source plugins. Five are live-ready without an API key — global-ats (Greenhouse + Ashby + Lever boards across ~27 AI / SaaS companies including Anthropic / OpenAI / Cursor / Stripe / Notion / Datadog), global-remoteok, global-remotive, global-hn-whoshiring (HN monthly via Algolia), kr-worknet (정부 공공고용서비스). Two more (kr-wanted, kr-saramin) need an API key per source. End-to-end live test: 5,000+ raw postings filtered to ~200 matches. The skill is standalone (no orchestrator routing) — skills/job-hunt/scripts/run.sh is the canonical implementation because every planner / qa stage would be near-empty for a mechanical filter / fetch / dedupe pipeline. Two ways to drive this repo. - Agent-driven (primary) — install Claude Code, point it at the cloned repo, type a mission. Claude Code edits files, commits, pushes. Cost: a Max subscription absorbs orchestration; the money firewall gates anything paid beyond that. - Script-only (fallback) — ./scripts/bootstrap.sh then the bash scripts run standalone. No Claude Code needed; no commits or pushes happen automatically, but the rendered output is identical. Cost: $0 beyond the optional free Pexels API key. The scaffold is general-purpose. Short-form video is the v1 domain because the deliverable is visually verifiable and failure modes are fast to catch; the architecture itself doesn't assume short-form anything. New skills pick the shape that fits — see the Architecture section below for the three-shape model and what a future skill (movie / game / longform) would likely route through. Built on a single premise: automate the production pipeline, then let the system evolve its own logic. Every commit is one observable step of that evolution. The history is the agent system's own growth, not a record of its outputs (those stay local in gitignored records/).

Engineering decisions, one page. docs/engineering-case-studies.md — nine production incidents and the minimum mechanism each one produced (Tier-1 routing, semaphore-bounded batch, content-quality feedback loop, three-layer reactive audit, shader-effects-in-ffmpeg / knowing-where-the-wall-is, onboarding-friction-kills-first-touch / zero-account demo path, declarative preset routing for genre-aware shaders, intervention-as-the-unmeasured-axis / autonomy signal + reduction levers, and the quality-bar-as-6-unenforced-contracts after the 2026-05-22 music-video QA pass). Each entry follows problem → constraint → decision → artifact.

What's shipped on top of the v5 prototype

- 23 ffmpeg shaders in scripts/music-video-shaders.sh across three stages — pond / halation / breathing / combo (first pass) + light_leak / duotone / vignette_pulse / scanline / chromatic_split / neon_edge / vhs / saturation_pulse / kaleidoscope / beat_burst / strobe / shake / color_burst / light_rays (genre-aware pass) + paper_grain / dust_speck / posterize / trail_echo / soft_bloom (Stage-2 + Stage-3). Cartoon / cel-shading deliberately deferred — see case study 5. - Genre-aware preset routing — 14-genre table in skills/music-video/data/genre-presets.yaml resolves a genre → preset → env overrides → post-shader chain (case study 7). Ambient / classical / dreamcore route to a separate scripts/music-video-stillzoom.sh (image + music → 60-second slow Ken-Burns) for genres where ANY cut violates the contract. - Per-genre base color grade — grade_profile field on every preset (kr_warm_pastel / hollywood_teal_orange / lofi_warm_grain / rnb_low_key / city_pop_neon / neutral) drives an ffmpeg curves + eq + colorbalance stage in scripts/music-video-grade.sh before shaders. Transforms generic Pexels B-roll into a genre-coded look before the effect layer. Research origin: docs/research/2026-05-22-music-video-pro-practices.md §2; visual A/B verdict in docs/research/2026-05-22-grade-profile-comparison.md. - Director-discipline shot plan (opt-in scaffold) — scripts/shot-plan.sh generates a per-segment intent layer from the lyric LRC + phrase boundaries before B-roll fetch, paralleling working music-video director practice (write the shot list before the shoot). Activated via MUSIC_VIDEO_USE_SHOT_PLAN=1. Methodology research in docs/research/2026-05-22-music-video-director-methodology.md. - Music-video quality bar — five contracts the system now enforces (case study 9 · full changelog at skills/music-video/CHANGELOG.md): A.1 B-roll dedup registry (records/youtube/broll-used.txt, 271 seeded ids), A.2 lyric vocal-onset alignment via whisper (scripts/music-video-lyric-align.sh, word-level KR / segment-level EN, LRC + JSON sidecar with drift verdict), A.3 lang_anchor + person-anchored keyword injection at every 3rd segment with a QA gate (scripts/music-video-qa-anchor.sh, exit 0 PASS / 1 WARN / 2 FAIL), B.1 shader-vocabulary expansion to 23 effects across three stages, C.1 four shader-gate modes via MUSIC_VIDEO_SHADER_GATE (uniform / phrase_climax / onsets / beats) with event-count cap at 30 to dodge ffmpeg's expr-length budget. - Operator-facing utilities — scripts/first-touch.sh wizard (single-command guided zero-account demo), scripts/music-video-batch.sh (multi-track render wrapper), scripts/music-video-validate.sh (combined pre-publish gate), scripts/music-video-thumbnail.sh (auto-extract upload-ready still), scripts/lyric-extract.sh (whisper-based lyric pull), scripts/morning-brief.sh (one-page overnight digest). Full table in docs/music-video-pipeline-reference.md. - Skill #2 — job-hunt v0.4.0 (separate from the music-video thread above) — short-keyword UX + 11 source plugins (5 live-ready no-key, 2 key-gated, 4 mock-fallback / permanent-mock) + 5 enrichment scaffolds. Walkthrough at docs/skills/job-hunt.md.

The faceless-short mission (narration-driven shorts) remains the showcase below; the v1 pipeline outputs (single-clip highlight + shorts-batch) remain as the baseline reference further down.