Glossary
What is a scorer for generative video?
A scorer is a function or model configuration that grades outputs during benchmarks or live scoring. Scorers are org-scoped and compose the “contract” for what “better” means on your team.
Designing scorers that survive production
The hard part of video eval is agreeing what to measure: temporal consistency, prompt adherence, brand safety, or latency budgets. Frametail keeps scorer libraries at the org level so benchmarks reuse the same definitions.
Hybrid approaches work well: automated scorers for volume, human spot-checks on edge cases.
Scorers on fal pipelines
Trace fal generations first, then attach scorers to benchmark rows that mirror production prompts. When a scorer regresses, the trace shows which span produced the clip.