CV System Design Basics: Latency, Accuracy, and Cost
CV System Design Basics: Latency, Accuracy, and Cost
Trade-off triangle
Improve accuracy → often increases latency/cost. Define SLAs early.
Key levers
- Model size
- Input resolution
- Hardware (CPU/GPU)
- Batching
Good habit
Benchmark on target hardware, not your dev machine.
