74
Art Installation - Movement Tracking
UpworkCHNot specifiedintermediate
AI Agent DevelopmentAI App DevelopmentData EngineeringAI ChatbotData AnalysisAPI IntegrationAmazon Web ServicesAutomationFull-Stack DevelopmentSoftware ArchitectureData ScienceETL PipelinePythonOpenCVComputer VisionImage ProcessingAnomaly DetectionEdge AI3D ImageArtificial Intelligence
Description
I am an artist working on a research-driven project exploring human movement as a structured “vocabulary.” I am looking for a developer with experience in computer vision and pose estimation to help build an initial prototype system.
The project involves capturing human movement through a camera-based system (e.g. pose estimation using MediaPipe or similar), structuring this movement as time-based data, and organizing gestures into defined categories.
This system will be part of a sound-based installation, where movement is translated into audio or used to trigger and modulate sound. The focus at this stage is on building a clear and reliable pipeline between camera → movement data → structured output, which can later be connected to a sound system.
The goal is not only to track bodies, but to begin constructing a system where gestures can be recorded, compared, and re-used as part of a broader artistic language.
Scope of Work
- Capture skeletal pose data using a camera (e.g. MediaPipe, OpenPose, or similar)
- Export joint coordinates over time (JSON or NDJSON format)
- Normalize skeleton data (scale, orientation, consistent reference point)
- Build a simple system to record, store, and replay movement sequences
- Develop a basic interface or data bridge between movement data and a sound system
- (e.g. mapping movement parameters to audio triggers or control values)
- Enable movement-driven interaction, where gestures can:
- trigger specific sound events
- modulate audio parameters (amplitude, frequency, effects, etc.) or be linked to predefined sound files or processes
Required Skills
- Strong experience in computer vision (Python, OpenCV, MediaPipe or similar)
- Experience working with pose estimation / skeleton tracking
- Understanding of time-series or sequential data
- Ability to structure clean, usable data outputs
Nice to Have
- Experience with gesture recognition or classification
- Familiarity with real-time systems
- Interest in interactive or artistic applications
- Experience with tools like TouchDesigner, Unity, or similar
Important:
- This is a focused prototype, not a large-scale production system.
- Clarity and simplicity are more important than over-engineering.
Unlock AI intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/mo