74

Art Installation - Movement Tracking

UpworkCHNot specifiedintermediate
AI Agent DevelopmentAI App DevelopmentData EngineeringAI ChatbotData AnalysisAPI IntegrationAmazon Web ServicesAutomationFull-Stack DevelopmentSoftware ArchitectureData ScienceETL PipelinePythonOpenCVComputer VisionImage ProcessingAnomaly DetectionEdge AI3D ImageArtificial Intelligence
Description I am an artist working on a research-driven project exploring human movement as a structured “vocabulary.” I am looking for a developer with experience in computer vision and pose estimation to help build an initial prototype system. The project involves capturing human movement through a camera-based system (e.g. pose estimation using MediaPipe or similar), structuring this movement as time-based data, and organizing gestures into defined categories. This system will be part of a sound-based installation, where movement is translated into audio or used to trigger and modulate sound. The focus at this stage is on building a clear and reliable pipeline between camera → movement data → structured output, which can later be connected to a sound system. The goal is not only to track bodies, but to begin constructing a system where gestures can be recorded, compared, and re-used as part of a broader artistic language. Scope of Work - Capture skeletal pose data using a camera (e.g. MediaPipe, OpenPose, or similar) - Export joint coordinates over time (JSON or NDJSON format) - Normalize skeleton data (scale, orientation, consistent reference point) - Build a simple system to record, store, and replay movement sequences - Develop a basic interface or data bridge between movement data and a sound system - (e.g. mapping movement parameters to audio triggers or control values) - Enable movement-driven interaction, where gestures can: - trigger specific sound events - modulate audio parameters (amplitude, frequency, effects, etc.) or be linked to predefined sound files or processes Required Skills - Strong experience in computer vision (Python, OpenCV, MediaPipe or similar) - Experience working with pose estimation / skeleton tracking - Understanding of time-series or sequential data - Ability to structure clean, usable data outputs Nice to Have - Experience with gesture recognition or classification - Familiarity with real-time systems - Interest in interactive or artistic applications - Experience with tools like TouchDesigner, Unity, or similar Important: - This is a focused prototype, not a large-scale production system. - Clarity and simplicity are more important than over-engineering.
View Original Listing
Unlock AI intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/mo