52
Build a Data Intelligence Platform (Excel → Searchable Database with Cleaning & Automation)
UpworkUSNot specifiedexpert
PostgreSQLSQLPythonReact
Project Description:
We are seeking an experienced developer to build a robust data platform that consolidates approximately 3 years of historical Excel data into a centralized, searchable database.
The end goal is to create a system that allows us to filter, search, and analyze data in a way similar to platforms like ImportGenius ( https://www.youtube.com/watch?v=9IaKZ1JUPmU) and Datamyne
(https://www.youtube.com/watch?v=0x3aTakUSl0 https://video.descartes.com/watch/bSvacD2MWcRSrAJoHttAAV)
Scope of Work:
1. Data Consolidation & Database Creation
- Merge multiple Excel files (3 years of historical data) into a structured database
- Ensure efficient indexing for fast search and filtering
- Design a scalable architecture to support ongoing data growth
2. Data Cleaning & Standardization
- Normalize inconsistent fields (e.g., addresses, phone numbers, company names)
- Implement automated formatting and validation rules
- Detect and handle duplicates or incomplete records
3. Ongoing Data Integration
- We receive new Excel files biweekly
- Build an easy-to-use upload system (UI or automated pipeline)
- Automatically process, clean, and append new data to the database
4. Email Extraction Integration
- We already have a working program that extracts and formats email addresses
- This must be integrated into the final system (API or embedded logic)
5. User Interface / Platform
- Web-based interface preferred
- Advanced filtering (multi-field search, date ranges, etc.)
- Clean, intuitive dashboard for querying and exporting data
- Ability to download filtered datasets
Unlock AI intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/moClient
Spent: $1,108.31Rating: 5.0Verified