Senior Developer Needed – One-Time Setup of Automated Job Scraping Pipeline (Greenhouse + Lever)

UpworkUSNot specifiedintermediateScore: 55
API IntegrationAutomationPythonData ScrapingNode.js
I am building a job platform and need an experienced developer to set up a clean, scalable job scraping pipeline. This is a one-time setup project. After completion, I should be able to run it daily myself. ⸻ 🎯 Objective Automatically fetch and export US-based full-time jobs (0–5 years experience) posted or updated in the last 24 hours. The system must use official APIs where possible (Greenhouse + Lever). ⸻ 🔍 Job Filtering Requirements Include only: • United States (including Remote US) • Full-time roles • 0–5 years experience (entry-level / junior) Filter by keywords such as: • Junior • Entry Level • Associate • New Grad • Engineer I / SDE I • 0–2 years / 1–3 years / 2–5 years Exclude: • Senior • Staff • Principal • Lead • Manager • Director ⸻ 📅 Fresh Jobs Only Only include jobs that: • Were updated in the last 24 hours OR • First detected within the last 24 hours ⸻ 📄 CSV Output Requirements The system must generate a clean CSV file including: • Job Title • Company Name • Company Logo URL • Location • Employment Type • Experience Level (derived) • Posted / Updated Date • Salary (if available) • Required Skills (extracted if possible) • Full Job Description • Direct Company Apply URL No duplicate jobs allowed. ⸻ ⚙ Technical Requirements • Use Greenhouse API • Use Lever API • Structured database (jobs + companies) • Unique job UID logic for deduplication • Scalable to monitor 1000+ companies • Simple run command (example: python scrape.py) • Proper documentation ⸻ 🚀 Deliverables • Fully working scraping system • CSV export functionality • Setup documentation • Clean code structure • Instructions for adding new companies
View Original Listing
Unlock AI Intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/mo

Client

Spent: $241.97Rating: 0.0Verified