Senior Developer Needed – One-Time Setup of Automated Job Scraping Pipeline (Greenhouse + Lever)
UpworkUSNot specifiedintermediateScore: 55
API IntegrationAutomationPythonData ScrapingNode.js
I am building a job platform and need an experienced developer to set up a clean, scalable job scraping pipeline.
This is a one-time setup project. After completion, I should be able to run it daily myself.
⸻
🎯 Objective
Automatically fetch and export US-based full-time jobs (0–5 years experience) posted or updated in the last 24 hours.
The system must use official APIs where possible (Greenhouse + Lever).
⸻
🔍 Job Filtering Requirements
Include only:
• United States (including Remote US)
• Full-time roles
• 0–5 years experience (entry-level / junior)
Filter by keywords such as:
• Junior
• Entry Level
• Associate
• New Grad
• Engineer I / SDE I
• 0–2 years / 1–3 years / 2–5 years
Exclude:
• Senior
• Staff
• Principal
• Lead
• Manager
• Director
⸻
📅 Fresh Jobs Only
Only include jobs that:
• Were updated in the last 24 hours
OR
• First detected within the last 24 hours
⸻
📄 CSV Output Requirements
The system must generate a clean CSV file including:
• Job Title
• Company Name
• Company Logo URL
• Location
• Employment Type
• Experience Level (derived)
• Posted / Updated Date
• Salary (if available)
• Required Skills (extracted if possible)
• Full Job Description
• Direct Company Apply URL
No duplicate jobs allowed.
⸻
⚙ Technical Requirements
• Use Greenhouse API
• Use Lever API
• Structured database (jobs + companies)
• Unique job UID logic for deduplication
• Scalable to monitor 1000+ companies
• Simple run command (example: python scrape.py)
• Proper documentation
⸻
🚀 Deliverables
• Fully working scraping system
• CSV export functionality
• Setup documentation
• Clean code structure
• Instructions for adding new companies
Unlock AI Intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/moClient
Spent: $241.97Rating: 0.0Verified