74
Python Web Scraping Developer (AWS Integration) – Freelance Project
UpworkESNot specifiedintermediate
PythonBack-End DevelopmentAWS DevelopmentAzure DevOpsMLOpsDjango StackFastAPIRetrieval Augmented GenerationGoogle Cloud PlatformLLM Prompt EngineeringMongoDBVector Embeddingn8nLLaMAPySpark
We are looking for a freelance developer specialized in Web Scraping to collaborate on a project related to our Generative AI products running on AWS.
At Aindeep Technology Solutions, we build technology solutions that combine cloud, AI, cybersecurity and IoT. Within our innovation line, we are developing the Kisai product family (Kicso and Kinai), AI-based assistants that help companies manage regulations and documentation more efficiently.
As part of the platform, we are developing a web scraping component that collects and updates information from online sources to feed the knowledge base of the AI agent.
Responsibilities
Design and develop a web scraping system to collect information from multiple online sources.
Implement data extraction, cleaning and periodic updates.
Ensure the solution is scalable and compatible with AWS environments.
Collaborate with our internal technical team to integrate the solution with the Kinai platform.
Requirements
Experience with Python web scraping.
Familiarity with tools such as Scrapy, BeautifulSoup, Playwright, Selenium or similar.
Experience working with APIs and structured data.
Experience with AWS or cloud environments is a plus.
Nice to have
Experience building data pipelines or ingestion systems.
Experience with serverless or container-based architectures in AWS.
Experience working on AI, knowledge bases, or data-driven systems.
Collaboration
Freelance/remoto and it will last 2 months
Unlock AI intelligence, score breakdowns, and real-time alerts
Upgrade to Pro — $29.99/mo