Betternship Jobs

Go to Betternship's main site

Post a Job

Python Developer – Web Scraping & Automation

Betternship
Remote
remote
Accepting Application
$400 – $900 gross
Apply Now
Please enable JavaScript in your browser to complete this form.
Name
Please enable JavaScript in your browser to complete this form.
Name
Gender
E.g. Fintech, HealthTech, AgriTech, Real Estate, Edutech
Click or drag a file to this area to upload.
Agreement
About Betternship

About

Our client is a software solutions company delivering custom, high-reliability systems for businesses across the GCC region. They work closely with clients to understand operational challenges and build tailored software that automates workflows, improves efficiency, and supports secure, large-scale transactions. The team has delivered on-site and remote solutions for over 40 clients, including fintech, logistics, and enterprise organizations. They focus on building systems that are not just functional, but scalable, secure, and reliable in real-world production environments.

Job Description

Job Description

Our client is looking for an experienced Python Developer with strong expertise in web scraping, automation, and data extraction. The role involves building, maintaining, and optimizing scalable scraping solutions while ensuring data accuracy, reliability, and compliance.

Key Responsibilities

  • Develop and maintain web scraping and automation scripts using Python

  • Extract, clean, and structure data from websites and web applications

  • Use Selenium for browser automation and dynamic content scraping

  • Use BeautifulSoup for HTML parsing and data extraction

  • Handle anti-bot mechanisms such as CAPTCHAs, headers, cookies, proxies, and rate limiting

  • Monitor scraping jobs to ensure data quality and consistency

  • Optimize scripts for performance, stability, and scalability

  • Collaborate with backend, data, and product teams to meet data requirements

  • Maintain clear documentation and follow best coding practices

Qualifications

  • 3+ years of professional experience in Python development

  • Strong hands-on experience with Selenium and BeautifulSoup

  • Solid understanding of HTML, CSS, DOM, XPath, and website structures

  • Experience with scraping frameworks and data extraction tools

  • Knowledge of Python libraries such as requests, pandas, and related data-processing tools

  • Experience handling large datasets and structured data formats (CSV, JSON, Excel)

  • Familiarity with Git and version control systems

  • Strong debugging and problem-solving skills

Nice to Have

  • Experience with Scrapy or similar scraping frameworks

  • API integration and RESTful services experience

  • Experience deploying scripts on Linux servers or cloud platforms

  • Knowledge of Docker and job scheduling tools such as cron

  • Understanding of ethical scraping practices and compliance considerations

Benefits

  • $400 – $900 gross monthly, depending on experience

  • Opportunity to work on real-world systems

  • Growth within a fast-moving engineering team

  • Collaborative, problem-solving focused culture

Apply to this job here

Please enable JavaScript in your browser to complete this form.
Name
Gender
E.g. Fintech, HealthTech, AgriTech, Real Estate, Edutech
Click or drag a file to this area to upload.
Agreement

Ready to Elevate Your Team?

Take the next step towards success by hiring top-tier talents through Betternship. Whether you need creative designers, skilled developers, or strategic marketers, we’ve covered you.

Hire Talent
Contact Us