Python Web Scraping Expert

4 weeks ago

Lahore, Punjab, Pakistan Pk Studio Full time
Job Description:

We are looking for an experienced Python web scraping expert who can extract structured data from websites and deliver it in JSON format or through a custom API.
The data should be clean, well-organized, and ready for use in applications or databases.

Key Responsibilities:

Scrape data from static and dynamic websites

Handle pagination, AJAX-loaded content, and login-protected pages (if needed)

Format extracted data into clean and structured JSON

Optionally expose the data via REST API (Flask/FastAPI)

Ensure the scraper is efficient, robust, and handles exceptions/errors

Maintain and update scrapers if website structures change

Required Skills:

Strong experience with Python and libraries like BeautifulSoup, Scrapy, or Selenium

Experience using requests, httpx, or aiohttp

Ability to deal with JavaScript-heavy sites using Selenium or Playwright

Data formatting skills (JSON, CSV, etc.)

Optional but preferred: experience with Flask or FastAPI

Knowledge of proxies, rate-limiting, and CAPTCHA handling

Clear and well-documented code practices

Attention to detail and ability to work independently

Deliverables:

Python code for scraping

JSON files or working API endpoint

Brief documentation or instructions to run the script/API

Bonus Points:

Ability to schedule scraping jobs (e.g., using cron or Celery)

Experience with storing data in a database (MongoDB, PostgreSQL, etc.)

Ability to containerize with Docker (optional)

Job Specification:
  • Strong proficiency in Python
  • Experience with web scraping libraries: BeautifulSoup, Scrapy, or Selenium
  • Knowledge of requests, httpx, or aiohttp for HTTP requests
  • Ability to scrape both static and JavaScript-rendered content
  • Familiarity with JSON data formatting and structuring
  • Optional: experience with Flask or FastAPI to create APIs
  • Understanding of proxies, rate-limiting, and CAPTCHA handling
  • Clean, modular, and well-documented coding practices
  • Ability to debug and maintain scraping scripts as websites change
  • Self-motivated and able to work with minimal supervision
#J-18808-Ljbffr

  • Senior Python Developer

    3 days ago

    Lahore, Punjab, Pakistan Devsinc Full time

    We are looking for a highly skilled Senior Python Developer with expertise in backend development, DevOps practices, and AI/ML technologies. The ideal candidate will have experience in building robust, scalable applications, integrating advanced NLP and generative AI solutions, and implementing efficient web scraping systems. You will play a critical role in...

  • Freelance Python Programmer

    4 weeks ago

    Lahore, Punjab, Pakistan DreamWorld Technologies Full time

    Freelance Python Programmer DreamWorld Technologies, Pakistan We're a UAE based company with offices in Dubai. We're looking for a Python programmer who knows how to work with the Scrapy Framework. Initially, you'll be working with us remotely (from home) on a contractual or per project basis. This is an urgent requirement.Job SpecificationResponsibilities...

  • Python Web Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Kavtech Solutions (Private) Ltd. Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Kavtech Solutions (Private) Ltd.Senior Executive Human Resource @ Kavtech | Talent Acquisition | Technical Recruitment | Your Hiring PartnerAs a leading tech innovator, our work environment reflects our commitment to excellence. We are on the lookout for a...

  • Backend Development Specialist

    24 hours ago

    Lahore, Punjab, Pakistan beBeeBackend Full time 900,000 - 1,200,000

    Backend Development SpecialistWe are looking for a highly skilled specialist with expertise in backend development, DevOps practices, and AI/ML technologies.The ideal candidate will have experience in building robust, scalable applications, integrating advanced NLP and generative AI solutions, and implementing efficient web scraping systems. You will play a...

  • Backend Engineer

    4 days ago

    Lahore, Punjab, Pakistan Talent Trellis Inc. Full time

    Backend Engineer (Automations & Scraping focus)We're hiring a Backend Engineer who can start immediately and is highly skilled at building automations and scraping systems. This role is focused on backend engineering and product features, with AI as a supporting layer.What You'll Work OnBuild and scale backend services & APIs (Ruby on Rails, Node,...

  • Python Django Developer

    3 days ago

    Lahore, Punjab, Pakistan Hashed System Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Hashed SystemHuman Resource at Hashed System |Helping Teams Thrive | HR with a Heart *We're Hiring: Python Django Developer* *Hashed Systems* is on the lookout for a talented *Python Django Developer* to join our team on an immediate basis If you're passionate...

  • Python Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is actively seeking a talented Python Developer to join our growing team. In this role, you will be responsible for designing and developing high-quality software solutions using Python. This position offers the opportunity to work on diverse projects and collaborate with cross-functional teams to create innovative applications that drive business...

  • Python Django Developer

    4 days ago

    Lahore, Punjab, Pakistan NKU Technologies Full time

    Direct message the job poster from NKU TechnologiesHR Manager | NKU Technologies |Talent Aquisition Specialist |Headhunter |We are seeking an experienced Python/Django Developer with 3-4 years of proven experience to join our growing development team.Key Responsibilities:Design, develop, and maintain complex web applications using Python and the Django...

  • Python Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Bit and Bytes LLC Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Bit and Bytes LLCHR Executive | Headhunter | Technical RecruiterWe're looking for a skilled Python Django Developer with 3 to 5 years of experience to join our growing team.Experience: 3 to 5 yearsType: Full-time | On-siteLocation: Khayaban-e-Ameen,...

  • Python Applications Developer

    3 days ago

    Lahore, Punjab, Pakistan beBeeSoftware Full time 3,000,000 - 5,000,000

    Senior Software Engineer - PythonBachelor's degree in Computer Science or a related field is essential for this position.Key Responsibilities:Design and develop complex Python applications for financial systems.Collaborate with cross-functional teams to conceptualize and implement innovative features.Identify and resolve issues in existing...