Python Web Scraping Expert

3 days ago

Lahore, Punjab, Pakistan Pk Studio Full time
Job Description:

We are looking for an experienced Python web scraping expert who can extract structured data from websites and deliver it in JSON format or through a custom API.
The data should be clean, well-organized, and ready for use in applications or databases.

Key Responsibilities:

Scrape data from static and dynamic websites

Handle pagination, AJAX-loaded content, and login-protected pages (if needed)

Format extracted data into clean and structured JSON

Optionally expose the data via REST API (Flask/FastAPI)

Ensure the scraper is efficient, robust, and handles exceptions/errors

Maintain and update scrapers if website structures change

Required Skills:

Strong experience with Python and libraries like BeautifulSoup, Scrapy, or Selenium

Experience using requests, httpx, or aiohttp

Ability to deal with JavaScript-heavy sites using Selenium or Playwright

Data formatting skills (JSON, CSV, etc.)

Optional but preferred: experience with Flask or FastAPI

Knowledge of proxies, rate-limiting, and CAPTCHA handling

Clear and well-documented code practices

Attention to detail and ability to work independently

Deliverables:

Python code for scraping

JSON files or working API endpoint

Brief documentation or instructions to run the script/API

Bonus Points:

Ability to schedule scraping jobs (e.g., using cron or Celery)

Experience with storing data in a database (MongoDB, PostgreSQL, etc.)

Ability to containerize with Docker (optional)

Job Specification:
  • Strong proficiency in Python
  • Experience with web scraping libraries: BeautifulSoup, Scrapy, or Selenium
  • Knowledge of requests, httpx, or aiohttp for HTTP requests
  • Ability to scrape both static and JavaScript-rendered content
  • Familiarity with JSON data formatting and structuring
  • Optional: experience with Flask or FastAPI to create APIs
  • Understanding of proxies, rate-limiting, and CAPTCHA handling
  • Clean, modular, and well-documented coding practices
  • Ability to debug and maintain scraping scripts as websites change
  • Self-motivated and able to work with minimal supervision
#J-18808-Ljbffr

  • Python Data Analyst/Developer

    5 hours ago

    Lahore, Punjab, Pakistan beBeeData Full time 2,500,000 - 3,500,000

    Agilekode is a software-based company specializing in innovative data solutions and software products.We are currently seeking an experienced Python Developer to work on various projects using web scraping and data mining techniques.Key ResponsibilitiesThe ideal candidate will develop and maintain Python scripts for data extraction and processing, leveraging...

  • Python Development Specialist

    7 hours ago

    Lahore, Punjab, Pakistan beBeeProgrammer Full time 900,000 - 1,200,000

    Job Opportunity:We are seeking a skilled Python programmer to collaborate with our team on a contractual basis.About the Role:This freelance position involves working with us to develop and maintain web scraping applications using the Scrapy Framework.Key Responsibilities:Develop high-quality web scraping applications using Scrapy.Collaborate with the team...

  • Senior Python Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    We are looking for a highly skilled Senior Python Developer with expertise in backend development, DevOps practices, and AI/ML technologies. The ideal candidate will have experience in building robust, scalable applications, integrating advanced NLP and generative AI solutions, and implementing efficient web scraping systems. You will play a critical role in...

  • Freelance Python Programmer

    3 days ago

    Lahore, Punjab, Pakistan DreamWorld Technologies Full time

    Freelance Python Programmer DreamWorld Technologies, Pakistan We're a UAE based company with offices in Dubai. We're looking for a Python programmer who knows how to work with the Scrapy Framework. Initially, you'll be working with us remotely (from home) on a contractual or per project basis. This is an urgent requirement.Job SpecificationResponsibilities...

  • Expert Python Web Developer

    8 hours ago

    Lahore, Punjab, Pakistan beBeeSoftware Full time 800,000 - 1,500,000

    Driven Senior Software Engineer needed to excel in Python web development.Key Responsibilities:Design, develop, and maintain scalable web applications using Python (e.g., Django, Flask, or FastAPI).Collaborate with cross-functional teams to build user-centric features.Write clean, reusable, and testable code.Participate in code reviews, standups, and...

  • Python Developer

    1 week ago

    Lahore, Punjab, Pakistan WEBSENTIAL Full time

    Wensential is a technology development company based in Lahore. We are dedicated to creating beautifully designed and well-engineered products that make a real impact on people's lives. Our team values innovative ideas and collaboration, while maintaining a humble approach. Wensential offers an environment where creativity thrives and great work happens.Role...

  • Senior Software Engineer-Python web

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    We're looking for a skilled Python Web Developer with at least 3 years of hands-on experience building scalable web applications. You'll be working closely with cross-functional teams, so excellent communication skills are essential. If you're passionate about clean code, efficient systems, and collaborative problem-solving, we'd love to meet youCore...

  • Python Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Selteq Full time

    5 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Selteq SolutionsStrategic HR Manager at SELTEQ SOLUTIONS | 6+ Years of HR Excellence | Expert Technical Recruiter | Talent Acquisition Specialist | 42K+ Followers Timings: 10 am to 7 pmOnsiteJob Summary:We are looking...

  • Python Developer

    2 weeks ago

    Lahore, Punjab, Pakistan eteksol Full time

    Direct message the job poster from eteksolYour Recruitment Partner | Recruitment consultant | Talent hunt| Recruiter | HR Operations | Payroll ManagementWe are looking for a highly skilled Senior Full Stack Engineer to join our dynamic and fast-growing engineering team. In this role, you'll play a key part in designing and building scalable web applications...

  • Python Developer

    4 weeks ago

    Lahore, Punjab, Pakistan Conovo inc. Full time

    Conovo Technologies is a bespoke software development company, that started as a team of passionate individuals, now specializing in research-led, human-centered custom software development. We help businesses elevate their value through custom software development, product design, QA and end-to-end IT consultancy services. Conovo Technologies is the...