PySpark Developer

5 days ago


Lahore, Punjab, Pakistan beBee Careers Full time

We are looking for a highly skilled PySpark Developer to be part of our team.

Responsibilities
  1. Create innovative data integration solutions in Apache Spark-based Platforms
  2. Analyze business needs, identify problems and provide effective solutions
  3. Solve complex scenarios with ease
  4. Write unit tests for Spark transformations and helper methods
  5. Document code with Scaladoc-style comments
Requirements
  1. BS degree in Computer Science or Software Engineering
  2. At least 2 years of experience as a PySpark Developer
  3. Strong Python skills
  4. Experience with source control systems such as Git, Bitbucket and Jenkins build tools
  5. Databricks or Apache Spark Experience
  6. Excellent Analytical Skills
  7. Nice to have experience in Shell Scripting
Perks and Benefits:
  • 18 Paid Holidays per year
  • In-patient and Out-patient medical coverage
  • Annual Increments
  • Personal Development Fund
  • Child Education Support
  • Training Fund
  • Vehicle Lease option
  • Flexibility to work weekends off
  • Opportunities for personal and professional growth

  • PySpark Developer

    4 weeks ago


    Lahore, Punjab, Pakistan Gtradecenter Full time

    InvoZone is a growing company in Lahore, headquartered in Canada, that offers a combination of consulting, outsourcing, and specialized services to a global clientele across all types of web and mobile app development. The company was launched by experienced and visionary IT professionals with more than 10 years of industry experience in the fraternity of...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are searching for a seasoned PySpark Developer to contribute to the design and implementation of large-scale data processing systems.Main ResponsibilitiesArchitect and develop scalable data pipelines using Apache SparkAnalyze complex data sets to identify patterns and trendsDevelop and maintain high-quality codebaseCollaborate with the team to resolve...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are looking for a highly skilled PySpark Developer to be part of our dynamic development team. The ideal candidate will have a strong background in Python, Apache Spark, and data integration.The selected individual will be responsible for innovating and implementing data integration solutions on our Apache Spark-based platform. This includes understanding...

  • Azure Data Engineer

    7 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    This role requires a strong background in data engineering and expertise in implementing and supporting ETL processes, Data Lakes, and data engineering solutions. The ideal candidate will have experience working with Azure Synapse Analytics and PySpark, as well as a strong understanding of SQL and data modeling.Data Engineering ResponsibilitiesDesign and...

  • Data Engineer

    4 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer with a strong background in SQL and PySpark development to join our team.This is a key role that involves designing and managing data pipelines using Azure Synapse Analytics, Delta Lake, and SQL environments.The ideal candidate will have:Extensive experience with SQL, including query writing and troubleshooting in...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    The role requires a strong background in data engineering, with extensive experience in SQL and PySpark development.Responsibilities include:Designing and managing data pipelines using Azure Synapse Analytics, Delta Lake, and SQL environments.Troubleshooting issues related to ETL pipeline failures, data inconsistencies, and performance...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    The ideal candidate will have 5+ years of experience in Dynamics 365 ecosystem with a strong background in PySpark development. A strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions is also required.Key ResponsibilitiesDesign and implement ETL processes using Azure Synapse Analytics and...

  • Big Data Expert

    4 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We seek an expert in Big Data processing and analytics to develop scalable data pipelines using PySpark.Key ResponsibilitiesDesign and implement efficient data integration architecturesDevelop and maintain high-quality Spark applicationsCollaborate with the team to resolve complex technical issuesWrite automated tests for Spark componentsProduce detailed...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Engineer Role OverviewAs a Data Engineer, you will play a pivotal role in enabling data-driven decision-making across the organization by designing and building scalable data pipelines. This involves integrating and processing data from diverse sources using Apache Kafka and other ingestion tools, as well as building ETL workflows leveraging PySpark and...

  • Cloud Data Engineer

    4 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Data Engineer RoleThis is a challenging opportunity for a skilled data engineer to collaborate with stakeholders to understand their requirements and work on building large-scale data pipelines.You will participate in daily project and production delivery meetings, providing technical support for faster issue resolution.We are looking for someone with strong...