Data Engineer

1 day ago

Gujranwala, Punjab, Pakistan beBeeDataEngineer Full time $60,000 - $100,000
Job Title

We are seeking an experienced data engineering professional to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, as well as experience with testing and validation.

Key Responsibilities:

  • Design and implement data pipelines using PySpark and SQL.
  • Develop and execute tests for data validation, storage, and retrieval.
  • Collaborate with development teams to assess changes in data workflows and update test cases.
  • Communicate testing progress effectively with stakeholders.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape.

Requirements:

  • Bachelor's degree in computer science or related discipline.
  • 3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & system integration testing in big data environments.
  • Knowledge and ability to design and execute test cases in a behaviour-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.

Benefits:

  • Opportunity to work with cutting-edge technologies.
  • Chance to contribute to the success of the company and personal growth.

About Us:

We are a vibrant and innovative company that values collaboration and learning. Our team is dedicated to delivering high-quality results and making the workplace fun.

  • Azure Data Engineer

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeDataEngineer Full time $80,000 - $110,000

    Job TitleWe are seeking a skilled data engineer to contribute to our team.About the Role:We will be working on designing and implementing robust data pipeline solutions within Azure Data Lake.The ideal candidate will have experience in integrating and transforming data from various sources to enable comprehensive analytics and reporting.We expect the...

  • Senior Data Engineering Leader

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeData Full time $100,000 - $125,000

    We are seeking an experienced Senior Data Engineering Leader to design, build and maintain large-scale data systems. This is a full-time remote position responsible for infrastructure and code required for data integration, storage, processing, pipelines and analytics from ingestion to consumption.The ideal candidate will have a strong foundation in...

  • Big Data Engineering Leader

    1 day ago

    Gujranwala, Punjab, Pakistan beBeebigdataengineer Full time 9,000,000 - 12,000,000

    Senior Big Data Engineer PositionWe are seeking an experienced Senior Big Data Engineer to lead our Big Data platform vision and roadmap using Azure services.Key Responsibilities:Develop a high-performing Big Data engineering team.Lead capacity planning and contribute to resource allocation.Define and execute the Big Data platform vision and roadmap using...

  • Building Robust Data Pipelines as a Senior Data Engineer

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeDataEngineering Full time $100,000 - $125,000

    Senior Data Engineer RoleWe are seeking a seasoned Senior Data Engineer to drive our data strategy and build robust data pipelines within Azure Data Lake.Main Responsibilities:Data Pipeline Design and Implementation: Develop and implement scalable data pipeline solutions that meet the organization's data needs.Data Integration and Transformation: Integrate...

  • Senior Data Engineer

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeData Full time $180,000 - $200,000

    About Our Data Engineering RoleWe are looking for an experienced data engineer to join our team. As a leading provider of AI strategy, talent, and education services, we strive to bring global expertise in AI to transform companies worldwide.Job OverviewThis remote full-time position requires designing, building, testing, optimizing, and maintaining data...

  • Data Platform Specialist

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeData Full time $120,000 - $140,000

    Job Title: Enterprise Data ArchitectThis is a remote position where we seek an experienced data architect to lead the design, development and maintenance of our enterprise data platform. The ideal candidate will collaborate with data engineers, BI engineers and data business analysts across various platform layers to ensure a scalable, secure and...

  • Data Integration Specialist

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeDataIntegration Full time 20,000,000 - 25,000,000

    **Job Opportunity:** Data Integration SpecialistThis is a key role that involves developing and managing data pipelines, ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.Key Responsibilities:Data Engineering: Utilize Azure Synapse Pipelines and PySpark for data transformation and...

  • Data Infrastructure Leader

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeData Full time $100,000 - $120,000

    Data Architect LeadWe are seeking a seasoned Data Architect to lead our data engineering efforts. The ideal candidate will have a strong background in designing and implementing scalable data infrastructure.

  • Chief Data Architect

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeData Full time $110,000 - $135,000

    Senior Data Engineer PositionThe company is seeking a seasoned Senior Data Engineer to join their team in designing, building, and maintaining data infrastructure required for integration, storage, processing, and analytics.The successful candidate will have extensive experience with Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps,...

  • Data Science Expert

    1 day ago

    Gujranwala, Punjab, Pakistan beBeeMachineLearningEngineer Full time $80,000 - $120,000

    Job DescriptionWe are seeking a skilled machine learning engineer to enhance our predictive automation capabilities.You will evaluate existing ML processes, perform statistical analysis to resolve data set problems, and optimize the accuracy of our AI software.A first-class machine learning engineer will translate expertise into improved predictive model...