Big Data Engineer Leader

1 week ago


Lahore, Punjab, Pakistan beBee Careers Full time

Data Engineer Job Summary:

">

This Big Data Engineer Leader will be responsible for leading the design, development, and maintenance of scalable data pipelines using PySpark and Azure Data Factory.

">

Responsibilities:

  1. Lead a team of data engineers to design and implement data pipelines.
  2. Transform and integrate large datasets from multiple sources.
  3. Work with cross-functional teams to define data requirements and deliver solutions.
  4. Ensure data workflows are optimized for performance, scalability, and cost efficiency.
  5. Monitor and troubleshoot data pipelines to ensure high availability and reliability.
  6. Implement best practices for data governance, security, and compliance.
  7. Utilize Power BI or other visualization tools to support the creation of dashboards and reports (preferred).

Requirements:

">
  • Experience: Minimum 5 years of hands-on experience in data engineering.
  • Technical Expertise:">
    • Strong knowledge of PySpark for data processing and transformation.
    • Proficiency in Azure Data Factory for building and managing ETL/ELT workflows.
    • Familiarity with data storage solutions (e.g., Azure Data Lake, SQL databases).
    • Experience with version control systems like Git.
  • Visualization Skills: Knowledge of Power BI or other visualization tools is highly desirable.
  • Problem-Solving: Excellent analytical and problem-solving skills to handle complex data challenges.
  • Communication: Strong verbal and written communication skills to collaborate effectively with cross-functional teams.
  • Preferred Skills:">
    • Understanding of cloud services in Azure (e.g., Azure Synapse, Logic Apps).
    • Familiarity with Agile methodologies and CI/CD pipelines.

Education:

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Aug AI Full time

    Direct message the job poster from Aug AIMarketing Strategy | Campaign Management | Marketing Automation | Google Ads, Facebook Ads, LinkedIn Ads | Analytics and Reporting | LinkedIn Lead GenerationLocation: Lahore / On-siteExperience Required: 4–5 yearsType: Full-TimeJob Summary:Note: The following description appears to be about a Big Data Engineer role,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a talented Senior Big Data Engineer to lead our team's efforts in designing and developing cutting-edge Big Data and Cloud technologies.Job DescriptionThe ideal candidate will have 4-6+ years of experience in Data Engineering, with a strong background in ETL, Big Data, and Cloud technologies. They will be responsible for designing, developing,...

  • Big Data Engineer

    6 days ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    A Senior Big Data Engineer PositionJob Description:We are seeking an experienced Senior Big Data Engineer to lead our data engineering team. The ideal candidate will have 4-5 years of experience in Big Data technologies, hands-on experience with Spark, Hadoop, Hive, Kafka, or similar technologies, and proficiency in Python, Scala, or Java.About the Job:This...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    BIG DATA ENGINEER ROLEWe are seeking a highly skilled Big Data Engineer to join our team. As a key member of the team, you will be responsible for developing and implementing data lake solutions, managing large sets of structured, semi-structured, and unstructured data in a modern cloud-based environment, and working closely with a diverse team of...

  • Data Engineer

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...

  • Big Data Architect

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have solid experience in data engineering and a passion for Big Data. They should have over 4 to 6+ years of experience specifically in Data Engineering.Key Responsibilities:Design and develop cutting-edge Big Data and Cloud technologies to build critical,...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    Arbisoft is seeking a highly skilled Cloud Data Engineer Leader to oversee the development and maintenance of scalable data systems.Responsibilities:Design, develop, and implement robust data pipelines and platforms utilizing cloud-based services.Manage the end-to-end development lifecycle, ensuring seamless deployment in production...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Platform LeaderWe seek an experienced Data Platform Leader to oversee the design, development, and maintenance of our enterprise data platform.You will collaborate with Data Engineers, BI Engineers, and Data Business Analysts across various platform layers, ensuring a scalable, secure, and high-performance data infrastructure.Responsibilities:Develop...