Senior Data Pipeline Architect

3 days ago

Lahore, Punjab, Pakistan beBeeDataEngineer Full time
Job Summary

We are seeking an accomplished Data Engineer to design, build, and maintain scalable data pipelines using cutting-edge tools like Airbyte, Airflow, and dbt. The ideal candidate will have hands-on experience with Snowflake, strong programming skills in Python, and a solid understanding of data warehousing.

About the Role
  • Design and Engineering

The Data Engineer will be responsible for designing efficient data pipelines that integrate with Snowflake, ensuring seamless data flow across systems.

Automation and Workflow Development

Develop and implement automations and workflows to streamline data processing and integration.

Cross-Functional Collaboration

Collaborate with cross-functional teams to set up and maintain data infrastructure that supports both engineering and analytical needs.

Big Data Processing and Analysis

Utilize Databricks and Spark for big data processing, ensuring data is processed, stored, and analyzed efficiently.

Monitoring and Quality Control

Monitor data streams and processes using Kafka and Monte Cristo, ensuring data quality and integrity.

Visualizations and Reporting

Work closely with data analysts and other stakeholders to create, maintain, and optimize visualizations and reports using Tableau.

Security and Compliance

Ensure the security and compliance of data systems, implementing best practices and leveraging tools like Terraform for infrastructure management.

Process Evaluation and Improvement

Continuously evaluate and improve data processes, staying current with industry best practices and emerging technologies.

Requirements
  • Proficiency in SQL

Experience with data visualization tools such as Tableau.

Hands-on Experience with Data Engineering Tools

Experience with data engineering tools and platforms including Snowflake, Airbyte, Airflow, and Terraform.

Strong Programming Skills

Strong programming skills in Python and experience with data transformation tools like dbt.

Knowledge of Big Data Processing Frameworks

Familiarity with big data processing frameworks such as Databricks and Apache Spark.

Experience with Data Streaming Platforms

Knowledge of data streaming platforms like Kafka.

Experience with Data Observability and Quality Tools

Experience with data observability and quality tools like Monte Cristo.

Solid Understanding of Data Warehousing

Solid understanding of data warehousing, data pipelines, and database management, with specific experience in Snowflake.

Ability to Design and Implement Automation

Ability to design and implement automation, workflows, and data infrastructure.

Strong Analytical Skills

Strong analytical skills with the ability to translate complex data into actionable insights, particularly using Tableau.

Excellent Problem-Solving Abilities

Excellent problem-solving abilities and attention to detail.

Benefits
  • Competitive Salary
  • Medical Benefits
  • Educational Courses

Generous Time Off

  • Senior Data Solutions Architect

    5 days ago

    Lahore, Punjab, Pakistan beBeeDataSolutions Full time $100,000 - $120,000

    We are seeking a highly skilled Senior Data Solutions Architect to design, build and manage large-scale data processing systems and machine learning pipelines. This role requires strong expertise in scalable data infrastructure and pipeline design, with the ability to integrate multiple data sources to support business goals.Key ResponsibilitiesDesign and...

  • Senior Data Architect

    6 days ago

    Lahore, Punjab, Pakistan beBeeData Full time $80,000 - $150,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect with expertise in building robust data pipelines, working with large-scale datasets, and leveraging modern Big Data and cloud technologies.The ideal candidate should have hands-on experience in designing and developing complex data solutions using Big Data and cloud-native...

  • Senior Data Architect

    7 days ago

    Lahore, Punjab, Pakistan beBeeDataArchitecture Full time $120,000 - $150,000

    Job Title: Senior Data ArchitectOur company is seeking a highly skilled and experienced Senior Data Architect to join our team. In this role, you will be responsible for designing and implementing data architectures that meet the needs of our business.Job Responsibilities:Design and implement scalable data architectures that meet the needs of our...

  • Senior Data Pipeline Architect

    6 days ago

    Lahore, Punjab, Pakistan beBeeDataEngineer Full time 1,500,000 - 2,000,000

    At DevRolls, we're on a mission to transform data into powerful tools that drive business growth. Our team of expert engineers builds innovative digital solutions using cutting-edge technologies like PySpark, Hive, and Hadoop.About the RoleWe're seeking a talented Data Engineer to design, develop, and maintain scalable data pipelines that meet our clients'...

  • Data Architect

    4 weeks ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe seek an experienced Data Architect to lead the design, development, and maintenance of our...

  • Senior Semantic Data Modeler

    19 hours ago

    Lahore, Punjab, Pakistan beBeeData Full time 2,000,000 - 2,500,000

    Data ArchitectWe are seeking an experienced Data Architect to play a critical role in designing, structuring, and maintaining enterprise-wide data models, ontologies, and semantic layers.Design and develop enterprise data ontologies to define relationships between business concepts and datasets.Architect scalable data solutions using Palantir Foundry,...

  • Master Data Solutions Architect

    3 days ago

    Lahore, Punjab, Pakistan beBeeDataEngineer Full time

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to develop innovative data solutions and optimize large-scale data pipelines.Key Responsibilities:Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena.Data Warehousing: Architect and manage data warehouses using...

  • Data Architect

    19 hours ago

    Lahore, Punjab, Pakistan beBeeData Full time 1,500,000 - 2,000,000

    Job Title: Master Data ArchitectKey Responsibilities:Design and implement large-scale data pipelines using modern big data technologies.Build scalable and efficient distributed data processing systems using Hadoop, Spark, Hive, and Kafka.Work extensively with cloud platforms (AWS) and services like EMR, Glue, Lambda, Athena, S3.Design and implement data...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team....

  • Strategic Data Architect

    3 hours ago

    Lahore, Punjab, Pakistan beBeeData Full time 2,000,000 - 2,500,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer to design and develop complex data pipelines and solutions using Big Data and cloud-native technologies.The ideal candidate will have hands-on expertise in ETL frameworks, distributed data processing, and data modeling within cloud environments such as AWS. They should be able to leverage tools...