Senior Data Infrastructure Engineer

7 days ago

Lahore, Punjab, Pakistan beBee Careers Full time
Job Requirements

We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in designing and developing efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.

The successful candidate will have hands-on experience with data engineering tools and platforms, including Snowflake, Airbyte, Airflow, and Terraform, and a solid understanding of data warehousing, data pipelines, and database management.

Key Responsibilities
  1. Data Pipeline Development: Design, build, and maintain efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.
  2. Data Warehousing Optimization: Manage and optimize data warehousing solutions using Snowflake, ensuring data is organized, secure, and accessible for analysis.
  3. Automation and Workflow Implementation: Develop and implement automations and workflows to streamline data processing and integration, ensuring seamless data flow across systems.
  4. Cross-Functional Collaboration: Collaborate with cross-functional teams to set up and maintain data infrastructure that supports both engineering and analytical needs.
  5. Big Data Processing: Utilize Databricks and Spark for big data processing, ensuring data is processed, stored, and analyzed efficiently.
  6. Data Monitoring: Monitor data streams and processes using Kafka and Monte Cristo, ensuring data quality and integrity.
  7. Data Visualization: Work closely with data analysts and other stakeholders to create, maintain, and optimize visualizations and reports using Tableau, ensuring data-driven decision-making.
  8. Data Security: Ensure the security and compliance of data systems, implementing best practices and leveraging tools like Terraform for infrastructure management.
  9. Process Improvement: Continuously evaluate and improve data processes, staying current with industry best practices and emerging technologies, with a strong emphasis on data analytics and visualization.
Requirements
  • SQL Proficiency: Proficiency in SQL and experience with data visualization tools such as Tableau.
  • Data Engineering Tools: Hands-on experience with data engineering tools and platforms including Snowflake, Airbyte, Airflow, and Terraform.
  • Programming Skills: Strong programming skills in Python and experience with data transformation tools like dbt.
  • Big Data Frameworks: Familiarity with big data processing frameworks such as Databricks and Apache Spark.
  • Data Streaming Platforms: Knowledge of data streaming platforms like Kafka.
  • Data Observability Tools: Experience with data observability and quality tools like Monte Cristo.
  • Data Warehousing: Solid understanding of data warehousing, data pipelines, and database management, with specific experience in Snowflake.
  • Automation and Workflow Development: Ability to design and implement automation, workflows, and data infrastructure.
  • Analytical Skills: Strong analytical skills with the ability to translate complex data into actionable insights, particularly using Tableau.
  • Problem-Solving Abilities: Excellent problem-solving abilities and attention to detail.
Benefits
  • Competitive salary
  • Medical
  • Educational courses

At our organization, we value diversity and are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

  • Data Engineer/Infrastructure Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for an experienced AI Platform / Infrastructure Engineer to join our team. The ideal candidate will have 5+ years of relevant experience (excluding internships, prototypes, or personal projects) in building and deploying solutions with a strong understanding of DevOps culture and...

  • Senior Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Stallions Tech Full time

    Stallions Tech is looking for a Senior Data Engineer to join their dynamic team. This role focuses on designing and optimizing scalable data pipelines, ensuring data quality, and managing modern data infrastructure. If you're passionate about data engineering and innovation, this opportunity is for youKey Responsibilities:Design, develop, and maintain robust...

  • Senior IT Infrastructure Engineer

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Senior DevOps Engineer Job DescriptionWe are looking for an experienced Senior DevOps Engineer to join our team. The ideal candidate will have a strong background in DevOps, cloud computing, and IT infrastructure management.Responsibilities:Support the development and implementation of DevOps practices and tools to improve the efficiency and effectiveness of...

  • Cloud Data Infrastructure Expert

    6 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job RoleThis is a leadership role that requires experience in designing, developing, and maintaining enterprise-level data infrastructure, working closely with cross-functional teams to ensure data architecture meets business needs.Key Responsibilities:Leadership and Mentorship: Mentor and guide a team of data engineers, promoting collaboration and knowledge...

  • Cloud Infrastructure Engineer

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled Senior DevOps Engineer to join our team. The ideal candidate will have extensive experience in designing, implementing, and managing cloud infrastructure with a strong focus on AWS, Terraform, and CI/CD pipelines.About the Role:The Senior DevOps Engineer will play a key role in automating our development and deployment...

  • Senior Data Engineer

    4 days ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Job Description: Senior Data Engineer at TkxelWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data Factory to join our team. The ideal candidate will have a minimum of 5 years of professional experience in data engineering and a strong understanding of data processing, transformation, and integration. Knowledge of...

  • Cloud Infrastructure Engineer

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    This role requires a Data Pipeline Developer to design, implement, and maintain scalable data pipelines across our cloud-based infrastructure. The ideal candidate will possess expertise in containerization, data pipeline development, and troubleshooting intricate data workflows.Main Responsibilities:Design and implement data pipelines for high-performance...

  • Senior Data Engineer Position

    8 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to design, develop, and deploy large-scale data solutions. The ideal candidate will have a strong background in building and optimizing cloud-based data pipelines, architecting data warehouses, and managing complex data environments using cloud technologies.The successful candidate will work...

  • Data Engineer Position

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job DescriptionThis Senior Data Engineer position focuses on designing and optimizing scalable data pipelines, ensuring data quality, and managing modern data infrastructure.The ideal candidate will have a passion for data engineering and innovation. They will design, develop, and maintain robust ETL pipelines to process and transform data.Key...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Systems Limited Full time

    Senior Data Engineer:Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache...