Senior Data Engineer

2 days ago Be among the first 25 applicants

We are looking for an experienced Senior Data Engineer to join our growing team. The ideal candidate will have over 7 years of experience in Data Engineering with strong expertise in designing, developing, and maintaining data pipelines using Azure and AWS technologies, modern data Lakehouse architecture, Apache ecosystem tools, and programming languages. The role involves building scalable data solutions, enabling real-time integrations, and supporting data-driven decision-making while implementing industry best practices.

Key Responsibilities:

• Design, develop, and manage robust ETL/ELT pipelines using Azure Data Factory (ADF), Azure Synapse, AWS Glue, and Apache NiFi/Airflow.
• Automate data ingestion, transformation, and storage processes to optimize performance.

Data Integration & API Development

• Integrate diverse data sources and third-party tools using APIs and Webhooks.
• Develop and manage custom APIs for data retrieval, transformation, and system integrations.

Modern Data Lakehouse Architecture

• Design and implement lakehouse architectures using Delta Lake, leveraging bronze/silver/gold medallion approach.
• Optimize storage layouts and partitioning strategies for performance and cost-efficiency.

Data Storage & Management

• Build and maintain Azure Data Lake Storage (ADLS), AWS S3, and HDFS for scalable and cost-effective data storage.
• Optimize storage structures to enable efficient querying and processing of large datasets.

Cloud Data Warehousing

• Implement and maintain large-scale data solutions using Azure Synapse Analytics, Amazon Redshift, and Apache Hive.
• Perform query tuning and ensure high performance for analytics workloads.

Programming & Automation

• Develop clean, efficient, and optimized code using Python, Scala, and C# for data transformation, API integration, and automation.
• Utilize DevOps tools for CI/CD pipelines and deployment automation.

Data Governance & Quality

• Ensure data accuracy, completeness, and security through governance policies.
• Monitor and maintain data lineage, metadata management, and data quality standards.
• Lead team members in implementing best practices for data engineering.
• Create documentation and knowledge sharing sessions on modern data architecture.

Key Skills & Technologies:

• Proficient in Azure (ADF, Synapse, Databricks) and AWS (Glue, Redshift, S3, EMR) cloud platforms
• Skilled in Python, Scala, C#, and SQL for data transformation, automation, and API integration
• Experienced with Apache Spark, Kafka, Hive, and orchestration tools like Airflow and NiFi
• Expertise in modern data lakehouse architectures using Delta Lake, Iceberg, and Hudi
• Familiar with CI/CD pipelines using Azure DevOps, GitHub Actions, and AWS CodePipeline
• Hands-on with Docker, Kubernetes, and IaC tools like Terraform and Pulumi
• Strong in data visualization using Power BI and Tableau

Required Qualifications:

• Bachelor's or master's degree in computer science, Engineering, or related field.
• Minimum of 6 years' experience in Data Engineering.
• Proven experience with Azure (ADF, Synapse, ADLS), AWS (Glue, Redshift, S3), Apache tools (Spark, Kafka), Delta Lake, and modern data lakehouse architectures.
• Strong proficiency in Python, Scala, C#, and SQL.
• Experience in building and maintaining data lakes, lakehouses, and warehouses.
• Knowledge of CI/CD pipelines and automation practices.
• Excellent problem-solving, analytical, and communication skills.

Nice to Have:

• Experience leading data engineering teams
• Knowledge of containerization tools like Kubernetes/Docker
• Familiarity with Machine Learning pipelines and MLOps workflows
• Certifications in Azure, AWS, or Apache technologies

What we Offer:

• Professional Working environment
• Life Insurance & Medical Insurance (Including Family)
• OPD
• Provident Fund
• Maximum 45 Weekly Hours (Monday-Friday)
• Remote Working (During Pandemic Situation)
• Company trip

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionInformation Technology
• IndustriesSoftware Development

Referrals increase your chances of interviewing at Joblogic Service Management Software by 2x

Get notified about new Senior Data Engineer jobs in Lahore, Punjab, Pakistan.

Data Engineer (Onsite, Lahore, Remittance Salary)Senior Software Engineer - Microsoft Dynamics 365Senior Software Engineer - Python - DjangoSenior Software Quality Assurance Engineer (Automation)

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

---