
Senior Data Engineer
1 day ago
- Job Responsibilities
- Data Ingestion and Integration: You will need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure using services such as Azure Data Factory for ETL jobs.
- Data Transformation and Processing: Large-scale data transformation and processing tasks to prepare the data for analysis and reporting using Azure Databricks and Azure Synapse Analytics and tools like Apache Spark.
- Data Storage and Management: Develop, build and manage the appropriate storage solutions for data using Azure SQL Database, Azure Cosmos DB for structured data, Azure Data Lake Storage for big data and unstructured data, and Azure Blob Storage.
- Data Warehousing: Implementing data warehousing solutions using services such as Azure Synapse Analytics to create scalable and distributed analytics capabilities for handling large datasets.
- Data Modeling and Analysis: Collaborate with machine learning engineers to design and implement data models for analytical workloads using Azure Analysis Services and Azure Databricks.
- Real-time Data Processing: Configure and optimize streaming pipelines to extract insights from live data streams for Azure Stream.
- Data Governance and Security: Data governance and security practices that cover data access controls, implement encryption, monitor data quality, and establish data retention policies.
- MLOps and Automation: Automating data pipelines, monitoring data processes, and managing deployments using tools like Azure DevOps, Azure Monitor, and Azure Automation to achieve continuous integration and delivery (CI/CD).
- Work in a team oriented and agile environment based on designed scrums, sprints and daily stand ups.
- Contribution in projects documentation.
Must Have Skills
- Bachelor's degree in computer science, computer engineering, or a related field.
- 5+ years of experience in data engineering.
- Proficiency in programming languages included Python and SQL.
- Knowledge and experiences for cloud-based platforms specifically Azure cloud included Azure SQL, Data factory, Synapse, and Data Warehouse.
- Participate in modeling Relational and NoSQL databases.
- Experience with of MLOps and DevOps principles and best practices.
- MS Power BI development and report management experience.
- Experience with Agile/Scrum framework.
- Excellent communication and collaboration skills.
-
Senior Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Quanticept AI Full timeGet AI-powered advice on this job and more exclusive features.We are seeking a Data Engineering & DevOps Specialist to design and deliver modern, scalable, and secure data solutions on AWS. This role requires a strong blend of data engineering expertise, cloud architecture skills, and DevOps best practices to build high-performance, automated, and reliable...
-
Senior Data Engineer
1 week ago
Lahore, Punjab, Pakistan Devsinc Full timeOverviewDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to...
-
Senior Data Engineer
5 days ago
Lahore, Punjab, Pakistan beBeeDataEngineer Full time $90,000 - $120,000As a senior data engineer, you will play a pivotal role in shaping our organization's data strategy.Job OverviewOur ideal candidate is an experienced professional with a strong background in data engineering. You will be responsible for designing and implementing robust data pipelines using orchestration tools such as Airflow and cloud-native services....
-
Senior Data Engineer
1 week ago
Lahore, Punjab, Pakistan Tkxel Full timeOverviewJoin to apply for the Senior Data Engineer role at Tkxel.Professional Summary: We seek a seasoned Data Engineer with a proven track record of over 5 years in architecting robust data solutions. You are someone who excels in cloud environments, particularly AWS and Azure, and possesses a deep understanding of data services essential for efficient ETL...
-
Senior Data Engineer
4 days ago
Lahore, Punjab, Pakistan Game District Full time $100,000 - $150,000 per yearAbout the Role:We are seeking aSenior Data Engineerwith a minimum of 7 years of hands-on experience who can both lead a team and make active contributions as an individual. The ideal candidate will have a strong background in data engineering, architecture, and pipeline development, along with the leadership ability to guide, mentor, and manage a team of...
-
Senior Data Engineer
4 days ago
Lahore, Punjab, Pakistan Devsinc Full time $90,000 - $120,000 per yearDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...
-
Senior Data Engineer
1 day ago
Lahore, Punjab, Pakistan Devsinc, LLC Full timeDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...
-
Senior ETL Data Engineer
3 days ago
Lahore, Punjab, Pakistan NorthBay - Pakistan Full time3 weeks ago Be among the first 25 applicantsJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working...
-
Senior Data Engineer
4 days ago
Lahore, Punjab, Pakistan Game District Full time $90,000 - $120,000 per yearAbout the Role: We are seeking a Senior Data Engineer with a minimum of 7 years of hands-on experience who can both lead a team and make active contributions as an individual. The ideal candidate will have a strong background in data engineering, architecture, and pipeline development, along with the leadership ability to guide, mentor, and manage a team of...
-
Senior Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan beBeeData Full timeJob Title: Data ArchitectAre you a seasoned data professional with expertise in designing and implementing large-scale data architectures? Do you have a passion for working with complex data systems and driving business growth through data-driven insights?We are seeking an experienced Senior Data Engineer to join our team. As a key member of our engineering...