Head Data Engineer

1 week ago

Karachi, Sindh, Pakistan Finclude Full time 1,200,000 - 3,600,000 per year
Job Purpose:
  • Head Data Engineer will design and maintain data pipelines of real-time and batch, creates data strategy, data architecture, best practices and who can lead the organization in making strategical improvements in the data engineering solutions.
  • This role requires to have a knowledge of core system, retail banking systems, digital journeys, marketing systems, risk and compliance systems which are very data intensive systems across UAE, Egypt, Pakistan etc. where bank operates retail business.
  • Our core function spans multiple platforms like Enterprise Data Lake, Azure Data Lake, Business Intelligence, Advanced Analytics and Realtime Streaming platforms.
  • The work involves developing new requirements in both on-premises and cloud data lake's estimating the efforts, designing an effective solution, data architecture and management, change release management, resource management, handling the deliverables across the business groups in the Bank. Also, handling critical applications that influence bank's management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.

Key Responsibilities:
  • Develops and maintains scalable data pipelines of batch and real-time to support continuing increases in data demands of volume and complexity.
  • Leading data engineering team and ensuring best practices and quality on the deliveries.
  • Designs and Develops Data domains across banking products and laying foundation for Data Mesh architecture.
  • Demonstrate deep knowledge and experience in databases, Datamart's, Data Modelling, Data Governance, Data Security, BI tools, ETL Solutions.
  • Data Orchestration and Data-Ops practices enabler for the team
  • Collaborates with analyst, data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Writes unit/integration tests, contributes to engineering wiki, and documents work.
  • Experience in Automating Deployment, scheduling, monitoring, and management of datasets and pipelines
  • Understand business requirements and identify key performance indicators (KPIs) in Data Engineering. Classification: Internal Use
  • Design data models to transform raw data into meaningful insights.
  • Ability to Debug Data issues in data platforms and Provide L2, L3 Production support as per SLA.
  • Recommend improvements to enhance existing ETL and data integration processes to enable performance and overall scalability.
  • Evaluate company's present data infrastructure/governance/architecture, identify gaps, and develop plans to integrate the current systems with the desired future model.
  • Identify, analyze various risks, and implement risk management controls, RCSA and contingency plans on Data Platform to mitigate future risk.
  • Reviewing, executing, and documenting Audit activities and its corrective actions on Data Platform.
  • Ensuring Data Platform security and compliance with data privacy regulations and company policies. Implementing access controls, data masking, and encryption where necessary to safeguard sensitive information.
  • Understands industry trends and the practical application of existing, new, and emerging technologies.
  • Forecasting future data storage and processing requirements and planning for scalability. Identifying potential bottlenecks and devising strategies to accommodate growing data volumes.
  • Developing and maintaining disaster recovery plans and business continuity strategies to address potential risks and minimize downtime.
  • Communicate and effectively articulate the DWH/DL solution/roadmaps to business and technical delivery teams.
  • Coordinate with change management approval board to get all desired approvals and ensure production deployments on timely manner.
  • Collaborate with Incident management team to track and report on incidents, their resolutions, and any necessary follow-up actions. Interacting with Data Platform software and hardware vendors to coordinate support, updates, and service-level agreements


Requirements
  • Principal Data engineer with a solid technical background and experience in data-intensive systems (> 15 years)
  • Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, Airflow
  • Proficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or similar data stack knowledge within Google/AWS cloud services
  • Proficiency in relational SQL, Graph and NoSQL databases.
  • Proficiency in Elastic Search and Couchbase databases
  • In-depth skills in developing and maintaining ETL/ELT data pipelines.
  • Experience in data modelling techniques such as Kimball star schema, 3NF, vault modelling etc.
  • Experience in workflow management tools such as Airflow, Oozie and CI/CD tools
  • Data streaming solution in Kafka or Confluent Kafka
  • Hands on experience in Google Big Query, Google Analytics & Clickstream Data Model
  • Reporting knowledge in Power BI, Tableau, Qlik etc.
  • Sound in Data Management Fundamentals and Data Architect, Modelling, Governance

    Management Skills:

    People management responsibilities encompass the tasks and activities involved in leading, guiding, and developing a team of individuals to achieve organizational goals effectively.
  • Setting clear performance expectations, conducting regular performance reviews, providing feedback, and offering guidance on areas of improvement.
  • Follow predefined processes and workflows to carry out specific tasks and activities accurately and in a timely manner.  Identify opportunities for process improvement and efficiency enhancement and provide feedback or suggestions to optimize workflows.  Analyze the needs, expectations, and concerns of each stakeholder. Assess their level of influence, interest, and potential power to affect the project's success.
  • Developing a comprehensive project plan that outlines the project scope, objectives, deliverables, timelines, resource requirements, and budget.

Additional Skills Desired:

  • Bachelors/Master's degree in computer science or equivalent
  • Excellent verbal and written communication skills and good stake holder management skills
  • Strong Analytical thinking and ability to handle stakeholders.
  • Confident in decision making and the ability to explain processes or choices as needed.
  • Ability to multitask on multiple projects in various phases.
  • Agile and waterfall Project Methodology Knowledge
  • Program Management & Deliverable


  • Head Of Engineering

    2 weeks ago

    Karachi, Sindh, Pakistan Aion Digital Full time 1,200,000 - 3,600,000 per year

    Company DescriptionAion's mission is to help traditional banks transition to digital platforms with confidence, aiming to delight 10 million customers for client banks in the Middle East and Africa. We offer a digital banking platform for on-the-go banking services and help clients monetize their data for personalized customer engagement. Aion's primary...

  • Head of Engineering

    2 weeks ago

    Karachi, Sindh, Pakistan Quantum Talent Group Full time 1,500,000 - 2,000,000 per year

    Our partner is seeking a dynamic Head of Engineering to join one of the region's most forward-looking banks and drive large-scale digital transformation. This is a unique opportunity to lead engineering teams building cutting-edge financial solutions in a highly regulated, fast-paced environment.Key ResponsibilitiesLead and scale large engineering teams (60+...

  • Head of Engineering

    2 weeks ago

    Karachi, Sindh, Pakistan Aion Digital Full time 600,000 - 1,200,000 per year

    Job Title: Head of Engineering/ Team LeadJob Category:Engineering /Solution Architecture  Location: Onsite, Karachi, Pakistan Employment Type: Full-Time Experience: 10+ years Salary Range: PKR - depending on experienceAbout the Role:The Head of Product Engineering will lead the design, development, and delivery of innovative financial technology products,...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan VerraCloud Full time 1,200,000 - 3,600,000 per year

    IntroductionVerraCloud is seeking a Data Engineerwith proven experience in modern data engineering to join our fully remote team. This is aproject-based contract rolewith competitive pay. As a Data Engineer, you will design, optimize, and maintain high-quality data pipelines and ensure reliable, scalable data infrastructure that supports business-critical...

  • Senior Staff Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Love for Data Full time 2,000,000 - 2,500,000 per year

    Love For Data is looking for a highly experienced and technically hands-on 'Senior Staff Engineer', based in Karachi, to lead its Python back-end team. This role demands strong expertise in scalable Python application development, particularly using the Django framework, along with the ability to architect solutions, enforce best practices, and provide...

  • Manager / Head - BPO ( Data Entry )

    2 weeks ago

    Karachi, Sindh, Pakistan Crossroad Consultants Full time 1,000,000 - 1,200,000 per year

    Crossroad is looking for a " Data Entry Manager / Head " to set up businessPrimary Responsibilities:Review and manage the processing of different invoicesHire & Manage Team of people who can provide services to different clientsEnsure Initially Business development also needs to be done by the candidateEnsure data is accurately and efficiently entered into...

  • Head of IT Infrastructure

    2 weeks ago

    Karachi, Sindh, Pakistan STAR HR Services Group Full time 900,000 - 1,020,000 per year

    Hiring: Head of IT Infrastructure[Candidates only from Banking Sector will be preferred]Location: KarachiIndustry: Digital Islamic BankingExperience Required: 10–12 years in a senior leadership role within IT Infrastructure in the Banking sector only.Our client, a forward-thinking and fully digital Islamic Bank, is seeking an accomplished and visionary...

  • Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time 900,000 - 1,200,000 per year

    Client company introduction: The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to clients based in the UK.Job Description:TheData Engineerwill play a pivotal role in shaping the company's data capabilities, working on projects for UK-based clients. Joining a new and dynamic team, this role...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Virtuosoft Full time 600,000 - 1,200,000 per year

    Company DescriptionVirtuosoft is an IT Consultancy firm with a mission to establish global peace and harmony through the use of technology. We have a unique client ownership approach and strive to deliver services with excellence (#Ihsaan). Our top priority is a human, whether it is a client or a colleague. Virtuosoft is committed to creating an ecosystem...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan mod Full time 1,200,000 - 3,600,000 per year

    About the RoleWe are looking for a highly skilled Data Engineer with strong expertise in DBT, SQL, Python, and APIs to join our growing data team. The ideal candidate will play a key role in designing, building, and optimizing our data pipelines, ensuring data quality and availability for analytics and reporting.This role requires not only strong technical...