Managing Consultant Data Engineering

1 week ago

Karachi, Sindh, Pakistan Systems Limited Full time 1,200,000 - 3,600,000 per year

Job Role: Data Ops Support Engineer

Job Responsibilities:

  • Implement and manage continuous integration and deployment pipelines for various applications and services.
  • Proactively monitor data pipelines, system performance and troubleshoot any issues to maintain high availability and reliability of the infrastructure.
  • Collaborate with development and business teams to design and implement scalable and resilient solutions.
  • Automate routine tasks and processes to streamline operations and improve efficiency.
  • Conduct in-depth reviews of code and debug issues in data pipelines across multiple applications in production environments, with the ability to perform detailed code analysis and troubleshoot complex issues effectively.
  • Implement security best practices and ensure compliance with relevant regulations.
  • Participate in on-call rotation and respond to incidents promptly to minimize downtime.
  • Document processes and procedures to maintain an up-to-date knowledge base.
  • Stay updated with emerging technologies and industry trends to drive innovation and continuous improvement.

Job Requirements:

  • Minimum one year development experience on big data tools with at least 2 years' experience in DevOps role or managed services operations role.
  • Knowledge and understanding of big data tools and AWS cloud services like MWAA, S3, Athena and Lambda is must.
  • Experience with Apache NiFi is must.
  • Proficiency in scripting languages like Python, Bash, or PowerShell is preferable.
  • Familiarity of containerization technologies like Docker and orchestration tools like Kubernetes.
  • Familiarity with monitoring and logging tools such as Yarn, CloudWatch etc.
  • Experience with version control systems like Git/Bitbucket.
  • Excellent communication and collaboration skills.
  • Ability to work independently and prioritize tasks effectively in a fast-paced environment.
  • Flexibility to operate across various time zones and schedules, including weekend shifts, is required.

  • Managing Consultant Data Engineering

    2 weeks ago

    Karachi, Sindh, Pakistan Systems Limited Full time 900,000 - 1,200,000 per year

    Job Summary:We are looking to hire an experienced data engineer with expertise in SQL and SSIS background and having familiarity with Azure environment.Job Requirements:Expertise in SQL, SQL Server, SSIS background.Strong Azure data engineering experience – ADF, Data Fabric, Databricks, PySpark.Experience with Power BI is a plus.Understand complex SQL...

  • Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time 900,000 - 1,200,000 per year

    Client company introduction: The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to clients based in the UK.Job Description:TheData Engineerwill play a pivotal role in shaping the company's data capabilities, working on projects for UK-based clients. Joining a new and dynamic team, this role...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Virtuosoft Full time 600,000 - 1,200,000 per year

    Company DescriptionVirtuosoft is an IT Consultancy firm with a mission to establish global peace and harmony through the use of technology. We have a unique client ownership approach and strive to deliver services with excellence (#Ihsaan). Our top priority is a human, whether it is a client or a colleague. Virtuosoft is committed to creating an ecosystem...

  • Civil Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Hire The Consultant Full time $25,000 - $30,000 per year

    One of our clients is looking for an experienced Civil Engine to join their team for a prestigious Hydroelectric Dam Construction and management project in Burundi (East Africa).Benefits:Salary: USD 2,500 – 3,000 / monthExecutive Accommodation providedCompany TransportAnnual Air Tickets for VacationHealth Insurance coverage.Your Role:Lead and oversee...

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time 900,000 - 1,200,000 per year

    Data Engineer - Karachi, PakistanClient company introduction:The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to UK-based clients.Job Description:The Data Engineer will play a pivotal role in shaping company's data capabilities, working on projects for UK-based clients. Joining a new and...

  • Process Engineer

    4 days ago

    Karachi, Sindh, Pakistan Petrochem Engineering Services (PES) Full time 900,000 - 1,200,000 per year

    Company DescriptionPetrochem Engineering Services (PES) is an ISO certified company established in 1998, providing specialized engineering consulting and design services worldwide for the Oil and Gas industries. Our mission is to deliver comprehensive engineering, procurement assistance, and construction management services with a strong commitment to...

  • Principal Data and Analytics Engineer

    6 hours ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time 900,000 - 1,200,000 per year

    We're hiring aPrincipal Data & Analytics Engineer - (Karachi Onsite)About the company:Hiring for a UK-based leading data consultancy.About the role:We are looking for a Principal Data & Analytics Engineer to join our team. This is our most senior technical role, responsible for designing and delivering scalable, high-quality data and reporting solutions...

  • consultant/engineer

    1 week ago

    Karachi, Sindh, Pakistan HRSG Full time 900,000 - 1,200,000 per year

    We need a qualified resource (consultant/engineer) with expertise in following areas:Civil building design and complete plot development (including access, safety, and security considerations).Preparation of architectural, structural, MEP, drainage, sewerage, and water supply drawings, along with data center design.Experience in obtaining Rated-3 Design...

  • Data Validator

    1 week ago

    Karachi, Sindh, Pakistan Love for Data Full time 600,000 - 1,200,000 per year

    About the RoleWe are looking for a detail-oriented Data Validator with strong expertise in Microsoft Excel to ensure accuracy, consistency, and quality of data. The role requires keen attention to detail, strong analytical skills, and the ability to work with large datasets.Key ResponsibilitiesValidate and verify data for accuracy, completeness, and...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan VerraCloud Full time 1,200,000 - 3,600,000 per year

    IntroductionVerraCloud is seeking a Data Engineerwith proven experience in modern data engineering to join our fully remote team. This is aproject-based contract rolewith competitive pay. As a Data Engineer, you will design, optimize, and maintain high-quality data pipelines and ensure reliable, scalable data infrastructure that supports business-critical...