Data Engineer

1 day ago

Islamabad, Islamabad, Pakistan ieng Group Full time

The Company's Equal Opportunities policy applies equally to the recruitment process and must be complied with at every stage of the recruitment process. This means that prospective applicants should not be discriminated against either directly or indirectly on the grounds of race, nationality, ethnic origin, gender, marital status, sexual orientation, cultural or religious beliefs, disability and age. In addition, candidates should not be discriminated against based on pregnancy. Preparation of job descriptions, person specifications, advertisements, short-listing, interviewing and selection of applicants should reflect a commitment to achieving and maintaining equal opportunities within the workplace. Interviewers should only ask job-related questions.

Role and Responsibilities:
  1. Programming and Scripting: Utilize programming languages such as Python, R, and Java to develop scripts for data processing tasks.
  2. Database Management: Work with various database systems including SQL and NoSQL databases for storing and managing data effectively.
  3. Container Management: Experience with container management frameworks like Docker, Kubernetes, and ECR to deploy and manage data processing applications efficiently.
  4. Data Processing Technologies: Proficiency in scalable and distributed data processing technologies/frameworks such as Spark/PySpark, DBT, Kafka, and Hadoop to handle large volumes of data effectively.
  5. SQL Skills: Strong SQL skills across a variety of relational data warehousing technologies, especially in cloud data warehousing platforms such as Amazon Redshift, Google BigQuery, and Snowflake.
  6. Software Development Lifecycle (SDLC): Understanding of SDLC, particularly Agile methodologies, to ensure efficient project delivery.
  7. Big Data Principles: Thorough understanding of big data principles, techniques, and best practices.
  8. Data Pipeline Architecture: Design and develop scalable, reliable, and efficient data pipelines for collecting, ingesting, and processing diverse data from multiple sources.
  9. Data Modeling and Warehousing: Create and optimize data models to enable seamless integration of data from various sources into centralized data warehouses or data lakes.
  10. Data Governance and Security: Establish data governance frameworks and implement robust data security measures to ensure compliance with privacy regulations and protect sensitive information.
  11. Performance Optimization: Continuously monitor and fine-tune data platform performance to meet SLAs and optimize resource utilization.
  12. Technology Evaluation: Stay updated with industry trends, emerging technologies, and best practices in data engineering. Assess and recommend new tools and frameworks to improve data processing capabilities.
  13. Cross-Functional Collaboration: Collaborate with data analysts, data scientists, and software engineers to understand their data requirements, offer data engineering support, and contribute to the development of data-driven products and solutions.
  14. Data Quality and Monitoring: Implement robust data quality checks and monitoring systems to ensure the accuracy, consistency, and reliability of data.
  15. Automation and Fault Tolerance: Possess an "automation-first" mindset when building solutions, incorporating self-healing and fault-tolerant methods to minimize manual intervention and downtime.
  16. Documentation and Knowledge Sharing: Create and maintain comprehensive documentation of data engineering processes, best practices, and technical standards. Facilitate knowledge sharing sessions with the broader team.
Qualifications Requirements:
  • 3 years of experience in data engineering or a related field.
  • Strong proficiency in programming languages such as Python, R, and Java.
  • Experience with database management systems, including SQL and NoSQL databases.
  • Familiarity with container management frameworks like Docker, Kubernetes, and ECR.
  • Experience with scalable and distributed data processing technologies/frameworks such as Spark/PySpark, DBT, Kafka, and Hadoop.
  • Solid understanding of big data principles, techniques, and best practices.
  • Experience with cloud data technology stacks such as Azure, AWS, or GCP is preferred.
  • Excellent communication and collaboration skills.
  • Ability to work effectively in a fast-paced, dynamic environment.
Education Requirements:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Advanced degree preferred.
Seniority level
  • Entry level
Employment type
  • Full-time
Job function
  • Engineering, Analyst, and Other
Industries
  • Telecommunications, Construction, and Services for Renewable Energy
#J-18808-Ljbffr

  • Data Engineers

    3 weeks ago

    Islamabad, Islamabad, Pakistan Nisum Full time

    What You Will DoDevelop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team.Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility,...

  • Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About us: VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property.VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside...

  • Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan DigyCorp Full time

    Contract Period: One Year (Extendable)Experience: 5+ years of experienceSeniority level: Mid/SeniorWe Have:Mission-led project that will revolutionize our ability to restore coral reefs affected by global warming.Team of Developers, Architects, ML Engineers, Bank-End Engineers and Front-End Developers interacting with back-end service architecture deployed...

  • Cloud Data Engineer

    24 hours ago

    Islamabad, Islamabad, Pakistan ieng Group Full time

    About the Role:We are seeking an experienced Cloud Data Engineer to join our team at the ieng Group. This individual will be responsible for designing, building, and maintaining scalable cloud-based data processing systems.Main Responsibilities:Design and Development: Design and develop scalable, reliable, and efficient data pipelines for collecting,...

  • Senior Data Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan LeanDNA Inc Full time

    We are seeking an experienced Senior Data Integration Engineer to join our team at LeanDNA Inc. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines that integrate customer data with our cloud-based Supply Chain Analytics solution.About the RoleIn this role, you will...

  • Big Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    Key QualificationsTo succeed as a Senior Data Engineer at VisionX Technologies, Inc., you should possess:A minimum of a bachelor's degree in Computer Science, Information Technology, or a related field.A deep passion for data and proven ability to create high-quality data products.At least 8+ years of experience in implementing Big Data, Data Lakehouse, and...

  • Data Engineering Specialist

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Key ResponsibilitiesIn this role, you will be responsible for designing and implementing data warehousing solutions in Azure Synapse. You will analyze and migrate existing data systems to the Azure Cloud, optimize data flow and collection to improve data accuracy and utility, and contribute to data architecture design and modeling initiatives. Additionally,...

  • Cloud Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Nisum Full time

    Required Skills And QualificationsStrong proficiency in ETL tools and processes, particularly Azure Data FactoryExpertise in SQL for complex queries and stored proceduresExperience with Azure Synapse Analytics and Azure Data Lake StorageProficiency in Python for data manipulation and analysisUnderstanding of machine learning concepts and their application in...

  • Senior Data Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are NorthBay Solutions, a leading provider of data-driven solutions. Our team is seeking a highly skilled Senior Data Engineer to join our ranks.About the Role:We are looking for an individual with expertise in AWS Glue, Lambda, Step Functions, and other AWS data services to monitor, troubleshoot, and optimize our data pipelines.You will be responsible...

  • Data Engineering Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    Job OverviewWe seek an experienced Senior Data Engineer to join our growing Data & Analytics team, focusing on developing high-quality Data Lakehouse products and solutions. The ideal candidate will combine data engineering and software development skills with business understanding and analytical capabilities.Understand business requirements and apply...

  • Data Engineering Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan Nisum Full time

    Job SummaryWe are seeking an experienced Cloud Data Engineer to join our team at Nisum. The ideal candidate will have a strong background in data engineering, cloud computing, and Azure technologies.

  • Principal Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of accomplishment of delivering scalable and efficient data solutions to meet complex business...

  • Data Engineer, Marketing

    2 weeks ago

    Islamabad, Islamabad, Pakistan S&P Global, Inc. Full time

    About the Role:Grade Level (for internal use): 09The Role: Data Engineer IIThe Team: Our Data Engineering Team is a dynamic group of professionals dedicated to building innovative and scalable data solutions. We pride ourselves on our expertise in cloud technologies, particularly AWS and Snowflake, and our commitment to data security and governance. Our team...

  • Data Engineering Lead

    6 days ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time

    About this Opportunity:We are looking for an experienced Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing a scalable Big Data Platform.This role involves working closely with cross-functional teams to deliver high-performance data solutions. The successful candidate will have...

  • Mid Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About us:VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property. VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside...

  • Senior Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are looking for a Data Engineer with 2-4 years of experience to design, build, and maintain data pipelines that enable efficient data processing and analytics. The ideal candidate will have expertise in SQL, data modeling, and Oracle Data Integrator (ODI) and will work closely with data analysts, BI developers, and business teams to ensure reliable and...

  • Data Insights Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    At Confiz, we are committed to delivering high-quality business intelligence solutions that meet the evolving needs of our organization. As a Data Insights Engineer, you will play a critical role in designing and developing innovative data analytics solutions that drive business growth and improvement.Main ResponsibilitiesDesign and develop data analytics...

  • Data Engineer, Marketing

    2 weeks ago

    Islamabad, Islamabad, Pakistan S&P Global Full time

    S&P Global Data Engineer, Marketing & Data Technology in Islamabad, PakistanAbout the Role:Grade Level (for internal use): 09The Role: Data Engineer IIThe Team: Our Data Engineering Team is a dynamic group of professionals dedicated to building innovative and scalable data solutions. We pride ourselves on our expertise in cloud technologies, particularly AWS...

  • Data Engineer with Big Data Expertise

    13 hours ago

    Islamabad, Islamabad, Pakistan FuseMachines Full time

    About FusemachinesFusemachines is a leading provider of AI strategy, talent, and education services. With a global presence and a team of experts, we seek to democratize AI and bring our expertise to companies worldwide.About the RoleThis contract position involves designing, building, and maintaining data infrastructure for integration, storage, processing,...

  • Senior Data Engineer Lead

    1 week ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are looking for a talented Senior Data Engineer to lead the design, development, and maintenance of our enterprise data integration solutions.About the Role:Design, develop, and implement data pipelines that support business analytics and reporting.Collaborate with cross-functional teams to ensure data quality, integrity, and consistency.Optimize SQL...