Data Engineer

4 weeks ago

Islamabad, Islamabad, Pakistan DigyCorp Full time

Contract Period: One Year (Extendable)

Experience: 5+ years of experience

Seniority level: Mid/Senior

We Have:

  • Mission-led project that will revolutionize our ability to restore coral reefs affected by global warming.
  • Team of Developers, Architects, ML Engineers, Bank-End Engineers and Front-End Developers interacting with back-end service architecture deployed on a Cloud Platform.
  • Innovation, team culture is at the heart of what we do.
  • An international team that promotes a multicultural working environment.
  • Offering great career growth opportunities working for international top clients within the global technology market.
  • An open mind for new ideas and methodologies and in fact the person filling the role is encouraged to come up with new data business concepts/products/features etc.
  • Adaptability. We share data knowledge and push to develop as innovation to create solutions that enable our clients goals.

You Have:

  • Develop scalable and efficient data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
  • Experience with Programming languages like Python and libraries like PySpark, Spark Streaming.
  • Experience with working data frames like Pandas and Spark Dataframes.
  • Implement data storage solutions such as Azure Data Lake, Azure SQL Database, and Cosmos DB.
  • Implement data pipelines to feed real-time and batch data to AI/ML models.
  • Support deployment and monitoring of machine learning models using Azure Machine Learning and MLOps best practices.
  • Integrate data from various on-premises and cloud sources.
  • Create and optimize Extract, Transform, Load (ETL) processes to ensure data quality and consistency.
  • Design and implement data models for both operational and analytical systems.
  • Ensure alignment with business and technical requirements.
  • Monitor and tune data pipelines and databases to optimize performance and reduce costs.
  • Implement caching strategies and partitioning to enhance data retrieval times.
  • Implement data security measures, including encryption and access controls, following best practices and organizational standards.
  • Ensure compliance with relevant regulations such as GDPR and HIPAA.
  • Work closely with data analysts, data scientists, and business stakeholders to understand data needs and deliver actionable insights.
  • Utilize third-party tools like Tableau, Power BI, or Looker for data visualization and advanced analytics.
  • Collaborate with DevOps teams to automate and manage data workflows.
  • Set up monitoring for data pipelines to proactively identify and resolve issues.
  • Perform root cause analysis for any data discrepancies or failures.
  • Design and implement scalable data models tailored for AI/ML and analytical workloads.
  • Support feature engineering and data preparation processes for machine learning models.
Seniority level

Mid-Senior level

Employment type

Contract

Job function

Information Technology

Industries

Technology, Information and Internet

#J-18808-Ljbffr

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan ieng Group Full time

    Role and Responsibilities:Programming and Scripting: Utilize programming languages such as Python, R, and Java to develop scripts for data processing tasks.Database Management: Work with various database systems including SQL and NoSQL databases for storing and managing data effectively.Container Management: Experience with container management frameworks...

  • Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan ieng Group Full time

    The Company's Equal Opportunities policy applies equally to the recruitment process and must be complied with at every stage of the recruitment process. This means that prospective applicants should not be discriminated against either directly or indirectly on the grounds of race, nationality, ethnic origin, gender, marital status, sexual orientation,...

  • Big Data Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the JobThis is a challenging opportunity to join our team as a Big Data Engineer where you will be responsible for designing and implementing scalable data solutions using big data technologies. The successful candidate will utilize expertise in cloud technologies, particularly AWS and Snowflake, to ensure robust data security and integrity.Key...

  • Data Engineering Expert

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are seeking an experienced Data Engineer to build and maintain robust data pipelines at Confiz. As a key member of our team, you will design and develop ETL/ELT data pipelines that support business analytics and reporting.Main Responsibilities:Pipeline Development: Develop high-quality data pipelines using Oracle Data Integrator (ODI) and SQL.Data...

  • Cloud Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the RoleThis is a unique opportunity to create a meaningful impact by designing and implementing our big data architecture. As a cloud data engineer, you will be responsible for developing and managing scalable data pipelines, integrating multiple systems, and supporting various applications.We are looking for a skilled professional with expertise in...

  • Data Engineer for Big Data Architecture

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team and play a key role in designing and maintaining our big data architecture. As a hands-on data engineer, you will be responsible for building and managing our Medallion Architecture (Raw → Curated → Semantic) on MINIO-based Delta Lake.Key Responsibilities:Develop and manage data...

  • Senior Software Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About this OpportunityWe are seeking an experienced Sr. Software Engineer - Data Engineering who will lead the design and implementation of scalable data solutions. The ideal candidate will have strong expertise in cloud technologies, particularly AWS and Snowflake, and excellent communication skills for effective collaboration across diverse teams.Key...

  • Data Engineering Expert

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a skilled Data Engineer to join our expanding Data & Analytics team. As a key member, you will play a pivotal role in the development of high-quality Data Lakehouse products and solutions.About the RoleDesign and build scalable data pipelines and systems.Collaborate with cross-functional teams to understand data requirements and...

  • Big Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Evamp & Saanga Full time

    As a Big Data Engineer specializing in Java development, you will play a crucial role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data. You will collaborate with cross-functional...

  • Data Engineer Lead

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job DescriptionThis is a challenging role for an experienced data engineer to lead and develop scalable data pipelines, integrate multiple systems, and support analytics, business intelligence, and machine learning applications.We are looking for a hands-on data engineer with expertise in Spark-based processing, object storage platforms, and data modeling to...