Big Data Engineer

4 weeks ago

Islamabad, Islamabad, Pakistan Evamp & Saanga Full time

As a Big Data Engineer specializing in Java development, you will play a crucial role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data. You will collaborate with cross-functional teams, including business analysts, customers, data scientists, data analysts, and software engineers, to deliver scalable and high-performance data processing pipelines.

Required Skills and Responsibilities:

  • Designing and developing Java-based applications and frameworks for big data processing, storage, and analytics.
  • Building and maintaining large-scale data processing pipelines using distributed computing frameworks like Apache Hadoop or Apache Spark.
  • Implementing data ingestion processes to acquire, process, and store structured and unstructured data from various sources.
  • Collaborating with data scientists and data analysts to understand their requirements and translate them into scalable and efficient data processing workflows.
  • Optimizing and tuning the performance of big data applications by implementing parallel processing, distributed caching, and other optimization techniques.
  • Developing and maintaining data models, schemas, and data dictionaries for efficient data storage and retrieval.
  • Ensuring data quality, data integrity, and data security throughout the data processing lifecycle.
  • Monitoring and troubleshooting data processing pipelines, identifying and resolving issues to ensure reliable and efficient operation.
  • Keeping up to date with the latest advancements in big data technologies and evaluating their applicability to enhance existing systems or introduce new capabilities.
  • Collaborating with the DevOps team to deploy, configure, and manage big data infrastructure and tools in a cloud or on-premises environment.

Qualification and Experiences:

  • Strong proficiency in Java programming language and its ecosystem, including frameworks like Spring or Java EE.
  • Experience with big data technologies and frameworks such as Apache Hadoop, Apache Spark or similar distributed computing frameworks.
  • Familiarity with data processing and storage technologies like Apache Kafka, Apache Hive, Apache HBase, or NoSQL databases.
  • Solid understanding of distributed computing principles and concepts, including parallel processing, fault tolerance, and scalability.
  • Knowledge of data modeling techniques and experience with designing and optimizing data schemas for efficient data storage and retrieval.
  • Proficiency in SQL and experience working with relational databases like MySQL, PostgreSQL, or Oracle.
  • Strong problem-solving skills and the ability to analyze complex data-related issues and provide effective solutions.
  • Familiarity with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) and visualization tools like Tableau/Power BI is a plus.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in big data engineering or a similar role.
#J-18808-Ljbffr

  • Big Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the JobThis is a challenging opportunity to join our team as a Big Data Engineer where you will be responsible for designing and implementing scalable data solutions using big data technologies. The successful candidate will utilize expertise in cloud technologies, particularly AWS and Snowflake, to ensure robust data security and integrity.Key...

  • Big Data Engineering Specialist

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking a seasoned Senior Big Data Engineer with expertise in designing and developing cutting-edge Big Data technologies. The ideal candidate will have experience of over 4 to 6+ years specifically in data engineering.This role offers the chance to join a global, multi-cultural team of data engineers and be part of the growth and development of it....

  • Big Data Expert

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. As a Big Data Engineer, you will play a crucial role in designing, developing, and implementing large-scale data processing systems.Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing...

  • Senior Big Data Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Lead Big Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the PositionWe are seeking a Lead Big Data Engineer to join our team. The successful candidate will be responsible for architecting, designing, and developing large-scale data systems using big data technologies such as Apache Spark and Azure Databricks.The ideal candidate will have strong experience with cloud-based large-scale data applications and...

  • Cloud and Big Data Professional

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking an experienced Senior Big Data Engineer to join our team. The successful candidate will have a strong background in data engineering and big data technologies, with experience in designing and developing big data technologies to build critical systems from scratch. You will also develop and manage complex ETL jobs and pipelines using...

  • Big Data Technology Specialist

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are looking for a Senior Big Data Engineer to join our team. As a key member of our global data engineering team, you will have the opportunity to work on exciting projects, participate in the growth and development of our team, and collaborate with our exceptional technology professionals.Key Responsibilities:Design and develop big data technologies to...

  • Data Engineer for Big Data Architecture

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team and play a key role in designing and maintaining our big data architecture. As a hands-on data engineer, you will be responsible for building and managing our Medallion Architecture (Raw → Curated → Semantic) on MINIO-based Delta Lake.Key Responsibilities:Develop and manage data...

  • Big Data Systems Designer

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    A seasoned Data Architect and Engineer is needed to design and implement data architectures for a fast-paced environment. The ideal candidate will have over 4 to 6+ years of experience working with Big Data technologies and cloud platforms.The role requires expertise in creating and driving large-scale ETL pipelines in AWS-based environments and experience...

  • Big Data Integration Specialist

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining high-performance, large-scale complex data architectures using Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based...