Senior Big Data Engineer

2 weeks ago

Lahore, Punjab, Pakistan Avanceon Limited Full time

Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.

As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi-structured, and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.

Job Responsibilities
  • Performing analysis of large data stores and derive insights using Big Data querying.
  • Design and develop code, scripts, and data pipelines that leverage structured, semi-structured, and unstructured data.
  • Manage data ingestion pipelines and stream processing.
  • Perform computations using Azure functions.
  • Responsible for the documentation, design, and development of Hadoop applications.
  • Perform day-to-day tasks to accuracy with minimal directions while meeting deadlines.
Qualification & Skillset
  • Bachelor/master's degree in computer science.
  • At least 4-6 years of relevant working experience with Cloud Computation.
  • Hands-on experience on Azure/AWS.
  • Experience working with Apache Spark, Apache Hive, Apache HBase.
  • Hands-on experience on SQL, Scala, Node.js, JS, Java.
  • Hands-on experience with Python, Pandas, NumPy, TensorFlow.
  • Experience with ETL.
Preferred Requirement
  • Implementing Lambda Architecture with stream processing and batch processing.
  • Implement security standards and practices in the Architecture of Cloud Solution.
  • Training/Certification on Data Lake HDFS.
  • Training/Certification on Azure Data Lake Gen 2.
  • Training/Certification on Data Bricks.
  • Experience with Azure Data Explorer and Kusto query language would be a plus.
  • Experience with Azure Data Factory would be a plus.
Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Engineering and Information Technology
Industries
  • Automation Machinery Manufacturing
#J-18808-Ljbffr

  • Senior Big Data Engineer Position

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    A Senior Big Data Engineer PositionJob Description:We are seeking an experienced Senior Big Data Engineer to lead our data engineering team. The ideal candidate will have 4-5 years of experience in Big Data technologies, hands-on experience with Spark, Hadoop, Hive, Kafka, or similar technologies, and proficiency in Python, Scala, or Java.About the Job:This...

  • Big Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Aug AI Full time

    Direct message the job poster from Aug AIMarketing Strategy | Campaign Management | Marketing Automation | Google Ads, Facebook Ads, LinkedIn Ads | Analytics and Reporting | LinkedIn Lead GenerationLocation: Lahore / On-siteExperience Required: 4–5 yearsType: Full-TimeJob Summary:Note: The following description appears to be about a Big Data Engineer role,...

  • Senior Big Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...

  • Big Data Solutions Engineer

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a talented Senior Big Data Engineer to lead our team's efforts in designing and developing cutting-edge Big Data and Cloud technologies.Job DescriptionThe ideal candidate will have 4-6+ years of experience in Data Engineering, with a strong background in ETL, Big Data, and Cloud technologies. They will be responsible for designing, developing,...

  • Big Data Architect

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have solid experience in data engineering and a passion for Big Data. They should have over 4 to 6+ years of experience specifically in Data Engineering.Key Responsibilities:Design and develop cutting-edge Big Data and Cloud technologies to build critical,...

  • Big Data Solutions Engineer

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    About the JobWe are seeking an experienced Big Data Engineer to join our team in a mid-senior level position. As a key member of our engineering and information technology team, you will be responsible for implementing data-related tasks, including provisioning data storage services, ingesting, streaming and batch data, transforming data, implementing...

  • Big Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...

  • Big Data Engineering Specialist

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    BIG DATA ENGINEER ROLEWe are seeking a highly skilled Big Data Engineer to join our team. As a key member of the team, you will be responsible for developing and implementing data lake solutions, managing large sets of structured, semi-structured, and unstructured data in a modern cloud-based environment, and working closely with a diverse team of...

  • Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and...

  • Big Data Engineer

    17 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer to join our team and help us achieve our goals.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using tools like Airbyte, Airflow, and dbt, focusing on Snowflake integration.Manage and optimize data warehousing solutions with Snowflake for security, organization, and accessibility.Develop...