Data Engineer for Big Data Pipelines

2 days ago

Lahore, Punjab, Pakistan beBee Careers Full time

We are seeking a seasoned data engineer to expand and optimize our big data pipelines.

The successful candidate will collaborate with other engineers and developers working on different layers of the infrastructure, requiring a commitment to collaborative problem-solving, sophisticated design, and the creation of quality products.

Key Responsibilities:
  • Design, prototype, implement, and optimize data ingestion pipelines in collaboration with Big Data Solution Architects, ensuring effective data sharing across various business systems.
  • Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and on-premises technologies.
  • Ensure the design, code, and procedural aspects of solutions are production-ready, adhering to operational, security, and compliance standards.
  • Participate in day-to-day project and production delivery status meetings and provide technical support for faster issue resolution.
Requirements:
  • Bachelor's degree from an accredited institution or equivalent work experience.
  • At least 5 years of experience performing data engineering, warehousing, publishing, and visualization throughout the full data lifecycle.
  • Two years of experience as an Azure Data Engineer or in a similar role in a technology or IT consulting environment.
  • Experience with data profiling, cataloguing, and mapping to enable the design and build of technical data flows.
  • Proficiency in defining ELT/ETL architecture and process design.
  • Experience with end-to-end implementation of data warehousing analytics solutions built on MS or Azure platforms.
  • Proficient in one of the object-oriented and functional languages: Python, Java, Scala, etc.
  • Experience with creating data pipelines using ETL tools like Airflow, ADF.
  • Familiarity with distributed computing technologies like Apache Spark, Databricks.
  • Experience with stream-processing systems like Spark Streaming, Eventhub.
  • Experienced in security best practices including encryption of sensitive data, encryption at rest and encryption in flight.
  • Experience with building CI/CD pipelines & DevOps orchestration tool like Jenkins.
  • Familiarity with Data Lakehouse, Delta Lake, Apache Hudi.

  • Full Stack Developer

    2 weeks ago

    Lahore, Punjab, Pakistan Big Data Inc Full time

    Overview:Big Data Inc is a cutting-edge technology company that offers innovative solutions for big data processing and analysis. We are currently seeking an experienced Full Stack Java Developer to join our team in Lahore, Pakistan.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications...

  • Big Data Pipeline Specialist

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data Pipeline SpecialistWe are seeking a skilled Senior Data Engineer to work on designing, developing, and maintaining large-scale data pipelines. The ideal candidate will have a strong background in data engineering, as well as experience in working with big data technologies.Key ResponsibilitiesDesign and Develop Data PipelinesOptimize Data Flow and...

  • Big Data Pipeline Specialist

    2 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in designing and developing efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.The successful candidate will have hands-on experience with data engineering tools and platforms, including Snowflake, Airbyte, Airflow,...

  • Big Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Gtradecenter Full time

    InvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...

  • Big Data Engineering Manager

    1 week ago

    Lahore, Punjab, Pakistan NorthBay Solutions Full time

    NorthBay Solutions is seeking an experienced Big Data Engineering Manager to manage our big data engineering efforts. The ideal candidate will have 4 to 6+ years of experience in data engineering with a focus on big data technologies.About the Position:Main Responsibilities: Lead our data engineering efforts, design and develop large-scale ETL pipelines in...

  • Senior Big Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Big Data Engineer

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We're seeking an experienced Senior Data Engineer to drive our data strategy forward.Main Responsibilities:Lead the development and maintenance of scalable data processing systems and data pipelines.Collaborate with data scientists, analysts, and engineers to design and implement data architectures that meet business objectives.Ensure high-quality data...

  • Backend Software Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Big Data Inc Full time

    Company Overview:Big Data Inc is a cutting-edge technology company that specializes in big data processing and analysis. Our mission is to provide innovative solutions to businesses and organizations.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications using Java back-end...

  • Big Data Specialist Opportunity

    2 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data TechnologiesWe are seeking a Senior Data Engineer to join our team and leverage their expertise in big data technologies to drive business growth.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipeline development.Main Responsibilities:Data Modeling: Design and implement data models that meet business...

  • Data Engineer with Scalable Pipeline Expertise

    2 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    About the Role:We are seeking a highly motivated Data Engineer to join our team. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.In this role, you will work with experienced engineers to develop, optimize, and maintain...