Big Data Pipeline Developer

1 day ago


Lahore, Punjab, Pakistan beBee Careers Full time

Azure Data Engineers lead the design, implementation, and optimization of data ingestion pipelines.

Main Responsibilities:
  • Designing and implementing data ingestion pipelines.
  • Developing analytics solutions using cloud and on-premises technologies.
  • Maintaining operational, security, and compliance standards.
  • Providing technical support for issue resolution during daily project delivery status meetings.
Qualifications:
  • Bachelor's degree or equivalent work experience.
  • 5+ years of experience performing data engineering, warehousing, publishing, and visualization.
  • 2+ years of experience as an Azure Data Engineer or in a similar role.
  • Proficiency in data profiling, cataloguing, and mapping.
  • Ability to define ELT/ETL architecture and process design.
  • End-to-end implementation of data warehousing analytics solutions.
  • Working experience with Azure.
  • Creating data pipelines using ETL tools like Airflow, ADF.
  • Distributing computing technologies like Apache Spark, Databricks.
  • Stream-processing systems like Spark Streaming, Eventhub.
  • Proficient in object-oriented and functional programming languages.
  • Writing effective unit and integration tests for ingestion pipelines.
  • Static analysis and code quality tools.
  • Code version control repositories like Git.
  • Security best practices including encryption of sensitive data.
  • Building CI/CD pipelines & DevOps orchestration tool like Jenkins.
  • Familiarity with Data Lakehouse, Delta Lake, Apache Hudi.

  • Full Stack Developer

    2 weeks ago


    Lahore, Punjab, Pakistan Big Data Inc Full time

    Overview:Big Data Inc is a cutting-edge technology company that offers innovative solutions for big data processing and analysis. We are currently seeking an experienced Full Stack Java Developer to join our team in Lahore, Pakistan.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data Pipeline SpecialistWe are seeking a skilled Senior Data Engineer to work on designing, developing, and maintaining large-scale data pipelines. The ideal candidate will have a strong background in data engineering, as well as experience in working with big data technologies.Key ResponsibilitiesDesign and Develop Data PipelinesOptimize Data Flow and...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in designing and developing efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.The successful candidate will have hands-on experience with data engineering tools and platforms, including Snowflake, Airbyte, Airflow,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a seasoned data engineer to expand and optimize our big data pipelines.The successful candidate will collaborate with other engineers and developers working on different layers of the infrastructure, requiring a commitment to collaborative problem-solving, sophisticated design, and the creation of quality products.Key Responsibilities:Design,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data TechnologiesWe are seeking a Senior Data Engineer to join our team and leverage their expertise in big data technologies to drive business growth.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipeline development.Main Responsibilities:Data Modeling: Design and implement data models that meet business...

  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Gtradecenter Full time

    InvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    NorthBay Solutions is seeking an experienced Big Data Engineering Manager to manage our big data engineering efforts. The ideal candidate will have 4 to 6+ years of experience in data engineering with a focus on big data technologies.About the Position:Main Responsibilities: Lead our data engineering efforts, design and develop large-scale ETL pipelines in...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Company Overview:Big Data Inc is a cutting-edge technology company that specializes in big data processing and analysis. Our mission is to provide innovative solutions to businesses and organizations.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications using Java back-end...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Engineering Opportunity:We are looking for a skilled Big Data Engineer to design, develop, and maintain scalable data solutions. The ideal candidate will have strong coding skills and experience in managing the end-to-end development lifecycle from development to deployment.Key Responsibilities:Design and develop robust data pipelines and...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...