Principal Big Data Specialist

5 hours ago

Lahore, Punjab, Pakistan beBeeDataEngineer Full time $120,000 - $180,000
Senior Data Engineer Position

We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing and building scalable data pipelines, with hands-on experience in Kafka, AWS Redshift, Snowflake, PySpark, and Apache Airflow.

Key Responsibilities:
  • Design and develop efficient data pipelines that meet business requirements.
  • Integrate and process data from diverse sources using Apache Kafka and other ingestion tools.
  • Build ETL workflows leveraging PySpark and manage orchestration with Apache Airflow.
  • Optimize data warehousing solutions using Amazon Redshift and Snowflake.
  • Collaborate with data analysts and scientists to understand data requirements and deliver solutions.
  • Monitor and troubleshoot data pipeline issues and ensure data integrity.
  • Ensure best practices for data quality, security, and compliance are followed.
Required Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience in Data Engineering or a similar role.
  • Strong programming skills in Python, particularly with PySpark.
  • Proven experience with Apache Kafka for real-time data streaming.
  • Hands-on experience with AWS Redshift and Snowflake for data warehousing.
  • Solid understanding and practical experience with Airflow for workflow orchestration.
  • Proficient in writing complex SQL queries for data transformation and reporting.
Preferred Qualifications:
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Familiarity with containerization tools (Docker).
  • Exposure to CI/CD pipelines and DevOps practices in data engineering.

  • Principal Software Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Big Entities Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Big EntitiesCo-Founder & CTO at Big Entities | VP Engineering at icōd.ai | Leading the AI Revolution at Big Entities: Harnessing ML, Deep Learning, and…Principal Fullstack Software Engineer (.NET Core & Angular)Location:Onsite - LahoreExperience:6 – 8+...

  • Big Data Innovator

    2 days ago

    Lahore, Punjab, Pakistan beBeeDataAnalyst Full time 6,000,000 - 12,000,000

    We are looking for enthusiastic and driven fresh graduates who have a strong interest and foundational understanding of Big Data concepts.This is an excellent opportunity to start your career in the rapidly growing field of Big Data, working alongside experienced professionals in a fast-paced and innovative environment.Assist in collecting, processing, and...

  • Emerging Big Data Professional

    5 hours ago

    Lahore, Punjab, Pakistan beBeeDataScience Full time 6,000,000 - 9,000,000

    Big Data Analyst Job OpportunityWe are seeking driven and enthusiastic fresh graduates with a strong foundation in Big Data concepts. As a Graduate Trainee – Big Data Analyst, you will join our dynamic Data & Analytics team where you will be trained and mentored to work on real-world big data projects, tools, and technologies.This is an excellent...

  • Graduate Trainee – Big Data Analyst

    14 hours ago

    Lahore, Punjab, Pakistan Confiz Limited Full time

    We are looking for enthusiastic and driven fresh graduates who have a strong interest and foundational understanding of Big Data concepts. As a Graduate Trainee – Big Data Analyst, you will be part of our dynamic Data & Analytics team, where you will be trained and mentored to work on real-world big data projects, tools, and technologies.This is an...

  • Senior/Principal Database Developer

    2 weeks ago

    Lahore, Punjab, Pakistan Soliton Technologies Full time

    Join to apply for the Senior/Principal Database Developer role at Soliton Technologies1 day ago Be among the first 25 applicantsJoin to apply for the Senior/Principal Database Developer role at Soliton TechnologiesGet AI-powered advice on this job and more exclusive features.Job DescriptionWe are seeking experienced and skilled Database Developers with 3-7...

  • Senior Data Infrastructure Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBeeData Full time $100,000 - $150,000

    Job Title: Data EngineerAs a Data Engineer, you will play a crucial role in designing, building and maintaining efficient data pipelines. Our team turns complex delivery processes into simple solutions.We leverage Airbyte, Airflow, dbt and Snowflake to develop robust data warehousing solutions.Collaborate with teams to set up and maintain scalable data...

  • Data Pipeline Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBeeDataEngineer Full time 15,000,000 - 25,000,000

    Simplify the delivery process for businesses.About UsOur mission is to become a go-to solution for companies offering seamless delivery experiences.Develop efficient data pipelines integrating Airbyte, Airflow, and dbt with Snowflake.Manage and optimize data warehousing solutions in Snowflake ensuring secure organized accessible data.Streamline data...

  • Senior Cloud Data Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBeeDataEngineer Full time 9,000,000 - 12,000,000

    Job Overview:We are seeking a highly skilled Senior Data Engineer to design and develop complex data pipelines and solutions using Big Data and cloud-native technologies.Responsibilities include designing and developing ETL pipelines, leveraging tools such as Ab Initio, Informatica, DBT, and Apache Spark to build scalable data workflows.Implement distributed...

  • Principal Database Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBeeDatabase Full time $120,000 - $150,000

    Join a team of expert Database Developers and be part of designing, implementing, and optimizing database solutions that support healthcare software products.Job DescriptionAs a seasoned professional in the field, you will play a critical role in:Designing and developing scalable data models and robust database architectures using SQL Server 2012+Writing and...

  • Advanced Data Architect

    5 hours ago

    Lahore, Punjab, Pakistan beBeeDataEngineer Full time 2,000,000 - 2,500,000

    Job Title: Advanced Data ArchitectLocation: Lahore, Pakistan (Hybrid)Overview:Our organization is seeking a highly skilled Data Engineer with expertise in large-scale data systems and advanced technologies. This role demands strong understanding of distributed data processing, big data engineering practices and extensive experience working with cloud...