Big Data Infrastructure Specialist

2 days ago


Lahore, Punjab, Pakistan kisaangroup Full time

About the Role

This Senior Data Engineer position involves designing, building, and optimizing scalable data pipelines using AWS.

The ideal candidate should have extensive experience in batch and real-time data ingestion, orchestration using tools like Apache Airflow or Dagster, and implementing fault-tolerant alerting and logging mechanisms.

This role is critical in ensuring the reliability and efficiency of our data infrastructure, enabling seamless data flow across our systems.

Main Tasks

  • Develop data pipelines for efficient batch and real-time data processing.
  • Collaborate with cloud-based platforms (AWS or GCP) to create efficient data infrastructure.
  • Implement and manage orchestration workflows using Apache Airflow, Dagster, or similar tools.
  • Monitor data quality, integrity, and security across all pipelines.
  • Set up logging, monitoring, and alerting mechanisms to detect and resolve issues promptly.
  • Optimize data storage solutions for high performance and scalability.
  • Collaborate with cross-functional teams to support data-driven decisions.
  • Automate data engineering processes for improved efficiency and reliability.
  • Promote best practices in data engineering among junior engineers.

  • Big Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Cloud-Based Solution SpecialistBig Data Inc is looking for a Cloud-Based Solution Specialist to join our team in Pakistan. As a key member of our team, you will be responsible for designing, developing, and deploying robust cloud-based solutions for our clients.Description:This position involves designing, testing, and implementing cutting-edge cloud-based...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Tkxel LLCTkxel is a leading software development company located in Reston, Virginia. We are dedicated to developing innovative software solutions for top enterprises in the world, helping them grow their businesses using cutting-edge technology solutions.Job DescriptionThe role requires a deep understanding of cloud-based big data ecosystems (AWS &...


  • Lahore, Punjab, Pakistan Cinnova Technologies, LLC Full time

    We are seeking an experienced Data Infrastructure Specialist to join our team at Cinnova Technologies, LLC. The ideal candidate will have expertise in designing and implementing scalable data infrastructure solutions.About the Position:Design and implement scalable data infrastructure solutions using GCP services.Leverage DevOps practices to streamline data...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions LLC.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop Big Data solutions using...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Tkxel LLCTkxel LLC is a leading software development company located in Reston, Virginia. Our team is committed to delivering innovative software solutions for top enterprises in the world, helping them grow their businesses using cutting-edge technology solutions.Job SummaryWe are seeking an experienced Enterprise Data Architect to lead the design,...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Job ResponsibilitiesOur ideal candidate will have a strong background in big data engineering, with hands-on experience in designing and developing scalable big data solutions. They will be responsible for:Designing and developing data pipelines using Hadoop, Spark, and NoSQL databasesManaging large datasets and performing data analyticsProviding insights...


  • Lahore, Punjab, Pakistan BIG IMMERSIVE Full time

    Job DescriptionWe are looking for a skilled and experienced DevOps Engineer to join our team. If you thrive in cloud environments, automation, and CI/CD pipelines, this is your chance to optimize infrastructure, streamline deployments, and enhance system reliability.The ideal candidate will have expertise in Docker & Kubernetes for container orchestration,...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    We are looking for a senior Big Data Technology Lead to drive our data engineering efforts forward.The successful candidate will have extensive experience with big data technologies and a strong understanding of data lake architecture. Key responsibilities include implementing lambda architecture with stream processing and batch processing, as well as...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    Job SummaryWe are looking for a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions LLC.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop Big Data solutions using...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...

  • Big Data Engineer

    7 days ago


    Lahore, Punjab, Pakistan Vodworks Full time

    We are seeking a highly skilled Big Data Engineer to join our analytics team at Vodworks. In this role, you will be responsible for designing and implementing data solutions that meet business needs.Key Responsibilities:Data Analysis and InsightsAnalyze complex data to provide actionable insights and identify trends for informed decision-making.Database and...

  • Big Data Expert

    4 days ago


    Lahore, Punjab, Pakistan Gtradecenter Full time

    At Gtradecenter, we're looking for a highly skilled Big Data Expert to join our development team.About UsWe're a growing company in the IT industry, with over 10 years of experience in software development. Our mission is to automate daily work processes for our clients using innovative business solutions.We take pride in our diverse team, consisting of...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    We are looking for a seasoned Senior Big Data Solutions Architect to lead our team's data engineering efforts.The successful candidate will have extensive experience with big data technologies and a strong understanding of data lake architecture. Key responsibilities include implementing lambda architecture with stream processing and batch processing, as...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Enterprise Java ExpertBig Data Inc seeks a highly skilled Enterprise Java Expert to lead our team's efforts in designing, developing, and delivering effective enterprise solutions.Description:This role requires expertise in designing, testing, and implementing cutting-edge open source software, technologies, and methodologies.Responsibilities include leading...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Full Stack Java DeveloperWe are seeking a seasoned Full Stack Java Developer to join our Big Data Inc team in Pakistan. As a key member of our team, you will be responsible for designing, developing, and deploying robust full stack solutions for our clients.Description:This position involves designing, testing, and implementing cutting-edge open source...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and...


  • Lahore, Punjab, Pakistan BIG IMMERSIVE Full time

    Role SummaryWe're seeking a highly skilled DevOps Engineer to join our team. The successful candidate will have expertise in cloud computing, automation, and CI/CD pipelines.The ideal candidate will be responsible for designing, implementing, and managing CI/CD pipelines, automating infrastructure provisioning and configuration, and optimizing cloud...


  • Lahore, Punjab, Pakistan Confiz Full time

    Our Technology StackWe utilize a range of big data tools and technologies, including Azure, Apache NiFi, and Power BI. Our team is well-versed in data lake architecture, data model design, and implementation, as well as enterprise application and data integration design and implementation.What We OfferA dynamic and innovative work environment.Opportunities...