Senior Data Architect

1 day ago

Lahore, Punjab, Pakistan beBee Careers Full time

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. This role is responsible for designing, building, and maintaining large-scale data pipelines, architecting cloud-based data solutions, and managing complex data environments using cloud technologies.

The ideal candidate will have a strong background in data engineering, with experience in building and optimizing ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena. They will also have expertise in architecting and managing data warehouses using cloud technologies, integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.

Some of the key responsibilities of this role include:

  • Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena.
  • Data Warehousing: Architect and manage data warehouses using cloud technologies, while integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into business insights.
  • Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB) databases, ensuring data is efficiently stored, retrieved, and queried.
  • Real-Time Data Processing: Implement and maintain real-time streaming data solutions using AWS Kinesis or Kafka for low-latency data processing.
  • Cloud Monitoring & Automation: Use AWS CLI and CloudWatch to monitor, automate, and optimize data pipelines and ensure efficient use of cloud resources.
  • Data Governance & Security: Ensure adherence to best practices for data security, governance, and compliance, including data encryption and access controls.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to align data infrastructure with business objectives.
  • Documentation: Maintain detailed documentation of data models, data pipeline processes, and system architectures.

To be successful in this role, you will need to have:

  • 5+ years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL as well as NoSQL databases such as MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.
  • Strong proficiency with PySpark for distributed data processing and transformation.
  • Experience with AWS CloudWatch for monitoring and optimizing data workflows.
  • Data warehouse architecture experience, including optimizing query performance in large-scale environments.
  • Strong understanding of data governance, security, and compliance best practices.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to have:

  • Familiarity with real-time data streaming solutions such as Apache Kafka or AWS Kinesis.

  • Data Architect

    6 days ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe seek an experienced Data Architect to lead the design, development, and maintenance of our...

  • Senior Cloud Data Engineer

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Senior Data EngineerA senior data engineer with expertise in building large-scale data pipelines and architecting cloud-based data solutions is sought after by a leading software development company. The ideal candidate will have experience designing, developing, and deploying data solutions that power business insights.Key Responsibilities:Data Pipeline...

  • Data Architect Role

    24 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Data Architect RoleWe are seeking an experienced Data Architect to lead the design, development, and maintenance of our enterprise data platform.This role requires a deep understanding of cloud-based big data ecosystems (AWS & Azure), real-time data processing, and enterprise data governance.The ideal candidate will have a strong track record in big data...

  • Data Architect

    3 weeks ago

    Lahore, Punjab, Pakistan Systems Limited Full time

    Job Summary:We are seeking a highly experienced Azure Data Architect with a strong telecom industry background to design, implement, and optimize cloud-based data solutions. The ideal candidate will have expertise in Azure Data Services, ETL pipelines, big data processing, and data governance, specifically tailored for telecom datasets such as CDRs, network...

  • Big Data Architect

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Title: Big Data ArchitectWe are seeking a highly skilled Senior Data Engineer to design and optimize scalable data pipelines, ensuring data quality and managing modern data infrastructure. This opportunity is perfect for someone who is passionate about data engineering and innovation.Key Responsibilities:Design, develop and maintain robust ETL pipelines...

  • Data Architect

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced AWS Data Architect to design and implement a scalable data lake solution on Amazon Web Services (AWS) for managing data from SAP ERP systems to support financial planning and analysis processes in Anaplan.Key Responsibilities:Data Architecture Design: Develop a robust data architecture to efficiently store, manage, and process...

  • Senior Data Architect

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Title: Senior Big Data EngineerOverviewThis role involves designing, implementing, and maintaining large-scale data systems, including data storage services provisioning, ingestion, streaming, and batch data processing. The successful candidate will have hands-on experience with cloud-based technologies such as Azure/AWS and proficiency in programming...

  • Senior Data Architect

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering, with a strong passion for Big Data and data engineering principles. They will be responsible for designing and developing cutting-edge Big Data technologies to build critical, highly...

  • Cloud Data Architect

    2 weeks ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    About the Role:We are looking for an experienced Cloud Data Architect to design and implement scalable data warehouse solutions across the organization. The ideal candidate will have hands-on experience with cloud platforms such as AWS, Azure, or GCP, and a strong understanding of dimensional modeling techniques.Responsibilities:Design and implement data...

  • Big Data Solutions Architect

    24 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data Solutions ArchitectWe are seeking an experienced Big Data Solutions Architect to design, develop, and maintain our enterprise data platform.You will collaborate with Data Engineers, BI Engineers, and Data Business Analysts across various platform layers, ensuring a scalable, secure, and high-performance data infrastructure.Responsibilities:Develop...