Big Data Engineer and Architect

7 days ago


Lahore, Punjab, Pakistan Data Pilot Full time
Empowering Businesses with Real-Time Insights through Advanced Data Architectures

Data Pilot is committed to helping organizations unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen. As an Associate Data Architect, you will play a crucial role in designing and implementing scalable, efficient data architectures that support advanced data engineering and analytics projects.

Our dynamic team works closely with clients to understand their unique business challenges and develop tailored solutions that meet their specific needs. With a strong focus on collaboration and innovation, we strive to deliver exceptional results that drive business growth and success.

Key Responsibilities:

  • Develop end-to-end data architectures for various data engineering and analytics projects, incorporating principles of medallion and lakehouse models to support real-time and batch analytics.
  • Use ETL tools, Python scripting, and SQL to construct scalable data pipelines that extract data from disparate sources, transform it to meet business needs, and load it into a centralized data warehouse, ensuring data quality and accessibility.
  • Leverage cloud computing platforms (AWS, GCP, Azure) to build secure, efficient, and scalable data infrastructures that support complex data analysis and reporting.
  • Apply in-depth knowledge of data warehouse concepts to design and optimize data storage solutions that support advanced data analytics and reporting.
  • Collaborate with the data science team to facilitate the development and deployment of machine learning models, providing technical expertise to guide project approaches and outcomes.

Qualifications:

  • Minimum Bachelor's degree in computer science or a related field.
  • 4-5 years of experience in data engineering, analytics, and data science, with a significant focus on data architecture and pipeline development.
  • 2-3 years of hands-on experience with at least two major cloud platforms (AWS, GCP, Azure) and a solution architect certification in one of these platforms.
  • Deep understanding of data warehouse concepts and experience in designing data warehousing solutions.
  • Proficiency in ETL tools, Python scripting, and SQL.
  • Knowledge of Spark and Databricks is highly desirable.
  • Experience in building and deploying machine learning models is highly desirable.
  • Strong analytical and problem-solving skills and the ability to work collaboratively with cross-functional teams.


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    NorthBay Solutions LLC is hiring a skilled Cloud Architect for Big Data Solutions. As a Senior Big Data Engineer, you will be responsible for designing and developing cloud-based Big Data solutions using AWS services such as EMR, Glue, Lambda, and Athena.About the Role:Design and develop cloud-based Big Data solutions using AWS services.Develop and manage...

  • Big Data Engineer

    5 hours ago


    Lahore, Punjab, Pakistan Gtradecenter Full time

    InvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...

  • Big Data Architect

    2 days ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Job Title: Senior Data SpecialistDevsinc is seeking a highly skilled Senior Data Specialist to design, implement, and maintain efficient data pipelines. This position requires expertise in data modeling, ETL frameworks, big data tools, and programming languages.Key ResponsibilitiesData Pipeline Development: Design and implement scalable and secure data...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are seeking an experienced Big Data Engineering Expert to join our team at NorthBay Solutions LLC. As a Senior Big Data Engineer, you will have the opportunity to design and develop cutting-edge Big Data technologies, build critical distributed systems from scratch, and lead complex ETL jobs and pipelines.About the Role:Design and develop using Big Data...

  • Data Architect

    3 weeks ago


    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe seek an experienced Data Architect to lead the design, development, and maintenance of our...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel LLC is committed to developing innovative software solutions for leading enterprises worldwide. As a forward-thinking organization, we seek a seasoned data architect to drive the success of our enterprise data platform.Key Responsibilities:Leverage your expertise in big data and cloud solutions on AWS and Azure to design and implement scalable, secure,...

  • Big Data Engineer

    3 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...

  • Big Data Specialist

    2 days ago


    Lahore, Punjab, Pakistan Crypthon Technologies Full time

    We're looking for a detail-oriented IT Infrastructure Developer to join our team. As a key member, you will be responsible for designing and implementing scalable data solutions.Key Responsibilities:You'll work closely with cross-functional teams to define data requirements and implement efficient pipelines.Bulk up your skillset by working with cutting-edge...


  • Lahore, Punjab, Pakistan Confiz Full time

    Big Data Engineer RoleAs a data engineer at Confiz, you will play a crucial role in designing and implementing big data pipelines that enable seamless data sharing across our systems.Key Responsibilities:Collaborate with solution architects to ensure data pipeline effectiveness.Develop ETL/ELT ingestion pipelines using cloud and on-premises...

  • Data Architect

    2 days ago


    Lahore, Punjab, Pakistan Crypthon Technologies Full time

    We're looking for a talented Data Architect to join our Crypthon Technologies team. As a key member, you will be responsible for designing and building scalable data solutions that drive business growth.Key Responsibilities:Bulk up your skillset by working with cutting-edge big data tools and cloud platforms.Collaborate with cross-functional teams to define...

  • Data Architect Lead

    1 week ago


    Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot is a cutting-edge data product development and consulting services company that empowers businesses to unlock the full potential of their data assets. As an Associate Data Architect, you will play a pivotal role in designing and implementing scalable, efficient data architectures that support advanced data engineering and analytics projects.Key...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    About the JobWe are looking for a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions. The ideal candidate will have extensive experience working with big data technologies and a passion for innovation.In this role, you will be responsible for designing and developing complex big data solutions using a variety of technologies,...

  • Big Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Burq Full time

    We value diversity and are an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.The Ideal Candidate Will HaveExperience working with data engineering tools and platformsStrong programming skills in Python and...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot: Unlocking Business Value through Scalable Data ArchitecturesAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel LLC is a leading software development company based in Reston, Virginia.Job Description:We are seeking an experienced Data Architect to lead the design, development, and maintenance of our enterprise Data Platform. The ideal candidate will collaborate with data engineers, business intelligence engineers, and data business analysts across various...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...

  • Data Architect

    3 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Direct message the job poster from Systems LimitedManager HR - Talent Acquisition | MBA in HRJob Summary:We are seeking a highly experienced Azure Data Architect with a strong telecom industry background to design, implement, and optimize cloud-based data solutions. The ideal candidate will have expertise in Azure Data Services, ETL pipelines, big data...