
Lead Data Engineer
1 day ago
Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic) and more than 450 employees, Fusemachines seeks to bring its global expertise in AI to transform companies around the world.
Location
Remote (Full-time)
Role Overview
This is a remote full-time position, responsible for designing, building, testing, optimizing and maintaining the infrastructure and code required for data integration, storage, processing, pipelines and analytics (BI, visualization and Advanced Analytics) from ingestion to consumption, implementing data flow controls, and ensuring high data quality and accessibility for analytics and business intelligence purposes. This role requires a strong foundation in programming, and a keen understanding of how to integrate and manage data effectively across various storage systems and technologies.
We\'re looking for someone who can quickly ramp up, contribute right away and lead the work in Data & Analytics, helping from backlog definition, to architecture decisions, and lead technical the rest of the team with minimal oversight.
Responsibilities
- Design, implement, deploy, test and maintain highly scalable and efficient data architectures, defining and maintaining standards and best practices for data management independently with minimal guidance
- Ensuring the scalability, reliability, quality and performance of data systems
- Mentoring and guiding junior/mid-level data engineers
- Collaborating with Product, Engineering, Data Scientists and Analysts to understand data requirements and develop data solutions, including reusable components
- Evaluating and implementing new technologies and tools to improve data integration, data processing and analysis
- Design architecture, observability and testing strategies, and building reliable infrastructure and data pipelines
- Takes ownership of storage layer, data management tasks, including schema design, indexing, and performance tuning
- Swiftly address and resolve complex data engineering issues, incidents and resolve bottlenecks in SQL queries and database operations
- Conduct Discovery on existing Data Infrastructure and Proposed Architecture
- Evaluate and implement cutting-edge technologies and methodologies and continue learning and expanding skills in data engineering and cloud platforms, to improve and modernize existing data systems
- Evaluate, design, and implement data governance solutions: cataloging, lineage, quality and data governance frameworks that are suitable for a modern analytics solution, considering industry-standard best practices and patterns.
- Define and document data engineering architectures, processes and data flows
- Assess best practices and design schemas that match business needs for delivering a modern analytics solution (descriptive, diagnostic, predictive, prescriptive)
- Be an active member of our Agile team, participating in all ceremonies and continuous improvement activities
Qualifications
- Must have a full-time Bachelor's degree in Computer Science Information Systems, Engineering, or a related field
- 5+ years of real-world data engineering development experience in AWS and GCP (certifications preferred). Strong expertise in Python, SQL, PySpark and AWS in an Agile environment, with a proven track record of building and optimizing data pipelines, architectures, and datasets, and proven experience in data storage, modeling, management, lake, warehousing, processing/transformation, integration, cleansing, validation and analytics
- Senior person who can understand requirements and design end to end solutions with minimal oversight
- Strong programming Skills in one or more languages such as Python, Scala, and proficient in writing efficient and optimized code for data integration, storage, processing and manipulation
- Strong knowledge SDLC tools and technologies, including project management software (Jira or similar), source code management (GitHub or similar), CI/CD system (GitHub actions, AWS CodeBuild or similar) and binary repository manager (AWS CodeArtifact or similar)
- Good understanding of Data Modeling and Database Design Principles. Being able to design and implement efficient database schemas that meet the requirements of the data architecture to support data solutions
- Strong SQL skills and experience working with complex data sets, Enterprise Data Warehouse and writing advanced SQL queries. Proficient with Relational Databases (RDS, MySQL, Postgres, or similar) and NonSQL Databases (Cassandra, MongoDB, Neo4j, etc.)
- Skilled in Data Integration from different sources such as APIs, databases, flat files, event streaming.
- Strong experience in implementing data pipelines and efficient ELT/ETL processes, batch and real-time, in AWS and using open source solutions, being able to develop custom integration solutions as needed, including Data Integration from different sources such as APIs (PoS integrations is a plus), ERP (Oracle and Allegra are a plus), databases, flat files, Apache Parquet, event streaming, including cleansing, transformation and validation of the data
- Strong experience with scalable and distributed Data Technologies such as Spark/PySpark, DBT and Kafka, to be able to handle large volumes of data
- Experience with stream-processing systems: Storm, Spark-Streaming, etc. is a plus
- Strong experience in designing and implementing Data Warehousing solutions in AWS with Redshift. Demonstrated experience in designing and implementing efficient ELT/ETL processes that extract data from source systems, transform it (DBT), and load it into the data warehouse
- Strong experience in Orchestration using Apache Airflow
- Expert in Cloud Computing in AWS, including deep knowledge of a variety of AWS services like Lambda, Kinesis, S3, Lake Formation, EC2, EMR, ECS/ECR, IAM, CloudWatch, etc
- Good understanding of Data Quality and Governance, including implementation of data quality checks and monitoring processes to ensure that data is accurate, complete, and consistent
- Good understanding of BI solutions including Looker and LookML (Looker Modeling Language)
- Strong knowledge and hands-on experience of DevOps principles, tools and technologies (GitHub and AWS DevOps) including continuous integration, continuous delivery (CI/CD), infrastructure as code (IaC – Terraform), configuration management, automated testing, performance tuning and cost management and optimization
- Good Problem-Solving skills: being able to troubleshoot data processing pipelines and identify performance bottlenecks and other issues
- Possesses strong leadership skills with a willingness to lead, create Ideas, and be assertive
- Strong project management and organizational skills
- Excellent communication skills to collaborate with cross-functional teams, including business users, data architects, DevOps/DataOps/MLOps engineers, data analyst, data scientists, developers, and operations teams. Essential to convey complex technical concepts and insights to non-technical stakeholders effectively
Equal Opportunity Employer
Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
#J-18808-Ljbffr-
Lead Data Engineer
12 hours ago
Islamabad, Islamabad, Pakistan North Eastern Services Full timeAbout FusemachinesFusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 employees)....
-
Lead Data Engineer
1 day ago
Islamabad, Islamabad, Pakistan S&P Global Full timeAbout the Role:Grade Level (for internal use):11The Role: Lead Data EngineerThe Location: Islamabad, PakistanThe Team: Our team is responsible for the design, architecture, and development of our Content applications using a variety of tools that are regularly updated as new technologies emerge. You will have the opportunity every day to work with people...
-
Lead Data Architect
19 hours ago
Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time 900,000 - 1,200,000Job OpportunityWe are seeking a highly skilled professional to fill the position of Lead Data Engineer. This is an exciting opportunity for individuals who are passionate about working with data and have a strong background in software development.About the Role:The ideal candidate will have a deep understanding of data engineering principles, including data...
-
Data Engineer
5 days ago
Islamabad, Islamabad, Pakistan Edge Full timeAt EdgeWe're on a mission to eliminate geographic borders as barriers to full-time employment and fair wages. We're creating a global HR platform ecosystem that seamlessly connects exceptional talent worldwide with North American businesses. By making global hiring easier than local hiring, we provide businesses access to a broader talent pool and accelerate...
-
Lead Data Architect
2 hours ago
Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 900,000 - 1,200,000Job Title:Senior Data EngineerOur company is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in data engineering, strong technical skills, and excellent problem-solving abilities.Job Description:This is a remote position.Job Timings: Monday to Friday US Central Time zoneJob Location:...
-
Senior ETL Data Engineer
5 days ago
Islamabad, Islamabad, Pakistan NorthBay - Pakistan Full time2 months ago Be among the first 25 applicantsJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working...
-
Data Engineer
1 day ago
Islamabad, Islamabad, Pakistan Teradata Group Full timeOur CompanyAt Teradata, we believe that people thrive when empowered with better information. That's why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers' customers—to make better, more confident decisions. The...
-
Data Scientist – Lead Generation
4 weeks ago
Islamabad, Islamabad, Pakistan BoostHive Full timeWhat is BoostHive?BoostHive is a business scale-up solutions provider that works with entrepreneurs, innovators, and founders to create boutique strategies for growth by unlocking potential. Providing services to 24+ Clients with over 101 Projects while growing through the Startup development phase. Our services majorly focus on but not limited to; Business...
-
Senior Data Engineer
5 days ago
Islamabad, Islamabad, Pakistan S&P Global, Inc. Full timeAbout the Role:Grade Level (for internal use):10The Team: Our Data Engineering Team is a dynamic group of professionals dedicated to building innovative and scalable data solutions. We pride ourselves on our expertise in cloud technologies, particularly AWS and Snowflake, and our commitment to data security and governance. Our team thrives on collaboration,...
-
Data Scientist/ ML Engineer
4 weeks ago
Islamabad, Islamabad, Pakistan LMK Resources Ltd. Full timeJob Summary:The Data Scientist / ML Engineer will support the development of machine learning models and data pipelines. The role focuses on data analysis, feature engineering, and scalable processing using modern data platforms.Responsibilities:Perform data analysis and build machine learning models using Python, Spark, and PySpark.Develop and maintain...