Senior Data Engineer

2 weeks ago


Karachi, Sindh, Pakistan traxccel Full time

We are looking for a highly experienced and motivated Azure Data Engineer to join our team. The successful candidate will have a minimum of 5 years of hands-on experience in Azure and Databricks architecture, migration, and development. This role requires excellent communication skills and the ability to own and self-manage work. The candidate must be able to overlap with US CST work hours for up to 6 hours daily.

Key Responsibilities:

  • Design, develop, and implement advanced analytics solutions using Azure and Databricks.
  • Perform data migration and transformation tasks on Databricks.
  • Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
  • Work closely with data engineers, data scientists, and business stakeholders to understand their requirements and provide expert guidance.
  • Optimize and tune the performance of Databricks and Azure-based solutions.
  • Manage and monitor the Databricks environment to ensure reliability and performance.
  • Lead the architecture and development of complex data integration projects.
  • Conduct code reviews, provide feedback, and ensure best practices are followed.
  • Own and self-manage assigned tasks, ensuring timely delivery with high quality.
  • Collaborate with cross-functional teams and stakeholders in a remote work environment.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • 5+ years of experience with Azure and Databricks architecture, migration, and development.
  • Strong experience in building and optimizing data pipelines, architectures, and data sets.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with big data tools and technologies (Spark, Hadoop, etc.).
  • Solid understanding of SQL and relational databases.
  • Experience with cloud infrastructure management and monitoring tools.
  • Excellent problem-solving skills and the ability to troubleshoot complex issues.
  • Strong communication skills and the ability to work effectively in a remote team.
  • Ability to work in the US CST time zone with up to 6 hours of overlap.

Preferred Skills:

  • Familiarity with other cloud platforms and tools.
  • Certification in Azure and/or Databricks is a plus.

Technical Skills:

  • Databricks
  • SQL and NoSQL databases
  • Data modeling and data warehousing
  • ETL processes and tools
  • Python and/or Scala
  • Power BI or other data visualization tools

Contact Information:

For any inquiries, please contact our HR department

Email: hr@traxccel.com

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

#J-18808-Ljbffr

  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...


  • Karachi, Sindh, Pakistan Office Field Full time

    About the RoleThis role involves working on high-impact projects that require the design, development, and maintenance of large-scale data systems. As a senior software engineer in our data engineering team, you will be responsible for:Designing and implementing data pipelines and architectures using Python and other relevant programming languages.Developing...

  • Senior Data Architect

    2 weeks ago


    Karachi, Sindh, Pakistan Addo AI Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Addo AIAVP Data Engineering at ADDO | Seasoned Solutions Architect | Director Data Engineering | Trusted Advisor | Technical Pre-Sales Advisor | Open Source…Company DescriptionAddo AI is an artificial intelligence advisory and incubator based in Singapore, with...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Job DescriptionWe are seeking a Senior Data Engineer with 7 years of experience to join our dynamic team, collaborating with cross-functional teams to gather requirements and architect data solutions that improve performance and efficiency.

  • Data Engineer

    2 days ago


    Karachi, Sindh, Pakistan Office Field Full time

    Direct message the job poster from Office FieldHuman Resources Executive at Office Field | HR Policies Implementation, Tech RecruitingOffice Field is looking for a Data Engineer to join our growing team of analytics experts. They will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and...


  • Karachi, Sindh, Pakistan Lumida Wealth Full time

    Get AI-powered advice on this job and more exclusive features.We are looking for a skilled Senior Data Scientist and leader to join our rapidly growing startup, Lumida Wealth, based in New York City.About the Role:This role focuses on asset classes including equities, digital assets, and macro. You will work closely with our CIO and engineering team to build...

  • Data Engineer

    1 week ago


    Karachi, Sindh, Pakistan Horizon Technologies Full time

    We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS Glue while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills,...

  • Data Engineer

    2 weeks ago


    Karachi, Sindh, Pakistan Pakistan Single Window (PSW) Full time

    Job ResponsibilitiesDevelop and implement data pipelines that extract, load, and transform data from various sources: This includes using ELT tools and technologies to clean, transform, and integrate data from different systems using Oracle Data Integrator.Design and develop data models that store data in a way that is efficient and scalable: This includes...


  • Karachi, Sindh, Pakistan Pakistan Single Window (PSW) Full time

    About the JobPakistan Single Window (PSW) is seeking an experienced Senior Data Engineer to lead the development of large-scale AI infrastructure. The ideal candidate will have a strong background in data engineering, AI/ML, and cloud-based AI infrastructure.Key ResponsibilitiesDesign and implement scalable data infrastructure using PySpark, Pandas, SQL, and...

  • Data Engineer

    1 week ago


    Karachi, Sindh, Pakistan Arpatech (Pvt) Ltd Full time

    Job Summary:We are seeking a highly skilled Data Engineer to design, build, and maintain the infrastructure required to manage and process large volumes of data. The ideal candidate will work closely with cross-functional teams to ensure the efficient flow, security, and availability of data, enabling analytics, reporting, and AI-driven decision-making.Key...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job DescriptionAs a Senior AWS Data Processor at NorthBay Solutions, you will play a critical role in the success of our team by designing, building, and maintaining scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring and troubleshooting data pipelines, investigating job...

  • Data Science Engineer

    2 weeks ago


    Karachi, Sindh, Pakistan Habib Bank AG Zurich Full time

    Direct message the job poster from Habib Bank AG ZurichJob Purpose:The job comprises most of the Data science domain related tasks. Some of the key purposes are to build, maintain and meet the organization's Machine Learning/Deep Learning/LLM Modeling projects, Data Warehouse for business needs.Tasks and Responsibilities:Generating different insights on the...


  • Karachi, Sindh, Pakistan Office Field Full time

    Office Field is looking for a Senior Software Engineer - AI to join our engineering team.ResponsibilitiesDeveloping Semantic search algorithms on documents and data.Building Generative AI models and pipelines.Training and Fine tuning AI models.Building RAG mechanism for information extraction.Deploying scalable AI system on the cloud.RequirementsBachelor's...

  • Data Engineer

    3 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job OverviewWe are seeking a highly skilled Data Engineer - L2 Support to join NorthBay Solutions. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. The successful candidate will work with various AWS data services, including Glue, Lambda, Step Functions, Athena,...

  • Senior PHP Developer

    2 weeks ago


    Karachi, Sindh, Pakistan Data Wise Full time

    Job Description:Job Description:Data Wise is a leading company in the Information Technology and Services industry, specializing in the design and development of dynamic, responsive, and high-performance websites and web applications. We leverage the latest web technologies to craft scalable and secure solutions for our clients. We are looking for a Senior...


  • Karachi, Sindh, Pakistan Data Ikseer Full time

    Spreadsheet, VBA, Apps Script Developer and DesignerThis role focuses on using advanced tools in Excel, Google Sheets, and Power BI to create automated workflows, clean data, and deliver insightful dashboards. Success involves developing user-friendly systems that enhance productivity and support data-driven decisions, aligning with organizational...


  • Karachi, Sindh, Pakistan Aion Digital Full time

    Senior Software Engineer (Full Stack / Backend)We're Hiring: Senior Software Engineer (Full Stack / Backend)Are you an experienced Full Stack/Backend Engineer with expertise in Node.js, TypeScript, Python, and microservices? Do you thrive in cloud-native application development and enjoy working with cutting-edge tools and technologies? If so, SpireTech...


  • Karachi, Sindh, Pakistan Al Nafi International College Full time

    Job DescriptionWe are seeking an experienced Senior Big Data Specialist/Analyst to join our innovative team at Al Nafi International College. This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management.This position emphasizes leveraging AIOps processes and...