Databricks Engineer and Architect

7 hours ago


Lahore, Punjab, Pakistan Techscale Full time
Databricks Engineer and Architect
We are seeking a highly skilled Databricks Engineer and Architect to join our team at Techscale. As a Databricks Engineer and Architect, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.

Responsibilities
  1. Design and implement data ingestion and transformation pipelines from various data sources.
  2. Optimize data storage and retrieval processes for performance and cost-efficiency.
  3. Write and optimize Spark jobs using PySpark or Scala.
  4. Manage Databricks clusters, including performance tuning and cost optimization.
  5. Collaborate with data scientists and analysts to prepare data for analysis and machine learning models.
  6. Develop monitoring solutions for data quality, pipeline performance, and system reliability.
  7. Implement data governance, security, and compliance best practices.
  8. Automate deployment and scaling of data infrastructure using CI/CD pipelines.

Requirements

  1. Strong Python programming skills and hands-on experience with Databricks.
  2. Proficiency in Apache Spark/PySpark, SQL databases, and data lake/warehouse concepts.
  3. Experience with RESTful APIs, performance tuning, CI/CD workflows, and cloud platforms.
  4. Bonus points for Scala, MLflow, Airflow/Prefect, Kafka, and containerization.

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and optimize our client data...


  • Lahore, Punjab, Pakistan Confiz Full time

    We are seeking a highly skilled data engineer to join our team at Confiz. As an Azure Data Engineer, you will play a key role in expanding and optimizing our big data pipelines.Key Responsibilities:Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines.Build ETL/ELT Ingestion pipelines and...

  • Python Data Engineer

    8 hours ago


    Lahore, Punjab, Pakistan Techscale Full time

    About The RoleWe are seeking a skilled Python Data Engineer (Databricks Specialist) to join our dynamic team. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.Key ResponsibilitiesDevelop, maintain, and optimize ETL/ELT data pipelines using Python and...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...

  • Data Architect

    1 week ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Direct message the job poster from Systems LimitedManager HR - Talent Acquisition | MBA in HRJob Summary:We are seeking a highly experienced Azure Data Architect with a strong telecom industry background to design, implement, and optimize cloud-based data solutions. The ideal candidate will have expertise in Azure Data Services, ETL pipelines, big data...


  • Lahore, Punjab, Pakistan Techscale Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Techscale. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.Key ResponsibilitiesDevelop, maintain, and optimize ETL/ELT data pipelines using Python and Databricks.Implement data ingestion and...


  • Lahore, Punjab, Pakistan Internetwork Expert Full time

    Systems Engineering RoleThe System Architect and Engineer at Internetwork Expert will design, implement, and maintain complex systems and infrastructure. This role requires strong technical knowledge, leadership skills, and the ability to collaborate with cross-functional teams.Responsibilities Include:Designing and implementing system architectures.Leading...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Avanceon Middle East & South Asia is seeking a skilled Azure Data Engineer to join their Lahore office. This role involves collaborating with a team to design, develop, and implement user-friendly software from start to finish in a fast-paced environment.Must-Have Qualifications:Hands-on Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and...


  • Lahore, Punjab, Pakistan Burq Full time

    About BurqBurq is a fast-growing technology company that aims to simplify the delivery process for businesses. We have built a large network of delivery partners and made it easy for companies to integrate our services into their operations.Job OverviewWe are looking for an experienced Data Engineering Specialist to join our team. As a key member of our data...

  • Architect

    5 days ago


    Lahore, Punjab, Pakistan Aqeel Design and Construction Full time

    Get AI-powered advice on this job and more exclusive features.Aqeel Design and Construction (ADC) is a Lahore-based firm. As the name suggests, our company provides complete turnkey solutions for all types of buildings, whether it's a residence, a restaurant, a corporate hub, or a commercial high-rise. We are dedicated to quality, exceptional service, and...


  • Lahore, Punjab, Pakistan Asfet Pvt Ltd Full time

    We are hiring Software Architect/EngineerJob Description:Strong technical skills in a variety of well-known solution development technologies including but not limited to: .Net, Java, Python, React Native, DBMS, Cross Platform Development.Proven skills in designing API, Front end components, and core frameworks.Solid experience with Object-Oriented...


  • Lahore, Punjab, Pakistan Techscale Full time

    Data Engineer OpportunityWe are looking for a talented Data Engineer to join our team at Techscale. As a Data Engineer, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.ResponsibilitiesDesign and implement data ingestion and transformation pipelines from various data sources.Optimize data storage and...


  • Lahore, Punjab, Pakistan Logica IT Solutions Full time

    We're seeking an IT Solutions Architect to join our team and lead the design, development, and delivery of high-quality software solutions. As an IT Solutions Architect, you'll be responsible for leading a team of software engineers, designing and developing software modules, communicating design specifications, owning development responsibility, leading and...

  • Azure Data Engineer

    7 days ago


    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Azure Data EngineerAVANCEON is hiring an Azure Data Engineer for their Lahore office. You will work with a team to develop user-friendly software from start to finish in a fast-moving and collaborative environment.Must-Have Checklist:Practical Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and DatabricksSkills in:Python, SQL, Scala, or...


  • Lahore, Punjab, Pakistan Abacus Full time

    Telephony Network ArchitectWe are seeking a highly skilled telephony network architect to join our team at Abacus. As a telephony network architect, you will be responsible for designing, implementing, and maintaining VoIP systems that meet the needs of our clients.Key ResponsibilitiesNetwork Design: Design and implement VoIP networks that meet the needs of...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...

  • Data Architect

    7 days ago


    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe seek an experienced Data Architect to lead the design, development, and maintenance of our...

  • AI/ML Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Burq Full time

    About BurqBurq started with an ambitious mission: how can we turn the complex process of offering delivery into a simple turnkey solution.We started with building the largest network of delivery networks, partnering with some of the biggest delivery companies. We then made it extremely easy for businesses to plug into our network and start offering delivery...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    In this role as an Azure Data Engineer at Avanceon Middle East & South Asia, you will have the opportunity to work with a team to develop end-to-end software solutions using Azure technologies. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Functions, and Data Lake Gen2.About the Job:This is a full-time position based in...