Python and Databricks Technical Lead

12 hours ago


Lahore, Punjab, Pakistan Techscale Full time
Technical Lead for Python and Databricks
We are looking for a highly skilled Technical Lead for Python and Databricks to join our team at Techscale. As a Technical Lead, you will oversee the design, development, and optimization of data pipelines and analytics workflows using Python and Databricks.

Responsibilities
  1. Oversee the design and implementation of data ingestion and transformation pipelines from various data sources.
  2. Optimize data storage and retrieval processes for performance and cost-efficiency.
  3. Lead the development and optimization of Spark jobs using PySpark or Scala.
  4. Manage Databricks clusters, including performance tuning and cost optimization.
  5. Collaborate with data scientists and analysts to prepare data for analysis and machine learning models.
  6. Develop monitoring solutions for data quality, pipeline performance, and system reliability.
  7. Implement data governance, security, and compliance best practices.
  8. Automate deployment and scaling of data infrastructure using CI/CD pipelines.

Requirements

  1. Strong Python programming skills and hands-on experience with Databricks.
  2. Proficiency in Apache Spark/PySpark, SQL databases, and data lake/warehouse concepts.
  3. Experience with RESTful APIs, performance tuning, CI/CD workflows, and cloud platforms.
  4. Bonus points for Scala, MLflow, Airflow/Prefect, Kafka, and containerization.


  • Lahore, Punjab, Pakistan Techscale Full time

    Databricks Engineer and ArchitectWe are seeking a highly skilled Databricks Engineer and Architect to join our team at Techscale. As a Databricks Engineer and Architect, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.ResponsibilitiesDesign and implement data ingestion and transformation pipelines...

  • Python Data Engineer

    13 hours ago


    Lahore, Punjab, Pakistan Techscale Full time

    About The RoleWe are seeking a skilled Python Data Engineer (Databricks Specialist) to join our dynamic team. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.Key ResponsibilitiesDevelop, maintain, and optimize ETL/ELT data pipelines using Python and...

  • Python ML Developer

    7 days ago


    Lahore, Punjab, Pakistan Devsinc LLC Full time

    Devsinc LLC is looking for a talented Senior AI/ML Engineer to join our team. The ideal candidate will have a strong background in machine learning, deep learning frameworks, and cloud environments.Key ResponsibilitiesThe successful candidate will:Design and implement AI solutions for various client applications.Develop and deploy scalable AI and machine...


  • Lahore, Punjab, Pakistan Techscale Full time

    Data Engineer OpportunityWe are looking for a talented Data Engineer to join our team at Techscale. As a Data Engineer, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.ResponsibilitiesDesign and implement data ingestion and transformation pipelines from various data sources.Optimize data storage and...


  • Lahore, Punjab, Pakistan Techleadz Full time

    Job Overview:The Senior Python Developer Position is a critical role within the Techleadz team, responsible for leading the development of multiple applications using the Python Django framework. This position requires a strong background in Python Django framework and familiarity with some ORM (Object Relational Mapper) libraries.Main Responsibilities:Lead...

  • Technical Lead

    7 days ago


    Lahore, Punjab, Pakistan Mobylogix Pvt. Ltd. Full time

    Mobylogix is actively seeking a talented and experienced Technical Lead for its Lahore office.Position:Technical LeadResponsibilities:Establish and implement training processes and strategies for all technical personnel.Assign and oversee the daily tasks of technical personnel while ensuring all subordinates are actively working toward established...

  • Lead Python Developer

    4 hours ago


    Lahore, Punjab, Pakistan Easy2Employ, LLC Full time

    The role of a Senior Python Full Stack Developer at Easy2Employ, LLC is pivotal in the development and maintenance of web applications. This position requires a deep understanding of both front-end and back-end development processes, as well as collaboration with cross-functional teams to deliver cohesive and efficient web platforms.Key...


  • Lahore, Punjab, Pakistan Assembly Full time

    About the Opportunity:We are seeking an exceptional Senior Technical Lead to join our engineering team at Assembly Industries. As a key member of our leadership team, you will be responsible for shaping the technical direction and architecture of our software systems.In this role, you will work closely with our CTO to make independent technical decisions and...


  • Lahore, Punjab, Pakistan Techscale Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Techscale. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.Key ResponsibilitiesDevelop, maintain, and optimize ETL/ELT data pipelines using Python and Databricks.Implement data ingestion and...

  • Technical Lead

    6 days ago


    Lahore, Punjab, Pakistan Educative Inc Full time

    Educative Inc is a leading platform for interactive text-based courses on computer science, cloud computing, and advanced technologies. We are seeking an experienced Technical Lead to join our team and contribute to the development of cutting-edge learning platforms.The ideal candidate will have a solid understanding of data structures and algorithms, as...

  • Bidding Expert

    5 days ago


    Lahore, Punjab, Pakistan LEAD Concept Full time

    Business Development PositionLEADconcept is hiring a skilled Business Developer/Bidding Expert to drive lead generation from the international market for its Lahore office.Candidates should possess:Technical proficiency in programming languagesEffective communication skills to address technical queriesAbility to create persuasive pitches in the global...


  • Lahore, Punjab, Pakistan Devsinc Full time

    We are seeking a highly skilled Full Stack Technical Lead to oversee the development of complex applications at Devsinc. This role requires a unique blend of technical expertise, leadership skills, and business acumen.About the PositionYou will lead a team of developers to design, build, and deploy scalable and secure applications using Python and related...


  • Lahore, Punjab, Pakistan Cogent Labs Full time

    Job OverviewWe are seeking an experienced Staff Engineer to join our Lahore office.As a key contributor to our engineering team, you will be responsible for designing and implementing full-stack web applications using Python and Django.We require a seasoned professional with a proven track record of success in software development, including at least 8 years...


  • Lahore, Punjab, Pakistan Devsinc LLC Full time

    We are looking for a skilled Senior AI/ML Engineer to develop and maintain AI and machine learning applications. Our ideal candidate will have experience in Python, machine learning frameworks, and cloud platforms.Job DescriptionThe successful candidate will:Design and implement AI solutions for various client applications.Develop and deploy scalable AI and...


  • Lahore, Punjab, Pakistan Hoboetech Full time

    We are Hoboetech, a leading technology company in the field of software development. Our goal is to provide innovative solutions that meet the needs of our clients.Job DescriptionWe are looking for a highly skilled and experienced Python Developer who can join our team as a Django Expert. As a key member of our team, you will be responsible for developing...


  • Lahore, Punjab, Pakistan DreamWorld Technologies Full time

    Freelance Python Programmer DreamWorld Technologies, Pakistan We're a UAE based company with offices in Dubai. We're looking for a Python programmer who knows how to work with the Scrapy Framework. Initially, you'll be working with us remotely (from home) on a contractual or per project basis. This is an urgent requirement.Job SpecificationResponsibilities...


  • Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    IT Project Lead for Technical Development - Join our team at NETSOL Technologies Inc. as a senior-level IT professional. In this role, you'll oversee the technical aspects of projects, ensuring successful delivery and adoption of new solutions. Your experience in full stack development and leadership skills will help drive our company forward.Key...

  • AI/ML Expert

    7 days ago


    Lahore, Punjab, Pakistan Devsinc LLC Full time

    Devsinc LLC is seeking an experienced Senior AI/ML Engineer to design and implement cutting-edge machine learning models and algorithms. The ideal candidate will have a strong background in Python, deep learning frameworks, and cloud environments.Develop scalable AI and machine learning applications using Python, TensorFlow, and PyTorch.Design innovative AI...


  • Lahore, Punjab, Pakistan Devsinc LLC Full time

    Devsinc is seeking a talented and experienced Senior Python Developer to design and develop high-quality Python applications in a collaborative environment.Responsibilities:Design, develop, and maintain high-performance Python applications.Collaborate with cross-functional teams to define and ship new features.Write clean and efficient code, and conduct code...

  • Python Developer

    3 days ago


    Lahore, Punjab, Pakistan Stone age SIA Full time

    We are looking for a Python Developer to join our team and help us develop and maintain high-quality software applications. The successful candidate will be responsible for building and maintaining software using Python and related technologies, as well as collaborating with cross-functional teams to define, design, and ship new...