Senior Data Architect

16 hours ago

Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 15,000,000 - 18,000,000
Job Overview

We're seeking a highly skilled Data Engineer to join our team.

This is a remote contract position responsible for designing, building, and maintaining the infrastructure required for data integration, storage, processing, and analytics.

Key Responsibilities:
  1. Architect, design, develop, test and maintain high-performance, large-scale, complex data architectures, which support data integration (batch and real-time, ETL and ELT patterns from heterogeneous data systems: APIs and platforms), storage (data lakes, warehouses, data lake houses, etc), processing, orchestration and infrastructure. Ensuring the scalability, reliability, and performance of data systems, focusing on Databricks and Azure.
  2. Contribute to detailed design, architectural discussions, and customer requirements sessions.
  3. Actively participate in the design, development, and testing of big data products.
  4. Construct and fine-tune Apache Spark jobs and clusters within the Databricks platform.
  5. Migrate out of Azure Synapse to Azure Data Lake or other technologies.
  6. Assess best practices and design schemas that match business needs for delivering a modern analytics solution (descriptive, diagnostic, predictive, prescriptive).
  7. Design and implement data models and schemas that support efficient data processing and analytics.
  8. Design and develop clear, maintainable code with automated testing using Pytest, unittest, integration tests, performance tests, regression tests, etc.
  9. Collaborating with cross-functional teams and Product, Engineering, Data Scientists and Analysts to understand data requirements and develop data solutions, including reusable components meeting product deliverables.
  10. Evaluating and implementing new technologies and tools to improve data integration, data processing, storage and analysis.
  11. Evaluate, design, implement and maintain data governance solutions: cataloging, lineage, data quality and data governance frameworks that are suitable for a modern analytics solution, considering industry-standard best practices and patterns.
  12. Continuously monitor and fine-tune workloads and clusters to achieve optimal performance.
  13. Provide guidance and mentorship to junior team members, sharing knowledge and best practices.
  14. Maintain clear and comprehensive documentation of the solutions, configurations, and best practices implemented.
  15. Promote and enforce best practices in data engineering, data governance, and data quality.
  16. Ensure data quality and accuracy.
  17. Design, Implement and maintain data security and privacy measures.
Requirements

The ideal candidate will have:

  • Experience with Databricks and Azure.
  • Strong knowledge of data architecture, data engineering, and data governance.
  • Excellent problem-solving skills.
  • Ability to work independently as well as collaboratively.
Benefits

Our company offers a competitive salary and benefits package.

  • Data Platform Architect

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 900,000 - 1,200,000

    Senior Data Platform ArchitectWe are seeking a highly skilled Senior Data Platform Architect to design, develop, and manage scalable data pipelines, storage, and transformation solutions. The role involves working on cloud-based data platforms, data warehouse / lakehouse design, workflow automation, and data integration to support business intelligence and...

  • Senior Data Architect

    17 hours ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 15,000,000 - 25,000,000

    Job Title: Senior Data Engineer Azure DatabricksAbout the Role:We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing, building, and maintaining large-scale data architectures on Azure Databricks.As a Senior Data Engineer, you...

  • Senior Data Architect

    5 days ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 1,200,000 - 2,500,000

    Job OverviewWe are seeking a highly skilled Data Engineer to spearhead our data platform. This individual will play a pivotal role in analyzing complex new data sources and transforming them into actionable business insights.Main ResponsibilitiesReview and analyze structured, semi-structured and unstructured data sources for quality, completeness and...

  • Advanced Data Architect

    16 hours ago

    Hyderabad City Taluka, Pakistan beBeeData Full time $100,000 - $120,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to lead our team's data engineering efforts.This role is crucial in designing, developing, and optimizing complex data architectures that support our business objectives.You will be responsible for implementing scalable ETL pipelines and advanced reporting solutions, leveraging...

  • Data Architect

    1 week ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    OverviewData Architect, ETL, Data Engineer, Python, SQLGSPANN is hiring a Data Architect for their data platform. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.Location: Gurugram / Hyderabad / PuneRole Type: Full TimePublished On: 26 September 2024Experience: 8+ YearsRole and...

  • Senior Network Security Architect

    16 hours ago

    Hyderabad City Taluka, Pakistan beBeeNetwork Full time 1,000,000 - 2,000,000

    Job Title: Senior Network Security ArchitectWe are seeking a highly skilled Senior Network Security Architect to join our team.The successful candidate will have extensive experience in designing and implementing secure network solutions, as well as the ability to support junior staff in their projects and work independently on various tasks.

  • Senior Cloud Data Architect

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $90,000 - $120,000

    Key Role: Data EngineerAbout the JobWe're seeking an experienced data engineer to design and implement cutting-edge data solutions. You will be responsible for architecting complex data systems, developing end-to-end cloud-native pipelines, and guiding the team on best practices.Job ResponsibilitiesDesign and build scalable data architectures to meet diverse...

  • Chief Enterprise Data Architect

    16 hours ago

    Hyderabad City Taluka, Pakistan beBeeData Full time $180,000 - $250,000

    Job OverviewThis is a senior position in enterprise data architecture, focusing on the design, development, and maintenance of large-scale Data Platforms. We seek an experienced professional to lead cross-functional teams across various platform layers, ensuring a scalable, secure, and high-performance infrastructure.Key ResponsibilitiesDevelop and implement...

  • Enterprise Data Architect and Modeller

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 900,000 - 1,200,000

    Job Title: Data Architect and ModellerLead the build out of a modern enterprise-wide lake house with scalable, reliable and business intuitive data architecture for supporting self-service capabilities across Data & Analytics solutions.This role will be an individual contributor and partnering closely with cross-functional teams in building enterprise data...

  • Senior Data Architect

    15 hours ago

    Hyderabad City Taluka, Pakistan beBeeData Full time $1,500,000 - $2,000,000

    About the Role">This is a senior-level position responsible for designing, implementing, and maintaining highly scalable data architectures. The ideal candidate will have expertise in cloud-based technologies, data engineering, and analytics.">Key Responsibilities:Design, implement, and maintain highly scalable data architectures.Collaborate with...