Data Architect

We are looking for an experienced Data Architect with 12+ years of progressive experience in data engineering, architecture design, and technical leadership. You will lead the architectural strategy and execution for our real-time and batch data platforms, ensuring scalability, reliability, and performance across a modern cloud-native ecosystem. This role is suited for a visionary technologist who can drive enterprise-grade solutions, establish best practices, and mentor high-performing engineering teams.

• Define and evolve the data architecture roadmap, ensuring alignment with business goals and scalability of data platforms.
• Architect real-time streaming and batch data pipelines using Kafka, Apache Flink, and Spark Structured Streaming.
• Lead the design of lakehouse architectures leveraging technologies such as Apache Spark (PySpark), Delta Lake, Iceberg, and Parquet.
• Establish governance, security, and compliance frameworks across data platforms and pipelines.
• Set standards for data orchestration using tools like Apache Airflow and Azure Data Factory.
• Guide the containerization strategy with Docker, Kubernetes, and Helm for scalable deployment of data applications.
• Architect and optimize analytics engines such as Trino or Presto for high-performance query execution.
• Define and implement observability frameworks to monitor SLAs, lineage, data quality, and pipeline health.
• Collaborate with DevOps on infrastructure-as-code (IaC) using Terraform and CI/CD automation through Azure DevOps.
• Establish and advocate best practices for coding standards, modular development, and testing in Python and SQL.
• Collaborate cross-functionally with product owners, data scientists, platform teams, and engineering leads.
• Lead architecture reviews, POCs, and technology evaluations to guide technology adoption and innovation.
• Mentor and guide senior and mid-level data engineers across solutioning, technical decisions, and design patterns.

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related discipline.
• 12+ years of experience in data engineering and architecture, with at least 3+ years in a lead/architect role.
• Must have the ability to take things to completion overcoming challenges like unavailability of stakeholders or information.
• Expert-level knowledge in Python, SQL, and scalable distributed systems.
• Deep expertise in streaming architectures with Kafka, Flink, and Spark Streaming.
• Strong experience designing and implementing batch data workflows using Apache Spark (PySpark).
• In-depth knowledge of cloud data platforms, particularly Azure (preferred).
• Extensive experience with data orchestration tools like Airflow and Azure Data Factory.
• Proven ability to design and implement data lakehouse architectures with formats like Parquet, Delta Lake, and Iceberg.
• Proficiency in containerization (Docker), orchestration (Kubernetes), and deployment via Helm.
• Solid experience implementing observability, lineage, and data quality frameworks, such as Great Expectations.
• Strong background in infrastructure as code (Terraform) and CI/CD integrations.
• Deep understanding of data governance, metadata management, and data privacy standards.
• Excellent communication skills with the ability to influence stakeholders and present architectural strategies to leadership.
• Experience working in agile development environments and fostering team-wide engineering excellence.
• Experience with large-scale API architecture and scalable data access layers is a plus.
• Familiarity with AI/ML-integrated data systems or tools (e.g., text-to-SQL) is a bonus.

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015, 27001:2013 & 20000-1:2018 certified. We have a vibrant culture of learning via collaboration and making the workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.