Big Data Solutions Architect

1 week ago

Karachi, Sindh, Pakistan beBeeData Full time
Job Title:

Senior Data Engineer

Description:

We are seeking a skilled and experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines.

Responsibilities:

  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Qualifications:

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Experience:

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Skills:

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.

  • AWS Data Architect

    3 weeks ago

    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Position OverviewWe are seeking an experienced AWS Data Architect to design and implement an AWS Data Lake solution for managing data from our SAP ERP systems to support FP&A processes in Anaplan. This hybrid role allows the candidate to work in Pakistan (Lahore, Karachi, Islamabad) with the flexibility to work remotely and on-site as needed. Additionally,...

  • Solutions Architect

    2 weeks ago

    Karachi, Sindh, Pakistan Creative Chaos Full time

    Job SummaryAs a Solutions Architect, you will be responsible to take the business requirements and turn that into a software design that can become a blueprint for the implementation team to follow. You will also be responsible to make sure that the implementation team follows the design and delivers the project as per the agreed designs.Duties and...

  • Solutions Architect

    2 days ago

    Karachi, Sindh, Pakistan Creative Chaos Full time

    Job SummaryAs a Solutions Architect, you will be responsible for taking the business requirements and turning them into a software design that can become a blueprint for the implementation team to follow. You will also ensure that the implementation team follows the design and delivers the project as per the agreed designs.Duties and ResponsibilitiesA...

  • Senior Big Data Specialist/Analyst

    2 days ago

    Karachi, Sindh, Pakistan Al Nafi International College Full time

    Position Overview:We are seeking a highly skilled and experienced Senior Big Data Specialist/Analyst to join our innovative team. This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management. The position emphasizes leveraging AIOps processes and procedures,...

  • Data Architect

    1 week ago

    Karachi, Sindh, Pakistan 1 Sol Digital Services (SMC) Pvt Ltd. Full time

    3 days ago Be among the first 25 applicantsWe are seeking an experienced Data Architect to join our team and lead the design, implementation, and maintenance of our enterprise data architecture. The ideal candidate will have extensive experience in creating robust data models, ensuring data integrity, and implementing scalable database solutions using SQL...

  • Data Architect

    2 days ago

    Karachi, Sindh, Pakistan Remotiv Full time

    Data Architect (Snowflake & BI)At Remotiv, we're connecting people worldwide. We connect talented people with businesses.*Hiring for one of our clients -Workplace type: OnsiteData Architect (Snowflake & BI) (Pakistan) – Join Our Client TeamWe are seeking an experienced Data Architect (Snowflake & BI) to lead data modeling, transformation, and business...

  • Data Architect

    17 hours ago

    Karachi, Sindh, Pakistan 1 Sol Digital Services (SMC) Pvt Ltd. Full time

    3 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Timings: 6 PM – 3 AM PKTExperience: 8+ yearsSalary: PKR 400,000 – 700,000 (based on experience)Company: 1Sol Digital Services (SMC-Pvt) LtdPosition OverviewWe are seeking an experienced Data Architect to join our team and lead the design,...

  • AWS Data Solutions Specialist

    2 days ago

    Karachi, Sindh, Pakistan beBeeDataArchitect Full time

    Job Title: AWS Data ArchitectAbout the RoleWe are seeking a skilled AWS Data Architect to lead the design and implementation of our data lake solution. This critical role will oversee the efficient storage, management, and processing of large volumes of data from our SAP ERP systems, ultimately supporting financial planning and analysis processes in...

  • AI Solutions Architect

    1 week ago

    Karachi, Sindh, Pakistan beBeeSoftware Full time

    Software Engineer - AI Solutions ArchitectWe are looking for a skilled Software Engineer to design and implement end-to-end workflows that integrate AI models into existing platforms. This role requires collaboration with AI engineers and data scientists to transition prototypes into high-availability production systems.Key Responsibilities:Design and...

  • Data Architect

    1 week ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time

    2 days ago Be among the first 25 applicantsDirect message the job poster from HR Ways - Hiring Tech TalentTalent Acquisition Specialist | Technical Recruiter| Placement & Acquisition | Hiring Tech Talent for 300+ CompaniesAbout the job Data Architect (On-site)A Leading US-based web solutions company is hiring a Data Architect for its Karachi office.As a Data...