Staff/Senior Data Consultant

2 weeks ago


Islamabad, Islamabad, Pakistan 10Pearls Full time

Company Overview

10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high performance team members. Our broad expertise in product management, user experience/design, cloud architecture, software development, data insights and intelligence, cyber security, emerging tech, and quality assurance ensures that we are delivering solutions that address business needs. 10Pearls is proud to have a diverse clientele including large enterprises, SMBs and high growth startups. We work with clients across industries, including healthcare/life sciences, education, energy, communications/media, financial services, and hi-tech. Our many long-term, successful partnerships are built upon trust, integrity and successful delivery and execution.

Requirements

Ideal candidate should have a Bachelor's degree in Computer Science with 5 – 8 years of programming in Snowflake, AWS, Glue, ETL pipeline, Athena, Apache Spark, Apache Hudi (Apache Iceberg and DeltaLake are similar tech), and Python.

Responsibilities

  • Develop, construct, test and maintain optimal data pipeline architecture.
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Identify ways to improve data reliability, efficiency and quality.
  • Prepare data for predictive and prescriptive modeling.
  • Use data to discover tasks that can be automated.
  • ETL pipeline build, deployment and operations, data quality, monitoring and alerting, CI/CD, governance, access control, etc.
  • Design and implement efficient and scalable data pipelines, including data ingestion, transformation, and storage, using Snowflake and other relevant technologies.
  • Stay up-to-date with industry best practices and emerging technologies related to data architecture, data modeling, Snowflake, and AWS.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Monitor process performance and advise any necessary changes.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics that assist in building and optimizing the product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Demonstrate proficiency in data management and automation on Spark, Hadoop, and HDFS environments.
  • Knowledge in DS/ML, analytics, or data warehousing.

Required Skills

  • Good communication skills.
  • Experience with Apache Hadoop, Hive, Spark, Airflow, Apache Livy, Scala, Java.
  • Experience in AWS EMR (HDFS, S3, Hbase), AWS Athena, PySpark or related technologies.
  • Experience with streaming technologies such as Kafka.
  • Experience of working with programming languages like Scala, Java, SQL, Python, R, etc.
  • Experience in managing data in relational databases and developing ETL pipelines.
  • Exposure to enterprise level service such as Cloudera, Databricks, AWS, etc.
  • Exposure to AWS data services and technologies such as EC2, EMR, Kinesis, Lambda, DynamoDB are nice to have.
  • Relevant certifications in Snowflake, AWS, or data architecture are highly desirable.
#J-18808-Ljbffr
  • Visa Consultant

    2 weeks ago


    Islamabad, Islamabad, Pakistan Cross river consultant Full time

    Company DescriptionWe suggest you enter details here.Role DescriptionThis is a full-time on-site role for a Visa Consultant located in Islamabad. The Visa Consultant will be responsible for handling immigration issues, visa processing, communication with clients, and providing consulting services to clients.QualificationsExperience in immigration issues and...


  • Islamabad, Islamabad, Pakistan 10Pearls, LLC Full time

    Company Overview10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high-performance team members. Our broad expertise in product management, user...


  • Islamabad, Islamabad, Pakistan Academix Connect Full time

    At Academix Connect, based in Canada, we believe education knows no boundaries. We empower Pakistani students by connecting them with global study opportunities through personalized guidance and support. With over 500 partner institutions worldwide, our transparent, data-driven process simplifies the journey from academic planning to visa processing.How We...


  • Islamabad, Islamabad, Pakistan 10Pearls Full time

    Company Overview10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high performance team members. Our broad expertise in product management, user...


  • Islamabad, Islamabad, Pakistan Pakistan Revenue Automation (Pvt) Ltd. Full time

    Job Title: Expert in Predictive AnalyticsLocation: Information Technology and Services - Islamabad, PakistanPosted on: Jul 4, 2016Last Date: Aug 8, 2016Job ResponsibilitiesThis role will act as an expert in Predictive Analytics to exploit new analytic and statistical tools, producing insights into our customers and undertaking predictive and behavioral...


  • Islamabad, Islamabad, Pakistan 10Pearls Full time

    Company Overview10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high-performance team members. Our broad expertise in product management, user...


  • Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is looking for a visionary and results-driven Senior Data Science Manager to join our leadership team. In this pivotal role, you will be responsible for overseeing the strategic direction and execution of data science initiatives across the organization. You will lead a talented team of data scientists, driving innovation in predictive modeling,...


  • Islamabad, Islamabad, Pakistan Nisum Full time

    About NisumWe're a leading digital transformation consulting firm that helps businesses unlock their full potential through innovative technology solutions.The OpportunityWe're seeking a skilled Data Engineer to join our team and drive the development of cutting-edge data engineering solutions using Azure cloud services.Your Key ResponsibilitiesLead the...


  • Islamabad, Islamabad, Pakistan MAF Software & Technologies Full time

    Maf Software & Technologies is looking for a Senior Azure Consultant to enhance our team's capabilities in designing and deploying Microsoft Azure focused solutions. As a Senior Consultant, you will play a key role in shaping our customers' cloud strategies.The ideal candidate will possess extensive experience with Azure Integration Services, particularly...


  • Islamabad, Islamabad, Pakistan Night Watchers Full time

    Night Watchers is seeking a Data Access Consultant to assist in retrieving inaccessible digital assets. As an IT Security Specialist, you will be responsible for resolving complex access issues and developing strategies to bypass security constraints.About the Role:Regain access to protected or inaccessible digital assetsAssist in recovering lost credentials...


  • Islamabad, Islamabad, Pakistan SOFTOO Full time

    About the RoleThis mid-senior level position requires expertise in Power BI, Tableau, and cloud platforms such as Azure Data Factory, Synapse, Azure Analysis Services, or AWS. The successful candidate will be responsible for developing and maintaining interactive dashboards and reports, designing and optimizing ETL processes, and working with...


  • Islamabad, Islamabad, Pakistan AlphaBOLD Full time

    JOB DESCRIPTIONThis senior-level consulting position provides quality and innovative solution leadership to the NetSuite practice through working with project teams to deliver NetSuite solutions within constraints of time and budget. The candidate will be guiding customers to ensure proper use of NetSuite environments, designing and optimizing system...

  • Senior Data

    2 weeks ago


    Islamabad, Islamabad, Pakistan 1840 & Company Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by 1840 & Company. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay range$4.00/hr - $7.00/hrOur client is looking for a Senior Data & Reporting Analyst to drive data-driven decision-making and operational...


  • Islamabad, Islamabad, Pakistan LeanDNA Inc Full time

    LeanDNA is helping solve the $150B problem that global manufacturers face–excess inventory tying up critical working capital and keeping manufacturing companies from being as efficient as they need to be. Without an effective way to optimize inventory, manufacturers are buying too much, too little, or placing inventory in the wrong place at the wrong...

  • Data Scientist

    3 weeks ago


    Islamabad, Islamabad, Pakistan TenX Full time

    JOB SUMMARY:TenX is searching for a strategic and inquisitive Data Scientist to develop and deliver data-centered projects. In keeping with this overarching aim, the Data Scientist will be required to outline work requirements, work hands-on and collaborate within the team. You should also harness your mastery of Data Science to consult on various aspects of...


  • Islamabad, Islamabad, Pakistan S&P Global, Inc. Full time

    About the RoleThe Channel Solutions Specialist will be integrated into a group with high expectations, focusing on quality user experiences. This position plays a crucial link between end-users and S&P Global's Channels Data Delivery Products/Solutions.Main Objectives:Provide technical product support as a consultant to customersPartnership with other...


  • Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are NorthBay Solutions, a leading provider of data-driven solutions. Our team is seeking a highly skilled Senior Data Engineer to join our ranks.About the Role:We are looking for an individual with expertise in AWS Glue, Lambda, Step Functions, and other AWS data services to monitor, troubleshoot, and optimize our data pipelines.You will be responsible...


  • Islamabad, Islamabad, Pakistan Academix Connect Full time

    MUST HAVE MINIMUM 1 YEAR EXPERIENCECompensation:Up to 70,000 PKR for experience up to 2 yearsUp to 100,000 PKR for experience up to 4 yearsCommission: 20,000 PKR per closed student minimumAbout Academix Connect:At Academix Connect, based in Canada, we believe education knows no boundaries. We empower Pakistani students by connecting them with global study...

  • Tele Sales Staff

    14 hours ago


    Islamabad, Islamabad, Pakistan District 92 Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from District 92Company DescriptionDistrict 92 Marketing & Developers (Private) Limited is a rapidly growing real estate company with significant achievements in the twin cities. With almost two decades of experience in real estate and an extensive branch network in major cities, we...


  • Islamabad, Islamabad, Pakistan Cydemic Full time

    Get AI-powered advice on this job and more exclusive features.Cydemic is a forward-thinking cybersecurity company specializing in three core areas:Cybersecurity Consultancy Services: Helping organizations build robust security programs and achieve compliance.Managed SOC Services (MSSP): Providing 24/7 monitoring, threat detection, and incident...