Data Engineer

4 weeks ago

Karachi, Sindh, Pakistan Horizon Technologies Full time

We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS Glue while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills, familiarity with programming languages such as Python and R, SQL, and experience in building ETL/ELT pipelines.

Must Haves:

  1. Bachelors degree in Computer Science or equivalent required.
  2. 2+ years of progressive experience in working on AWS services.
  3. Previous experience as a data engineer or in a similar role.
  4. Technical expertise with data models, data scraping, data cleansing, and segmentation techniques.
  5. Knowledge and understanding of Amazon Web Services such as AWS Glue (Crawler, Job, Database, Workflow), AWS S3, AWS App flow, AWS Athena, AWS Lambda, etc.
  6. Knowledge and experience in connecting with multiple data sources using different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.
  7. Knowledge and experience of Python and PySpark.
  8. Knowledge and experience in SQL and SparkSQL queries.
  9. Knowledge of MS Excel and ability to build various views using pivot tables.
  10. Great numerical, statistical, and analytical skills.
  11. Data engineering certification will be a plus.
  12. Knowledge and experience in Beautiful Soup/Selenium/Scrappy will be a plus.
  13. Knowledge and experience on Terraform will be a plus.

Responsibilities:

  1. Extract data from multiple sources (Cloud/On-Prem) and ingest it into a data lake (AWS S3) through different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.
  2. Cleanse, transform, and maintain data quality in data lakes and data warehouses.
  3. Build and maintain data lakes, data warehouses, and data marts on AWS as per the business requirements.
  4. Build data catalogs on AWS Glue.
  5. Build data pipelines and workflows to ingest raw data and transform/clean data into data lakes and data warehouses respectively using AWS Glue.
  6. Conduct complex data analysis and report on results.
  7. Explore ways to enhance data quality and reliability.
  8. Evaluate business needs and objectives.
  9. Interpret trends and patterns.

Other Details:

  1. Work Days: Monday-Friday
  2. Office location: Off to Shahrah-e-Faisal, PECHS, Karachi
#J-18808-Ljbffr

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Horizon Technologies Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join Horizon Technologies. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems using AWS services.The ideal candidate should have strong analytical skills, familiarity with programming languages such as Python and R, SQL, and experience in...

  • Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan Enterprise64 Full time

    OverviewEnterprise64 is a U.S.-based technology company that creates digital solutions for startups to Fortune 500 companies in the United States, Europe, and the United Arab Emirates. We are growing rapidly across all our global offices and have career opportunities for tech professionals who are looking to work in a fast-growing company, work in a fun...

  • Optimize Data Systems as a Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job Overview:Data Engineer - Optimize Data SystemsWe are looking for an experienced Data Engineer to join our team. The ideal candidate will have strong SQL skills and experience working with Snowflake or other ETL tools.The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and...

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Gymboree Play and Music Full time

    Gymboree Play and Music is looking for a highly skilled Senior Data Engineer to lead the development of our enterprise data infrastructure.About the RoleThe successful candidate will have a strong background in data engineering, with expertise in designing and developing scalable data solutions. This role requires excellent leadership skills, with the...

  • Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Office Field Full time

    Direct message the job poster from Office FieldHuman Resources Executive at Office Field | HR Policies Implementation, Tech RecruitingOffice Field is looking for a Data Engineer to join our growing team of analytics experts. They will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and...

  • Data Engineer Lead

    4 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Bachelor's degree in Computer Science, Engineering, or a related field is preferred for this role.We are seeking an experienced Senior Data Engineer with 7 years of experience to architect data solutions.ResponsibilitiesDesign and develop scalable data pipelines and ETL processes for improved performance and efficiency.Collaborate with cross-functional teams...

  • Big Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    This role requires a Bachelor's degree in Computer Science, Engineering, or a related field, with a Master's degree preferred.We are seeking an experienced Senior Data Engineer to lead our team and design data solutions that meet business needs.Key ResponsibilitiesDevelop and maintain scalable data pipelines and ETL processes for improved performance and...

  • Senior Data Engineer

    4 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • Senior Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • Data Engineering Lead

    2 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team at BlueBerry Tech inc. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes.About the Role:Lead the development of internal tools and shape work environments.Seamlessly integrate IT operations with a...