Mid Data Engineer

7 days ago


Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

About us:

VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property. VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside the likes of Microsoft & Snap. We develop cutting-edge software products integrating computer vision, 3D modeling, AR, VR, decision sciences, and IoT addressing a wide variety of use cases across different industries.

Your role

We are looking for talented and experienced data engineers to join our growing Data & Analytics team and help us develop high-quality Data Lakehouse products and solutions for our company. As a Senior Data Engineer, you combine solid data engineering and software development skills, data modelling, integration knowledge with your business understanding, and strong analytical skills that enable you to deliver the expected benefits to the business. You will play a key role in the Data engineering team, interfacing with the Data Architect, Governance, Data Science Team, AI Team, Reporting and Business partnering teams.

Responsibilities

  1. Understand business requirements, identify and apply appropriate Data and Analytics tools and technologies to solve problems, and participate in the architecture and execution of technology solutions.
  2. You will help evolve, build, and maintain data pipelines for multiple data sources and interface with system owners.
  3. Design and develop data models, and ETL/ELT workflows for Data Lake House products/solutions. Manage the entire data flow, from acquisition to transformation into actionable insights using SQL, Python, and other ETL technologies AWS Kinesis, Kafka, AWS Glue, AWS EMR, etc.
  4. Design and implement scalable ETL solutions for structured, semi-structured, and unstructured data, including batch and streaming processes.
  5. Build data pipelines, and standardize and cleanse data for AI, Data Science, and Analytics use cases to support business needs.
  6. Identify and apply the appropriate data integration, cleansing, quality, and master data management tools and technologies to solve problems.
  7. Establish and enforce best practice standards for data, such as data modeling, database design, ETL design, job scheduling, and monitoring.
  8. Define data engineering and governance standards, guidelines, and best practices for both business groups and technical teams.
  9. Drive the collection of new data and the refinement of existing data sources to continually enhance data quality by streamlining data flow and data quality processes to improve data accuracy.
  10. Work independently as well as collaboratively with a team and learn from colleagues. Collaborate closely with team members, providing subject matter expertise and solutions to the most challenging software development tasks.

What you need

  1. Minimum of bachelor's degree in computer science, Information Technology, or a related field.
  2. Possess a deep passion for data and a proven ability to create high-quality data products.
  3. Bring at least 8+ years of data engineering experience in implementing Big Data, Data Lakehouse, and Data Warehouse solutions for banking clients.
  4. Have over 8+ years of hands-on experience building production data pipelines and working with structured, semi-structured, and unstructured data.
  5. Accumulate 6+ years of experience in engineering data solutions within both cloud and hybrid infrastructures, with strong expertise in AWS cloud.
  6. Extensive experience with the AWS data and AI technology stack and developing and deploying scalable tools and services to handle large data sets, ensuring the highest quality for feeding large ML models, such as LLMs.
  7. Experienced in identifying and evaluating new technologies to enhance the performance, maintainability, and reliability of data pipelines.
  8. Apply software engineering rigor and best practices to data engineering, including automation.
  9. Hands-on experience with data integration/ETL technologies such as Python, Spark/PySpark, Kafka/Kinesis/EMR, Lambda, API Gateway, REST API, AWS Glue, etc.
  10. Proficient in database technologies like AWS S3, MongoDB, DynamoDB, AWS Redshift, Glacier, and other SQL and NoSQL databases.
  11. Experienced with CI/CD pipelines and tools such as Jenkins, GitLab CI, or Azure DevOps.
  12. Deep architectural understanding of relational and non-relational systems, especially with a focus on massively parallel processing database technologies and on-premises, hybrid cloud technologies in IaaS/PaaS/DBaaS.
  13. Consult on optimal design of database environments, performance improvements, analyzing complex distributed production deployments, data security, and best practices for cloud adoption.
  14. Extensive experience in database design, ETL/ELT process development, Data Lakehouse performance tuning, and storage optimization.
  15. Strong understanding of modern cloud platforms (AWS/GCP/Azure) and various cloud services.
  16. Hands-on experience in different APIs and API integration, along with microservice architecture.
  17. Experience in integrating customer contact center data with Lakehouse is a plus.
  18. Strong analytical, logical, problem-solving and numerical skills.
  19. A self-starter and creative thinker who collaborates well and communicates confidently, driven by a passion for excellence.
  20. Capable of handling multiple assignments/projects simultaneously, prioritizing workloads to meet competing deadlines.
  21. Adept at building strong relationships that foster robust debate and efficiently resolve periodic disagreements about priorities.
  22. Effective in communicating with both technical and non-technical audiences.
  23. Proven ability to take initiative and proactively learn new technologies.
  24. Demonstrates a solid work ethic and provides timely, high-quality support.
  25. Embraces a mindset of Continuous Improvement.

Why choose us

Our global network of industry experts and mentors helps shape your growth and future. We believe in delivering client value through our work. We build products that are not good or great, but outstanding. You deliver We will make your stay and journey with us worthwhile.

We are an equal opportunity employer, and we value diversity. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected status.

#J-18808-Ljbffr
  • Big Data Engineer

    2 days ago


    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time

    We are seeking an experienced Data Engineer to join our team.The ideal candidate will have a strong background in data engineering, particularly in big data environments on Azure's cloud platform.Job DescriptionThis is a mid-senior level full-time position that requires a bachelor's degree in computer science or a related field and 3-6 years of...

  • Senior Data Engineer

    2 weeks ago


    Islamabad, Islamabad, Pakistan TenX Full time

    Join to apply for the Senior Data Engineer role at TenXSenior Talent Acquisition Executive @ TenX | 360° HR Resource | Scouting Talent | C-level Recruitment | Your hiring PartnerJOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. They should be able...


  • Islamabad, Islamabad, Pakistan beBeeDataWarehouse Full time

    Key Responsibilities:Design and develop data warehouses and ETL processes to extract, transform, and load data from various sources.Analyze business goals and objectives to create optimal ETL/BI processes.Data Warehouse/Etl Specialist Requirements:Bachelor's degree in computer science or related field; a master's degree is preferred.3-4 years of experience...


  • Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time

    About the RoleThis is a remote full-time position working in the Travel & Hospitality Industry, responsible for designing, building, testing, optimizing and maintaining infrastructure and code required for data integration, storage, processing, pipelines and analytics from ingestion to consumption. This role requires strong programming skills and...

  • Data Engineer in Test

    2 weeks ago


    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Data Engineer in Test role at Confiz.We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.ResponsibilitiesWrite PySpark and SQL scripts to validate data pipelines, transformations, and integrations.Design and run tests for data validation,...

  • Data Engineer

    7 days ago


    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time

    About Data Engineering at DigitalTolkJob Description:We are seeking a skilled data engineer to join our team. The ideal candidate will have experience designing, implementing, and optimizing scalable data pipelines and ETL processes. They will also be responsible for developing data visualizations and identifying patterns to communicate actionable metrics to...

  • Data Engineer

    7 days ago


    Islamabad, Islamabad, Pakistan Leed | Pakistan Full time

    Direct message the job poster from Leed | PakistanCertified Human Resources Professional -CHRPCompany Description:Leed Pakistan is a software development company established in 2020, headquartered in Canada, with development offices in Germany and Pakistan. Despite our rapid growth to 50+ professionals, we prioritize quality and customer care. We work with...

  • Data Engineer

    7 days ago


    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About us: VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property.VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside...


  • Islamabad, Islamabad, Pakistan Motive Full time

    About the RoleAs a Mid-Market Account Manager, you will leverage your experience to manage a select group of large US-based customers within a specialized book of business. Building on success in SMB or Commercial roles, this position requires an advanced skill set in selling software solutions and navigating more complex organizational structures....


  • Islamabad, Islamabad, Pakistan FuseMachines Full time

    About FusemachinesFusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...