Data Engineer

About us:

VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property.

VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside the likes of Microsoft & Snap Inc.

We develop cutting-edge software products integrating computer vision, 3D modeling, AR, VR, decision sciences, and IoT addressing a wide variety of use cases across different industries.

Your role

We are seeking talented and experienced data engineers for our expanding Data & Analytics team and aid in the development of high-quality Data Lakehouse products and solutions for our company. As a Data Engineer, you will leverage your solid data engineering, ETL/ELT, and data integration skills, along with strong analytical abilities, to deliver valuable business benefits. You will play a pivotal role within the Data Engineering team, interfacing closely with the Data Science, AI, and Reporting teams.

Responsibilities

1. Design, build, and maintain scalable data pipelines and systems.
2. Collaborate with cross-functional teams to understand data requirements and develop appropriate solutions.
3. Implement and automate ETL processes to extract, transform, and load data from various sources, building Data Lakehouse solutions.
4. Develop real-time data pipelines and applications using serverless and managed AWS services such as Kafka, Lambda, Kinesis, API Gateway, REST Api, etc.
5. Develop scalable ETL pipelines for structured, semi-structured, and unstructured data, including both batch and streaming processes.
6. Standardize and cleanse data for AI, Data Science, and Analytics use cases to support business needs.
7. Create and optimize databases and data models for efficiency and performance.
8. Ensure data quality and integrity by performing data validations and implementing quality checks.
9. Develop and maintain documentation related to data infrastructure and processes.
10. Troubleshoot and resolve data-related issues.
11. Stay up to date with the latest trends and technologies in data engineering and data management.

What you need

1. Bachelor's degree in Computer Science, Information Technology, or a related field.
2. Possess a deep passion for data and a demonstrated ability to create high-quality data products.
3. 4+ years of experience working with customer-centric data on a big data scale, preferably in a banking, online, or e-commerce context.
4. 4+ years of hands-on experience building production data pipelines and working with structured, semi-structured, and unstructured data.
5. 3+ years of experience in engineering data solutions within both cloud and hybrid infrastructures, with strong expertise in AWS Cloud.
6. 2+ years of experience with one or more programming languages, especially Python.
7. 2+ years of experience with data integration/ETL technologies such as Python, Spark/PySpark, Kafka/Kinesis/EMR, Lambda, API Gateway, REST API, AWS Glue, etc.
8. Proficient in database technologies like AWS S3, MongoDB, DynamoDB, AWS Redshift, Glacier, and other SQL and NoSQL databases.
9. Experienced with CI/CD pipelines and tools such as Jenkins, GitLab CI, or Azure DevOps.
10. Experience with modern real-time data pipelines (e.g., serverless framework, Lambda, Kinesis, etc.).
11. Experience designing ETL/ELT process flows for Data Lakehouse implementation.
12. Experience in AWS data ecosystem and various other cloud services.
13. Experienced in different APIs and API integration, along with microservice architecture.
14. Experience integrating customer contact center data with data Lakehouse is a plus.
15. Strong analytical, logical, problem-solving and numerical skills.
16. A self-starter and creative thinker who collaborates well and communicates confidently.
17. Effective in communicating with both technical and non-technical audiences.
18. Proven ability to take initiative and proactively learn new technologies.
19. Demonstrates a solid work ethic and provides timely, high-quality support.
20. Embraces a mindset of Continuous Improvement.

Why choose us

Our global network of industry experts and mentors helps shape your growth and future. We believe in delivering client value through our work. We build products that are not good or great, but outstanding.

You deliver We will make your stay and journey with us worthwhile.

We are an equal opportunity employer, and we value diversity. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected status.