Data Ingestion Specialist

The RoleWe are seeking an exceptional Scraping and Data Ingestion Expert to join our team. As a key contributor, you will design and build web scraping tools to extract relevant data from various websites. Your expertise in crawling, extracting, and processing data will be essential in providing actionable insights to drive business decisions.Main...

Job Title: Data Extraction SpecialistAs a web scraping focused data engineer, you will be responsible for extracting and ingesting data from websites using web crawling tools.In this role, you will own the creation process of these tools, services, and workflows to improve crawl/scrape analysis, reports, and data management.Key Responsibilities:Familiarity...

Data Engineering ResponsibilitiesThe Principal Data Engineer will be responsible for:Designing and developing scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.Implementing real-time data streaming and batch processing solutions to support diverse business needs.Building and optimizing data storage solutions, including...

Office Field is looking for a diligent and experienced Data Architect to join our team.Responsibilities:Design and implement effective database solutions for stock, crypto, and financial data.Establish best practices in architecture, design, and development.Perform SQL tuning and optimize database responsiveness.Use Snowflake to support high-frequency data...

Job DetailsAs a Web Scraping focused Data Engineer, you will be responsible for extracting and ingesting data from websites using web crawling tools. This role involves owning the creation process of these tools, services, and workflows to improve crawl/scrape analysis, reports, and data management.ResponsibilitiesFamiliarity with techniques and tools for...

Senior Data Engineer Role DescriptionThis Senior Data Engineer will play a key role in developing and maintaining complex data systems that drive organizational success.Main Responsibilities Include:Data Ingestion and Processing Systems: Design and build scalable data ingestion and processing systems using Apache NiFi and Apache Spark.Distributed Database...

Senior Data Engineer JobThe role of Senior Data Engineer is a high-impact position that focuses on designing, building, and optimizing scalable data analytics systems and pipelines. This contributes significantly to the efficiency, reliability, and performance of data-driven solutions, enabling accurate insights and informed decision-making across the...

The role of a Senior Data Engineer involves designing, developing, and optimizing scalable data analytics systems and pipelines to improve the efficiency, reliability, and performance of data-driven solutions.ResponsibilitiesDesign and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.Optimize and maintain...

Senior Data Engineer Job OpportunityWe're seeking an experienced Senior Data Engineer to join our team and contribute to the design, development, and maintenance of scalable data systems and pipelines.Main Responsibilities:Scalable Data System Development: Design and build scalable data ingestion and processing systems using Apache NiFi and Apache...

Key ResponsibilitiesMonitor and troubleshoot AWS data pipelines using AWS Glue, Lambda, Step Functions, Athena, Redshift, or AirflowInvestigate job failures, analyze CloudWatch logs, and collaborate with L2/L3 teams to implement corrective actionsRe-run failed jobs and retry data ingestion processes while ensuring data consistency