𝗔𝗜 𝗔𝗴𝗲𝗻𝘁 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲: 𝗔𝗜 𝗔𝗴𝗲𝗻𝘁 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿 (𝗪𝗲𝗯 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 & 𝗗𝗮𝘁𝗮 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀)

𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: 𝗢𝗻𝘀𝗶𝘁𝗲/𝗡𝗦𝗧𝗣

𝗕𝘂𝗶𝗹𝗱 𝘁𝗵𝗲 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲 𝘁𝗵𝗮𝘁 𝗽𝗼𝘄𝗲𝗿𝘀 𝗔𝗜 𝗱𝗿𝗶𝘃𝗲𝗻 𝗵𝗲𝗮𝗹𝘁𝗵𝗰𝗮𝗿𝗲. We are developing a real time data intelligence engine that transforms the web into a structured, queryable database, enabling groundbreaking healthcare research. We need an engineer to architect the core data acquisition and automation systems that make this possible.

𝗬𝗼𝘂𝗿 𝗠𝗶𝘀𝘀𝗶𝗼𝗻:

*Architect and scale robust web scraping systems to collect data from thousands of dynamic sources using Scrapy, Playwright and Selenium.

*Build and optimize high performance ETL pipelines that deliver clean, structured data for analysis and AI models.

*Develop resilient data workflows that intelligently adapt to source changes and ensure data quality at scale.

*Apply AI agent frameworks (LangChain, LangGraph) to automate complex data extraction and enrichment tasks.

*Integrate and manage data flow across diverse systems including PostgreSQL, MongoDB and Elasticsearch.

𝗪𝗲'𝗿𝗲 𝗟𝗼𝗼𝗸𝗶𝗻𝗴 𝗙𝗼𝗿:

*Proven experience building large scale web scraping systems with Scrapy and Playwright/Selenium.

*Strong proficiency in Python and expert knowledge of data engineering best practices (ETL, APIs, async programming).

*Hands on experience with PostgreSQL, MongoDB & Elasticsearch.

*Practical experience with AI agent frameworks (e.g., LangChain, CrewAI) and a clear understanding of how to apply them to automate and intelligentize data workflows.

𝗪𝗵𝘆 𝗝𝗼𝗶𝗻 𝗨𝘀

Victreat offers an attractive compensation package that reflects your skills and contributions. We are committed to your professional development by offering a variety of learning opportunities. Our engaging team culture fosters collaboration and creativity, ensuring that you thrive in a dynamic work environment. Plus, you'll have the chance to be at the forefront of groundbreaking advancements in healthcare technology, making a meaningful impact in the industry.

𝗣𝗹𝗲𝗮𝘀𝗲 𝘀𝗲𝗻𝗱 𝘆𝗼𝘂𝗿 𝗿𝗲𝘀𝘂𝗺𝗲𝘀 𝗮𝘁: