
Big Data Pipeline Developer
1 day ago
Azure Data Engineers lead the design, implementation, and optimization of data ingestion pipelines.
Main Responsibilities:- Designing and implementing data ingestion pipelines.
- Developing analytics solutions using cloud and on-premises technologies.
- Maintaining operational, security, and compliance standards.
- Providing technical support for issue resolution during daily project delivery status meetings.
- Bachelor's degree or equivalent work experience.
- 5+ years of experience performing data engineering, warehousing, publishing, and visualization.
- 2+ years of experience as an Azure Data Engineer or in a similar role.
- Proficiency in data profiling, cataloguing, and mapping.
- Ability to define ELT/ETL architecture and process design.
- End-to-end implementation of data warehousing analytics solutions.
- Working experience with Azure.
- Creating data pipelines using ETL tools like Airflow, ADF.
- Distributing computing technologies like Apache Spark, Databricks.
- Stream-processing systems like Spark Streaming, Eventhub.
- Proficient in object-oriented and functional programming languages.
- Writing effective unit and integration tests for ingestion pipelines.
- Static analysis and code quality tools.
- Code version control repositories like Git.
- Security best practices including encryption of sensitive data.
- Building CI/CD pipelines & DevOps orchestration tool like Jenkins.
- Familiarity with Data Lakehouse, Delta Lake, Apache Hudi.
-
Full Stack Developer
2 weeks ago
Lahore, Punjab, Pakistan Big Data Inc Full timeOverview:Big Data Inc is a cutting-edge technology company that offers innovative solutions for big data processing and analysis. We are currently seeking an experienced Full Stack Java Developer to join our team in Lahore, Pakistan.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications...
-
Big Data Pipeline Specialist
4 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeBig Data Pipeline SpecialistWe are seeking a skilled Senior Data Engineer to work on designing, developing, and maintaining large-scale data pipelines. The ideal candidate will have a strong background in data engineering, as well as experience in working with big data technologies.Key ResponsibilitiesDesign and Develop Data PipelinesOptimize Data Flow and...
-
Big Data Pipeline Specialist
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in designing and developing efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.The successful candidate will have hands-on experience with data engineering tools and platforms, including Snowflake, Airbyte, Airflow,...
-
Data Engineer for Big Data Pipelines
2 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeWe are seeking a seasoned data engineer to expand and optimize our big data pipelines.The successful candidate will collaborate with other engineers and developers working on different layers of the infrastructure, requiring a commitment to collaborative problem-solving, sophisticated design, and the creation of quality products.Key Responsibilities:Design,...
-
Big Data Specialist Opportunity
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeBig Data TechnologiesWe are seeking a Senior Data Engineer to join our team and leverage their expertise in big data technologies to drive business growth.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipeline development.Main Responsibilities:Data Modeling: Design and implement data models that meet business...
-
Big Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Gtradecenter Full timeInvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...
-
Big Data Engineering Manager
1 week ago
Lahore, Punjab, Pakistan NorthBay Solutions Full timeNorthBay Solutions is seeking an experienced Big Data Engineering Manager to manage our big data engineering efforts. The ideal candidate will have 4 to 6+ years of experience in data engineering with a focus on big data technologies.About the Position:Main Responsibilities: Lead our data engineering efforts, design and develop large-scale ETL pipelines in...
-
Backend Software Engineer
2 weeks ago
Lahore, Punjab, Pakistan Big Data Inc Full timeCompany Overview:Big Data Inc is a cutting-edge technology company that specializes in big data processing and analysis. Our mission is to provide innovative solutions to businesses and organizations.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications using Java back-end...
-
Big Data Solutions Architect
4 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeData Engineering Opportunity:We are looking for a skilled Big Data Engineer to design, develop, and maintain scalable data solutions. The ideal candidate will have strong coding skills and experience in managing the end-to-end development lifecycle from development to deployment.Key Responsibilities:Design and develop robust data pipelines and...
-
Senior Big Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan NorthBay Solutions Full timeWe are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...