Big Data Engineer
5 days ago
Responsibilities:
· Develop, test, and maintain data processing pipelines and workflows, ensuring optimal performance and reliability.
· Collaborate with data scientists and analysts to understand data requirements and design appropriate data models and schemas.
· Optimize and tune existing data pipelines, storage systems, and analytical frameworks to improve efficiency and reduce processing time.
· Monitor and troubleshoot data processing jobs, performance bottlenecks, and data quality issues.
· Stay up-to-date with the latest advancements in big data technologies and recommend innovative solutions to improve our data infrastructure.
· Collaborate with cross-functional teams to gather requirements and define technical specifications for data-related projects.
· Document design decisions, technical specifications, and standard operating procedures for the big data infrastructure.
· Mentor junior engineers and provide guidance on best practices for big data engineering and development.
Requirements:
· Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
· Proven experience as a Big Data Engineer or similar role with expertise in Azure and Hadoop technologies.
· Strong knowledge of the Azure cloud platform, including Azure Data Lake Storage, Azure Data Factory, Azure Databricks, and Azure HDInsight.
· Proficiency in Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Pig, Spark, and HBase.
· Experience with big data processing frameworks like Apache Kafka and Apache Storm is a plus.
· Solid understanding of data modeling, data warehousing, and ETL processes.
· Strong programming skills in languages such as Java, Scala, or Python.
· Familiarity with SQL and NoSQL databases.
· Knowledge of data governance, data privacy, and data security best practices.
· Excellent problem-solving and analytical skills with a strong attention to detail.
· Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities.
· Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.
Job Type: Full-time
Work Location: In person
-
Big Data Engineer
5 days ago
I-, Islāmābād, Pakistan 3c58e311-855a-4813-b54a-5398398b79c7 Full time $30,000 - $60,000 per yearResponsibilities:· Develop, test, and maintain data processing pipelines and workflows, ensuring optimal performance and reliability.· Collaborate with data scientists and analysts to understand data requirements and design appropriate data models and schemas.· Optimize and tune existing data pipelines, storage systems, and analytical frameworks to...
-
Data Engineer
2 weeks ago
Islamabad, Islamabad, Pakistan PLC Group Full time 1,200,000 - 3,600,000 per yearJob Title:Data EngineerSchedule:On-site Full-timeWork Location:I-10/3 Islamabad, PakistanAre you passionate about building scalable data pipelines, managing large datasets, and enabling advanced analytics? Do you enjoy working with cutting-edge technologies to support AI, ML, and IoT-driven solutions? If so, then PLC Group wants youAs a Data Engineer, you...
-
Executive (EDW and Big Data Operations)
1 week ago
Islamabad, Islamabad, Pakistan Ufone 4G Full time 500,000 - 1,000,000 per yearARE YOU READY TO RISE WITH PTCL GROUPWe are not just industry leaders; we are redefining excellence with groundbreaking solutions. PTCL Group stands out in the technology industry with its commitment to high-end innovation and leading the way in delivering integrated ICT and Cellular Network services in Pakistan, all rooted in our journey of Culture...
-
Senior Data Engineer
7 days ago
Islamabad, Islamabad, Pakistan TenX Full time 1,200,000 - 2,400,000 per yearJOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. He should be able to analyze and digest what a business wants to accomplish with its data and design the best possible ETL/BI process around those goals.DESCRIPTION: Data Warehouse /ETLParticipates...
-
Data Engineer
1 week ago
Islamabad, Islamabad, Pakistan MA Services Full time $100,000 - $120,000 per yearAbout the RoleWe are seeking a skilled and motivated Data Engineer (AI/ML) to design, build, and maintain scalable data pipelines and infrastructure that power advanced analytics, machine learning, and AI solutions. This role requires strong expertise in data engineering, cloud technologies, and ML operations to enable data scientists and AI teams to deliver...
-
Data Engineer
1 week ago
PER - Islamabad, PK Contour Software Full time 1,200,000 - 3,600,000 per yearAbout ContourContour Software has grown from a dozen people to over 2,000 staff across 3 cities, in less than 14 years. As a subsidiary of Constellation Software Inc., we are proud to be part of a global enterprise software conglomerate that has grown to become one of the top 10 software companies in the world, with employees and customers in 100+...
-
Data Engineer
7 days ago
Islamabad, Islamabad, Pakistan 7e3b0306-ce58-45a4-9c04-55b0d4d0560e Full time 500,000 - 1,500,000 per year𝗕𝘂𝗶𝗹𝗱 𝘁𝗵𝗲 𝗧𝗿𝘂𝘀𝘁𝗲𝗱 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲 𝗳𝗼𝗿 𝗔𝗜-𝗗𝗿𝗶𝘃𝗲𝗻 𝗛𝗲𝗮𝗹𝘁𝗵𝗰𝗮𝗿𝗲At Victreat, we're engineering a real-time data intelligence engine that transforms the unstructured web into a structured, queryable and trusted database. This is the core of...
-
Data Scientiest
1 week ago
Islamabad, Islamabad, Pakistan MA Services Full time 900,000 - 1,200,000 per yearAnalyzes complex data to extract insights, build predictive models, and support data-driven decision-making.Key Responsibilities:- Perform exploratory data analysis and feature engineering.- Build statistical and machine learning models.- Present insights through visualizations and reports.- Collaborate with cross-functional teams to define data strategies.-...
-
Senior Data Engineer
5 days ago
Islamabad, Islamabad, Pakistan Tekrowe Full time 1,200,000 - 2,400,000 per yearThe Company Tekrowe Digital, a rapidly growing Software Development and Technology Innovation company in Pakistan, specializes in cutting-edge Web and Mobile technologies. Serving clients globally, we prioritize impact investments in technology for positive change. With a talented team, we fosters a culture of quality, growth, innovation, and teamwork. We...
-
Data Engineer
3 days ago
Islamabad, Islamabad, Pakistan Cloud Enterprise Business Solutions (CEBS) Full time 900,000 - 1,200,000 per yearCustomer Data Platform Data EngineerWe are looking for a Customer Data Specialist Data Engineer to join our data team for a major European retail company. The ideal candidate has experience working as a Data Engineer and Customer Data Platform Engineer ( ideally Tealium) and is passionate about leveraging data to drive personalization, segmentation, and...