
Big Data Solutions Developer
2 days ago
As a Senior Big Data Engineer, you will play a crucial role in designing and developing data solutions that cater to the needs of our organization. Your responsibilities will include analyzing large data stores to derive meaningful insights using Big Data querying.
Key Responsibilities- Design and develop code, scripts, and data pipelines that leverage structured, semi-structured, and unstructured data.
- Manage data ingestion pipelines and stream processing.
- Perform computations using Azure functions.
- Responsible for the documentation, design, and development of Hadoop applications.
- Perform day-to-day tasks with accuracy and minimal directions while meeting deadlines.
- Bachelor/master's degree in computer science or related field.
- At least 4-6 years of relevant working experience with Cloud Computation.
- Hands-on experience on Azure/AWS.
- Experience working with Apache Spark, Apache Hive, Apache HBase.
- Hands-on experience on SQL, Scala, Node.js, JS, Java.
- Hands-on experience with Python, Pandas, NumPy, TensorFlow.
- Experience with ETL.
- Implementing Lambda Architecture with stream processing and batch processing.
- Implement security standards and practices in the Architecture of Cloud Solution.
- Training/Certification on Data Lake HDFS.
- Training/Certification on Azure Data Lake Gen 2.
- Training/Certification on Data Bricks.
- Experience with Azure Data Explorer and Kusto query language is desirable.
- Experience with Azure Data Factory is also desirable.
- Mid-Senior level position in Engineering and Information Technology.
- Full-time employment opportunity.
-
Big Data Solutions Engineer
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeEnterprise Data Solutions ArchitectThe successful candidate will be responsible for leading the roadmap and enhancements for the enterprise Big Data Platform, ensuring scalability, reliability, and cost efficiency. They will also architect end-to-end data solutions that fulfill business intelligence and analytics needs while ensuring best practices in...
-
Senior Big Data Developer
6 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeIn this role, you will play a crucial part in building scalable data solutions that can handle petabytes of data. Your expertise in big data processing using Spark, Hudi/DeltaLake/Iceberg, Data Catalog, Data Lineage, Glue, and EMR will enable you to design and implement efficient data pipelines.Responsibilities:Big Data Engineering: Design, develop, and...
-
Big Data Architect
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeThe ideal candidate will have hands-on experience in designing, developing, and deploying big data solutions using cloud-based technologies. As a senior big data engineer, you will work closely with cross-functional teams to identify business needs and develop scalable data solutions.ResponsibilitiesDesign and implement data Lake solutions for company-wide...
-
Big Data Solution Architect
6 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeEnterprise Data Architecture OpportunityThe ideal candidate will have a deep understanding of cloud-based big data ecosystems (AWS & Azure), real-time data processing, and enterprise data governance. They will lead the roadmap and enhancements for the enterprise Big Data Platform, ensuring scalability, reliability, and cost efficiency.
-
Big Data Solutions Architect
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeWe are seeking an experienced Senior Big Data Engineer with a solid background in data engineering and a passion for Big Data.The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering. They will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and...
-
Big Data Solutions Specialist
1 day ago
Lahore, Punjab, Pakistan beBee Careers Full timeJob DescriptionThe role of a Big Data engineer involves handling data-related implementation tasks, including provisioning of data storage services, ingesting and streaming batch data, transforming data, implementing security requirements, and managing large sets of structured, semi-structured, and unstructured data.ResponsibilitiesPerforming analysis of...
-
Senior Big Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeWe are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...
-
Big Data Solutions Engineer
6 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeAs a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data.Job...
-
Senior Big Data Developer
6 days ago
Lahore, Punjab, Pakistan beBee Careers Full timeOur ideal candidate is a highly skilled Big Data engineer with a passion for designing and developing innovative data solutions. As a key member of our team, you will be responsible for leading the development of data pipelines and implementing data storage solutions.ResponsibilitiesLead the development of data pipelines that leverage structured,...
-
Big Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Arbisoft Full timeSoftware Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...