Data stage with Pyspark

3 days ago

Hyderabad, Pakistan Wipro Full-time
Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.

Job Description

Must Have

  • Strong hands-on experience with IBM InfoSphere DataStage
  • Strong programming experience in PySpark
  • Good knowledge of Apache Spark architecture
  • Strong SQL skills
  • Spark SQL and DataFrames
  • DataStage Parallel Jobs and ETL transformations
  • Data integration and ETL/ELT concepts
  • Performance tuning and troubleshooting
  • Partitioning and handling data skew
  • Linux/Unix scripting
  • Experience processing high-volume datasets

 

Mandatory Skills: DataStage .

 

Experience: 5-8 Years .

 

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.