Company
Chabez Tech logo

Chabez Tech

chabeztech.com
Location

In office: Chennai

  • 🇮🇳 India
Apply

Python Developer

Job Description

Job Title: PySpark and Python Expert

Location: Chennai, India (Work from Office)

Experience: 5-9 years (UK Timing)

Job Description:

We are seeking a skilled PySpark and Python Expert to join our team at an esteemed organization. As a Subject Matter Expert, you will play a vital role in developing and maintaining data pipelines using PySpark. Your expertise in Python, Hadoop, Spark Scala, Hive, Impala, and SQL technologies will contribute to the success of our projects.

Responsibilities:

  • Serve as a subject matter expert in Python and Spark technologies.

  • Utilize your in-depth knowledge of Hadoop, Spark Scala, PySpark, Hive, Impala, and SQL to design and develop efficient data pipelines.

  • Analyze migration plans for different versions of Cloudera Distribution of Apache Hadoop, conduct impact analysis, and propose mitigation plans.

  • Build and maintain PySpark pipelines, ensuring smooth data processing and transformation.

  • Collaborate with cross-functional teams to understand business requirements and provide technical solutions.

  • Stay updated with the latest industry trends and technologies related to PySpark and Python.

Requirements:

  • Strong expertise in Python and Spark technologies, with a minimum of 3 years of experience.

  • Proficiency in Hadoop, Spark Scala, PySpark, Hive, Impala, and SQL technologies.

  • Proven experience in designing and developing data pipelines using PySpark.

  • Ability to analyze migration plans and propose mitigation strategies.

  • Excellent problem-solving and analytical skills.

  • Strong communication and collaboration abilities.

Additional Information

UK Shift