Home

Pyspark Tech Lead - Mettawa, IL & Chicago, IL (Hybrid) at Chicago, Illinois, USA
Email: [email protected]
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=2255919&uid=

From:

Mano,

Sight Spectrum

[email protected]

Reply to:   [email protected]

Hi All,  

Greetings from Sight Spectrum

Hope you are doing good.

This is Mano from Sight Spectrum     

I hope this email finds you well. We have a requirement for Pyspark Tech Lead at our company. I came across your profile and were impressed with your experience and skills. I believe that your skills and experience is a good match for our client requirement.

If you are interested in this opportunity, we would love to hear from you. Please send us your updated resume.                                  

Role:

Pyspark Tech Lead

Location:

Mettawa, IL & Chicago, IL (Hybrid)

Hiring Mode: Contract

Inperson Interview must 

Job Description:

Required Skills: Cloudera HUE, PySpark, Spark Pyspark, Cloudera Data Platform, Apache Iceberg

Responsibilities :

Lead the design and implementation of data solutions using Cloudera HUE and Cloudera Data Platform

Supervise the integration of Apache Iceberg and Spark into existing data workflows

Provide technical guidance and mentorship to junior team members on PySpark best practices

Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions

Ensure data quality and integrity through meticulous testing and validation processes

Develop and maintain documentation for data architectures and workflows

Optimize data processing pipelines for performance and efficiency

Conduct code reviews to ensure alignment to coding standards and best practices

Solve and resolve complex technical issues related to data processing

stay updated with the latest advancements in data technologies and incorporate them into projects

Drive innovation by exploring new tools and techniques in the research and development domain

Communicate effectively with stakeholders to gather requirements and provide project updates

Contribute to the overall success of the company by delivering high-quality data solutions that drive business value

Qualifications

Possess strong expertise in Cloudera HUE and Cloudera Data Platform

Demonstrate proficiency in Apache Iceberg and Spark

Have extensive experience with PySpark for data processing

Show a solid understanding of data architecture and data engineering principles

Exhibit excellent problem-solving skills and attention to detail

Have a background in research and development is a plus

Display strong communication and collaboration skills

Be able to work effectively in a hybrid work model

Have a proactive approach to learning and staying current with industry trends

Be capable of mentoring and guiding junior team members

Demonstrate the ability to deliver high-quality solutions within deadlines Show a commitment to continuous improvement and innovation

Possess a strong sense of ownership and accountability for project outcomes.

Regards,

Mano

US IT Recruiter

Mail : mano.m
@sightspectrum.com

www.sightspectrum.com |

Keywords: information technology Illinois
Pyspark Tech Lead - Mettawa, IL & Chicago, IL (Hybrid)
[email protected]
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=2255919&uid=
[email protected]
View All
03:10 AM 14-Mar-25


To remove this job post send "job_kill 2255919" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]


Time Taken: 28

Location: Chicago, Illinois