| Big Data PySpark Tech Lead - Chicago - Mattawa, IL - Day 1 Onsite at Chicago, Illinois, USA |
| Email: [email protected] |
|
From: Basavaraj, Centraprise [email protected] Reply to: [email protected] Hi Team, Greetings from Centraprise, Role: Big Data PySpark Tech Lead Location: - Chicago - Mattawa, IL - Day 1 Onsite NOTE: LinkedIn & Passport Number Is Must Experience :11yrs --Required Skills : Cloudera HUE, PySpark, Spark Pyspark, Cloudera Data Platform, Apache Iceberg strong experience in Big Data skills (including PYSPARK, HADOOP, HIVE, SQOOP), and is proficient in SQL with implementation in snowflake DWH. Good to have onshore and offshore models. Job Summary : We are seeking a PySpark Technical Lead with 11 years of experience to join our team. The ideal candidate will have expertise in Pyspark , Cloudera HUE, Cloudera Data Platform, Apache Iceberg, Spark. This role involves working in a hybrid model with day shifts. The candidate will play a crucial role in driving our research and development initiatives, leveraging their technical skills to deliver impactful solutions. Responsibilities : Lead the design and implementation of data solutions using Cloudera HUE and Cloudera Data Platform Supervise the integration of Apache Iceberg and Spark into existing data workflows Provide technical guidance and mentorship to junior team members on PySpark best practices Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions Ensure data quality and integrity through meticulous testing and validation processes Develop and maintain documentation for data architectures and workflows Optimize data processing pipelines for performance and efficiency Conduct code reviews to ensure alignment to coding standards and best practices Solve and resolve complex technical issues related to data processing Stay updated with the latest advancements in data technologies and incorporate them into projects Drive innovation by exploring new tools and techniques in the research and development domain Communicate effectively with stakeholders to gather requirements and provide project updates Contribute to the overall success of the company by delivering high-quality data solutions that drive business value Qualifications Possess strong expertise in Cloudera HUE and Cloudera Data Platform Demonstrate proficiency in Apache Iceberg and Spark Have extensive experience with PySpark for data processing Show a solid understanding of data architecture and data engineering principles Exhibit excellent problem-solving skills and attention to detail Have a background in research and development is a plus Display strong communication and collaboration skills Be able to work effectively in a hybrid work model Have a proactive approach to learning and staying current with industry trends Be capable of mentoring and guiding junior team members Demonstrate the ability to deliver high-quality solutions within deadlines Show a commitment to continuous improvement and innovation Possess a strong sense of ownership and accountability for project outcomes. Appreciate your time. "Centraprise is an equal opportunity employer. Applicants must be authorized to work in the U.S. U.S. citizens and Green Card holders are strongly encouraged to apply." Thanks & Regards Basavaraj | Talent Acquisition Associate Centraprise Corp 33 Wood Avenue South, Suite 600, Iselin NJ 08830 Direct Desk : +1 848-209-8309 Email: [email protected] Connect me on LinkedIn: linkedin.com/in/basavaraj-n-methre-720b55223 Keywords: Illinois New Jersey Big Data PySpark Tech Lead - Chicago - Mattawa, IL - Day 1 Onsite [email protected] |
| [email protected] View All |
| 01:04 AM 12-Mar-25 |