| Python Pyspark & Data Bricks at Remote, Remote, USA |
| Email: [email protected] |
|
From: Rishav Verma, Tanisha Systems Inc [email protected] Reply to: [email protected] Greetings, My name is Rishav and I'm an IT recruiter at Tanisha Systems Our records show that you are an experienced IT professional with experience in Python Pyspark & Data Bricks . This experience is relevant to one of my current openings. The opening requires good communication skills in addition to the above skills. It is in Jersey City, NJ (5 Days Onsite) Job Type :: Contract Job Title:- Python Pyspark & Data Bricks Location: Jersey City, NJ (5 Days Onsite) Need locals and 12+ years candidate for C2C Need locals and 10+ years candidate for W2 Required Skills: Experience with Databricks PySpark & Python is must Job Description: Duties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS data platform into Chases environment Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives Build libraries to standardize how we process data Loves to teach and learn, and knows that continuous learning is the cornerstone of every successful engineer Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and is able to intelligently convey such knowledge Implement automation on applicable processes Mandatory Skills: 8+ years of experience in a data engineering position Proficiency is Python (or similar) and SQL Strong experience building data pipelines with Spark Strong verbal & written communication Strong analytical and problem solving skills Experience with relational datastores, NoSQL datastores and cloud object stores Experience building data processing infrastructure in AWS Bonus: Experience with infrastructure as code solutions, preferably Terraform Bonus: Cloud certification Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or Delta Lake Bonus: Familiar with data observability solutions, data governance frameworks Requirements Bachelors degree in computer science/Programming or similar is preferred Right to work Thanks & Regards Rishav Verma Sr. Technical Recruiter Tanisha Systems Inc. [99 Wood Ave South Suite # 308, Iselin, NJ 08830] Office Number: 732-490-4608 | Ext: 429 Email: [email protected] LinkedIn: https://www.linkedin.com/in/rishav-verma-93783b172/ Web: www.tanishasystems.com Keywords: information technology wtwo New Jersey Python Pyspark & Data Bricks [email protected] |
| [email protected] View All |
| 11:44 PM 02-Dec-24 |