| PySpark Developer with AWS EMR at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=458887&uid= From: Gourav, Siriinfo [email protected] Reply to: [email protected] Hello, Hope you are doing well!! Greeting from Siri Info Solutions. I am Gourav Sharma From Siri Info Solutions. Siri Info Solutions is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients. Job Title: PySpark Developer with AWS EMR Experience Location : Remote In EST Time zone Technical/Functional Skills (Mandatory skills): 5+ years of experience in programming with python. Strong proficiency in python Familiarity with functional programming concepts 3+ years of Hands on experience in developing ETL data pipelines using pyspark on AWS EMR Hands on experience of XML processing using python Good understanding of Sparks RDD API Good understanding of Sparks Dataframe and API Experience in configuring EMR clusters on AWS Experience and good understanding of Apache Spark Data sources API. Experience of dealing with AWS S3 object storage from Spark. Experience in trouble shooting spark jobs. Knowledge of monitoring spark jobs using Spark UI Performance tuning of Spark jobs. Nice to have skills: Knowledge of AWS SDK CLI Experience of setting up continuous integration/deployment of spark jobs to EMR clusters Knowledge of scheduling spark applications in AWS EMR cluster. Understanding the differences between Hadoop Mapreduce and Apache Spark Proficient understanding of code versioning tools as Git, SVN Roles & Responsibilities: Design, development and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with customer. Be a team player and willing to work in an onsite offshore model, mentor other folks in the team (onsite as well as offshore) Best Regards, Gourav Sharma | Lead Technical Recruiter SIRI INFO SOLUTIONS INC Email id : [email protected] Desk No: 7325646221 www.siriinfo.com 3 Ethel Rd, Suite # 302 Edison NJ 08817 Keywords: user interface access management sthree Idaho New Jersey http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=458887&uid= |
| [email protected] View All |
| 03:55 AM 28-Jul-23 |