| C2C with Persistent (Backfill Role--Immediate Interview)---Lead Data Engineer --- Tarrytown, NY (Fully Onsite--Local Consultant prior)------Required 12+ Years experience---CPT/OPT Won't work at Tarrytown, New York, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=498574&uid= Hi , Hope you are doing well !! I am having a wonderful Job opportunity please go through the Job description below and let me know if you have relevant candidate for this role. Passport number is must at the time submission for H1B/GC-EAD/H4EAD Role : Lead Data Engineer Location : Tarrytown, NY (Fully Onsite) Duration : C2C Experience : 12+ Years Candidate should have Here are the key expectations from the tech perspective: Primary skills are PySpark, RedShift, Airflow, AWS Must have in-depth understanding of how data pipelines are built Typical challenges with fetching data from various sources. How incremental/CDC data flows are handled. How do you ensure data quality How do you do Data profiling Hands-on experience with Pyspark, Redshift (SQL) and Airflow at minimum Should be able to design and document data model at various levels Job Description: Candidate should have 12+ years of experience in Data Engineering Designing, creating, testing and maintaining the complete data management & processing systems. Working closely with the stakeholders & solution architect. Building highly scalable, robust & fault-tolerant systems. Knowledge of Hadoop ecosystem and different frameworks inside it HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and Kafka Must have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift, Apache Airflow and EMR Must have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB) Should have Python/Scala/Java Programming skills Discovering data acquisitions opportunities Finding ways & methods to find value out of existing data. Improving data quality, reliability & efficiency of the individual components & the complete system. Problem solving mindset working in agile environment Best Regards, Ghufran Mansoori (SAM) Sr. Technical Recruiter Quantum World Technologies Inc. 4281 Katella Ave, Suite # 102 Los Alamitos, CA, 90720 www.quantumworldit.com E: [email protected] Desk: (805) 222 0532, EXT- 220 Direct: (706) 607 3338 Linkedin: linkedin.com/in/gufran-mansoori-sam-a3ba34227 -- Keywords: access management database information technology golang green card California New York http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=498574&uid= |
| [email protected] View All |
| 12:47 AM 09-Aug-23 |