| Big Data (Spark , Scala) :: NYC, NY (locals and nearby) :: Only H1B at NYC, New York, USA |
| Email: [email protected] |
|
Job Title: Big Data (Spark , Scala) Work Location: New York (locals and nearby location). Note: Only H1b Candidates with Passport No. "SparkScala is the primary job requirement Abinito knowledge would help as the work is to migrate Abinito graph to Spark Cloud knowhow is a big plus Knowledge Skills: 1 Experienced in Cloud Data Architecture and designing same based on business need and developing a migration strategy for data 2 Hands on Experience with SparkPython and Abinitio 3 Architected Developed All Ingestion Patterns Real Time Batch Structured Unstructured ImagesPDF for each data analytics platform 4 Strong analytical skills with a proven ability to understand and document business data requirements in complete accurate extensible and flexible logical data models data modeling tools 5 Able to facilitate discussions between Technology and business people recognize issues of conflict and inconsistency between data requirements and pursue a resolution of these issues 6 Evaluates and undertakes impact analysis on major design options for Spark jobs and assesses and leads associated risks 7 Design and Developed ETL Engineering Frameworks Low Code No Code and Intake frameworks 8 Leads modification and maintenance of data structures and associated components according to logical and physical design structures for large or complex systems 9 Crafts andor uses SystemofRecords SORs and identify data reuse 10 Deep Technical knowledge of DBMS products and ecosystem eg storage formats access algorithms data management processes administration data maintenance replication high availability encryption etc 11 Ability to monitor and tune databases and DBMSs to reach high performance eg use data monitoring and analysis tools tune configuration parameters alter physical designs benchmark etc 12 Takes part in reviews of own work and leads reviews of colleagues work 13 Has working knowledge of the range of tools used in the planning analyzing crafting building testing configuring and maintaining of assigned applications 14 Able to participate in assigned teams Agile delivery methodology 15 Understands and has practical experience with infrastructure technologies and components like servers jvms and networking concepts 16 Application of industry best practices processes and standards 17 Identifies a number of ways to do things differently that will continuously improve the product 18 Understands the complete vertical platform environment technical stack Everyone needs to be wellequipped with Spark job design should be proactive enough to perform RDs assess best architecture options etc and should be handson Developers who can write Speak and deliver against a given backlog is not good enough need people who has experience in Spark migration familiar with challenges can proactively recommendimplement best practices Thanks, Ahsan Khan -------------------------------------- Senior Technical Recruiter [email protected] -- Keywords: information technology Big Data (Spark , Scala) :: NYC, NY (locals and nearby) :: Only H1B [email protected] |
| [email protected] View All |
| 01:58 AM 21-Jan-25 |