| Data Engineer at Baskin, NJ (Day 1 onsite) at Day, New York, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=755858&uid= Job Title : Data Engineer Lead (Bigdata Production support) Location : Baskin, NJ (Day 1 onsite) Duration : 12+ months Job Description : Responsibilities: Monitor production jobs for P1 system (Data Management and Reporting DMR). Debug and restart in the event of production failures. Acknowledge, respond and resolve production issues. Understand change requests / enhancements requests. Design and developed data loading strategies. Build, develop, testing shared components that will be used across modules. Extract source data files, stage, transform and load into EERA system (PostGres SQL) Ingest data from Mainframe system using Kafka and load into EERA. Extract source data files, stage, transform and load into BDS system (Hive based) Use Apache Spark for large data processing integrated with functional programming language Scala Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email. On call support during weekend Handshake with offshore team on daily / need basis. Mandatory Skills: Scala, Spark, Hadoop, Kafka Postgres SQL Hive Airflow (or Control M / Oozie) Kubernetes (or equivalent containerization tool) Agile Strong architecture, design & coding skills Experience in production operations and support Experience in distributed databases Nice to have skills Java as some of the UI applications are built in Java. Resource should know Java fundamentals. Thanks & Regards, Akanksha Done Ph: 9015043481 Agile Enterprise Solutions Inc. 7460 Warren Pkwy,Suite 100, Frisco, TX 75034. Email: [email protected] Website: www.aesincus.com -- Keywords: user interface information technology New Jersey Texas http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=755858&uid= |
| [email protected] View All |
| 10:48 PM 16-Oct-23 |