| Data Engineer (Spark, Airflow, GCP) @ Bentonville, AR (Remote) at Bentonville, Arkansas, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2120465&uid= Must have - Spark, Airflow, GCP Job Title: Data Engineer Location: Bentonville, AR (Remote) Job Description: Designing and Building ETL pipeline using Sqoop, Hive, Map Reduce and Spark on on-prem and cloud environments. Functional Programming using Python and Scala for complex data transformations and in-memory computations. Using Erwin for Logical/Physical data modeling and Dimensional Data Modeling. Designing and developing UNIX/Linux scripts for handing complex File formats and structures. Orchestration of workflows and jobs using Airflow and Automic. Creating Multiple Kafka producers and consumers for data transferring Performing Continuous Integration and deployment (CI/CD) using tools like GIT, Jenkin to run test cases and build applications with code coverage using Scala test. Analyzing data using SQL, Big Query monitoring the cluster performance, setting up alerts, documenting the designs, workflow. Providing production support, troubleshooting, and fixing the issues by tracking the status of Running applications to perform System Administrator tasks. Regards, Adil Musawwir E: [email protected] Disclaimer: The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only. E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e-mail and its contents (with or without referred errors) shall therefore not attach any liability on the originator or Excelon Solutions LLC or its affiliates. Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the views or opinions of Excelon Solutions LLC or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of this message without the prior written consent of authorized representative of Excelon Solutions LLC is strictly prohibited. This communication is intended only for the use of the addressee(s) and contains information that is PRIVILEGED AND CONFIDENTIAL. Unauthorized reading, dissemination, distribution, or copying of this communication is prohibited. -- Keywords: continuous integration continuous deployment information technology Arkansas Data Engineer (Spark, Airflow, GCP) @ Bentonville, AR (Remote) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2120465&uid= |
| [email protected] View All |
| 09:55 PM 28-Jan-25 |