| Urgent need Senior Data engineer Remote at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=258321&uid= From: Pranayanee Sahoo, Siaraa technologies [email protected] Reply to: [email protected] Hello, Hope you are doing well!! I am Pranayanee, a part of the Recruitment Team at Siaraa Technologies. We have following opportunity with one of our clients. Please share qualified resumes if you have any. IMPORTANT NOTE: Need 10+ Years total work experience & LinkedIn is Must NO USC/GC Please Need Passport No., If employers/Candidate is not comfortable to share. Please do not send the profiles. Roles : 2 (1 - Senior Data Engineer and 1 Data Engineer) Location : EST and CST candidates only (Remote role) Experience : 10+ Years Role Description: Data Engineer (AWS) The ideal candidate is a hands-on technology developer with experience in Apache Sqoop, MapR and able to perform an intelligent monitoring of batch jobs from the upstream systems. Perform data quality checks, developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and responsibilities Create batch jobs and processing using Apache Sqoop, fine tune of the batch jobs to improve the performance Perform intelligent monitoring of these batch jobs to check the job status and resource utilization Able to perform Data Quality checks and Validation rules at every stage of data processing Experience working with different source file types like PARQUET, AVRO, CSV, JSON, XML etc Hand on experience with pySpark, Apache Spark Strong Programming skills in languages such as Scala & Python Experience of using Code Versioning and Build Process tools like GIT Self-motivated and self-driven individual who can work against tight timelines Prioritize across multiple tasks and manage time effectively Learn new technologies as per the demand in the project Develop solutions to challenging complex business problems Effectively communicate with team members, project managers and clients, as required Search Keywords: AWS, ETL, Data Integration, PL/SQL, Scala, Apache Sqoop, Big Data PySpark Technical skills requirements The candidate must demonstrate proficiency in, Developing, Debugging and Deploying ETL Jobs using one of the ETL Tools like AWS Glue / Spark / Hive / AWS Athena etc. Experience in extracting transforming & loading data from heterogeneous data sources like Oracle, SQL Server, SAP, MySQL, DB2, excel/CSV/Text/Log files etc. Analyzing source system data and data flows, working with structured and unstructured data. Experience in data warehouse design and best practices. Strong development experience in Big Data using Apache Spark, MapR, Sqoop Proficient in Scala Programming, SQL programming Tuning of the batch jobs to improve the performance Proficient in Developing and Debugging complex SQL queries Intelligent Monitoring of the jobs to check the job status and resource utilization Scaling of the jobs to handle large data and to meet the execution time requirement Application of Data Quality and Validation rules at every stage of data processing Migration of data and platform to AWS cloud Nice-to-have skills Exposue with APIs, Rest API Distributed Transactions Fine tuning and optimization of ETL jobs Unix or scripting Qualifications 10+ Years of relevant work experience in IT/ITES industry B.Tech., M.Tech. or MCA degree from a reputed university Thanks, and regards Pranayanee Sahoo Technical Recruiter USA : +1 3153651700 India - 9337263066 [email protected] www.siaraatechnologies.com 103 College Road E, Princeton, New Jersey, 08540, USA 7111 Syntex Dr., Mississauga, ON, L5N 8C2, Canada The content of this email is confidential and intended for the recipient specified in the message only. It is strictly forbidden to share any part of this message with any third party, without the written consent of the sender. If you received this message by mistake, please reply to this message and follow with its deletion, so that we can ensure such a mistake does not occur in the future. Keywords: access management information technology green card http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=258321&uid= |
| [email protected] View All |
| 06:45 PM 09-Jan-23 |