| Snowflake with AWS Data Engineer - Onsite at Chicago, IL at Chicago, Illinois, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=548484&uid= From: Roopendra Reddy, Stacknexus [email protected] Reply to: [email protected] Role Description Title : AWS Data Engineer Location : Onsite at Chicago , IL Primary Responsibilities: As a AWS Data Engineer, primary responsibilities will be Design, develop and support AWS based data lake and data warehouse solution Develop process flows using Python, DataFrames, Pyspark for Data ingestion, validation, enrichment and extraction services. Experience with Python modules such as Pandas/Unit test and SonarQube Writing effective, scalable code and testing code in Python Experience automating code testing and pipelines Develop and support batch and real-time data pipelines built using AWS Serverless services Develop and configure S3, Athena, Lambda, Glue, Dynamo DB, Kinesis and SQS related components. Develop framework to perform Extract, transform, and load data from a wide variety of SQL and No-SQL data sources Perform unit testing and Integration testing using SonarQube and implement quality validation rules defined by Stake holders Work hand in hand with Data Modelers, Data Developers, and Business SMEs to ensure the data needs and business rules are accurately captured, understood and delivered. Experience in DevOps: GIT, pipeline deployment like: Azure DevOps pipelines, Jenkins, GitLab, CircleCi, etc. Nice to have Snowflake: Snowpark, procedures, tasks, views. Keywords: sthree database Illinois http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=548484&uid= |
| [email protected] View All |
| 06:57 PM 21-Aug-23 |