| Snowflake Data Engineer with Airflow at Snowflake, Arizona, USA |
| Email: [email protected] |
|
Processing description: http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1190517&uid= Hello , Hope you are doing well...!!! My name is Nikhil and I represent Virtual Networx Inc., a staff augmentation firm providing a wide-range of talent on-demand and Contingent workforce solutions. We have excellent domain expertise in all verticals. Repositioning professionals is what we do, and we do it very well. We have an immediate job opportunity with our premier client. Below is the job description and if you feel you are suitable for this role, please share you updated profile to ( [email protected]) LinkedIn: linkedin.com/in/nikhil-reddy-ankila-9431b3140 Please share profile to [email protected] Role : Snowflake Data Engineer with Airflow Location : Chicago, IL (On-Site / Hybrid) Duration : 12+ Months Experience : 10+ Years Responsibilities: Design, implement, and maintain data pipelines on Snowflake, ensuring scalability, reliability, and performance. Develop and optimize data ingestion processes from various sources, including Azure Blob Storage, Azure Data Lake, databases, APIs, and streaming data sources. Implement data transformation workflows using SQL, Python, and Airflow to cleanse, enrich, and aggregate raw data for downstream consumption. Collaborate with data scientists and analysts to understand data requirements and implement solutions that enable advanced analytics and machine learning. Design and implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements. Perform performance tuning and optimization of Snowflake data warehouse, including query optimization, resource management, and partitioning strategies. Develop monitoring, alerting, and logging solutions to ensure the health and availability of data pipelines and Snowflake infrastructure. Stay up to date with the latest trends and technologies in data engineering, cloud computing, and workflow orchestration, and recommend relevant tools and practices to enhance our data infrastructure. Qualifications: Bachelors degree in computer science, Engineering, or a related field (or equivalent work experience). Minimum of 8years of experience working as a Data Engineer, with a focus on cloud-based data platforms. Strong expertise in Snowflake data warehouse, including experience with Snowflake architecture, SQL, and performance optimization. Hands-on experience with Azure cloud platform, including Azure Blob Storage, Azure Data Lake, and Azure SQL Database. Proficiency in workflow orchestration tools such as Apache Airflow, including DAG definition, task scheduling, and error handling. Experience with data modeling concepts and techniques, including dimensional modeling and data warehousing best practices. Strong programming skills in SQL and Python, with experience in data manipulation, transformation, and analysis. Solid understanding of data governance, security, and compliance requirements, particularly in a regulated industry. Excellent problem-solving skills and the ability to troubleshoot complex issues in data pipelines and infrastructure. Strong communication skills and the ability to collaborate effectively with cross-functional teams. Keywords: information technology Illinois http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1190517&uid= |
| [email protected] View All |
| 11:37 PM 06-Mar-24 |