Looking To Hire Snowflake Developer with Airflow to Astronomer Migration Experience , Cincinnati, OH at Cincinnati, Ohio, USA |
Email: dibyaranjan.sahoo@scalable-systems.com |
From: Dibyaranjan Sahoo, Scalable Systems dibyaranjan.sahoo@scalable-systems.com Reply to: dibyaranjan.sahoo@scalable-systems.com Job Title: Snowflake Developer with Airflow to Astronomer Migration Experience Requirement ID: 9346758 Location: TCS - Cincinnati, OH CINCINNATI Cincinnati, O Role Description: We are seeking a skilled Snowflake Developer with expertise in migrating Airflow to Astronomer. The ideal candidate will have a strong understanding of Snowflake architecture, design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse. They will possess hands-on development experience with Snowflake features such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time Travel, Zero-copy cloning, Optimizer, Metadata Manager, data sharing, and Stored Procedures. The role involves developing EL pipelines in and out of the data warehouse using a combination of Python and Snow SQL. The candidate should have a deep understanding of data pipelines and modern ways of automating them using cloud-based testing and should be able to clearly document implementations for easy understanding by others. Additionally, the candidate should be capable of working both independently and as part of a team. Responsibilities include the creation and deployment of Directed Acyclic Graphs (DAGs) in Astronomer, including migrating DAGs from lower environments to higher environments. Expertise in setting up internal and external dependencies of the DAGs in Astronomer, scheduling DAGs, and monitoring production systems is essential. Competencies: Digital: Snowflake Experience (Years): 4-6 Essential Skills: Strong understanding of Snowflake architecture, design, implementation, and operationalization of large-scale data and analytics solutions. Hands-on development experience with Snowflake features such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time Travel, Zero-copy cloning, Optimizer, Metadata Manager, data sharing, and Stored Procedures. Development of EL pipelines using Python and Snow SQL. Understanding of data pipelines and modern methods of automating them using cloud-based testing. Ability to work independently and as part of a team. Creation and deployment of DAGs in Astronomer. Expertise in setting up internal and external dependencies of DAGs in Astronomer. Experience with scheduling DAGs in Astronomer. Migration experience from Airflow DAGs to Astronomer. Proficiency in any scripting language, preferably Python. Experience with DataStage ETL tool is an added advantage. Expertise in monitoring production systems, handling incidents, and resolving problems within SLAs. Desirable Skills: (Repeated for emphasis) Country: United States Branch | City | Location: TCS - Cincinnati, OH CINCINNATI Cincinnati, OH Best Regards Dibyaranjan Sahoo US IT Recruiter Phone -7327883006 Email ID: dibyaranjan.sahoo@scalable-systems.com Scalable Systems | Inspiring Innovation Big Data | Analytics | Integration | Intelligence www.scalable-systems.com Keywords: information technology Idaho Ohio |
dibyaranjan.sahoo@scalable-systems.com View All |
08:43 PM 15-Feb-24 |