| AWS Architect with Airflow Experience at Remote, Remote, USA |
| Email: [email protected] |
|
From: DEBASISH PATTNAIK, MRTECHNOSOFT [email protected] Reply to: [email protected] Job Title: AWS Architect with Airflow Experience Boston MAJob Description We are seeking a highly skilled AWS Architect with expertise in Apache Airflow to design, develop, and implement scalable and robust cloud solutions. The ideal candidate will have a deep understanding of AWS services, data engineering pipelines, and orchestration frameworks like Airflow. This role involves collaborating with cross-functional teams to deliver cloud-based solutions that optimize performance, reliability, and scalability for data workflows and applications.Responsibilities Design and implement cloud architecture using AWS services such as EC2, S3, Lambda, RDS, Redshift, EMR, and Glue. Develop and maintain data pipelines using Apache Airflow and integrate with AWS-native services. Orchestrate and automate complex workflows and data pipelines to ensure seamless data operations. Optimize existing cloud infrastructure for cost, performance, and scalability. Collaborate with data engineers, software developers, and DevOps teams to deliver end-to-end solutions. Ensure security and compliance best practices across all AWS resources. Monitor, troubleshoot, and improve the performance of Airflow DAGs and AWS workflows. Provide technical leadership and mentorship to team members in cloud architecture and orchestration.Required Skills and Experience 10+ years of experience in IT with at least 5+ years as an AWS Cloud Architect. Strong hands-on experience with Apache Airflow for orchestrating data workflows. Expertise in AWS services including, but not limited to, S3, Lambda, Glue, RDS, EMR, Redshift, and CloudFormation. Proficient in scripting/programming languages such as Python or Java. Strong understanding of data pipelines, ETL processes, and big data frameworks. Experience with CI/CD pipelines, Terraform, and CloudFormation templates. Knowledge of IAM roles, policies, and AWS security best practices. Familiarity with containerization and orchestration tools like Docker and Kubernetes. Excellent problem-solving skills and the ability to troubleshoot complex workflows. Thanks Debasish Pattnaik [email protected] www.mrtechnosoft.com Keywords: continuous integration continuous deployment sthree information technology AWS Architect with Airflow Experience [email protected] |
| [email protected] View All |
| 10:00 PM 14-Jan-25 |