Opening for Azure Data Cloud Developer (Cloud and Airflow) Location: Minneapolis, MN - (Remote) at Minneapolis, Minnesota, USA |
Email: [email protected] |
From: Rahman, Webster Tech Solutions INC [email protected] Reply to: [email protected] Position: Azure Data Cloud Developer (Cloud and Airflow) Location: Minneapolis, MN - (Remote) Job Details: Cloud & Data Pipeline Development: Design, develop, and deploy scalable cloud-based applications and data pipelines using Azure services (Azure Data Factory, Azure Functions, Azure Kubernetes Service, etc.). Implement Apache Airflow DAGs for scheduling and orchestrating complex data workflows. Optimize data extraction, transformation, and loading (ETL/ELT) processes for high performance. Ensure fault tolerance, scalability, and monitoring of cloud-based applications. Airflow Workflow Orchestration: Develop and manage Apache Airflow DAGs to automate data workflows. Integrate Airflow with Azure Data Services, SQL, and cloud storage. Monitor, troubleshoot, and optimize Airflow performance and dependencies. DevOps & CI/CD Automation: Implement CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins for automated deployments. Manage infrastructure as code (IaC) using Terraform, ARM templates, or Bicep. Automate cloud resource provisioning and application deployments. Ensure logging, monitoring, and alerting using Azure Monitor, Application Insights, or Prometheus. Security & Compliance: Implement role-based access control (RBAC), encryption, and cloud security best practices. Ensure compliance with industry security standards (ISO, SOC, GDPR). Optimize cost and resource utilization across cloud environments. Keywords: continuous integration continuous deployment Minnesota Opening for Azure Data Cloud Developer (Cloud and Airflow) Location: Minneapolis, MN - (Remote) [email protected] |
[email protected] View All |
03:22 AM 01-Mar-25 |