Urgent Requirment || DataOps / Databricks Architect || Seattle, Washington || Not H1B at Seattle, Washington, USA |
Email: [email protected] |
Hi , Hope you are doing well. We are looking for DataOps / Databricks Architect to fill its Long-Term Contract position. If you are interested, please reach out to me on [email protected]/ 9732409524 to discuss more about the position. Job Title: DataOps / Databricks Architect Location: Seattle, Washington Job Description DataOps / Databricks Architect Duration: 6-12 months Key/critical components .strong Databricks experience with Unity Catalogs, sharing data across multiple accounts, cluster management borderline Databricks Architect. Also need to have Terraform or other IaC experience. I called it DataOps because thats what it feels like or a super strong data driven DevOps. Who understands the infrastructure and architecture. Client has been struggling to find people who are deep enough with Databricks. They all seem to have experience with it, but not architect type. Data Platform Infrastructure (Data Infrastructure resources 1-2) Capacity planning, configure, deploy and maintain Databricks clusters, workspaces and Snowflake infrastructure on Azure cloud Use Terraform to automate provisioning and deploy Databricks clusters, workspaces, Snowflake and associated Azure resources. Ensure consistency and repeatability by treating infrastructure as code Monitor and optimize Databricks cluster performance and Snowflake resource utilization, troubleshoot issues to ensure optimal performance and cost-effectiveness. Implement and manage access controls and security policies to protect sensitive data. Develop environment strategies across the technology stack and governance based on best practices Provide technical support to Databricks and Snowflake users, including troubleshooting and issue resolution. Implement and enforce security policies, RBAC, access controls, and encryption mechanisms. Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability. Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions Data Governance and Quality Management: Create and enforce data governance standards, ensuring robust data quality and compliance through tools such as Databricks Unity Catalog, Collibra and Snowflake Polaris. Enforce data governance, data quality, and enterprise standards, supporting a robust production environment . Required Experience: Experience in Data Platform Engineering: Proven track record in architecting and delivering cloud-native data solutions on Azure using Terraform Infrastructure as Code. Proficiency in Azure, Databricks and Snowflake: Strong skills in data warehousing and lakehouse technologies with hands-on experience in Azure, Databricks, Delta Lake and Snowflake Tooling Knowledge: Experience with version control (GitHub), CI/CD pipelines (Azure DevOps, GitHub Actions), data orchestration and dashboarding tools -- Keywords: continuous integration continuous deployment information technology Urgent Requirment || DataOps / Databricks Architect || Seattle, Washington || Not H1B [email protected] |
[email protected] View All |
10:48 PM 31-Jan-25 |