| Azure DevOps DataOps Architect With Data Engineering projects at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=712561&uid= From: Pradeep, IDC Technologies [email protected] Reply to: [email protected] Hi, Greetings of the day!!! I have an urgent contract requirement below, please go through JD and let me know if you are comfortable or not. Kindly revert me back with your updated resume as well. Title: Azure DevOps/DataOps Architect With Data Engineering projects Location: REMOTE Duration: Long term Contract Required Experience: 12+ years. Key Notes: DataOps is data engineering CI/CD automation, so we need candidates with DevOps experience with a data engineering background in 1 or 2 DE projects. At the same time, the candidate shouldn't be a Data architect or Data engineer. Consultant must have implemented using Azure stack of data engineering tools like ADF, ADB, ARM templates, and other Azure security and networking configuration. Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Looking for someone who has Implemented Azure Devops on at least 2 projects. DevOps in the data area (Azure Data Factory, Databricks, etc.). Good communication skills Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses. Understanding of extract, load, transform (ELT) and extract, transform, load (ETL) tools. Using automation to streamline data processing to reduce development time and increase data reliability. Hands-on experience to automate manual processes, such as data extraction and testing. Hands-on experience managing the production of data pipelines. Communicate and collaborate with other data and BI team members to enhance the quality of data products. Hands-on experience with Design, Develop and Executing automated testing at every stage of a pipeline to increase productivity while reducing errors. This includes unit tests (testing separate components of a data pipeline) as well as performance tests (testing the responsiveness) and end-to-end tests (testing the whole pipeline). Hands-on experience with testing and adopting solutions and tools that adhere to the DataOps best practices. Hands-on experience handling security and ensure data security standards are applied across the data pipelines. Hands-on skills on IaC Automation to improve development and deployment processes. Implement DevOps for data process for the pilot scope including code repository folder structure and Branching Strategy Deploy DevOps for data pipelines, SQL Artifacts, and all components for the Pilot Scope Work with Infrastructure Engineer for IaC design and development of static and dynamic components including KMS, Secrets Roles, Policies, Clusters, Pipelines, DDL/DML, etc. Establish end to end CI/CD pipelines for all artifacts Migrate dev code to QA using the DevOps Framework Integration testing of DevOps for data framework in the QA environment Update DevOps for data Track documentation as necessary Thanks & Regards, Pradeep Sharma Team Lead IDC Technologies, Inc. Cell: 408-684-1721 Email: [email protected] Website: www.idctechnologies.com Keywords: continuous integration continuous deployment quality analyst business intelligence information technology golang Delaware http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=712561&uid= |
| [email protected] View All |
| 06:50 PM 04-Oct-23 |