| Azure Data Bricks at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2019539&uid= Position: Azure Data Bricks Location: Remote Duration: Long Term Job Summary We are seeking a skilled Azure Data Engineer with expertise in Databricks to design, develop, and maintain scalable data pipelines and solutions on the Azure platform. The ideal candidate will have hands-on experience with Azure Data Services, Databricks, and data engineering best practices to support data transformation, analytics, and business intelligence. Key Responsibilities Design and implement scalable data pipelines, workflows, and ETL processes using Azure Data Services and Databricks. Collaborate with data scientists, analysts, and business stakeholders to deliver end-to-end data solutions. Develop and optimize Spark jobs for data transformation and processing in Databricks. Integrate data from various sources, ensuring data quality, consistency, and security. Implement and manage Azure resources such as Data Lake, Data Factory, Synapse Analytics, and Azure SQL Database. Create and maintain technical documentation, including data architecture, workflows, and operational processes. Monitor and troubleshoot data pipelines, ensuring performance and availability. Implement DevOps practices for CI/CD and automation of data pipelines. Ensure compliance with data security and governance standards. Required Skills & Qualifications Experience: Minimum 10+ years in data engineering with at least 5+ years in Azure-based solutions. Databricks: Proficiency in developing and optimizing Spark jobs and workflows on Databricks. Azure Expertise: Hands-on experience with Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL Database, and other Azure services. Programming: Strong programming skills in Python, SQL, and experience with PySpark. Data Warehousing: Experience in designing and managing data lakes and data warehouses. ETL Processes: Proficiency in building robust ETL pipelines and workflows. DevOps: Familiarity with CI/CD pipelines using tools like Azure DevOps or Jenkins. Data Governance: Knowledge of data security, compliance, and governance principles. -- Keywords: continuous integration continuous deployment information technology California Azure Data Bricks [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2019539&uid= |
| [email protected] View All |
| 07:34 PM 17-Dec-24 |