Senior Azure Databricks Engineer- Remote at Remote, Remote, USA |
Email: [email protected] |
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2148622&uid= Job Title: Senior Azure Databricks Engineer Location: Baltimore Metro / Washington DC Metro (Remote) Job Summary We are seeking a skilled and experienced Senior Databricks Engineer to join our team. This role is pivotal in designing, developing, and managing scalable data solutions, ensuring seamless data migration, modeling, and analytics within the Azure Databricks environment. The ideal candidate will possess a strong technical background in data engineering, be adept at using Databricks on Azure, and thrive in an Agile, collaborative team setting. Preference is given to candidates in the Baltimore Metro and Washington DC Metro areas. Key Responsibilities: Design, develop, and maintain Python-based data pipelines using Azure Databricks to ensure scalable and efficient data processing. Operationally monitor and maintain data pipelines to ensure reliability and performance within the Azure Databricks environment. Collaborate with internal team members to analyze and optimize existing software programs and processes. Lead data management, integration, analytics, and migration projects, ensuring accuracy and integrity throughout the transition. Model and manage data within the Azure Databricks environment, aligning with business needs and objectives. Design and implement advanced analytics and Machine Learning (ML) using Azure Databricks for prediction, forecasting, regression, clustering, classification, etc. Assist in implementing new technologies to enhance data solutions and processes in the Azure environment. Develop roadmaps and tools to monitor and guide technology usage across projects. Troubleshoot and resolve data-related challenges, providing innovative technology solutions for complex business problems. Drive continuous improvement initiatives within the data engineering domain. Provide routine data extraction and reporting for internal teams and clients. Document processes, workflows, and solutions to ensure clarity and maintainability. Leverage DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure. Qualifications Education and Experience: Bachelors degree in Computer Science, Programming, or Management Information Systems. At least 8 years of experience in computer science/programming or management information systems, including design, development, implementation, data management, and data analytics. Minimum of 5 years of hands-on experience with Azure Databricks. Experience with DevSecOps practices. Technical Skills: Proficiency in Python-based data pipeline development. Expertise in data migration, advanced analytics, modeling, and management within Azure Databricks. Knowledge of DevOps practices and tools. Experience with Agile methodologies and tools such as Jira. Familiarity with Azure Blob Storage, Azure Synapse Analytics, and other Azure services is a plus. Certification: Databricks Certification (preferred). Azure Data Engineer certification is a plus. Soft Skills: Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. Ability to work effectively in a fast-paced, team-oriented environment. Must have been in the United States for a minimum of 3 years. -- Keywords: continuous integration continuous deployment machine learning information technology Senior Azure Databricks Engineer- Remote [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2148622&uid= |
[email protected] View All |
02:21 AM 06-Feb-25 |