| Data engineer with Databrick exp. local to MN at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1320371&uid= From: Pranjali Sikarwar, Technocraft Solutions [email protected] Reply to: [email protected] Hello, Hope you are doing well! My name is Pranjali and I'm associate recruiter at Technocraft solutions. We provide IT Consulting Services to our customers immediate and long-term resource needs. I am contacting you either because your resume has been posted to one of the internet job sites to which we subscribe or you had previously submitted your resume to Technocraft solution. Position: Databricks Platform Engineer/Architect Location: Hybrid/Remote At Dever or Minneapolis, MN Duration of Assignment: 3 months contract to hire Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. Collaborating with data engineers, data scientists, and stakeholders, you'll ensure the platform aligns with requirements while maintaining security and performance standards. Job Description: Configure, deploy and maintain Databricks clusters and workspaces. Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources. Ensure consistency and repeatability by treating infrastructure as code Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance. Implement and manage access controls and security policies to protect sensitive data. Manage platform feature and software releases and updates. Provide technical support to Databricks users, including troubleshooting and issue resolution. Conduct training sessions to educate users on platform best practices and capabilities. Optimize cluster configurations for performance and cost-effectiveness. Monitor and manage auto-scaling to ensure resources are allocated efficiently. Implement and enforce security policies, access controls, and encryption mechanisms. Stay up-to-date with security best practices and compliance requirements. Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability. Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes. Monitor and manage platform costs, including optimizing resource utilization to control expenses. Maintain detailed documentation of configurations, procedures, and best practices. Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions Minimum Qualifications: Bachelor's degree in a relevant field (computer science, data engineering, etc.) 8+ years of related professional experience. 5+ years' experience with Databricks Lakehouse Platform Architecture on AWS Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps Proficiency in AWS cloud platforms Experience in Utility and Energy related business is a plus. Professional Competencies: Integrity and Trust Customer Focus Functional/Technical skills Written/Oral Communication Excellent analytical and problem-solving skills. Ability to adapt to different projects and assignments quickly. Team player with strong communication skills Certifications : AWS/Databricks Keywords: continuous integration continuous deployment access management information technology Minnesota Data engineer with Databrick exp. local to MN [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1320371&uid= |
| [email protected] View All |
| 03:35 AM 18-Apr-24 |