| Databricks Support Engineer::Chicago, IL - Hybrid::6+ months-USC-Locals at Chicago, Illinois, USA |
| Email: ap@susinfotek.com |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2078828&uid= From: AMIT, SUS ap@susinfotek.com Reply to: ap@susinfotek.com Position: Databricks Support Engineer Location: Chicago, IL - Hybrid Duration: 6+ months Phone and Video REQUIRED SKILLS Machine Learning Exposure Need a Databricks SME! Need a strong Databricks engineering skills , they have machine learning pipelines pulling data from BigQuery doing modeling and imprints and pushing it back to BigQuery (Mandatory) - Supporting day to day databricks jobs, troubleshooting databricks pipelines, debugging Python/SQL code. (basic knowledge) - Databricks admin: Cluster management, cluster policies (add on) - Machine learning pipelines using mlFlow in Databricks Day-to-Day Databricks Operations Support & Performance Tuning Regularly monitor the health and performance of Databricks jobs, clusters, and pipelines. Ensure that clusters are properly sized, running efficiently, and scaling as needed. Diagnose and resolve issues related to jobs, notebooks, and clusters, including performance bottlenecks, failures, and resource constraints. This often involves debugging both Python and SQL code used in Databricks environments. Provide support to data scientists, data engineers, and other users by helping them with their Databricks workspaces, job configurations, code issues, and cluster configurations. Respond to and resolve support tickets related to Databricks failures, performance degradation, connectivity issues, etc. Keep stakeholders informed about the status of incidents. Regularly analyze the performance of Databricks clusters and jobs, using Databricks' built-in monitoring tools (e.g., Spark UI, Ganglia, Databricks Metrics), and suggest improvements. Work with data teams to ensure that Spark jobs running in Databricks are optimized for speed, resource usage, and cost. Monitor and optimize costs by managing cluster scaling, idle time, and instance selection for both Databricks jobs and clusters. Regards, Amit Panthri Technical Recruiter E: ap@susinfotek.com Keywords: user interface information technology Illinois Databricks Support Engineer::Chicago, IL - Hybrid::6+ months-USC-Locals ap@susinfotek.com http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2078828&uid= |
| ap@susinfotek.com View All |
| 09:07 PM 14-Jan-25 |