| Big Data Engineer (Databricks Administrator) - Local to GA at Atlanta, Georgia, USA |
| Email: [email protected] |
|
From: Shivam Pachauri, Tek inspirations LLC [email protected] Reply to: [email protected] Job Description - Job Title: Big Data Engineer (Databricks Administrator) LOCATION: Atlanta, GA Hybrid Need Local with DL Duration: 12+ Months LinkedIn Required Need Senior Candidates about 12+ Candidates Big Data Engineer (Databricks Administrator) Responsibilities will include designing, implementing, maintaining databricks platform, and providing operational support. Operational support responsibilities include platform set up and configuration, workspace administration, resource monitoring, provide technical support to data engineering, Data Science/ML, Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues. The position will also involve management of security and changes. The position will work closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts. This position will involve participation in on-call rotation for 24/7 support. Responsibilities: Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization. Collaborate with data engineering team to ingest, transform, and orchestrate data. Manage privileges over the entire Databricks account, as well as at workspace level, Unity Catalog level and SQL warehouse level. Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions. Install, configure, and maintain Databricks clusters and workspaces. Maintain Platform currency with security, compliance, and patching best practices. Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance. Implement and manage access controls and security policies to protect sensitive data. Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions. Administer interfaces with Azure AD and Amazon AWS. Hadoop admin skills are preferred Knowledge about Apache Kafka is desirable Skills & Experience 5+ years of production support of Databricks platform 2+ years AWS/Azure PaaS 2+ years of automation framework such as Terraform 2+ years of Hadoop administration (Cloudera/Hortonworks) 2+ years of Apache Kafka streaming platform administration Thanks & Regards, Shivam Pachauri Technical Recruiter TEK Inspirations LLC | 13573 Tabasco Cat Trail, Frisco, TX 75035 E: [email protected] Linkedin: linkedin.com/in/shivam-pachauri-97b754296 Keywords: machine learning active directory Georgia Texas Big Data Engineer (Databricks Administrator) - Local to GA [email protected] |
| [email protected] View All |
| 09:41 PM 25-Mar-24 |