| Regarding Sr. Databricks Lead In Location: Dallas, TX at Dallas, Texas, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=3463831&uid=974b4affc494474a8cceca615319105c From: krishnakant Upadhyay, Valzosoft [email protected] Reply to: [email protected] Sr. Databricks Lead Dallas, TX Role Descriptions: Sr. Databricks Lead Job role and Responsibilities A Sr. Databricks Developer designs| builds| and optimizes big data ETLELT pipelines using PySpark| SQL| and Delta Lake within cloud environments (Azure| AWS| or GCP). Key ResponsibilitiesKey responsibilities include creating scalable data solutions| optimizing Spark jobs| and managing data workflows to support analytics. Required skills include proficiency in Python SQL| Spark| and experience with data warehousing concepts. Pipeline Development Design| develop| and maintain robust| scalable ETLELT data pipelines using Databricks and PySpark. Data Processing Work with structured and unstructured data| utilizing Delta Lake for efficient storage and management. Optimization Perform performance tuning and optimization on Databricks clusters and Spark jobs for cost-efficiency. Orchestration Use tools like Azure Data Factory (ADF) or Airflow for workflow orchestration and scheduling. Integration Integrate Databricks with cloud data sources (Azure Data Lake Gen2| S3) and BI tools. Data Quality Security Implement data quality checks| validation| and security protocols. Required Skills Qualifications Technical Skills Expert-level knowledge of PySpark| Apache Spark| and SQL.Cloud Platforms Hands-on experience with Azure Databricks (most common)| AWS Databricks| or GCP. Data Engineering Strong understanding of Data Modeling| ETLELT patterns| and Data Warehousing concepts. Tools Languages Python| Azure Data Factory (ADF)| Delta Lake| GitAzure DevOps. Experience 6-8 years of experience in data engineering or software development. Regards, Krishnakant Upadhyay Phone :- 404-282-9268 Sr. Technical Recruiter Valzo Soft Solutions Email ID: [email protected] Keywords: business intelligence sthree information technology Idaho Texas Regarding Sr. Databricks Lead In Location: Dallas, TX [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=3463831&uid=974b4affc494474a8cceca615319105c |
| [email protected] View All |
| 10:03 PM 19-Jun-26 |