Senior Developer (Python, PySpark, Azure, Databricks) 12+ yrs at Minneapolis, Minnesota, USA |
Email: [email protected] |
Hello, Job Description: Senior Developer (Python, PySpark, Azure, Databricks) Location: Minneapolis, MN(Hybrid) About the Role: We are seeking a highly skilled and motivated Senior Developer to join our data engineering team. The ideal candidate will have strong expertise in Python, PySpark, SQL, and hands-on experience with Azure Powertools (Logic Apps, Azure CLI, etc.) and Databricks. You will play a key role in building scalable data solutions, optimizing data pipelines, and contributing to the overall data strategy. Key Responsibilities: Design, develop, and optimize ETL pipelines using PySpark, Databricks, and Azure Data Services. Develop and deploy scalable data models, transformations, and solutions using Python and SQL. Manage and orchestrate workflows using Azure Logic Apps and Azure CLI. Implement best practices for data governance, security, and monitoring. Collaborate with data scientists, business analysts, and other developers to understand and meet data processing needs. Ensure high performance, reliability, and scalability of data platforms and solutions. Automate data pipelines, deployments, and processes to increase system efficiency. Troubleshoot and resolve issues with data integrity, performance, and availability. Stay up-to-date with the latest tools, frameworks, and practices in data engineering and cloud services. Required Skills and Qualifications: 5+ years of experience in software or data engineering. Strong programming skills in Python and distributed data processing with PySpark. Proficiency in SQL for data manipulation, optimization, and analysis. Hands-on experience with Azure services, including: o Logic Apps o Azure CLI o Azure Storage (Blob, Data Lake) Expertise in Databricks for data integration, transformation, and analysis. Experience in designing and managing ETL pipelines and data warehouses. Knowledge of cloud infrastructure and containerization concepts. Strong problem-solving and debugging skills. Ability to work in an agile environment with cross-functional teams. Thanks & Regards Prameela Sr Technical Recruiter | FISEC GLOBAL INC 9255976011 ext 511 fisecglobal.net/ prameela @fisecglobal.net linkedin.com/in/-prami0116 Keywords: Minnesota Senior Developer (Python, PySpark, Azure, Databricks) 12+ yrs [email protected] |
[email protected] View All |
01:59 AM 25-Feb-25 |