| Data Engineer (Python, PySpark, Azure, Databricks) || Minneapolis, MN(Hybrid) at Minneapolis, Minnesota, USA |
| Email: [email protected] |
|
Need Hands-on experience with Azure services, including: o Logic Apps o Azure CLI o Azure Storage (Blob, Data Lake) Job Description: Data Engineer (Python, PySpark, Azure, Databricks) Location: Minneapolis, MN(Hybrid) About the Role: We are seeking a highly skilled and motivated Senior Developer to join our data engineering team. The ideal candidate will have strong expertise in Python, PySpark, SQL, and hands-on experience with Azure Powertools (Logic Apps, Azure CLI, etc.) and Databricks. You will play a key role in building scalable data solutions, optimizing data pipelines, and contributing to the overall data strategy. Key Responsibilities: Design, develop, and optimize ETL pipelines using PySpark, Databricks, and Azure Data Services. Develop and deploy scalable data models, transformations, and solutions using Python and SQL. Manage and orchestrate workflows using Azure Logic Apps and Azure CLI. Implement best practices for data governance, security, and monitoring. Collaborate with data scientists, business analysts, and other developers to understand and meet data processing needs. Ensure high performance, reliability, and scalability of data platforms and solutions. Automate data pipelines, deployments, and processes to increase system efficiency. Troubleshoot and resolve issues with data integrity, performance, and availability. Stay up-to-date with the latest tools, frameworks, and practices in data engineering and cloud services. Required Skills and Qualifications: 5+ years of experience in software or data engineering. Strong programming skills in Python and distributed data processing with PySpark. Proficiency in SQL for data manipulation, optimization, and analysis. Hands-on experience with Azure services, including: o Logic Apps o Azure CLI o Azure Storage (Blob, Data Lake) Expertise in Databricks for data integration, transformation, and analysis. Experience in designing and managing ETL pipelines and data warehouses. Knowledge of cloud infrastructure and containerization concepts. Strong problem-solving and debugging skills. Ability to work in an agile environment with cross-functional teams. Abhishek Singh | Senior Recruitment Specialist Intellectt INC(Available in EST hours till 6:00 PM EST) a [email protected] intellectt.com/ 517 Route 1 South, Suite 2103 Iselin, NJ 08830, If you prefer not to receive further communications from us, kindly click : -- Keywords: information technology Minnesota New Jersey Data Engineer (Python, PySpark, Azure, Databricks) || Minneapolis, MN(Hybrid) [email protected] |
| [email protected] View All |
| 02:29 AM 25-Feb-25 |