| Azure Data Bricks Engineer at Eden Prairie, MN (Onsite) at Eden, New York, USA |
| Email: [email protected] |
|
From: Prashant, Veridian Tech Solutions, Inc. [email protected] Reply to: [email protected] Job Title: Azure Data Bricks Engineer Location: Eden Prairie, MN (Onsite) Duration: 12+ months contract Job Description: 8+ years Hands-on experience with - Azure Data Bricks . Must be well versed with the platform Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks Developing scalable and re-usable frameworks for ingesting of data sets Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms Working with event based / streaming technologies to ingest and process data. Develop and maintain data pipelines on Snowflake and Azure platforms. Assist in deploying applications with Kubernetes and Dockers. Contribute to event streaming and processing using KAFKA. Must have 3+ years of relevant experience Java development background with strong Azure knowledge, develop and maintain Java applications using Springboot, Jboss, and other technologies. Azure Cloud Experience hands-on experience with Storage Format, provisioning options and single tenant and multi-tenant concepts. Bigdata Experience : Proficient in ETL development with Talend, Big Data processing and storage, MDM implementation for data consistency Python/Spark/Scala development > 5+ years coding experience . Lead the design and implementation of cloud-based data solutions. The candidate should be very well versed with Cloud technology and Java is a must. Keywords: Minnesota |
| [email protected] View All |
| 07:15 PM 07-Sep-23 |