| Senior Data Engineer in Des Moines, Iowa (Mid-West) Hybrid at Des Moines, Iowa, USA |
| Email: [email protected] |
|
From: sarfaraz, convextech Inc [email protected] Reply to: [email protected] Hi Hope you are doing good.!! Please let me know if you are interested in the position Title : Senior Data Engineer Location : Des Moines, Iowa (Mid-West) Hybrid .Relocation is fine Duration: 6-12 months Visa : Only USC, GC(No GC EAD) Max Rate: $50/Hr/on c2c OR 1099 Job Description Key Responsibilities Lead the design, development, and optimization of data pipelines and architectures utilizing Azure technologies (Synapse, Azure Data Factory, Delta Lake, Databricks) or equivalent platforms such as AWS, Snowflake, or GCP. Define and implement comprehensive data architecture strategies, focusing on Data Quality, Metadata Management, and Master Data Management (MDM) to support enterprise-wide analytics and decision-making. Develop and oversee advanced dimensional data models (e.g., Star Schema) and implement efficient data population techniques for scalable and performant analytics systems. Write and review complex PySpark and SQL code, ensuring best practices and scalability for data transformation and processing pipelines. Drive the integration of hybrid data environments, seamlessly combining on-premises and cloud technologies to support diverse business needs. Design and enforce CI/CD pipelines to enhance automation, efficiency, and reliability of data deployments. Act as a technical leader in Product Scrum Agile teams, mentoring team members, ensuring alignment with agile principles, and delivering high-impact solutions. Monitor, troubleshoot, and continuously improve data systems, ensuring optimal performance and resilience. Provide thought leadership on emerging trends in data engineering, recommending tools and technologies to enhance the organizations data capabilities. Must-Have Skills Extensive experience with Azure Cloud Technologies (Synapse, Azure Data Factory, Delta Lake, Databricks) or similar platforms in AWS, Snowflake, or GCP. Deep expertise in data architecture principles, including Data Quality, Metadata Management, and MDM. Proven track record of designing and optimizing dimensional data models (e.g., Star Schema) for high-performance analytics. Advanced programming and optimization skills in PySpark and SQL, capable of handling complex data transformations. Comprehensive knowledge of hybrid data ecosystems, combining on-premises and cloud infrastructures. Strong experience with CI/CD pipelines and their application in data engineering environments. Demonstrated leadership in Agile/Scrum teams, including mentoring junior engineers and driving best practices. Strong analytical, problem-solving, and decision-making skills, with a focus on delivering scalable and reliable solutions. Preferred Skills Expertise in data challenges and opportunities within the manufacturing industry. Experience with real-time data processing and streaming data solutions. Proficiency in implementing data governance frameworks to ensure compliance and security. Familiarity with advanced analytics tools, such as machine learning platforms or AI integration for predictive insights. Thanks and Regards Sarfaraz Khan US IT Recruiter | Convex Tech In Email: [email protected] Keywords: continuous integration continuous deployment artificial intelligence information technology green card Senior Data Engineer in Des Moines, Iowa (Mid-West) Hybrid [email protected] |
| [email protected] View All |
| 01:24 AM 14-Dec-24 |