| Aws Data engineer Minneapolis, MN Hybrid at Minneapolis, Minnesota, USA |
| Email: javed.tamboli@innoworxllc.com |
|
https://jobs.nvoids.com/job_details.jsp?id=2182371&uid= From: Javed, Innowox javed.tamboli@innoworxllc.com Reply to: javed.tamboli@innoworxllc.com Aws Data engineer Minneapolis,MN Hybrid Contract *Note 15+ Exp Only and Max rate is 60/hr on c2c* Dont call for rate negotitaion Responsibilities will include the following: Develop and Maintain Data Integration Solutions: Design and implement data integration workflows using AWS Glue/EMR, Lambda, Redshift. Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing large datasets Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems. Ensure Data Quality and Integrity: Validate and cleanse data to maintain high data quality. Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines. Optimize Data Integration Processes: Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure. Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance, Regularly review and refine integration processes to improve efficiency. Support Business Intelligence and Analytics: Translate business requirements to technical specifications and coded data pipelines. Ensure timely availability of integrated data for business intelligence and analytics. Collaborate with data analysts and business stakeholders to meet their data requirements. Maintain Documentation and Compliance: Document all data integration processes, workflows, and technical and system specifications. Ensure compliance with data governance policies, industry standards, and regulatory requirements. Required Skills and Expertise: Bachelor's degree in computer science, information technology, or a related field. 7-10+ years of experience in data engineering, database design, and working with ETL processes. 5+ years of experience working hands-on with programming languages such as PySpark, and Python. 5+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, Postgres, RDS, Lambda, PySpark). 3+ years of experience of working with databases/ data marts/data warehouse Proven experience in ETL development, system integration, and CI/CD implementation. Experience in complex database objects to move the changed data across multiple environments. Solid understanding of data security, privacy, and compliance. Excellent problem-solving and communication skills. Display good communication skills to effectively collaborate with multi-functional teams. Willingness and ability to participate in Agile development processes including sprint planning stand-ups and retrospectives. Ability to provide technical guidance and mentorship to Junior Developers. Must exude attention to detail and have a commitment to data quality. Should have a continuous learning mindset to keep up with evolving technologies and best practices in data engineering. Thanks & Regards Javed Tamboli Recruitment Manager Innoworx Technology services LLC Mob : +1 858 358 0940 Email : javed.tamboli@innoworxllc.com www.innoworx.tech https://www.linkedin.com/in/javed4m/ Keywords: continuous integration continuous deployment sthree Minnesota Aws Data engineer Minneapolis, MN Hybrid javed.tamboli@innoworxllc.com https://jobs.nvoids.com/job_details.jsp?id=2182371&uid= |
| javed.tamboli@innoworxllc.com View All |
| 02:03 AM 18-Feb-25 |