| Senior Data Engineer or Solution Architect at Remote, Remote, USA |
| Email: indu@cloudsecurityweb.com |
|
https://rb.gy/r1ud0k https://jobs.nvoids.com/job_details.jsp?id=2270613&uid= From: Indu, CSW indu@cloudsecurityweb.com Reply to: indu@cloudsecurityweb.com Hello, We have below req, please share your updated resume if the req suits your profile. JD: We are seeking a highly skilled Senior Data Engineer/Solution Architect with 14+ years of experience to join our dynamic team. The ideal candidate must have strong expertise in Talend ETL, SQL, Data Warehousing (DWH), Snowflake, and Postgres, along with experience working in an AWS cloud environment. You will be responsible for data analysis, solution design, and hands-on development, working closely with Data Architects to implement high-quality ETL and data pipeline solutions. Key Responsibilities: Data Analysis & Solution Design: o Analyze and design the existing data environment, identifying Dimensions, Facts, and Aggregated tables aligned with the Enterprise Data Platform (EDP) architecture. o Collaborate with Data Architects and business stakeholders to understand data mapping specifications and ensure seamless data integration. o Connect with subject matter experts (SMEs) to identify problem areas o Propose IT solutions based on customer needs o Partner with teams across business functions to drive organizational efficiency o Design and test technical architecture ETL Development & Data Integration: o Develop and optimize Talend ETL jobs to integrate data from flat files and source databases into the Enterprise Data Platform. o Utilize Talend Reference Projects, Metadata, and Talend Management Console (TMC) for efficient ETL processing. o Implement data ingestion, transformation, and validation processes using best practices in data modeling and ETL design. o Develop and review code o Ensure comprehensive IT documentation and best practices SQL & Data Processing: o Write and optimize complex SQL queries for data extraction, transformation, and storage in Snowflake and Postgres databases. o Work with existing Snowflake schemas, tables, and materialized views for storing and processing Project Construction data. o Implement push-down SQL transformations in Snowflake to improve performance and scalability. Cloud & Agile Practices: o Work in an AWS cloud environment, ensuring scalable and secure data solutions. o Utilize Kanban boards and Agile methodologies for project tracking and execution. Hands-on Coding & Development: o Be prepared to work hands-on with Talend ETL, SQL, and Snowflake to develop robust data solutions. o Continuously improve data pipelines, optimize performance, and resolve technical issues. Required Skills & Qualifications: 14+ years of experience in ETL Design, Development, Data Engineering, and Data Warehousing Solutioning Strong expertise in Talend ETL (Talend Studio, TMC, Metadata Management). Proficiency in SQL (complex queries, optimization, push-down processing). Strong knowledge of Data Warehousing concepts, Dimensional Modeling, Facts & Dimensions. Experience working with Snowflake (schemas, materialized views, performance tuning). Knowledge of Postgres databases for data storage and retrieval. Familiarity with AWS Cloud services related to data processing. Experience working in an Agile/Kanban environment. Strong analytical and problem-solving skills. Ability to work independently and collaborate effectively with cross-functional teams across the globe Strong interpersonal skills and Analytical skills Excellent verbal and written communication skills Ability to organize and prioritize critical projects Knowledge of PowerBI, Thoughtspot is an added advantage Preferred Qualifications: Experience with other cloud platforms (Azure, GCP) is a plus. Knowledge of Python, Spark, or other data processing tools is an advantage. Certifications in Talend, Snowflake, AWS, or Data Engineering are a plus. Keywords: information technology Senior Data Engineer or Solution Architect indu@cloudsecurityweb.com https://rb.gy/r1ud0k https://jobs.nvoids.com/job_details.jsp?id=2270613&uid= |
| indu@cloudsecurityweb.com View All |
| 01:56 AM 20-Mar-25 |