| Only Locals & No GC Job Opening | Sr Data Engineer | Onsite Parsippany, NJ at Parsippany, New Jersey, USA |
| Email: [email protected] |
|
Hello Hope you are doing great! This is Nitin, I work as a Tech. Recruiter at NYTP. Reach me at [email protected]) if you want to apply for the below role: Position Sr Data Engineer Location- Onsite Parsippany, NJ T ype Long Term Required Skills : Python, Amazon Redshift, Amazon S3,AWS,Data Modelling, AWS Databases Job summary We are seeking an experienced Sr. Data Engr with 10 to 13 years of experience to join our team. The ideal candidate will have a strong background in Data warehousing, with proven background in any of the Cloud Data pipeline development, Python, Performance Optimization, and SQL. The Data Engr will play a crucial role in designing, developing, and optimizing data pipelines for client projects to support our business objective Responsibilities Experience in Enterprise Data Engineering and Analytics projects including any Cloud Data pipeline development platform and enterprise data warehousing project/ETL. Clear understanding Data warehousing and Data Lake concepts. Must Have Requirement gathering Working with business/product owners to clarify the reporting needs. Working with other stakeholders like application teams etc to clarify the source systems/data. Performing source data analysis, discovery/reverse engineering of existing models. Designing Creating the data model designs/relations. Designing the etl pipeline. Experience with SQL/Stored Procedures . Experience with ETL orchestration. Understanding of metadata driven frameworks for performing ELT. Pros/Cons of using ETL tools VS custom built frameworks in SQL/Python. High level understanding/knowledge of ingestion/collection patterns in to cloud objects storage(streaming, file based ) Good understanding of storage optimizations(partitioning, archiving unused data), knowledge of various file formats CSV/JSON/PARQUET/ORC/AVRO Optimizing the ETL/SQL for performance, performance troubleshooting, DB specific features related to query performance. Intermediate to expert knowledge in python. Exposure to any clouds(AWS/Azure/GCP/OCI) Build Strong experience in working in Star schema models Experience in building and maintaining of Datawarehouse implementations of the data models using ELT. Development of the etl pipeline using redshift SQL/stored procedures. Troubleshooting the ETL loads , failures. Orchestration of pipelines using airflow. Performance optimization of the pipelines. Complete involvement in the SDLC. Nice to Have Data Modelling design (ER/Dimensional Modelling) Conceptual/Logical/Physical. Experience with streaming data ingestions/collections using Kafka etc. Consumption of DWH data in BI platforms like tableau/power BI, data source preparation (live/extracts). Data sharing methodologies. Experience with AWS/OCI. Non-technical Communication/listening skills Exposure to tools like Service Now, Jira, Confluence Work with various SMEs in understanding business process flows, functional requirements specifications of existing system, their current challenges and constraints and future expectation Address customer issues with speed and efficiency Develop and manage relations with key client stakeholders Collaborate with solutions delivery architects Ensuring contracts are carried out according to agreed terms Strong customer focus, ownership, urgency, and drive. Should be able to drive engineering best practices and mentoring junior engineers. Proficient in troubleshooting technical problems. Excellent client interfacing communication skills and the Thanks, _______________________________________ Nitin Pillai | New York Technology Partners 120 Wood Avenue S | Suite 504 | Iselin NJ 08830 Direct: 201.987.0020 EXT: 484 | LinkedIn | www.nytp.com We respect your online privacy. If you would like to be removed from our mailing list please reply with "Remove" in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. -- Keywords: business intelligence sthree database information technology New Jersey Only Locals & No GC Job Opening | Sr Data Engineer | Onsite Parsippany, NJ [email protected] |
| [email protected] View All |
| 12:53 AM 22-Nov-24 |