| (Hybrid) Opportunity for Data Engineer role at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=95141&uid= From: Stephen, W3Global [email protected] Reply to: [email protected] Job Title:Data Engineer Dear Vendor, Kindly share your consultant profiles for the below position. Employment Type:Contract, C2C, Full time / Direct Hire, 1099 Location:Englewood Cliffs, NJ Job Description Responsibilities: Leads all phases of solution development. Designs and codes complex ETL (Extract / Transform / Load) processes and adhoc queries. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions. Must be a forward thinker that sees the larger picture; looks beyond the current, anticipates what could happen or what the future needs will be. Translates business specifications into design specifications and code. Assesses data quality and tests code thoroughly for accuracy of intended purpose. Educates and mentors a team of data engineers on the team while applying quality control to their work. Develops data engineering standards. Troubleshoots software and processes for data consistency and integrity. Experience: Expert level Data Engineer with solution architecture experience Well-seasoned in data modeling, data intake, and data-curation procedures In-depth practical experience and demonstrated comprehensive know-how in designing and implementing modern cloud architectures based on micro-services and continuous delivery Experience with data protection regulations (e.g. GDPR), data masking techniques and the concepts of k-anonymity and i-diversity Ability to develop a holistic approach and to abstract reasoning, as well as the ability to communicate complex issues to internal and external non-professionals in an easily understandable way Strong service orientation, target driven, high degree of intercultural competence, team player with highest commitment Strong leadership and interpersonal skills Ability to schedule and prioritize workload demands on a team Required Skills SQL Python Spark - SQL and Python (must have) Tools AWS (S3 - IAM - Kinesis - SNS - SQS) Databricks Terraform (or very good experience with Cloudformation) Airflow Experience with setting up data pipelines in the AWS cloud Experience with setting up data pipelines with Databricks Experience with Monitoring and Alerting Referrals appreciated and welcomed. http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=95141&uid= |
| [email protected] View All |
| 12:06 PM 29-Oct-22 |