| Lead GCP Data Engineer -- NO GC at Remote, Remote, USA |
| Email: [email protected] |
|
From: Rakesh, Blue Ocean Ventures [email protected] Reply to: [email protected] Hi, Lead GCP Data Engineer Remote Build and operationalize cloud-based platform components. Build production quality ingestion pipelines with automated quality checks to help enable the business to access all of our data sets in one place Understand and assess the systems architecture currently in place and work with technical staff to recommend solutions to improve it. Build automation, using Python modules and DAGS, to support our product development and data analytics initiatives Achieve maximum uptime of our platform utilizing cloud technologies such as Kubernetes, Terraform, Docker, etc. Resolve technical problems, identify Root Cause, and propose potential solutions. Provide guidance to development teams. Continually research current and emerging technologies and propose changes where needed. Assess the business impact that certain technical choices have. Participate in a collaborative, peer review based environment fostering new ideas via cross team guilds / specialty groups Maintain comprehensive documentation around our processes / decision making YOUR QUALIFICATIONS Have experience with DevOps / Automation tools to help minimize operational overhead for our platform Must be able to contribute to self-organizing teams with minimal supervision working within the Agile / Scrum project methodology Bachelor's Degree in Computer science or related field 5+ years of related information technology experience 3+ years of strong experience building complex ETL pipelines with dependency management utilizing File Watchers, APIs, etc. Airflow, Talend, etc. 3+ years of strong experience directly related to Big Data technologies Spark, Hive, Hadoop, Parquet, HDFS, Python, Scala, Data Lake, NoSQL Industry recognized certifications (similar to below): GCP Certified Data Engineer GCP Certified Solutions Architect AWS Solutions Architect Spark Certified Developer Demonstrated experience with the Scrum Agile methodology Deep familiarity with PaaS services, containers, orchestrations specifically around Docker and Kubernetes. Strong ability to learn new technologies in a short time. Must possess well-developed verbal and written communication skills. Keywords: information technology Lead GCP Data Engineer -- NO GC [email protected] |
| [email protected] View All |
| 11:06 PM 12-Feb-25 |