| Lead Data Engineer - GCP in San Jose, CA / Austin, TX (Day 1 onsite & Need Locals) at San Jose, California, USA |
| Email: [email protected] |
|
Hi, Please find the below requirements and send me your updated profile to [email protected] Position: Lead Data Engineer - GCP Location: San Jose, CA / Austin, TX ( Day 1 onsite & Need Locals ) Duration: 12+Months (Possible Extension) Need 12+ years (Lead experience 5 +yrs.) Data Engineer with extensive experience in building data integration pipelines in CI/CD model Ability to design and develop a high-performance data pipeline framework from scratch Data ingestion across systems Data quality and curation Data transformation and efficient data storage Data reconciliation, monitoring, and controls Support reporting model and other downstream application needs Skill in technical design documentation, data modeling and performance tuning applications Lead and manage a team of data engineers, contribute towards code reviews, and guide the team in designing and developing convoluted data pipelines adhering to the defined standards. Be hands on, performs POCs on the open source/licensed tools in the market and share recommendations. Provide technical leadership and contribute to the definition, development, integration, test, documentation, and support across multiple platforms (GCP, Python, HANA) Establish a consistent project management framework and develop processes to deliver high quality software, in rapid iterations, for the business partners in multiple geographies Participate in a team that designs, develops, troubleshoots, and debugs software programs for databases, applications, tools etc. Experience in balancing production platform stability, feature delivery and reduction of technical debt across a broad landscape of technologies. Skill in the following platform, tools, and technologies GCP cloud platform GCS, Big Query, Streaming (pub/sub), data proc and data flow Python, PYSpark, Kafka, SQL, scripting & Stored procs Data warehouse, distributed data platforms and data lake Database definition, schema design, Looker Views, Models CI/CD pipeline Proven track record in scripting code in Python, PySpark and SQL Excellent structured thinking skills, with the ability to break down multi-dimensional problems Ability to navigate ambiguity and work in a fast-moving environment with multiple stakeholders Good communication skills and ability to coordinate and work with cross functional teams. Full Legal Name of the candidate | Current Location | Relocation (open to relocate to work location) | Availability to Join | Currently on project / Project last date MM/YY | Contact Number | Reason for change of project | Work Authorization Status & Validity | Last 4 Digit SSN | Email ID | Any Interviews in Pipeline | Total Exp. | Education Details ( Degree/ University / Year of passing) | LinkedIn: | Interview availability | Passport Number | Any vacation plans in the Next 3 months | Thanks & Regards, Vamshi VRN Technologies LLC. 1908 Yaupon Trail, Suite 203 Cedar Park TX 78613 Email: [email protected] Website: www.vrntech.us -- Keywords: continuous integration continuous deployment materials management information technology California Idaho Texas Lead Data Engineer - GCP in San Jose, CA / Austin, TX (Day 1 onsite & Need Locals) [email protected] |
| [email protected] View All |
| 10:44 PM 02-Jan-25 |