| Data Engineer with building data integration pipelines in CICD modelExperience. For San Jose, CA at San Jose, California, USA |
| Email: [email protected] |
|
From: Manish Kumar, Scalable Systems [email protected] Reply to: [email protected] Position: Data Engineer with building data integration pipelines in CI/CD modelExperience. Location: San Jose, CA Position: Data Engineer with extensive experience in building data integration pipelines in CI/CD modelExperience: Lead 12 + years , Sub-Leads 7+ years of experience Ability to design and develop a high-performance data pipeline framework from scratch o Data ingestion across systemso Data quality and curationo Data transformation and efficient data storageo Data reconciliation, monitoring and controls Support reporting model and other downstream application needso Skill in technical design documentation, data modeling and performance tuning applications o Lead and manage a team of data engineers, contribute towards code reviews, and guide the team in designing and developing convoluted data pipelines adhering to the defined standards.o Be hands on, performs POCs on the open source/licensed tools in the market and share recommendations.o Provide technical leadership and contribute to the definition, development, integration, test, documentation and support across multiple platforms (GCP, Python, HANA) o Establish a consistent project management framework and develop processes to deliver high quality software, in rapid iterations, for the business partners in multiple geographies o Participate in a team that designs, develops, troubleshoots, and debugs software programs for databases, applications, tools etc. o Experience in balancing production platform stability, feature delivery and reduction of technical debt across a broad landscape of technologies.o Skill in the following platform, tools and technologies GCP cloud platform GCS, Big Query, Streaming (pub/sub), data proc and data flow Python, PYSpark, Kafka, SQL, scripting & Stored procs Data warehouse, distributed data platforms and data lake Database definition, schema design, Looker Views, Models CI/CD pipelineo Proven track record in scripting code in Python, PySpark and SQLo Excellent structured thinking skills, with the ability to break down multi-dimensional problemso Ability to navigate ambiguity and work in a fast-moving environment with multiple stakeholderso Good communication skills and ability to coordinate and work with cross functional teams. Best Regards Manish Kumar Phone - +17327883626 Email ID: [email protected] Scalable Systems | Inspiring Innovation Big Data | Analytics | Integration | Intelligence www.scalable-systems.com Keywords: continuous integration continuous deployment California Idaho Data Engineer with building data integration pipelines in CICD modelExperience. For San Jose, CA [email protected] |
| [email protected] View All |
| 07:25 AM 11-Jan-25 |