| Data Engineer with Apache Calcite || REMOTE || NO H1b at Apache, Oklahoma, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1797925&uid= From: Vaibhav, Winorbit technology [email protected] Reply to: [email protected] Data Engineer with Apache Calcite No visa requirements. Manufacturing client. Project Overview This project aims to implement a semantic layer over multiple disparate data sourcesEpicor, Shop Floor Connect, and Visibilityby leveraging Apache Calcite's schema discovery capabilities. The semantic layer will provide a unified, business-friendly view of the data, simplifying data access for end-users such as sales representatives, managers, and analysts. Project Objectives Automatic Detection of Data Structures: Utilize Apache Calcite's schema discovery to automatically understand the structure of the underlying databases, reducing manual ePort. Unified View of Disparate Systems: Create a unified logical schema that integrates data from Epicor, Shop Floor Connect, and Visibility. Mapping Business Concepts to Data: Map business concepts onto the underlying technical data structures to build a semantic layer. Simplifying Query Creation and Optimization: Provide an easy-to-use interface for querying data without needing technical knowledge. Federated Queries Across Multiple Data Sources: Enable retrieval and joining of data from diPerent databases in a single query. Enhancing Flexibility and Scalability: Ensure the semantic layer adapts dynamically to changes in the underlying data schemas. Project Scope Data Sources: o Epicor: Sales and financial data. o Shop Floor Connect: Production data. o Visibility: Business intelligence and reporting data. Technologies: Apache Calcite, database connectors, and ETL tools as needed. Deliverables: Operational semantic layer, documentation, training materials, and deployment plans. Keywords: Data Engineer with Apache Calcite || REMOTE || NO H1b [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1797925&uid= |
| [email protected] View All |
| 12:37 AM 01-Oct-24 |