| Looking for Azure Data Factory Engineer at Remote, Remote, USA |
| Email: [email protected] |
|
From: Almas Fathima, OrbIT People LLC [email protected] Reply to: [email protected] Hello, Please share suitable profiles for Azure Data Factory Engineer. Overview: We are looking for an experienced Azure Data Factory Data Engineer to join our team. The ideal candidate will focus on sourcing data from ODATA services and loading it into PostgreSQL databases. This role requires expertise in data integration, ETL processes, and a solid understanding of Azure cloud technologies. Knowledge on Azure DataBricks notebook creation for ETL processing is an added advantage. Key Responsibilities: Data Pipeline Development: Design and implement data pipelines using Azure Data Factory to extract data from ODATA sources and load it into PostgreSQL databases. ODATA Integration: Configure and optimize ODATA connectors to ensure efficient data retrieval and integration. Data Transformation: Utilize Azure Data Factorys data flow features to transform data as needed before loading it into PostgreSQL. Performance Monitoring: Monitor and troubleshoot data pipelines to ensure optimal performance and reliability. Collaboration: Work closely with data analysts, database administrators, and stakeholders to gather requirements and deliver effective data solutions. Documentation: Create and maintain documentation for data pipeline architectures, workflows, and processes. Best Practices: Implement data governance and best practices in ETL processes, including version control and testing. Technical Skills: Strong proficiency in Azure Data Factory, including pipeline creation and management. Knowledge of SQL and experience with PostgreSQL, including data modeling and query optimization. Familiarity with Azure services like Azure Blob Storage and Azure SQL Database. Knowledge of programming languages such as Python or Scala for data processing in Databricks Location : New Brunswick. Onsite. Keywords: information technology Looking for Azure Data Factory Engineer [email protected] |
| [email protected] View All |
| 01:41 AM 05-Oct-24 |