Retail Data Architect || USC GC || EST Candidates Only at Remote, Remote, USA |
Email: [email protected] |
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1964798&uid= From: Awkash Kumar, Largeton INC [email protected] Reply to: [email protected] JD :: This person will possess strong technical proficiency in a variety of tools and technologies relevant to data engineering in Azure cloud environments. This includes demonstrated expertise in Azure Databricks for building and optimizing data pipelines, as well as experience with Azure Synapse Analytics for data warehousing and analytics. Proficiency in SQL is essential for querying and manipulating data within these platforms, along with programming skills in Python and PySpark for data processing and transformation tasks. Additionally, the candidate should have experience working with distributed computing frameworks and familiarity with cloud-based storage solutions such as Azure Blob Storage and Azure Data Lake Storage. Knowledge of data modeling, ETL processes, and data security best practices is also crucial for designing and implementing scalable and reliable data solutions. Key Responsibilities Design and implement robust data pipelines for high-throughput data ingestion, transformation, and storage. Optimize data processing workflows for performance and scalability in Azure cloud environments. Ensure data consistency, reliability, and security in distributed data processing environments. Monitor and troubleshoot data pipeline failures, ensuring minimal downtime and maximum reliability. Draft architectural diagrams, interface specifications and other design documents Participate in the development and communication of data strategy and roadmaps across the technology organization to support project portfolio and business strategy Innovate, develop, and drive the development and communication of data strategy and roadmaps across the technology organization to support project portfolio Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms Define high-level migration plans to address the gaps between the current and future state, typically in sync with the budgeting or other capital planning processes Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement Mentor team members in data principles, patterns, processes and practices Promote the reuse of data assets, including the management of the data catalog for reference Draft and review architectural diagrams, interface specifications and other design documents Must haves: 8+ years of experience in data engineering - looking for an Architect level candidate. Top Sills: Databricks, PySpark, & Data Modeling Proficiency in Python, PySpark, and SQL. Experience with data modeling tools and frameworks. Strong understanding of data engineering concepts and hands-on experience with Databricks. Familiarity with system design concepts relevant to data architecture. Knowledge of data governance practices, including the use of Unity Catalog. Keywords: Retail Data Architect || USC GC || EST Candidates Only [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1964798&uid= |
[email protected] View All |
01:49 AM 26-Nov-24 |