| Azure Data Architect || USC GC || EST CST Candidates only at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1997331&uid= From: Awkash Kumar, Largeton INC [email protected] Reply to: [email protected] JD:: Looking to fulfill a Remote Contract Data Lead/Architect (HandsOn) for one of our clients. Must have: Hands-on Data Engineer (Python, Spark SQL, T-SQL, Azure Ecosystem) We seek a skilled and motivated Lead/Architect Engineer with expertise in Spark SQL, T-SQL, and a strong background in the Azure ecosystem. Key Responsibilities: Data Engineering: Design, develop, and maintain ETL/ELT pipelines using Spark SQL, T-SQL, and other relevant tools. Implement data integration and transformation workflows for structured and unstructured data sources. Optimize data pipelines for performance, reliability, and scalability. Azure Ecosystem Expertise: Utilize Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage for data movement, transformation, and storage. Leverage Azure SQL Database and related services to build efficient and scalable data solutions. Explore and implement best practices for data management and orchestration in the Azure cloud. Data Modeling and Development: Design and implement data models to support business intelligence, analytics, and reporting. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Develop reusable data assets such as scripts, templates, and frameworks for engineering workflows. Performance and Optimization: Conduct performance tuning for Spark SQL and T-SQL queries and workflows. Optimize data pipelines and data structures for faster processing and minimal latency. Required Qualifications: Bachelors degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience). 3+ years of experience with Spark SQL and T-SQL in a professional setting. Strong experience in building ETL/ELT pipelines and data integration workflows. Expertise with Azure cloud services, including Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage, and Azure Data Lake. Proficient in designing and optimizing complex data pipelines for both batch and streaming data. Strong understanding of data warehousing concepts, dimensional modeling, and big data processing. Preferred Qualifications: Experience with CI/CD workflows using Azure DevOps or similar tools. Familiarity with programming languages like Python or Scala for data engineering tasks. Knowledge of tools and platforms like Databricks or Apache Hadoop. Experience working in an Agile development environment. Azure certifications such as Azure Data Engineer Associate or similar are a plus. Cancel Keywords: continuous integration continuous deployment Azure Data Architect || USC GC || EST CST Candidates only [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1997331&uid= |
| [email protected] View All |
| 01:09 AM 10-Dec-24 |