Urgent Hiring Senior Azure Data Engineer at Remote, Remote, USA |
Email: [email protected] |
From: Shivam Pachauri, Tek inspirations LLC [email protected] Reply to: [email protected] Job Description - Senior Azure Data Engineer Duration 6 + mos with extensions Onsite in Houston at Philllips 66 in Energy Corridor ( Must be local & active LinkedIn) Be able to work onsite from Day 1 M-F (hybrid schedule eventually but first they need to prove themselves and build rapport with the team) Must have at least 10 years of US exp as Azure Data Engineer with MLOps exp. The project at P66 is a large MLOps project We need to look for candidates with MLOps exp. as the project that they will be working on is MLOps. This is a Data Engineer role primarily to enable the data science team. This is a hands-on keyboard role thats a combination of making data available for the Data Scientist to do analysis, build models and then productionizing anything they build. The productionizing aspect can mean anything from hyper parameter tuning to building an azure function for inferencing. I was informed by my customer that he will have an upcoming Azure Data Engineer role. This is for a senior level, and they need to have excellent communication and solutioning skills. Someone that knows how to do implementations from scratch and be able to find a solution if they do not know it. I listed their typical boiler plate below. Description The Data Engineer will be responsible for creating and optimizing our data pipeline, data architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and projects. Responsibilities and Duties Create and maintain optimal data pipeline. Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc. Build analytics tools/dashboards that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics using Tableau. Work with stakeholders including the business owners, Data and Design teams to assist with data-related technical issues and support their data needs. Create data tools for analytics and data scientist team members that assist them in building and optimizing models/visualizations. Required Experience and Qualifications We are looking for a candidate with 3+ years of experience in a Data Engineer role, who has attained a bachelor's degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience in following: Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL). Experience building and optimizing 'big data' data pipelines, architectures and data sets. Knowledge with data visualization best practices. Minimum 1-year experience in Tableau development Experience with various data prep/pipeline/integration tools like Alteryx, Azure Data Factory etc. In-depth knowledge of relational databases (e.g. Oracle and SQL Server), including data warehousing concepts and best practices Proficient is SQL Experience in at least one the following languages R, Python, SCALA Experience with Microsoft Azure data services (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL, Azure Datawarehouse) Experience building Alteryx workflows Experience building Tableau dashboards Experience working in an agile or Scrum based environment Ability to test and document end-to-end processes. Experience working with Microsoft Azure or AWS platform will be preferred SQL, Alteryx, Azure Data Factory Agile or Scrum based environment Building and optimizing 'big data' data pipelines Data Engineer & Tableau development Keywords: rlang information technology |
[email protected] View All |
02:43 AM 10-Nov-23 |