| Urgent Need New Role ML Ops Engineer with Airflow for San Francisco, CA Onsite position...!!! at San Francisco, California, USA |
| Email: [email protected] |
|
From: Aniket Arya, Cloud Think Tech Inc [email protected] Reply to: [email protected] Hi, I hope you are doing good. Position- ML Ops Engineer with Airflow Location : San Francisco, CA ( Onsite Position) locals or near by 10+ Years Need From Infra Background We are looking for an ML Ops Engineer who can assist us with deployment of and infrastructure for machine learning models. For some years now, we have built and maintained our own ML Ops platform on top of Sagemaker, with associated infrastructure in AWS. We are going to move to using DataRobot for our model development and deployment needs in the near future. We also currently use Airflow in several different areas, specifically the MWAA hosted-Airflow offering from AWS. This role involves supporting two main areas, ML Ops and our "Central Airflow" platform, which supports the Data Engineering team. 1) For ML Ops, we support the Data Science team with development and deployment of ML models. Currently this is done in Sagemaker / AWS, but in the near future this will be done in DataRobot. This involves infrastructure in AWS, as well as CI/CD, Python for the modelling / platform component, etc 2) For Airflow, there are typically daily requests for creating secrets / variables in Airflow, deploying DAGs, and reviewing modifications that Data Engineers submit to ensure they are following best practices, and deploying changes to Airflow which support new packages, platforms, etc including containerized solutions. We are looking for the following skills, primarily in Python, Airflow, and AWS: REQUIRED- Python (4+ years) REST APIs (2+ years) Airflow (3+ years) - DAG authoring - Deployment / administration - Knowledge / support (we have numerous data engineers working on Airflow, who often need advice / support on how Airflow works) AWS infra / networking (4+ years, ideally managed via Terraform or other Infrastructure-as-Code tech) - e.g. S3, Sagemaker Studio, MWAA, ECS, SecretsManager, general experience Terraform (1+ years) BONUS- Python (7+ years) Docker (1+ years) Linux admin (1+ years) Github Actions Azure Thanks & Regards Aniket Arya Sr. Recruitment Manager CloudThink Tech Inc E: [email protected] Website: https://cloudthinktech.com/ Address: 10301 Northwest FWY STE 314, Houston TX, 77092 Keywords: continuous integration continuous deployment machine learning sthree California Texas Urgent Need New Role ML Ops Engineer with Airflow for San Francisco, CA Onsite position...!!! [email protected] |
| [email protected] View All |
| 10:02 PM 16-Jan-25 |