| Onsite Role-Generative AI Data Engineer, Santa Clara, CA at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2273114&uid= Onsite Role-Generative AI Data Engineer, Santa Clara, CA Responsibilities: Design, develop, and evaluate innovative LLM models to solve diverse challenges and opportunities across multiple use-cases using MS Azure services. Understand business problems, and help with defining and implementing a scalable Generative AI platform to solve them. Build large-scale production systems utilizing advanced machine learning and big data technologies. Develop and optimize data processing workflows for chunking, indexing, ingestion, and vectorization for both text and non-text data Benchmark and implement various vector stores, embedding techniques, and retrieval methods Create a flexible pipeline supporting multiple embedding algorithms, vector stores, search types (vector search, hybrid search, etc.) and search ranking Implement and maintain auto-tagging systems and data preparation processes for LLMs Develop tools and pipelines for text and image data cleaning, and refinement Integrate and optimize workflows using Azure AI Search, Azure AI Services, Azure PostgreSQL and various vector store technologies Use advanced prompting techniques to develop and optimize prompts for LLM to ensure model performance, responses quality and accuracy of the Gen AI platform. Contribute to automated model testing and evaluation infrastructure Build automations to create and select the best prompts for any given task Gen AI Data Engineer: o Azure and Azure AI infrastructure o Autogen 4 and 6 o Semantic Kernel o Millions of documents handling o Agentic Tools experience -- Keywords: artificial intelligence information technology microsoft California Onsite Role-Generative AI Data Engineer, Santa Clara, CA [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2273114&uid= |
| [email protected] View All |
| 09:24 PM 20-Mar-25 |