| Applied Scientist :: Remote at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2318115&uid= Job Title: Applied Scientist Location: Remote Job Summary: Duties/Responsibilities: We focus on evaluating BizChat quality across various scenarios, such as summarizing content from documents, generating images, and projecting data into graphs. For each scenario, we have a set of concrete user tasks (e.g., "Could you extract the KPIs from the document and project them into a table"). We will obtain responses from different versions of AI Assistants. The Applied Scientist (AS) will help us[KM7] [LY8] [YW9] develop an LLM-based labeler that can evaluate the quality of responses given the task. To achieve this, the AS is expected to combine different methods as appropriate. For example, one approach is to define the correct answer for a given user task and match the chatbot response to this answer, such as a mathematical task like "Can you help me sort the following numbers: 67, 111, ...". The AS can generate these answers by combining results from multiple LLM models. For creative open-answer questions such as "Summarize the key points from section 4 in this document," the AS can help develop an LLM-based judge to evaluate the quality of the summary. To do so, they are expected to refine the prompt to the LLM judge, guiding the LLM-based judge to score different aspects of the summary based on dimensions such as accuracy, comprehensiveness, and conciseness.Required Skills/Abilities: Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, Applied Mathematics, or a related field AND 3+ years of related experience (e.g., statistics, predictive analytics, research). Experience working on successful applied research projects in industry environments. Applicants with the following skills would be a plus:o Good coding/engineering skill to build production quality solution.o Applications of Foundation Modelso Application of Vision, Audio, and Multimodal Foundation Modelso Prompt Tuningo Natural Language Processingo Applied Machine Learningo Data Mining with Language Modelso Data Annotation Specialty Strong English reading comprehension and ability to quickly analyze and interpret complex information or Applied Linguistics background is also a plus. Thanks & Regards, Trayambkeshwer Dwivedi (Trayam), Sr. Technical Recruiter Raas infotek corporation 262 Chapman road, Suite 105A, Newark, DE-19702 Email: [email protected] Website: raasinfotek.com LinkedIn: linkedin.com/in/trayambkeshwar-dwivedi-792283218 -- Keywords: artificial intelligence information technology Delaware Applied Scientist :: Remote [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2318115&uid= |
| [email protected] View All |
| 01:19 AM 05-Apr-25 |