Description
Summary:
Seeking a Senior Data Scientist specializing in LLMs and Python to develop AI-powered chatbot solutions, focusing on NLP, Conversational AI, and Responsible AI.
Highlights:
1. Develop AI-powered chatbot solutions with LLMs and Python
2. Focus on Responsible AI, compliance, and hallucination prevention
3. Collaborate across teams to optimize a shopping assistant chatbot
We are seeking a **Senior Data Scientist** with expertise in Large Language Models (LLMs) and Python to develop AI\-powered chatbot solutions for specialized use cases.
The ideal candidate has a strong background in Natural Language Processing (NLP) and Conversational AI, with experience in hallucination prevention, Responsible AI \& compliance, and data analysis.
**Responsibilities**
* Collaborate with cross\-functional teams across product, analytics, and engineering to build and optimize a shopping assistant chatbot
* Develop and refine prompt engineering strategies to improve chatbot interactions
* Implement LLM\-based agents that integrate with APIs, databases, and external tools through function calling
* Ensure chatbot reliability and hallucination prevention by applying model evaluation techniques
* Work with A/B testing frameworks to evaluate and continuously improve chatbot performance
* Apply Responsible AI and compliance principles to guarantee ethical and regulatory adherence
* Conduct exploratory data analysis to derive insights and create structured requirements for the data engineering team
* Guide cloud engineering teams on the infrastructure needs for AI\-powered chatbot solutions
**Requirements**
* At least 3 years of professional relevant experience in data science
* Expertise in LLMs, including working with OpenAI APIs on Azure
* Strong Python skills for integrating and optimizing AI workflows
* Experience developing AI agents using function calling to interact with external tools and databases
* Knowledge of hallucination prevention techniques to ensure chatbot accuracy and reliability
* Solid understanding of Responsible AI and compliance best practices, including ethical AI guidelines
* Background in Natural Language Processing (NLP) and Conversational AI development
* English at B2 level or higher, with strong written and verbal communication skills
**Nice to have**
* Experience with A/B testing and experimentation, working closely with analytics teams
* Ability to define and implement a testing strategy using key performance metrics for chatbots
* Proficiency in exploratory data analysis (EDA) for uncovering insights from data
* Ability to define and communicate data requirements for the data engineering team
* Understanding of cloud services, either through hands\-on experience or the ability to specify requirements for cloud engineering teams