Generative AI Engineer

Build Python-based pipelines for automated quality testing of AI responses. Integrate LLMs into automated evaluation frameworks (e.g., using GPT-based evaluators, embeddings, or custom scoring). Automate regression and stress testing for conversational AI flows. Define evaluation metrics (relevance, factuality, coherence, safety, empathy). Implement both rule-based and AI-driven quality checks. Monitor model drift, bias, and hallucinations using automated workflows. Work with APIs, SDKs, and CI…