About the Role

We are seeking an experienced AI Data Scientist to join Deltek’s growing AI Center of Excellence team to design, build, evaluate, and optimize enterprise AI solutions leveraging Large Language Models (LLMs), AI Agents, Retrieval-Augmented Generation (RAG), multimodal AI, Opensource AI Models, and emerging foundation model technologies.

This role is focused exclusively on AI innovation and implementation rather than traditional analytics or reporting. The ideal candidate will develop intelligent AI systems, evaluate model performance, architect agentic workflows, and drive adoption of AI-powered business solutions.

The successful candidate combines deep expertise in Generative AI, machine learning, prompt engineering, and AI evaluation with a passion for translating cutting-edge AI capabilities into scalable business outcomes. This role reports to the Senior Director, AI Solutions.

Generative AI Solution Development

• Design, develop, and deploy enterprise-grade Generative AI solutions

• Build AI applications leveraging Large Language Models (LLMs) & SLMs

• Develop Retrieval-Augmented Generation (RAG) architectures

• Implement conversational AI, AI copilots, and intelligent assistants

• Design and optimize advanced prompt engineering strategies

• Develop multimodal AI solutions involving text, image, audio, and document understanding

Agentic AI & Autonomous Systems

• Design and develop AI Agents capable of complex reasoning and task execution

• Build multi-agent frameworks and agent orchestration solutions

• Develop autonomous workflows integrating enterprise systems and business processes

• Implement tool-calling, function-calling, and agent memory architectures

• Optimize agent planning, reasoning, and decision-making capabilities

AI Model Evaluation & Optimization

• Establish evaluation frameworks for AI solutions

• Design benchmarks for quality, accuracy, groundedness, hallucination detection, and safety

• Evaluate and compare foundation models for business use cases

• Improve AI system performance through prompt tuning, fine-tuning, and model optimization

• Monitor AI solution effectiveness and recommend enhancements

AI Engineering & Deployment

• Collaborate with engineering teams to deploy AI solutions into production environments

• Build scalable AI pipelines and inference architectures

• Support integration of AI services with enterprise applications and workflows

• Partner with platform teams to optimize AI costs, latency, scalability, and performance

• Implement AI observability, monitoring, and governance controls

Responsible AI & Governance

• Ensure Responsible AI principles are embedded throughout the AI lifecycle

• Evaluate solutions for bias, fairness, explainability, security, and compliance

• Support AI governance policies, risk assessments, and model validation processes

• Develop safeguards and guardrails for enterprise AI applications

AI Innovation & Research

• Stay current with advancements in Generative AI, foundation models, open-source AI, and agentic systems

• Evaluate emerging AI technologies and recommend adoption opportunities

• Create proof-of-concepts and pilot solutions using next-generation AI capabilities

• Contribute to enterprise AI strategy and AI capability development

Required Qualifications

• Bachelor’s degree in Computer Science, Artificial Intelligence, Machine Learning, Engineering, or related field

• 5+ years of experience developing AI/ML solutions

• 3+ years of hands-on experience with Agentic AI, Generative AI and Large Language Models

• Strong experience building AI copilots, AI Assistants, RAG solutions, or AI Agents

• Proficiency in Python and modern AI frameworks

• Experience integrating AI solutions into enterprise environments

• Strong communication and stakeholder engagement skills

Preferred Qualifications

• Master’s degree in AI, Computer Science, Machine Learning, or related discipline

• Experience with Microsoft Azure AI Foundry, Azure OpenAI, OpenAI APIs, Anthropic Claude, Gemini, or similar platforms

• Experience with fine-tuning, model adaptation, embeddings, and vector databases

• Knowledge of Agentic AI frameworks such as Semantic Kernel, LangChain, LangGraph, AutoGen, CrewAI, A2A, MCP or similar technologies

• Experience deploying AI solutions in regulated enterprise environments

• AI-related certifications from Microsoft, OpenAI, AWS, or Google Cloud

Benefits and perks listed here may vary depending on the nature of employment with Deltek. Employees have access to healthcare benefits, a 401(k) plan and company match, paid vacation time and holidays, well-living programs, short-term and long-term disability coverage, basic life insurance and tuition reimbursement.