AI prompt analyst

Ova Technologies

Alpharetta, GA

JOB DETAILS
SKILLS
A/B Testing, Analysis Skills, Artificial Intelligence (AI), Best Practices, Communication Skills, Computer Science, Data Science, Detail Oriented, Linguistics, Metrics, Modeling Languages, Natural Language Processing (NLP), Performance Analysis, Performance Management, Performance Reviews, Product Engineering, Productivity Management, Quality Assurance, Requirements Management, Test Design, Testing, Writing Skills
LOCATION
Alpharetta, GA
POSTED
30+ days ago

Job Title: AI Prompt Analyst

Job Summary

We are seeking a detail-oriented and analytical AI Prompt Analyst to design, optimize, and evaluate prompts for AI models. The ideal candidate will bridge the gap between business requirements and AI capabilities by crafting effective prompts that generate accurate, reliable, and high-quality outputs.


Key Responsibilities

  • Design, test, and refine prompts for AI models (LLMs, image models, etc.)

  • Analyze AI-generated outputs and improve prompt performance for accuracy and relevance

  • Collaborate with product, engineering, and business teams to translate requirements into AI-driven solutions

  • Develop prompt libraries, templates, and best practices

  • Conduct A/B testing and performance evaluation of prompts

  • Identify edge cases, bias, hallucinations, and inconsistencies in AI responses

  • Document prompt strategies, learnings, and optimization techniques

  • Stay updated with advancements in AI/LLMs and prompt engineering techniques


Required Skills & Qualifications

  • Bachelor's degree in Computer Science, Data Science, Linguistics, AI, or related field

  • 1 3 years of experience in AI, NLP, content strategy, or related domain

  • Strong understanding of Large Language Models (LLMs) and prompt engineering

  • Excellent written communication and analytical skills

  • Experience with tools like ChatGPT, Claude, Gemini, or similar AI platforms

  • Ability to interpret business requirements and convert them into structured AI prompts

  • Strong problem-solving and critical thinking skills


Preferred Qualifications

  • Experience in Python or basic scripting

  • Familiarity with NLP concepts and model evaluation metrics

  • Experience in AI testing, QA, or conversational design

  • Knowledge of AI ethics, bias mitigation, and responsible AI practices


Key Competencies

  • Analytical thinking

  • Attention to detail

  • Structured experimentation mindset

  • Clear communication

  • Continuous learning attitude

About the Company

O

Ova Technologies