AI Prompt Developer

About the role

Caravel is building a brand‑new AI practice and needs an AI Prompt Developer to create the production layer of client solutions and internal accelerators. You will work closely with AI Specialists to turn design concepts into reliable, evaluated, production‑ready LLM workflows.

Key responsibilities

• Design, build, test, and iterate on prompts and prompt chains for production LLM workflows.
• Implement evaluation harnesses, guardrails, and regression tests to ensure stable output quality.
• Integrate LLM components with business systems via APIs, retrieval/RAG pipelines, and structured outputs.
• Partner with AI Specialists to convert solution designs into production builds and document reusable patterns.
• Optimize prompts for accuracy, cost, latency, and safety using real evaluation data.
• Expand Caravel's library of reusable AI accelerators.

Required profile

• 2+ years of experience building software or AI/LLM components.
• Hands‑on experience crafting and iterating prompts for real applications.
• Working knowledge of LLM fundamentals such as context windows, few‑shot prompting, function calling, structured outputs, and basic RAG.
• Test‑and‑measure mindset with a focus on quantitative output evaluation.
• Strong written English and documentation habits.
• Ability to collaborate across time zones with an on‑shore/near‑shore team.

Required skills

• Python (or similar language)
• APIs, JSON, and version control (Git)
• Prompt engineering and chain design
• Evaluation frameworks (e.g., promptfoo, Ragas)
• Embeddings, vector databases, and retrieval pipelines
• Familiarity with ERP/CRM platforms (NetSuite, Salesforce)
• Agentic frameworks and orchestration tools

What we offer

• Fully remote work within South America with daily overlap with US business hours.
• Opportunity to shape a new AI practice inside a two‑decade‑old technology services firm.
• Collaborative, multi‑regional team and access to real client problems and production systems.