Senior AI Engineer – LLM Systems & RAG Optimization

Descrição da Vaga

Requisitos

• You must have real production experience building and scaling LLM systems
• 3+ years in applied ML or NLP
• Strong Python skills
• Deep experience with RAG systems
• Experience with vector databases (Pinecone, Weaviate, FAISS, etc.)
• Experience optimizing chunking & embedding strategies
• Experience evaluating LLM systems beyond subjective review
• Familiarity with LLM observability tools (LangSmith, Helicone, PromptLayer, etc.)
• Experience deploying scalable AI systems in production
• Experience with SMS-based AI systems
• Experience with multi-model routing
• Experience with context compression
• Startup experience
• Strong system design background

Responsabilidades

• You will improve and scale our parent SMS AI chatbot used by thousands of families
• Optimizing and redesigning our RAG architecture
• Reducing hallucinations and irrelevant retrieval
• Improving latency and token efficiency
• Building robust evaluation pipelines
• Implementing LLM observability and monitoring
• Designing cost-efficient scaling infrastructure
• Improving conversation memory and routing logic
• Hardening guardrails for real-world usage
• You will operate as the AI systems architect for this product
• Diagnose retrieval failures
• Build evaluation datasets
• Hallucination rate meaningfully reduced
• Retrieval accuracy measurably improved
• Cost per conversation reduced
• Clear evaluation metrics implemented
• Scalable architecture roadmap in place
• Audit our existing SMS chatbot and deliver a structured improvement plan including:
• Architecture critique
• Retrieval optimization suggestions
• Hallucination reduction strategies
• Scaling plan
• 30 / 60 / 90-day roadmap

Benefícios