- Compensation: COP - COP - yearly

Company Description
Vichara is a Financial Services focused products and services firm headquartered in NY and building systems for some of the largest i-banks and hedge funds in the world.
Job Description
Key Responsibilities
Architect, design, and lead multi-agent LLM systems using LangGraph, LangChain, and Promptfoo for prompt lifecycle management and benchmarking.
Build Retrieval-Augmented Generation (RAG) pipelines leveraging hybrid vector search (dense + keyword) using LanceDB, Pinecone, or Elasticsearch .
Define system workflows for summarization, query routing, retrieval, and response generation, ensuring minimal latency and high precision.
Develop RAG evaluation frameworks combining retrieval precision/recall, hallucination detection, and latency metrics — aligned with analyst and business use cases.
Integrate GPT-4o, PaLM 2, and open-weight models (LLaMA, Mistral) for task-specific contextual Q&A.;
Fine-tune transformer models (BERT, SentenceTransformers) for document classification, summarization, and sentiment analysis.




Manage prompt routing and variant testing using Promptfoo or equivalent tools.
Implement multi-agent architectures with modular flows — enabling task-specific agents for summarization, retrieval, classification, and reasoning.
Design fallback and recovery behaviors to ensure robustness in production.
Employ LangGraph for parallel and stateful agent orchestration, error recovery, and deterministic flow control.
Architect ingestion pipelines for structured and unstructured data — including financial statements, filings, and PDF documents.
Leverage MongoDB for metadata storage and Redis Streams for async task execution and caching.
Implement vector-based search and retrieval layers for high-throughput and low-latency AI systems.
Observability & Production Deployment
Deploy end-to-end AI systems on AWS EKS / Azure Kubernetes Service , integrated with CI/CD pipelines (Azure DevOps) .
Build comprehensive monit

📌 AI Software Engineer (Chía)
🏢 Vichara Technologies
📍 Chía