Vichara is a Financial Services focused products and services firm headquartered in NY and building systems for some of the largest i-banks and hedge funds in the world.
Key Responsibilities
Architecture & System Design
- Architect, design, and lead multi-agent LLM systems using LangGraph, LangChain, and Promptfoo for prompt lifecycle management and benchmarking.
- Build Retrieval-Augmented Generation (RAG) pipelines leveraging hybrid vector search (dense + keyword) using LanceDB, Pinecone, or Elasticsearch .
- Define system workflows for summarization, query routing, retrieval, and response generation, ensuring minimal latency and high precision.
- Develop RAG evaluation frameworks combining retrieval precision/recall, hallucination detection, and latency metrics — aligned with analyst and business use cases.

AI Model Integration & Fine-Tuning
- Integrate GPT-4o, PaLM 2, and open-weight models (LLaMA, Mistral) for task-specific contextual Q&A.;
- Fine-tune transformer models (BERT, SentenceTransformers) for document classification, summarization, and sentiment analysis.




- Manage prompt routing and variant testing using Promptfoo or equivalent tools.

Agentic AI & Orchestration
- Implement multi-agent architectures with modular flows — enabling task-specific agents for summarization, retrieval, classification, and reasoning.
- Design fallback and recovery behaviors to ensure robustness in production.
- Employ LangGraph for parallel and stateful agent orchestration, error recovery, and deterministic flow control.

Data Engineering & RAG Infrastructure
- Architect ingestion pipelines for structured and unstructured data — including financial statements, filings, and PDF documents.
- Leverage MongoDB for metadata storage and Redis Streams for async task execution and caching.
- Implement vector-based search and retrieval layers for high-throughput and low-latency AI systems.

Observability & Production Deployment
- Deploy end-to-end AI systems on AWS EKS / Azure Kubern

📌 AI Software Engineer (Bogotá)
🏢 Aimlroles
📍 Bogotá