AI Software Engineer
About the Role We are looking for a Software Engineer who specializes in building intelligent LLM-powered agents and Retrieval-Augmented Generation (RAG) systems. You will design and implement agentic workflows that combine reasoning, tool use, and high-quality retrieval over structured and unstructured data.This role focuses on taking AI systems from prototype to production, with an emphasis on reliability, evaluation, and real-world constraints.
What You’ll Do
Design and build agent-based systems that plan, reason, and act autonomously.
Implement RAG pipelines for grounding LLMs in enterprise and domain-specific data.
Build ingestion pipelines for documents (PDFs, HTML, databases, APIs).
Implement chunking, embedding, indexing, and retrieval strategies.
Integrate agents with vector databases and search systems.
Optimize retrieval quality, latency, and cost.
Design orchestration logic for multi-step agent workflows.
Implement guardrails, fallback strategies, and human-in-the-loop flows.
Build evaluation frameworks to measure retrieval accuracy and agent performance.
Deploy and monitor systems in production environments.
Required Qualifications
Strong software engineering fundamentals (data structures, algorithms, system design).
Proficiency in Python
Experience building backend services, APIs, or distributed systems.
Hands-on experience with RAG architectures in production or near-production systems.
Experience with embeddings, vector databases, and semantic search.
Familiarity with LLMs, prompt engineering, and tool/function calling.
Preferred Qualifications
Experience with agent frameworks (e.g., LangGraph, LlamaIndex)
Experience with vector stores (e.g., Pinecone, Weaviate, Milvus, FAISS, OpenSearch Vector Search).
Familiarity with hybrid retrieval (keyword + semantic search).
Experience with evaluation techniques (retrieval metrics, grounding, hallucination detection).
Knowledge of observability tools for AI systems.
Experience implementing access control and data security in RAG systems.
Experience with cloud platforms (AWS, GCP, or Azure).
Strong debugging skills in non-deterministic systems.
Job Type: Full-time
Pay: ₹250,000.00 - ₹1,000,000.00 per year
Work Location: Remote
Location
Remote
Salary
₹3L - ₹10L
Experience
Not specified
Software Engineer at KostCare Infotech PVT. LTD. | GetHired