AI Engineer - Document Intelligence (2-6 Years Experience)

**Location:** Hybrid - 2-3 days in office (Delhi / Gurgaon) **Company:** Lighthouz AI **Domain:** B2B SaaS ### **About Lighthouz AI** Lighthouz AI is automating the back office accounting of freight brokers with freight-native AI agents. Our AI agents process messy document paperwork in accounting in secondsnot hoursby replacing manual data verification, extraction, & audits and brittle RPA. Our platform thrives in real-world document chaosscanned and handwritten paperwork, and ambiguous emailsexecuting complex workflows automatically. The result: faster invoicing, quicker time-to-get-paid, fewer disputes, and 10x operational growth. We're a Y Combinator S24 company, founded by a team with deep experience across AI, supply chain, and enterprise systems (Google, Georgia Tech, Progressive). At Lighthouz, we're not just streamlining freight financewe're rebuilding it from the ground up. * * * ### **Role Overview** We're seeking an AI Engineer (Document Intelligence) to design, build, and maintain intelligent agents that will automate and transform document-based freight workflows. You'll work on the two core components of our AI agents first, the core perception systems that extract structured insights from messy, real-world freight documentshandwritten, scanned, distorted, or multi-page and second, our AI agents for email communications between freight parties. You will push the boundaries of creative prompt engineering to solve real-world problems at scale, fine-tuning LLMs, building large-scale document classification and entity extraction models, communication understanding, intent classification your code will be at the heart of automating financial decision-making in freight. You'll collaborate closely with the backend and product teams to bring AI models to life in production environments and continuously improve performance in the wild. **What You'll Do** * Create accurate and reliable systems to extract and analyze knowledge from documents * Architect, implement, and deploy AI agents for email and phone communications between freight accounting parties (payer/payee), leveraging language and vision LLMs for automation and analysis. * Design and refine high-impact prompts, templates, and evaluation harnesses to ensure robust, reliable agent behavior. * Build scalable pipelines for preprocessing, training, inference, and feedback loops, including evaluation and integration of VLMs. * Monitor and diagnose agent performance in production, rapidly addressing failures and refining prompts, workflows, and models. * Create and maintain high-quality training, evaluation, and test datasets. * Enhance the AI stack through creative prompting, fine-tuning, and continuous iteration. * Productionize models within Lighthouz's intelligent automation platform. * Collaborate with product and engineering teams to integrate AI outputs into document, email, and voice workflows, delivering polished, production-ready solutions. * Continuously improve model performance in real-world conditions. ### **What We're Looking For** * 2+ years in ML/AI roles, ideally in document AI * Deep learning expertise with PyTorch, TensorFlow * Prompting wizardry skilled at crafting precise, reliable prompts for VLMs & LLMs, translating complex tasks into actionable instructions * Experience fine-tuning VLMs * Strong knowledge of OpenAI, Claude, and other agentic toolkits * Hands-on with OCR, visual transformers, multimodal models * Background in conversational AI, voice AI, NLP research, and LLM training * Proven track record of training & deploying models to production * Problem-solver & builder mindset fast to prototype, faster to iterate * Comfortable with ambiguity and evolving datasets ### **Nice to Have** * Experience with AWS, Azure, or GCP-based ML infrastructure * Exposure to RAG pipelines, foundation models, or vector search systems * Knowledge of document layout understanding (e.g., Donut, LayoutLM, PubLayNet) * Background in building secure, production-grade ML services * Prior experience working in a startup ### **What We Offer** Competitive salary High ownership, zero bureaucracyhelp shape our AI stack from day one Work on impactful real-world problems that blend AI and automation at scale