AI & Agents

Multimodal RAG over Technical Documents

Charts, tables and images in technical documents become searchable text, and answers cite their sources.

Documents are converted to PDF pages; Document Intelligence reads the text and a multimodal model turns each page, with its charts and tables, into Markdown. Chunks are embedded into Azure AI Search. Questions are rewritten, searched by vector and keyword, fused, and answered with citations.

questionrewrite, answerhybrid searchuploadvectors + metadataMicrosoft AzureQuestion answeringIngestion pipeline · batchUsersengineers, staffChat front endReactBack-end APIAzure VMsAzure OpenAIchat model · rewrite, answerRAG evaluationmethods comparedAzure AI Searchvector + BM25, fusedSource documentsPDF, DOCX, XLSX, PPTXRaw filesBlob StorageConvert and splitLibreOffice, page imagesAzure AI DocumentIntelligenceOCRMultimodal modelpage to MarkdownChunkingby Markdown headingsEmbedding modelAzure OpenAI embeddings

Point at a component to light its links; select it for what it does here and the practice that makes it right on Azure.

When to use it

  • Manuals, specifications and reports where the answer is in a chart or table
  • Mixed formats (PDF, Word, Excel, PowerPoint) that plain text extraction misreads
  • Teams on Azure who need answers they can check against the source page

How NGT delivers it

Built from code, reviewed at a gate by an NGT architect, and handed over with runbooks your team can run.

AI & Agents