Artificial Intelligence1 min read

What to know before building an internal AI assistant

A guide to data preparation, RAG architecture, permissions and accuracy measurement for an assistant that answers from company documents.

An assistant that lets employees ask questions of company documents looks attractive. Data and permission design, not model choice, decide whether it works.

What is RAG and why use it?

RAG means searching for the relevant document passages before the model answers. The model is not trained on your knowledge; the right passages are handed to it for each question. Information stays current and answers can cite sources.

What is the most common mistake?

Forgetting permissions. Someone without access to an HR document must not reach that information by asking the assistant. The search step has to be filtered by the permissions of the person asking.

How should documents be prepared?

Old versions, conflicting documents and scanned PDFs reduce accuracy. Start with a current set of documents that have clear owners. Tabular content needs a separate processing step.

How do you measure accuracy?

Build a test set of real questions with known answers and run it after every change. Showing the source and being able to say "I do not know" are the two features that affect user trust most.

FluxPeek MühendislikEngineering team

Our articles come from issues we meet in our own projects.

Related articles