AI assistant or AI agent? And how to let it into your system without losing control.
Every system now says it has AI. Some of it is a chat window that writes lovely sentences about numbers it never saw; some of it goes into your books and changes them. The difference is not the name but three questions: where the number comes from, whose permissions it works with, and what happens before a step that cannot be undone. This guide is written to be useful with any vendor you sit in front of; at the end we tell you where we stand.
First: an assistant and an agent are not two names for one thing
Three different things are all sold as "AI inside the system", and they are built differently:
- A chat window stuck on the system — it answers from general knowledge, not from your data. It looks clever in a demo and invents figures when it does not know.
- An AI assistant — you ask, and it answers from your own system: it reads invoices, stock and payroll with tools, shows the figure and the table, and does what you ask with your permissions.
- An AI agent — it works on its own on a task you gave it: every morning, when a document is submitted, at month end. It reads, prepares, and brings you whatever needs your decision.
Ask in the demo: "How many invoices are overdue right now?" Then open the system and count them yourself. If the numbers differ, you are looking at a chat window, not an assistant.
What each one does on a real working day
The assistant is for the question you have now; the agent is for the work that comes back every day:
- Sales — you ask the assistant "this month against last?" and get the figure. You give the agent a report that reaches you every morning.
- Collections — the assistant tells you who is late and since when. The agent reviews the late payers every Sunday, drafts the reminders, and waits for your OK.
- HR and payroll — the assistant answers "what is this month's payroll?" The agent reviews leave requests and shift swaps every day and prepares the payroll at month end for you to approve.
- Stock — the assistant lists the items running low. The agent tells you the moment a stock movement breaks a reorder level.
If you ask the same question every week, it is not a question. It is a task, and it belongs to the agent.
Seven questions to ask any vendor
Print these and take them with you. Each one reveals something the demo does not:
- Whose permissions does it work with? If it can see what the person asking cannot, you have handed a new hire the keys to every department.
- Where does the number come from? Ask to see the steps: which report it read, which filter it used. A figure you cannot trace is not fit for a decision.
- What happens before a step that cannot be undone? Submitting an invoice, paying, deleting, sending to a customer — does it do it alone or wait for explicit approval?
- Can you see every step afterwards? Who asked, what it read, what it changed, and when. Without a log, nobody is accountable.
- How is it priced? Per message, per user, or unlimited? Ask for a monthly cap where it stops, not a bill that surprises you.
- Where does your data go? Is the model trained on your conversations, and can you say no? The answer should be written, not spoken.
- How do you stop it? One switch that stops an agent, or all of them, at once — ask to see it.
If the agent gets it wrong, how will you know? A silent mistake is worse than a stop. Ask what happens when a step fails, and who is told.
Levels of autonomy: start at the bottom
Do not give an agent everything on day one. The four sensible levels:
- Report — it reads and tells you what it found, and changes nothing.
- Draft — it prepares documents, comments and assignments as drafts for a person to review; it never submits or sends.
- With approval — every change it wants becomes a request that waits for someone to approve it.
- Act — it makes small changes on its own within a limit; everything else waits for approval.
Ask for a test run that changes nothing and tells you what it would have done. If there is none, you are testing on your real data.
What breaks in the second month
In week one everything looks wonderful. The problems appear once people get used to it:
A clerk asks it about colleagues' salaries and gets an answer. The AI bill arrives at three times the estimate. The agent sends a customer the same reminder twice because the task ran twice. It gives a figure that differs from the report and nobody knows why. It stops working and tells no one.
Every one of these has a question among the seven. Ask it before you sign, not after the first surprise.
Red flags in the demo
- It answers with figures and will not show where they came from.
- It answers questions beyond the permissions of the user trying it.
- "It can do anything" — with no word on what waits for approval.
- No cost cap, or "pricing depends on usage" with no number.
- It is shown on prepared demo data and you are not allowed to ask your own question.
- No written answer about training the model on your data.
Tell the vendor: "Log in as a sales user, ask it for the accountants' salaries, then ask it to submit an invoice." This shows permissions and approvals in two minutes.
Checklist before you switch it on
- You saw its answer match the system's report.
- You tried it with a limited user, and it stayed within those limits.
- You know what waits for approval, and who approves it.
- You know the monthly cost cap and what happens when it is reached.
- You saw the log of steps yourself.
- You have the answer in writing about your data and training on it.
- You know where the stop switch is.
And where we stand
We built Managely's AI Team on the answers above. The assistant and the agent work inside the system itself, with the permissions of the user who asks and nothing above them, and they read your data with tools, so no figure is without a source. Submitting, sending, paying and deleting wait for a confirmation, and every step is logged under the name of whoever asked. An agent works on tasks a manager sets — on a schedule or when a document changes — at one of the four levels, and no task is switched on before a test run has passed. Each agent has a monthly and a daily cap from a separate wallet, and a switch that stops it at once. And we learn from your conversations only if you explicitly allow it.
We will not tell you it replaces your team. It answers, prepares and follows up; the decisions stay with the people who own them. And this guide works with any other vendor too.
The AI agents page shows each agent, what it does and what it never does, and you can start with a single assistant.
Meet the AI agents
Leave a comment