AI phone assistant: how it works and what to watch out for
An AI phone assistant answers calls when nobody can pick up. How the technology works, what the AI Act, criminal law and GDPR require, and how to get started.

You're up a ladder, under a sink or driving to the next customer. The phone rings. If nobody picks up, the customer may call the next business. And when you call back in the evening, sometimes the first thing you hear is: "You never call back." An AI phone assistant is meant to help right here: it answers, understands what the caller wants, answers simple questions and takes down the rest for you.
That sounds practical, and it can be. But on the phone there are rules that are easy to overlook when buying: telling callers it's an AI, recordings, and data protection. This article explains how such an assistant works, what it's good for and what you should clarify before you start. It is for businesses looking for support with incoming calls.
Note: This article gives an overview and does not replace legal advice. As of: November 2026.
In short
- An AI phone assistant turns speech into an answer and speaks it with a synthetic voice. It can access programs such as your calendar if it is set up to do so.
- Since 2 August 2026, the transparency obligation of the EU AI Act (Art. 50) applies: callers must learn that they are talking to an AI at the latest at the first contact.
- Recording calls is a sensitive matter. Anyone who records another person's non-public spoken words without authorisation commits a criminal offence under § 201 StGB (the German Criminal Code).
- Under the GDPR (in German: DSGVO), you must inform callers when you collect their data (Art. 13) and conclude a data processing agreement with the provider (Art. 28).
- Check first whether a simpler solution is enough. If not: start small, with a few clear tasks and always a way to reach a human.
First: do you need AI for this?
Not every phone problem needs an AI assistant. Often less will do:
- a voicemail message that says when you'll call back, instead of just "Please speak after the tone",
- an enquiry form on your website that asks for location, request, photos and preferred callback time straight away,
- fixed callback times, for example every day after the lunch break,
- a notification on your phone when a new enquiry comes in.
If you already use trade business software, ask there. Some providers now have a phone assistant built in. An assistant of your own is more of an option if lots of calls come in with similar requests and you still can't take them.
How an AI phone assistant works
At its core, the assistant is a language model, like the one behind ChatGPT, just with ears and a voice. In its developer documentation, OpenAI describes, among other things, two ways to build one:
- In three steps: Speech recognition turns what was said into text. A language model decides what to do and writes the answer. Speech output reads it aloud. According to OpenAI, this approach fits when each step needs to be visible or replaceable. You have the text in between, can store it, check it before an answer is given, and query other systems.
- In one step: A single model listens, decides and answers directly with a voice. According to OpenAI, the session also takes care of interruptions and the use of tools.
"Tools" means connections to other programs. For example, the assistant can look for a free slot in your calendar or write a callback request into your inbox. You decide what it may do when it is set up.
One point you should test: the waiting time. OpenAI recommends measuring how long callers wait for a useful spoken answer. Long pauses on the phone can sound as if the line has gone dead.
What it is good for and what it isn't
It works well for questions that have a fixed answer:
- opening hours, directions, parking
- taking down an appointment request or offering a free slot
- noting a callback request with name, number and reason for the call
- simple questions about the process ("Do I need to bring anything?")
It gets difficult with anything that needs judgement: a price for work nobody has seen yet, a complaint, a question about health. Expect the assistant to mishear or misunderstand something now and then. That's why every setup needs a clear rule for when it hands over to a person or promises a callback.
For a trade business, for example, this means: the assistant notes what the job is, where and how urgent, and says when someone will get back to the caller. It doesn't quote a price. For a practice: it takes appointment requests and callback requests. It does not ask about complaints, test results or medication.
What you need to consider legally
1. Say that an AI is speaking
According to Art. 50(1) of the EU AI Act, AI systems that interact directly with people must be designed so that these people learn they are dealing with an AI. Exception: if this is obvious anyway to a reasonably well-informed person. With a natural-sounding voice on the phone, you shouldn't rely on that.
According to Art. 50(5), the information must be clear and distinguishable and come at the latest at the first contact. These rules have applied since 2 August 2026.
The obligation in paragraph 1 is addressed to the provider, meaning the maker of the system. But the caller hears your business name. So make sure the notice is right there in the greeting, for example:
"Hello, this is the digital assistant of Example Painters. I am an AI and can help you with appointments and callbacks."
Sounds trivial. Don't leave it out anyway.
2. Recordings: better none than the wrong ones
§ 201 StGB makes it a criminal offence to record another person's non-public spoken words on a sound carrier without authorisation. It is also an offence to use such a recording or make it accessible to third parties. The penalty: imprisonment of up to three years or a fine.
For you, this means: ask the provider exactly whether calls are stored as audio, where and for how long. If you don't need recordings, switch them off. If you do want them, clarify with your legal adviser beforehand how you will inform callers and obtain their consent.
3. Inform callers
Name, phone number, reason for the call: the assistant collects personal data. According to Art. 13 GDPR, you must inform the people concerned at the time the data is collected. This includes, among other things, your name and contact details, the purpose and legal basis, the recipients of the data, any planned transfer to a country outside the EU, the storage period and the callers' rights.
An assistant can hardly read all of that out on the phone. One option: a short notice in the greeting and the full details in your privacy policy. Whether that is enough in your case is something to clarify with your data protection adviser.
4. Contract with the provider
The provider processes your callers' data on your behalf. According to Art. 28 GDPR, you may only work with service providers that offer sufficient guarantees for protecting the data. And you need a contract that sets out, among other things, the subject matter, duration, nature and purpose of the processing. According to Art. 28, the provider may only bring in other service providers with your authorisation. This matters because several services can be behind a phone assistant, for example for speech recognition, the language model and the voice.
Questions for the provider
Before you sign, have these points answered, ideally in writing:
- Does the assistant say right at the start that it is an AI? Can I set the greeting myself?
- Are calls stored as audio? Can that be switched off?
- Where are audio and text processed and stored, and for how long?
- Which other services are involved?
- Is there a data processing agreement under Art. 28 GDPR?
- How does the assistant hand over to a person, and what happens outside opening hours?
- Do I keep my phone number, and how does the call reach the assistant?
- How long does a caller wait for an answer on average? Can I test this beforehand?
Your first assistant in 6 steps
- Collect questions. For one week, write down what people ask on the phone. That gives you the tasks.
- Limit the tasks. Choose two or three tasks with a fixed answer, for example opening hours and callback requests.
- Write down the answers. The assistant is only as good as the information you give it. Keep it short and up to date.
- Set limits. What should it never do? No prices, no answers to health questions, no promises.
- Sort out the legal side. AI notice in the greeting, no unclear recordings, update your privacy policy, data processing agreement.
- Test, then launch. Call yourself, have friends call, including with dialect and building-site noise in the background. Read the first call logs and make improvements.
How we can help
Before we talk about technology, we look at the process with you: which calls are left unanswered, which details are you missing when you call back, who gets back to whom and when? Often the first step is an enquiry form that asks for the details you need, plus a notification on your phone. We set that up in the area of automation. If it's to be an AI phone assistant, we can develop one that fits your business. We work through the questions above with you, so that requests reach you in an orderly way. You'll find more on this and on the obligations under the AI Act in our Artificial intelligence area.
In a free initial consultation, we look together at which calls are left unanswered for you and whether an assistant, a simpler solution or the software you already have is the best fit.
Sources & further reading
- EU-KI-Verordnung, Art. 50: Transparenzpflichten (AI Act Explorer) artificialintelligenceact.eu
- § 201 StGB: Verletzung der Vertraulichkeit des Wortes gesetze-im-internet.de
- Art. 13 DSGVO: Informationspflicht bei Erhebung von personenbezogenen Daten dsgvo-gesetz.de
- Art. 28 DSGVO: Auftragsverarbeiter dsgvo-gesetz.de
- OpenAI: Voice agents (Aufbau von Sprachassistenten) developers.openai.com


