Asset 20 8 2
Does AI recommend your business? Run the free check →

Join 15,000 business owners, marketers and entrepreneurs. The Sunday newsletter you'll be annoyed only arrives once a week.

Article

The AI Notetaker Problem: What Happens When a Client Spots the Bot on Your Call

Bottom line: AI notetakers like Otter, Fireflies, Fathom and Zoom AI Companion now auto-join calls by default on many calendars, and most small business owners have no idea theirs is doing it. That’s a trust problem before it’s ever a legal one, and it’s costing people client relationships they don’t even know they’ve damaged.

The call that went sideways

I was forty minutes into a discovery call with a potential retainer client, a director of a family-run manufacturing firm in the Midlands, when he stopped mid-sentence and said, “Sorry, who’s Fireflies?”

There it was, sitting in the participant list like a silent guest at dinner: “Fireflies.ai Notetaker.” I hadn’t put it there deliberately. It had auto-joined because I’d connected my calendar to the tool three weeks earlier and never checked the default settings. He hadn’t been told, hadn’t agreed to it, and had spent the last forty minutes talking about supplier problems and staff issues he clearly didn’t want transcribed and stored on a server he knew nothing about.

He was polite about it. He was also noticeably more guarded for the rest of the call, and he didn’t sign. I’ll never know for certain if the bot was the reason, but I know the shift in his tone happened the second he clicked on that name.

Why this is happening on so many calls right now

This isn’t a niche problem. Fireflies, Otter, Fathom, Read.ai and Zoom’s own AI Companion have all pushed toward “set it and forget it” auto-join in the past year or two, because it drives usage. Fireflies’ free and paid plans will auto-join every meeting on your synced calendar unless you go into Settings, then Calendar, then switch off auto-join per calendar or per meeting. Otter does the same through its “Otter Notetaker” calendar integration. Zoom AI Companion often gets switched on at the account level by an admin who never mentioned it to the sales team using the account daily.

The result is that thousands of small business owners are recording and transcribing client conversations they never explicitly asked permission to capture, and doing it without meaning to. It’s not malicious. It’s a default setting nobody read before ticking “connect calendar.”

The uncomfortable bit that most people writing about AI productivity tools skip over is this: the reason we don’t ask is that asking feels like it will slow the sale down, and we’re worried the answer might be no. So we let the bot join quietly and hope nobody notices. That’s not an oversight, that’s an avoidance, and clients can usually tell the difference between the two even if they can’t name it.

What UK data protection rules require

If you’re a UK small business, recording a call with a client, even just an audio transcript for your own notes, counts as processing personal data under UK GDPR. That means you need a lawful basis for doing it, and you need to tell people it’s happening before it starts, not after they’ve noticed a bot’s name on screen. “Legitimate interest” can sometimes cover simple note-taking, but if the recording is being sent to a third-party AI vendor’s servers for transcription and storage, most data protection guidance points toward getting clear consent first, because you’re sharing that person’s personal data (their voice, their opinions, sometimes commercially sensitive information about their business) with another company.

Practically, that means: a verbal heads-up at the start of the call, a written line in the calendar invite, or both. It takes fifteen seconds. Most people skip it because they’ve never been caught out, right up until they are.

The five-minute fix

  1. Open your notetaker’s settings today and switch auto-join to manual, per meeting, not blanket for every calendar entry.
  2. Add one line to your calendar invite template: “This call may be recorded and transcribed using AI note-taking software for internal notes. Let me know if you’d prefer it off.” That single sentence covers most of your consent obligation before anyone dials in.
  3. Say it out loud at the start too. Something like: “I’ve got an AI notetaker on this call so I can focus on you instead of typing, are you happy with that?” Nine times out of ten people say yes, and now it’s on record that you asked.
  4. Offer the option to turn it off. If a client says no, respect it immediately, close the bot, and take notes by hand. It costs you nothing and it tells them more about how you run your business than any pitch deck will.
  5. Delete transcripts you don’t need. Most tools default to storing everything indefinitely. Set a retention rule, thirty or sixty days, and stick to it.

Where AI notes help, and where they quietly hurt you

I’m not against these tools. Fathom’s free summary after a client call has saved me real time, and having an accurate record of what a client agreed to on a scoping call has settled more than one dispute over what was promised. Used well, an AI notetaker means you’re not scribbling while someone talks, you’re listening, which is the whole point of the call in the first place.

Where it hurts is when the tool becomes the reason you stop paying attention to the human in front of you, or when its presence signals to a client that they’re a data point rather than a relationship. Howard Schultz built Starbucks on the idea that the person behind the counter should remember your name, not just your order, and there’s a version of that principle worth holding onto here, in the business lessons Schultz left behind: technology should make the human interaction better, not replace the appearance of caring with the appearance of efficiency.

There’s a marketing angle here too, and it’s one I think about a lot. The same transparency that makes a brand like Away work, being upfront about flaws, refunds, and how the product is made, as I’ve written about in how Away built its brand on straight talk, is exactly what’s missing when a bot silently joins a call. Trust, in almost every business, is built by telling people what’s happening before they find out for themselves. Ahrefs did the same thing by publishing their numbers and their process openly rather than hiding behind marketing gloss, something I dug into in the Ahrefs marketing strategy breakdown, and it’s the same instinct: show your working, don’t make people go looking for it.

A script that works on sales calls

If you’re worried that asking permission will make you sound less confident or slow down momentum, try this exact wording, which I’ve used on every discovery call since the Fireflies incident:

“Before we start, quick housekeeping, I use an AI tool that transcribes calls so I can stay focused on the conversation instead of note-taking. It’s just for my records, nothing gets shared, and I’m happy to turn it off if you’d rather I didn’t. Are you OK with it running?”

That’s it. It takes under fifteen seconds, it puts the client in control, and in my experience it makes people relax rather than tense up, because you’ve named the thing before they had to ask about it themselves. The one time someone said no, I turned it off, took notes on paper like it was 2004, and still closed the deal. The bot was never the thing that mattered. The honesty about the bot was.

Napoleon Hill wrote about the importance of a “definite chief aim” backed by trust between people doing business together, and it’s worth remembering, as I explored in the business lessons still worth taking from Hill, that no amount of automation replaces the basic decency of telling someone what you’re doing with their words before you do it.

The bigger pattern worth watching

This isn’t only about notetakers. It’s part of a wider shift where small businesses are quietly automating the parts of client interaction that used to signal effort, a personalised proposal, a handwritten follow-up, a genuine question about their business, and replacing them with tools that run in the background without anyone being told. The same instinct that makes a brand feel trustworthy when it gives customers something transparent to interact with, like the interactive calculators that let visitors see exactly how a number was worked out instead of a black-box quote, is the same instinct that should make you tell a client exactly what’s recording them and why.

If you’re building an AI-heavy way of working, whether that’s notetakers, chatbots, or automated follow-ups, and you want a second pair of eyes on where it’s helping versus where it’s quietly eroding trust, that’s exactly the kind of audit an AI consultant for small business should be doing with you, not just recommending more tools.

Frequently asked questions

Do I legally need to tell someone an AI notetaker is on the call?

In the UK, yes, in practice. Recording and transcribing a call counts as processing personal data under UK GDPR, and best practice is to give clear notice before the call starts, either in the calendar invite or verbally at the start, rather than relying on the participant list to explain itself.

How do I stop my AI notetaker auto-joining every call?

Go into the tool’s settings (Fireflies: Settings, then Calendar, then Auto-join; Otter: Calendar Integration settings; Zoom: AI Companion settings, often controlled by an account admin) and switch from automatic joining on every synced meeting to manual, per-meeting activation.

Will asking permission make me look less professional on a sales call?

The opposite, in most cases. A short, confident line like “I use an AI notetaker so I can stay focused on you, are you happy with that?” reads as considerate and organised, not hesitant, and it puts the decision in the client’s hands before they discover it themselves.

What should I do with old transcripts I never got consent for?

Delete anything you can’t confirm the client agreed to, set a retention limit (thirty or sixty days is reasonable) inside your notetaker’s settings going forward, and add the consent line to your calendar invite template so it’s automatic from now on rather than something you have to remember each time.

Related reading: The AI Notetaker in Your Sales Calls Is Costing You More Than You Think and The AI Notetaker in Your Sales Calls Is Quietly Costing You Deals.

Published and maintained by the Lilach Bullock team, covering marketing, AI and business growth.
Your buyers are asking AI who to use. Does it say you?

See for free whether ChatGPT, Claude, Perplexity, Gemini and Google name you, and get the plan to become the answer.

Check my AI visibility →
Sundays only

Get the Sunday newsletter.

One email a week. AI experiments, marketing tactics, and the workflows Lilach is building right now in her own business.

Subscribe free

Let’s get your marketing running on AI.

Book a free 30-minute call

We figure out what you need, where AI fits in, and what working together would look like.

Book the call →

Or take the 30-second calculator

You’ll see the hours and the money quietly leaking out of your week, and the three workflows worth building first.

Take the calculator →

Or grab the free AI resource library

Prompt packs, templates, checklists, and swipe files. The exact tools I build for paying clients. Yours, free.

Get the library →
Keep reading

More from the blog.