Endless Customers Endless Customers Podcast

Half Of All Web Traffic Is Now Bots. Is Your Site Ready? [Endless Customers Podcast Ep. 193]

At a Glance

Do you still need a website now that AI answers buyers' questions?

Even with website traffic falling, your website plays a critical role in your business' visibility. AI agents now visit websites to research on buyers' behalf, and AI tools pull their answers from your site and third-party sites. To earn a recommendation, a website needs clear headings, key information in plain text instead of images or hidden accordions, and claims backed by numbers, reviews, and dates.

Who This Episode Is For

  • Business owners watching website traffic fall and wondering whether the website still matters
  • Marketing leaders who want to know what an AI agent sees when it visits their company's site
  • Anyone who has asked ChatGPT or Claude for a website audit and isn't sure which advice to follow

View the full transcription of this episode.

Close Transcript Popup Close Transcript Popup Default

This transcript has been generated by AI and not checked for accuracy. 

[00:00:00] Bob Ruffolo: Your website may already be getting more visits from AI agents researching on behalf of potential customers than from those actual customers themselves. So how do you make sure both AI and people can understand what you do, who you help, and why they should trust you? Today, I'm joined by Mary Brown, website strategist here at Impact.

[00:00:17] Bob Ruffolo: We'll get into what information needs to be easy to find, how to back up your claims, and a simple way to check where your site needs work. Let's get into it.​

[00:01:09] Bob Ruffolo: And welcome back to the Endless Customers Podcast. We are here in the studio with Mary Brown, website strategist. Welcome to the show.

[00:01:18] Mary Brown: Thank you. Glad to be here.

[00:01:19] Bob Ruffolo: And now Mary, for those of you that don't know Mary, she's been with IMPACT for six years, uh, works with many of our clients to help them get their website strategies right, optimizing their sites.

[00:01:27] Bob Ruffolo: But Mary was also our highest rated speaker at Endless Customers Live, so we had to bring her right onto the show. So thanks for joining us today.

[00:01:35] Mary Brown: Uh, you got me with that, Bob. I did not know you were gonna say that.

[00:01:38] Bob Ruffolo: Well, no, you were, you were great, and thank you for how hard you worked on the, the event. Um, and I think everyone loved your presentation so much. Um, now obviously you talked about, um, the future of websites and who's gonna be using your website and how you make a website that's great for buyers and how you also make a website that's great for AI, 'cause bots are going through s- uh, your, your site, and we're gonna talk a lot about that today.

[00:01:59] Bob Ruffolo: But you also throw [00:02:00] down some websites right in front of everybody, real websites of audience members. People love that. Um, so we're gonna dive into all that today. Does that sound good?

[00:02:07] Mary Brown: sounds awesome.

[00:02:08] Bob Ruffolo: Cool. All right, so let's just start really, really high level. Um, I think we all know, uh, AI is here. Um, we know humans go to websites.

[00:02:17] Bob Ruffolo: Now, I don't think everyone fully processes that AI actually goes through websites a lot like humans. Some people might think, "Oh, how do we block bots from going to our site?" But we don't wanna be doing that. Give us the lay of the land. What's going on with, with bots and websites today?

[00:02:32] Mary Brown: There is a huge shift that has happened, and Cloudflare... So for those who are not familiar, Cloudflare is a huge global player in website, uh, infrastructure and cybersecurity. They have reported that around 50% of web traffic today is non-human- Wow ... is bot. That is a huge, huge number. Um, so that is the big shift that everyone is focusing on now is what is, what does that [00:03:00] mean?

[00:03:00] Mary Brown: Um, what does it mean for how our websites are structured and how we build them? And does it mean that no one is ever gonna... a human is never gonna visit our site again? And is that a bad thing? And what do we do about it? But I think because, um, these numbers are only growing, it's getting a lot of attention, but people know less about what to do about it.

[00:03:19] Bob Ruffolo: So what do you think that means? So, you know, okay, so we have bots going to websites and, you know, I guess the easiest thing w- that we should shift mindsets to say it probably is a really good thing because that means that these AI agents are being sent out to do research, and they're finding your company, they're finding your site.

[00:03:36] Bob Ruffolo: You're in the conversation at least, and AI might come back after they do their research to the human in those platforms and say, "Hey, you should probably check out this company," right?

[00:03:45] Mary Brown: Yeah. I think, uh, the word traffic and how you look at it is where we should go with this because a drop in traffic doesn't mean that the website information that you've got isn't being processed. It's just being processed [00:04:00] by a bot instead of human now.

[00:04:02] Bob Ruffolo: that's not being count as a visitor to the site?

[00:04:04] Mary Brown: Right. So the interesting thing that I like to break down with people, uh, because they're saying, "Do I not need a website?" Or, "What do I do with my website?" Um, is that you still need a website, first of all. And the way that bots are processing information as of right now is largely being broken down by intent.

[00:04:22] Mary Brown: So, um, zero-click, which a term we're all familiar with by now, right, is when someone sees an answer in an AI Overview, and they are not clicking through to a website, so there's no click happening. The answer happens right there in the overview, is you can break it down by intent. So 71% of searches are ending without a click.

[00:04:41] Mary Brown: Huge number. If you break that down by intent, though, 74% of that is largely top-of-the-funnel informational searches, right? So people wondering definitions. What is this? How do I do this? So that's being eaten by zero-click. 31% of that is being eaten by more bottom-of-the-funnel, [00:05:00] um, I'm ready to make my decision.

[00:05:01] Mary Brown: So it is largely different based on that intent. So first of all, um, understanding that you still need a website for all of it, but how that, uh, website information is being, uh, consumed and where it's being consumed is what's changing. 

[00:05:17] Bob Ruffolo: So that's

[00:05:17] Bob Ruffolo: changing. So that's interesting you say that. So you say 31%, and I think we just need to clarify for the audience, too.

[00:05:23] Bob Ruffolo: Um, zero-click has always been a thing. Um, it's not like just because AI came out that all of a sudden people stopped clicking into Google. There were searches forever that people searched something and then they actually never clicked on a website. So that 31%, I don't know what it was before, but I'm gonna imagine that probably hasn't changed much.

[00:05:39] Bob Ruffolo: It's the top of funnel, like what is this? Or, you know, something that you normally would have landed on a blog article for and you have researched. You're not in buying mode yet. That traffic has generally gone away, right?

[00:05:52] Mary Brown: Yeah, absolutely. Um, and the other interesting thing that I like to talk to people about is, okay, so those answers are [00:06:00] being found, um, and we understand that being cited, being mentioned, uh, is really, really important for people.

[00:06:06] Mary Brown: But another thing to know is that a lot of mentions by, of brands are happening from third-party resources and not by even the brand's own website or its- Yeah ... its own pages. So it doesn't mean, oh, I shouldn't have that information on my site. It's that a third party might be finding that information on your site and then repeating it, and that's where AI could be getting its answer from.

[00:06:30] Mary Brown: So you still need, you know, any of that, uh, top-of-the-funnel content that's really important in the big five, you still need to answer that so that third parties can find it, and then they can source it for AI, so it's still being answered.

[00:06:43] Bob Ruffolo: Yeah, and, and, you know, uh, I'm sure there's gonna be more technical people listening to this who are gonna probably be more specific on how this works. But these models are being trained on what's available on the internet. Um, and they go out and they crawl and they learn, and they learn, and they learn, and they learn.[00:07:00] 

[00:07:00] Bob Ruffolo: Um, and then they get locked in at a certain point, and they say, "Okay, this is Opus 5.5. This model is done. It's shipped. We're shipping it out. It is what it is." Um, all that Big Five content you created could be training the model. So when AI is answering a question, it might not go to the internet and do research if it already knows the answer because it's already learned from you, so you're not getting that bot traffic, you're not getting human traffic, but you're still in the conversation 'cause you're built into the model.

[00:07:30] Bob Ruffolo: Another way of looking at, at that, too. It's... I mean, this is just a totally different world we're living in than it was just three years ago

[00:07:35] Mary Brown: Yeah, and that's a really important distinction. I'm glad you brought that up.

[00:07:38] Bob Ruffolo: Now, another, another thing that's interesting too, so think about website traffic. Um, any time a browser, uh, loads a website, that counts as a session or a website visitor. Now, we were just talking about this before we started, and I found this to be pretty interesting, is that when I'm using ChatGPT or Claude, I'm a power user.

[00:07:58] Bob Ruffolo: I'm on it all day. You are too. [00:08:00] Most of our staff is. And we're going through websites, and it's opening up websites. Um, I'm not even looking at what's on the page. So Claude or ChatGPT are doing an activity for me, they're doing a task, doing some research, and they're flying through screens. That's an AI visiting the site, a bot going, doing-- using the site.

[00:08:18] Bob Ruffolo: I'm not looking at it even though it's open on my, my screen.

[00:08:21] Mary Brown: Right.

[00:08:22] Bob Ruffolo: So even that traffic that we're seeing that maybe, okay, we used to get, you know, 100,000 visitors to our site, now we're only getting 30,000 visitors to our site. But even some of that is probably still AI and not humans looking at it, which is another weird way of looking at it too

[00:08:34] Mary Brown: Yeah. Uh, and I think that's one of the important things for people to learn about this. You're saying there might be some more technical people listening, but for those who aren't as familiar with that, um, that kind of browser-based, uh, AI visiting, it's good to know how all of that works and how your website needs to be prepared for it, because they aren't visiting websites the way we visit websites, and they're not [00:09:00] looking at pages the way we look at pages.

[00:09:02] Mary Brown: So it's important to know, um, what you need to do to your website to prepare it for that.

[00:09:06] Bob Ruffolo: Now, I was at your session at Endless Customers Live, so I know exactly where you're going with this. So let's continue pulling on that thread, um, 'cause that's what the audience really wants to know. What do I do right now? Okay, so do I need to do something different with my site to make it more ready for AI and bots that will help me continue to get more customers?

[00:09:29] Mary Brown: I think to know what you need to do, you first need to understand the why. So one of the big differences between the way humans and AI look at websites is a human can go to a website, and we love design, right?

[00:09:43] Mary Brown: We love things that are aesthetically pleasing, and design has a lot of inference that it can give us from heading styles, um, and things like images, and maybe people have even text in images and those types of things. And humans can do a lot of inference and [00:10:00] understand things based on design. AI does not look at a website that way.

[00:10:05] Mary Brown: AI does not- It could ... do inference right now.

[00:10:08] Bob Ruffolo: It could, but it won't, right? There's a, that's also important distinction to make is, um, if you tell AI to go...

[00:10:16] Bob Ruffolo: If it's out doing its research, what we've learned is AI is lazy, right? They don't wanna burn... And, and it's all on purpose, right? They just don't wanna burn a lot of tokens and, and burn a lot of usage going deep into a website trying to understand all of it. So it goes as light and quick as it possibly can, front load things, headlines, text, and it gets out of there.

[00:10:36] Mary Brown: Yes.

[00:10:37] Bob Ruffolo: Unless you tell it to go back and look at it in great detail again, which most of us don't do. 

[00:10:41] Unknown: Right

[00:10:42] Mary Brown: and the, the people who do that and challenge that are, they're people like us who do this work, and we're trying to understand how it works. Your average buyer doesn't wanna know how it works. They don't care to know, nor should they.

[00:10:55] Mary Brown: Yeah. Nor do they need to. Uh, but what we know and what we've learned is that it has to be [00:11:00] stupid simple for AI to get the information it needs, like you said, because it's moving so fast. So making sure that everything is in that plain text, in that HTML. It's reading that HTML. Um, it's scanning headings, which people do that too, right?

[00:11:15] Mary Brown: It's just not looking for that additional inference. So the job, if I could say it most simply, is just to make it as easy for AI, AI to parse the information as possible. So make sure, um ... You know, I used to be a journalist. I used to be a writer. I used to love narratives and how to tell stories, and that was a really important part of the marketing copy that I wrote in emails and on websites and things like that.

[00:11:40] Mary Brown: And we've gotta change that mindset where we're not about the narrative anymore. You've gotta give the answer to the question, right? And we need to speak in a format of questions and answers. I know from doing lots of research with client sites where I'll have it review a page. And I'll say, "Hey, [00:12:00] compare our client page to a competitor, uh, local page, and tell me which one you think is stronger."

[00:12:05] Mary Brown: And it will highlight things like, " Well, this H2 told me it was in this local area, and this H2 told me this and that." And I could say things like, "Well, it was in the subtext. Did you not read it?" It's like, "Nope. Sure didn't. Didn't read the pre-headers, didn't read all that stuff. I just scanned the H2s." So making sure that you have those things in mind as you're shifting the content on your site, and that's

[00:12:30] Mary Brown: The best part is this, these are easy things to fix, right?

[00:12:33] Bob Ruffolo: And, you know, one of the best piece of advice I received about this came from AI telling me what it wants from a page. It reads web pages like a table of contents. That's the easiest way to remember this. You have a title of the page, just like the title of a book.

[00:12:51] Bob Ruffolo: You've got an H1, which, again, is very similar. And then your H2s are like each of your chapters, and H3s are like sections [00:13:00] of those chapters. And you really wanna structure all your pages like that. And sometimes we use an H2 or an H3 because we want big font. We want a big headline. We want emphasis or something.

[00:13:09] Bob Ruffolo: That's wrong. There's other things you use from an HTML standpoint, like spans and, and, and emphasis and things to, to do that, but the structure of the page matters so much. It always has for Google and SEO, but it matters even more for AI today

[00:13:23] Mary Brown: Yeah, and this is where, I mean, we've been telling people for years that it's better to be clear than cute or to be clever, but now it's, it's more like a human might read your clever headline and go, "Huh, okay, they've got some personality," but it's- Yeah

[00:13:37] Mary Brown: gonna do nothing for AI. So that clarity is just more critical than it ever has been.

[00:13:43] Bob Ruffolo: And I still think there's a place for great writing with narratives and a story. Um, but most research, people, people doing research, whether they're in buying or AI, whatever they're out there doing, we just don't have [00:14:00] patience for that anymore. We wanna get in, we wanna get our answer, we wanna get out, and AI is the same way.

[00:14:05] Bob Ruffolo: So if we were gonna go and say, um, what is Endless Customers? Say we're gonna have an article for that. We can't have a whole backstory of what, you know, what's changed in the world and all this, uh, to get to a main point like you would, like we did in the book, right? In the beginning of the book, we have that, and that's where that belongs.

[00:14:27] Bob Ruffolo: But on the website, what is Endless Customers? Like, quick answer right up front. Like, here, matching it right up. A- and that's what AI's looking

[00:14:34] Mary Brown: Yeah, and I think, like you're saying, time and, and place is really important, context is really important, so, um, I still consume content online, and I am a human, and when I consume content online, I want it to be well-written and I want it to be written for me.

[00:14:50] Mary Brown: So that to me is very different, and I think the s- you know, some of the articles and content we put on our website, we still have the human buyer in [00:15:00] mind, and we still write that content for them so that it's quality good content so that... You know, we want humans to be reading the stuff that we put out there as well.

[00:15:07] Mary Brown: Um, um, I'm thinking more about, you know, when it comes to your website and answering the questions you have to answer for someone to be able to move along in their journey and buy, that stuff has to be absolutely crystal clear.

[00:15:18] Bob Ruffolo: Yeah. One of the things that we're doing, um, on our site, so obviously we, we, we understand the difference b- between this. Um, we still want the narrative, and we're writing these guides that educate and they have that narrative. It's not an AEO play. We know that. We have other articles that-- Marcus talked about this at a past Endless Customers Live.

[00:15:39] Bob Ruffolo: It's like you almost have to have two blogs. And I think we've probably evolved and, and learned more from that. But we will be writing a guide that's very educative. It's a 20-minute read. It's, it's something we're gonna assign to somebody because we're controlling their learning experience from that.

[00:15:54] Bob Ruffolo: But we're gonna have articles that answer very similar things, but it's gonna be written much more where people are doing [00:16:00] quick research or AI doing quick research, and that's the way that needs to be worked.

[00:16:03] Mary Brown: piece is gonna be important.

[00:16:04] Mary Brown: Yeah. Yeah. That's a good point. I mean, you should be able to know instantly where somebody's service areas are, and AI needs to know where someone's service areas are. But that's very different from if you're making a big dollar purchase, there's so much more, uh, information that the human is gonna wanna know as they consider that as well.

[00:16:22] Bob Ruffolo: Um, what else on a website? So we talked about obviously the structure of the page, the H1s, H2s. Um, is there anything else that you're seeing that's a key difference between, um, maybe a website that we've-- or our website is right now and we want to improve it for bots going to our site for either visibility or accessibility?

[00:16:44] Mary Brown: Absolutely. So first of all, and it's, it's almost funny that, uh, I have to say this, but making sure your bot can-- I mean, your site can be crawled by AI - Yeah ... is actually important. And you might think, "Wait, it can't?" Well, some- sometimes a site [00:17:00] can't.

[00:17:00] Mary Brown: So, uh, every website has a robots text file, robots.txt file, and that is a file where you can put directives, where you can say, "I wanna block this," or, "I wanna block that." And I know there are some companies out there who said, "I don't want my site to train bots." Um, and you can put a directive in there to say, you know, "We're blocking bots," um, you know, Grok bot, whatever it is, from using our site.

[00:17:25] Mary Brown: But for companies that want their site to be open and crawlable and findable by all of that, um, you wanna make sure that your robots.txt file allows for that and is open to crawling. So that's kind of step one, is making sure that you've got the right AI directives- Yeah ... in there that say, "We're good.

[00:17:43] Mary Brown: We're open. Come on in."

[00:17:44] Bob Ruffolo: So, you know, that's interesting 'cause it reminds me of, um, again, the SEO days. It's-- We would have our websites and we knew certain content we wanted to be in the search results, and certain content we didn't want to be in the search results. And the way we would do that is with the [00:18:00] robots.txt, we would block things.

[00:18:01] Bob Ruffolo: Mm-hmm. But now it's the same thing. Are we blocking bots from seeing our site as well? So that's a simple way to, to think about this, is when you're talking about a robots.txt file, why does that exist and, and what, what should we be using it for? You may have certain parts of your website that you wanna block bots from accessing, um, because that might have certain information.

[00:18:21] Bob Ruffolo: It's not the marketing part of your website, it's an operations part of your website. But yeah, all your marketing stuff has to be-- make sure it's accessible. How do you test for that? 

[00:18:29] Unknown: I would-

[00:18:31] Mary Brown: you have to make sure it's successful. How do you test for that? So I would... You can do a few things. Um, a robots.txt file is really easy to find. It's usually just domain/robots.txt. So you can look at that and check, or you can ask your AI of choice, or ask a bunch of different LLMs.

[00:18:43] Mary Brown: Um, that's one thing that if you've never done that before, do it. Go ahead and check your, um, site and say, "Hey, can you crawl my site? What do you see?" Um, that's... And you mentioned this earlier, Bob, where you were saying, uh, "I have, I have a question, I ask the AI." [00:19:00] Yes. So do that. Yeah. Get really comfortable doing that.

[00:19:03] Bob Ruffolo: Yeah. I mean, that's the best way to, to optimize for AI is ask, "How should I optimize for you?" Just, "Look at my site, tell me what to do." Now, Gemini can't do that, which I think is really weird. Um, Gemini, uh, for whatever reason, if you put a URL in, it's like, "I can't read your URL."

[00:19:19] Bob Ruffolo: Everyone else can, but Gemini can't for whatever reason. It's frustrating.

[00:19:21] Mary Brown: Yeah.

[00:19:22] Bob Ruffolo: But Gemini has the best advice, I find

[00:19:24] Mary Brown: They're, they're different for different, uh, people for different purposes, and I think that's one of the things that can be really overwhelming for people. It's like, "Well, where do I start? Which one do I use?" And I know a lot of us at Impact use different LLMs for different purposes for different things.

[00:19:39] Mary Brown: So, um, I would also advise that people explore and, you know, try different things. Um, and also test one answer with another LLM. I do that all the time. If I write schema in ChatGPT, I give it to Claude and I say, "I want you to review this schema that ChatGPT did and tell me if it's..." And it will find stuff that [00:20:00] ChatGPT got wrong.

[00:20:01] Mary Brown: So it's really useful, uh, 'cause they see things differently. 

[00:20:04] Bob Ruffolo: Yeah. Um,

[00:20:06] Bob Ruffolo: my hack for Gemini, by the way, what I do is I take a screenshot of the entire page, and then I also take all the HTML for the page, and I put both of those into, to Gemini.

[00:20:17] Bob Ruffolo: Then I say, "Analyze this page. How it could be better?" Because I-- what I said, I think Gemini has the best advice to your point.

[00:20:22] Mary Brown: Yeah。

[00:20:23] Bob Ruffolo: ChatGPT, I find, and, and, and Claude be very agreeable. They're like, " That's

[00:20:28] Mary Brown: say, Bob 

[00:20:29] Bob Ruffolo: Yeah,

[00:20:29] Bob Ruffolo: gonna save us. Yeah. It's like, "That's a great idea." Or... And they, they miss things. And where Gemini, I just find to be a little bit more rigid and a little bit more tough.

[00:20:35] Bob Ruffolo: It's like, and it gets more technical, and I love that. So when you have the balance between the two, and sometimes I'll have them talk to each other. So I'll like-- And I'm sure there's a better way of

[00:20:44] Mary Brown: me out of it.

[00:20:44] Bob Ruffolo: Like a round robin. Yeah, it's sort of. Um, where I'll have my ChatGPT set up, and then in the browser, I log into Gemini- Yeah

[00:20:52] Bob Ruffolo: and I say, you know, "Send prompts over to Gemini, you know, Gemini can read, and you guys go back and forth." And it's like, "Gemini had a great idea." It's [00:21:00] like, "All right. This is pretty cool."

[00:21:01] Mary Brown: And Gemini's the only one that can watch video, right? It's, uh, 30 seconds or

[00:21:06] Bob Ruffolo: be. It used to be. I think the other ones can now see video a lot more, yeah. Yeah. Um, but for a while, Gemini was the only one that could see video. Yeah, so you could take a screen recording or whatever and pop it in there. Um, cool. You know, uh, this is going off our script a little bit. Um, yes, we have show notes, and as anyone that listens to the show knows, I just kind of go where the conversation goes, which Ashley loves when she has to write all these articles up.

[00:21:28] Bob Ruffolo: But we were talking about attribution, and I think, you know, tracking AI visibility and, and all this, I think there's still a lot of questions out there. Um, yes, our analytics will tell us if we have a source, and it's ChatGPT or Claude or whatever, it could tell if it's an AI source. Um, but you and I were talking about, like, you have clients or, or at least people coming to you and saying, like, "I want to know exactly what comes from this."

[00:21:56] Bob Ruffolo: Um, what are you seeing? I know I have my opinions, too. Let's have a nice riff on that.

[00:21:59] Mary Brown: [00:22:00] So I have been doing website strategy for over a decade, and it's long been part of my conversation with clients that if you want black and white answers, if you want definitive answers, this isn't the place you're gonna get 'em.

[00:22:14] Mary Brown: I'm very sorry. Uh, that's just not how web land works. Attribution has always had issues with it, and AI is only adding another new kink to it. So if I recommend to a client, you know, let's add an llms.txt file, which is like a, a little welcome packet on your website, right? And we're saying it's gonna give information about who you are and all of the pages on your site and what they're for and blah, blah, blah, and someone says, "Okay, so what's that gonna get me?"

[00:22:40] Bob Ruffolo: Yeah.

[00:22:41] Mary Brown: I don't know. Uh, it's something that we're doing that makes sense and is very smart because we're trying to put your website in terms the robot can parse extremely quickly. So it's a smart thing to do, right? But if you want me to draw a direct line between adding an llms.txt file to your website and what you're [00:23:00] gonna get out of it, I cannot do that for you.

[00:23:02] Mary Brown: It's just not possible, and I think that's something that people are struggling with with AI attribution overall is if I do this thing, what am I gonna get out of it, or how do I directly at- a- attribute ROI to one effort I made with AI? It's, it's so impossible, and you brought up a really good example, um, that I would love for you to share here.

[00:23:21] Bob Ruffolo: Yeah. Well, I, I gave the, a very basic example of like, um If attribution with, like, analytics, um, if somebody goes to Google and they type in IMPACT and they land on our website, um, our Google Analytics or HubSpot Analytics will tell us that you got, uh, one visitor from organic. And we can say, "Oh, it must be our SEO efforts."

[00:23:46] Bob Ruffolo: But what happens if behind the scenes, which we didn't know, it's that I told you, "Hey, there's this great company called IMPACT. You should check them out." And your activity was like, "Great." And you go onto Google and like, "I'm looking for IMPACT," and then I go [00:24:00] there. Is that an SEO thing? No, it's a branded term.

[00:24:02] Bob Ruffolo: It's... The attribution should go to me, who was the one that said, "IMPACT's a great company. You should go with them." However, now attribution, this is the, the crazy thing about attribution, there's another layer here that, again, this is all, like, um, you can't track this stuff, right? It's word of mouth, and people forget.

[00:24:18] Bob Ruffolo: We always think, "Oh, well, we'll just ask people and they'll just tell us the answers." Like, no, people are gonna remember some of it, and we have an unconscious or, um, a subconscious part of our brain. We don't always remember why we do things. We just know we should be doing things. So what if the reason why I referred you to IMPACT was 'cause I worked with Mary at IMPACT, and to get me to sign on with IMPACT, Mary had to work really hard to build my trust and, and really just, you know, she spent so much time nurturing me and educating me to the fact that I said, "Fine, I will give you my business."

[00:24:52] Bob Ruffolo: And then Mary did a great job for me. That's why I'm referring IMPACT. And so who gets the [00:25:00] credit? Is it SEO because I just happened to show up for my own branded term, or was it me, the customer, who referred you to IMPACT, or is it really Mary, who worked really hard to do such a great job? And we can go even another layer back.

[00:25:15] Bob Ruffolo: The CEO of IMPACT trained Mary, and Mary made her awesome, so I should... No, I'm just kidding on that. No, Mary was awesome before she came here. But you get the point here is that so many people want really, like, precise attribution reporting, and I've always said forever, I, I barely ever swear on this show, but attribution's bullshit.

[00:25:32] Bob Ruffolo: It really is. There's just so much that goes into it, so many people that are part of the decision, so many things that factor into a decision. There's lots of different points. It's almost impossible to track everything. But what you t- what you do really well, and I believe in, the way I've always ran our marketing, and at one point when traffic mattered, we had almost a million people to our site.

[00:25:52] Bob Ruffolo: Just do the things that you know are right. If Google's telling you to do things, do the things that Google's telling you to do really, really well and score yourself on [00:26:00] how well we're doing that, and then y- the outcomes will come, and I think that's a better way of looking at it. And AI visibility's the same way

[00:26:06] Mary Brown: the same way.

[00:26:06] Mary Brown: Yes. Oh my gosh. Uh, so many things came to mind as you were talking about that. So one is, as we're looking at reporting and more, um, specific breakdowns of AI sources are becoming available, you know, you can see AI Mode in Search Console now, and we can see, uh, impressions from that, and things like that.

[00:26:25] Mary Brown: Um, I will have clients say, "Ooh, I got... You know, found I have more traffic from ChatGPT." And we'll say, " Okay, but for what?" You... On that surface, you don't know what for. Is it stuff that, you know, makes sense for you to rank? Are they things? So then we say, "Okay, let's look at a tool like HubSpot's AEO tool, where we can actually track specific prompts."

[00:26:47] Mary Brown: So that's a better level, where we're saying, "Are we showing up for the things we want to show up for, rather than just showing up?" Because that's not good enough, right?

[00:26:55] Bob Ruffolo: The AEO tool is great, but again, it's not a definitive [00:27:00] attribution report, which is a very big difference. You should use the HubSpot AEO tool. We're using it. I love it. I set up all these prompts. I made sure I put the prompts in there weren't branded. You know, what we originally had in there was, like, what is Endless Customers?

[00:27:12] Bob Ruffolo: Of course, we're gonna show up for that. So I took all that out, and I put things that buyers would be looking for in AI that might be unaware of us, but that's where I want them to find us, right? It was that middle between being top of funnel and not too branded. It was like the sweet spot in between, filled it up with that.

[00:27:29] Bob Ruffolo: And that is not definitively telling me attribution, but if we start doing much better on those, uh, prompts, uh, as a whole, as a- as the AEO tool is analyzing us, then we should see a lift in the outcomes on the other side of it

[00:27:43] Mary Brown: Right, and those are the kinds of things that you want to keep track of, right? Because we've been asked, you know, "What KPIs should I be looking at? What-- I don't even know what to track anymore. What should we care about and report on?"

[00:27:55] Bob Ruffolo: Brian had a great session, a great episode on that too. So he, he went through e- [00:28:00] exactly what we should be tracking, but yeah, yeah

[00:28:02] Mary Brown: So it's, it has changed, um, and attribution, as you said, is, is really difficult, and it's just about, uh, how you, your perspective on all of it, and making sure that, as you said, you're just focused on doing the right things and the smart things, um, and hopefully seeing lift from that

[00:28:17] Bob Ruffolo: All right. So that was a nice little tangent, uh, um, uh, uh, on, uh, attribution, which again, I hate when people say, "I need perfect attribution," 'cause I just don't believe in it.

[00:28:28] Bob Ruffolo: Um, let's get back to some of our questions here. When a buyer and an AI agent land on the same page, what does each see? Are they seeing things-- We started covering this a little bit, but are they seeing things differently?

[00:28:40] Mary Brown: Yeah, they are seeing things differently. So, uh, as I mentioned before, a, a human is going to see that design, and they're gonna take everything in that way.

[00:28:49] Mary Brown: But what an agent is gonna see and what AI is going to see is, um, as you said, they're trying to look at things really quickly and scan the text and get as much as they can from the easy-to-read text. It's [00:29:00] gotta be in the HTML. Whatever you want to express has to be in the HTML and has to be very clear and easy to understand.

[00:29:06] Mary Brown: Um, and the way it can look at a page, uh, is never the same way twice too sometimes. As you mentioned, it can be very lazy. So I recently was... Um, I'm, uh, primarily a Claude user, and I was working in Claude one day, and I had it look at a page for me. Um, and it said, um, "These H2s on this website say this." And I said, "No, they don't, Claude.

[00:29:31] Mary Brown: Uh, they don't actually say that." And I said, "Why did you think that they said that?" And it said, "Well, the page reading tool that I'm using, uh, gives me a summary of what the page is, and this is what the summary said." And so I'm thinking, "You didn't even look at the page yourself. You are so lazy. You used a page reading tool, and the page reading tool gave you..."

[00:29:53] Mary Brown: And I said, "Show me what the page reading tool gave you. I wanna see what it said." And it was this plain text summary, but yeah, some of the [00:30:00] information was wrong.

[00:30:00] Bob Ruffolo: Wow

[00:30:02] Mary Brown: So that was something I, I hadn't even been aware of. Yeah. That it can offload- It's taking- Yeah, and it's, it's offloading its task. It's saying, "Eh, I don't feel like reading this page, so I'm gonna have a tool read it, and I'm just gonna read the summary."

[00:30:12] Mary Brown: It wanted its own CliffsNotes. So, uh, but that, I think, really underscores making sure that any information, you know, you can't... JavaScript can be such a problem because if you've got information that needs JavaScript to load and render later, AI's not gonna wait for that. Yeah. It has no patience for rendering and slow rendering, and it just h- it has timeouts.

[00:30:37] Mary Brown: It has token limits, so it needs to be fast.

[00:30:40] Bob Ruffolo: And really, we make so many connections on this show to humans, and if you told a human... This is what AI does. Um, you say, "Find me the best," blank, right? Um, it starts with a pool. It says, "We're gonna go anywhere between, you know, 5, 10, up to, like, 40 [00:31:00] options," products, services, companies, whatever, right?

[00:31:02] Bob Ruffolo: It's gonna find 40 options. And then to your point, what would a human do if they had 40 options? They're gonna scan them all quickly, they're gonna eliminate some, and then they're gonna go a little bit deeper on some, eliminate a few more, go deeper, deeper, deeper until it says, "Here's my number one choice, and here are my two backups."

[00:31:18] Bob Ruffolo: That's what humans would do. That's how AI works. So to your point, if you're one in that initial pool, great, you're at least in the conversation. Um, and that's not too hard. You gotta be, you know, have your company, your website, your products, services where they belong online to at least get found. But then the next thing it's trying to do is to scan really, really quickly, so that's why your stuff has to be front lower on the page, accessible.

[00:31:39] Bob Ruffolo: I even found out the other day, it deprioritizes things that are no displayed, like things in accordions. Mm-hmm. That was really interesting to find out. So we had to take everything out of accordions on our site, like our FAQs, because it was saying, "Well, if it's, you're not showing this to the human, it probably isn't really important."

[00:31:55] Bob Ruffolo: So how do you make sure that the content is just visible and then, [00:32:00] uh, uh, so it's really, it makes a lot of sense there. Um, but the other big thing too, on this page, is, um, having evi- evidence on the site, credibility- Mm-hmm ... legitimacy. Hey, I was able to say that word smoothly. I was mumbling on that word as we

[00:32:15] Mary Brown: heard him earlier.

[00:32:16] Bob Ruffolo: Yeah

[00:32:16] Bob Ruffolo: legitimacy. Um, so legitimacy, um, why does that matter so much?

[00:32:22] Mary Brown: I love this so much, Bob, because this is the same thing humans care about, and it just comes back to trust. Humans want to be able to trust the company that they're going to work with, and so does AI. It's just changed in the way we need to approach it, possibly.

[00:32:42] Mary Brown: But the question is the same, whether you are an AI agent or you're a human, is this real? Is this current? Is this credible? That's what it wants to know. So trust is still the name of the game. But what it means is you have to look at your website so much more [00:33:00] critically to say, "Okay, we're making a lot of claims on this website, but are we actually backing it up?"

[00:33:06] Mary Brown: Because AI doesn't care about things like best in class or trusted. That's, that's probably the word on a website that drives me the craziest is saying we're trusted doesn't equal trust. You can't do that. And that bothered me for humans, but AI will just ignore you if that's all you're saying because you've got to back up any claim you make.

[00:33:27] Mary Brown: It has to be quantifiable. You gotta give me a reason to trust you. So how long have you been in business? When were you founded? How many, uh, reviews, reviews, reviews, reviews on third-party platforms? Can you show your reviews on third-party platforms? And, um, can you back everything up with numbers? Don't say you're responsive.

[00:33:47] Mary Brown: Say, "We respond to every inquiry within 24 hours," or whatever your number is. That's the stuff you've gotta do now

[00:33:54] Bob Ruffolo: You know, a- and Mary, so great, great points. Um, I think we often [00:34:00] forget too when we hear stuff like we're talking about today, we gotta do this, we gotta do that, we gotta do that, we gotta do that, right?

[00:34:05] Bob Ruffolo: And the reality is you actually don't have to do everything. Um, you just have to be better than the other companies or products or services you're competing with. Um, so, so, uh, as you're saying all these things, I'm thinking about my recent experiences. We've been working on our website at Impact. Um, I have some other clients I've been working with.

[00:34:23] Bob Ruffolo: I have some manufacturing clients, and what's really interesting is I did a prompt the other day, um, and it was a, a sample prompt for manufacturing and, uh, I was looking for like stainless b- tube material, whatever it was. And the reality is that most of those people in that space have terrible websites.

[00:34:40] Bob Ruffolo: So it did recommend a company to me, like recommended with still some question marks, but it still went through the same process, still created a pool from as many companies as it could find and eliminated them and still gave me the company that it had the most confidence in. And even though that co- they didn't mention pricing on their page, and they had said that, [00:35:00] "I don't know what their pricing is.

[00:35:01] Bob Ruffolo: I don't know this. I don't know that." Um, but it still felt this was the most credible option to recommend to me. All it takes is one of their competitors right now to do the things you're saying, at least do more of it better than that company it recommended, and they're gonna get recommended, right?

[00:35:17] Bob Ruffolo: That's as much as it takes. So we for- when we forget about this competitive part of it. Now Impact, we're a marketing company going against marketing companies that try to do AI visibility for other companies that also do AI visibility, right? It is a knife fight. It's like, you know, trying to create a YouTube, uh, channel on how to do great YouTube videos, right?

[00:35:35] Bob Ruffolo: It's, it's... That's so competitive that you have to be flawless to win in that. So for us, everything you're mentioning, we gotta do at like a 12 out of 10. Um, we have to have the best case studies, the best examples, uh, all this great evidence on our site if we're ever gonna win because there's other marketing companies that know this stuff that too, and they're doing this really, really well.

[00:35:59] Bob Ruffolo: So [00:36:00] that's another piece of advice to, to share to everybody here too. But it doesn't mean it doesn't... It matters. It's, it's... As we're talking about the process of maybe we start with 40 companies and we're dwindling it down. In the middle part of that where it's starting to dwindle you down is based on can you back up your claims better than anyone else you're competing with?

[00:36:20] Mary Brown: Absolutely. And this is another great spot where you can ask AI, because you did this, right? So if you want to know, you know, who are you going to recommend for this service in this location, and then ask it why. Ask it why you recommend. You can do this. Run this exercise, and it will give you the reasons, and then you will know.

[00:36:42] Mary Brown: And this kind of competitor research is so easy now. It's, it's so easy to do. Um, and it takes just a few seconds, so it's worth doing. And then find out what that is, and then that can kind of give you a priority list of, okay, for us in particular, what do we need to do in our space against who we're [00:37:00] competing with to really nail it in and, and that will help you.

[00:37:04] Bob Ruffolo: And of course, you know, what I like to say too is ask it why and it'll tell you. And it'll say 90% of the time it's right or 90% of what it gives you is right, 10% of it might not be right or right for you. Um, it might, you know, you could do it, but should you do it? That's the value of working with someone like you is being able to parse that data, use AI as a tool that makes you incredibly more efficient when you're working with your clients or working on a project.

[00:37:30] Bob Ruffolo: But just if you don't know what you don't know, you can confuse yourself, you can go down the wrong road, you could do things you shouldn't be doing and maybe it's not the best thing for you to do. It might be something better. And we've all had this experience with AI where we ask it something, it gives us an answer.

[00:37:43] Bob Ruffolo: We're like, "Actually, that's not completely correct. You missed this." And AI says, "Oh yeah, you're right." That's the human judgment that AI just does not have that we still have to have if we're going to be successful optimizing a website in an AI first world

[00:37:56] Mary Brown: Yeah, and I'm really glad you brought that up because [00:38:00] this is something that worries me for our clients or for other people, because anyone can go to ChatGPT and say, "Give me a conversion audit on my website," and it will give you one.

[00:38:11] Mary Brown: And it will give you one that has a lot of information in it, and it might sound really, really awesome, and it might also have things that are wrong. And if you don't have decades of experience doing conversion rate optimization, you're not gonna know what's wrong. And that's where my worry is, because I, I do that in my job.

[00:38:29] Mary Brown: I will say, "Hey, Claude, go do a conversion optimization report for me on this." And I spend the time going through it, and I will challenge it, and I will say, "You said this. That's not right." And it will say, "Oh, you know, that was superficial." Or, um, either it often says, "That was just a superficial read," or it will say, you know, "That was a generalization."

[00:38:49] Mary Brown: Or, and I'll say, "No, I want you to look at this data instead." And I can do that because I have the background and expertise. But when people don't, that's when they could, you know... If you say, "Give [00:39:00] me recommendations on the 10, top 10 things I should be doing with my site," what if they're wrong? You know? So you do have to be careful with things like that.

[00:39:07] Bob Ruffolo: things like that. And, you know, the best way to still think about this is like you're delegating this to somebody more junior than you, doing the thing for you, and then giving it back to you for your feedback. Mm-hmm. And if you don't know what you're doing and you're only relying on it, it's like you're working with somebody junior that's doing their best, hoping that you like the work.

[00:39:26] Bob Ruffolo: And if you take that, you'll probably get some improvement, but it's not gonna be anywhere near what you should be doing or s- or as fast. But, like, in this case, it's like you know if you're passing this down to somebody more junior, when they come back, it's like, "All right. This 80, 90% of it's correct. This is wrong.

[00:39:40] Bob Ruffolo: We're not gonna do this. We're gonna do this. We're gonna prioritize it this way. Thank you for doing that work. You just saved me 10 hours, but now we can go and do real work." Yeah. And I think that's a, a way we should be thinking

[00:39:48] Mary Brown: Yeah, absolutely. Um, that's certainly what we do.

[00:39:52] Bob Ruffolo: All right. Um, we are so over on time 'cause I'm really enjoying this conversation with you, Mary.

[00:39:56] Bob Ruffolo: Um, so I'm gonna let you pick one of these last questions that you want [00:40:00] to answer as we wrap up the episode.

[00:40:02] Mary Brown: Um, I think a question that I get a lot, and this goes to prioritization, is, "Okay, where do I start?" Or, "What should I do right now?"

[00:40:11] Mary Brown: Um, and I would say if you wanna do one thing right now is run a prompt of your site. Run your site through a prompt. It will be really fast, and it will definitely give you some things that are real, that are actionable because the thing you don't know right now is how AI looks at your site. You just don't.

[00:40:28] Mary Brown: You can't, because you're not one. So uh, what I want you to say is, you know, you're evaluating my website the way an AI agent would do that. So can you find our pricing? Can you find our services? And can you find out how to contact us without guessing? What content do we have that is machine readable versus any content that we might, might have that's either locked in images, locked in JavaScript?

[00:40:53] Mary Brown: What can't you see? What is

[00:40:55] Bob Ruffolo: goes back to what we said before. If you instruct it to read the images, it can. It [00:41:00] won't unless you instruct it to.

[00:41:01] Mary Brown: Exactly. Um, and what would stop you from confidently recommending us over competitor, over this?

[00:41:08] Bob Ruffolo: What a prompt

[00:41:09] Mary Brown: Yeah, and then based on what you see, that can give you, you know, write down the top three things.

[00:41:14] Mary Brown: What are the top three things that it gives you? And then see what you can do about those top three things, because I guarantee that these are gonna be things that you can do. It's not like you're gonna get a list of stuff and you hear- you're gonna say, "Oh, no, I need a developer. Oh, no, I need help." It's like there are definitely going to be things that you can do right now.

[00:41:31] Bob Ruffolo: And I'll just add to that too. I thought that was perfect, and that everyone should write that prompt down. It's gonna be in the transcript. Copy paste that, put that in. Um, but I think your model matters and the level of effort matters. And one other keyword I might add to that is, um, you could do this if you've never done this before, do it on, you know, if you have Astra, I think Astra's great, or Fable, um, and do it on like a high effort.

[00:41:56] Bob Ruffolo: Um, but once you've done that and you've exhausted, you wanna go even deeper, [00:42:00] say, " Do some deep research." Mm. And what I found is then it goes and works for like 10, 15 minutes, comes back with a very detailed report, and that is... I find that the output of that is just awesome. Um, but again, you have to be really geeky like you and me to actually enjoy that stuff because the more simple report, if you don't do deep research, you use it on like a high model, um, will be really, really more simple and, and meaningful as well

[00:42:26] Mary Brown: Yeah. And another thing you can add to it, uh, is you can threaten it. So you can basically say, uh, "Don't make any mistakes," which I know you might be thinking like, "Should- do I really have to say that?" But yeah. Yeah. Yeah, you should absolutely say, "Don't make any mistakes." And you can also say, if you want, um, "Ask me any questions you need to ask to do this task perfectly."

[00:42:47] Mary Brown: Yeah. And then if, if it's not clear, then it might ask for some follow-up questions. That's something I like to do in my work- 

[00:42:52] Bob Ruffolo: Yeah ... 

[00:42:53] Mary Brown: because I think I'm pretty good at prompting at this point, but just there are always things, uh, that you can add.

[00:42:58] Bob Ruffolo: I've used, uh, [00:43:00] double-check your work. 

[00:43:00] Bob Ruffolo: Yeah. 

[00:43:01] Bob Ruffolo: And it's, it'll actually tell me, "I am double-checking my work now." And then it'll come back and be like, "I found two errors."

[00:43:08] Bob Ruffolo: Good 

[00:43:08] Mary Brown: job, buddy.

[00:43:09] Bob Ruffolo: if I didn't tell it to double-check its work, it would be like, "Here's my response with my errors." Uh, Mary, you're, you're awesome.

[00:43:16] Bob Ruffolo: Um, if somebody after this wants to get in touch with you and have you analyze their website and give feedback, what, how can they get in touch with you?

[00:43:24] Mary Brown: Um,

[00:43:26] Bob Ruffolo: email you or, or, or fill out the, um, talk to us on, and say you wanna request a conversation with me.

[00:43:33] Mary Brown: Okay. If anyone ever wants to get ahold of me, you can either send me an email, it's just mbrown@impactplus.com, or you could go to our website, fill out our form. Uh, in the near future, maybe have your AI agent fill out the form for you, uh, if we get that ready. But either way, I'm on the other end.

[00:43:49] Bob Ruffolo: Yeah, and say you've heard her on the podcast and you want her to analyze your website, that's great. Mary, you were awesome today. Thank you. I really enjoyed this conversation.

[00:43:55] Mary Brown: Me too.

[00:43:56] Bob Ruffolo: All right. Well, this is another episode of the Endless Customers Podcast. We will [00:44:00] see you at the next episode

[00:44:01] Stephanie Baiocchi: If you liked this episode, please take a minute to leave us a review. Thanks for checking out the Endless Customers Podcast.

Falling traffic doesn't mean nobody is reading your site

I use ChatGPT and Claude all day. When I hand one of them a research task, it opens website after website on my screen, and I'm not reading any of them. The AI is. Every one of those page loads counts as a visit in someone's analytics.

So if your site went from 100,000 visitors to 30,000, some of those 30,000 probably aren't people either. No wonder owners keep asking me whether they even need a website anymore.

To answer that, I sat down with Mary Brown, a website strategist who has spent six years at IMPACT helping clients get their websites right. Mary was the highest-rated speaker at Endless Customers Live, where she reviewed real audience websites live on stage.

How does AI read a website vs. a human visitor? 

Cloudflare is reporting that around half of web traffic is now bots, and much of that is AI doing research for a buyer.

AI doesn't take in your design the way a person does. Mary once asked Claude to compare a client's local page with a competitor's. It favored the competitor because its H2s included the city. Her client's page mentioned the city too, in the smaller text below the headings, and Claude admitted it never read that text.

I've learned to think of every page as a table of contents: the H1 is the book title, the H2s are chapters, and the H3s are sections. We even pulled the FAQs on our own site out of accordions after AI told us it gives hidden content less weight. Mary's rule for all of it is one we've taught for years, be clear instead of clever, and it matters even more when AI is doing the reading.

Saying you're trusted doesn't make you trusted

Mary said the question AI asks about your company is the same one a buyer asks: is this real, current, and credible? Writing "trusted" on your homepage doesn't answer it. Your founding year, your third-party reviews, and "we respond to every inquiry within 24 hours" do.

You also don't have to be perfect. You have to be easier to verify than your competitors. When I tested a prompt for a stainless tubing supplier, AI recommended a company with no pricing on its site because no competitor gave it more to work with. One competitor with better proof could take that spot tomorrow.

The prompt Mary uses to see a site the way AI does

Mary closed with something every listener can do this week: run your website through a prompt that asks AI to act like an agent researching your company.

Can it find your pricing, your services, and how to contact you without guessing? What can't it see? What would stop it from recommending you over a competitor?

The prompt:

You’re evaluating my website the way an AI agent would. Can you find our pricing? Can you find our services? Can you find out how to contact us without guessing? What content do we have that’s machine readable, and what content is locked in images or JavaScript? What can’t you see? What would stop you from confidently recommending us over [competitor]? Don’t make any mistakes. Ask me any questions you need to ask to do this task perfectly.

She also warned that an AI audit will sound confident and still get some things wrong, so someone with real website judgment needs to decide which findings to act on.

Mary and I also got into why perfect attribution doesn't exist, how she checks one AI's work with another, and the exact wording of her audit prompt.

Watch the full episode above or listen on Apple Podcasts, Spotify, or your podcast platform of choice, then run Mary's prompt on your own site.

Connect with Mary

Mary Brown is a website strategist at IMPACT, where she has spent six years helping clients build and improve websites for buyers and AI search. She has worked in website strategy for more than a decade and is a former journalist and writer. She was the highest-rated speaker at Endless Customers Live, and she uses Claude in her daily work to review client pages, then challenges its findings before they reach a client.

Keep Learning

__

Endless Customers is a podcast for business owners/leaders, marketers, creatives, and sales teams who want to build trust, attract the right buyers, and drive sustainable revenue growth with the Endless Customers System.

Produced by IMPACT, a sales and marketing training organization, we help businesses become the most recommended in their market by buyers and AI.

Interested in sponsorship opportunities or joining us as a guest? Email brand@impactplus.com.

Facing a challenge in your sales and marketing? Schedule a call with an advisor to talk through your next step.

Recent Episodes

Episode 193
Half of All Website Traffic is Bots. Is Your Website Ready?
Episode 192
How AI Can Do More Than Save Your Business Time
Episode 191
Should You Vibe Code Your HubSpot Or WordPress Website?