Overview
There's a wide gap between getting things done and getting things right. In business, marketing is usually the biggest culprit on the return for what you spend. Discover why standard marketing attribution tools assign credit to the wrong channels due to Apple's ITP, bot traffic, and cookie blocks, and how to design marketing experiments that prove incrementality in your P&L.
A couple of summers ago, one of our clients had just tested a new agency with a $3 million campaign. According to the agency's attribution model,¹ they'd improved acquisition costs by 25%. The agency did everything right on paper. They aligned with the marketing team on the metrics that mattered to them: lead costs, Return on Ad Spend² (ROAS), and Customer Acquisition Cost ³ (CAC). They even used machine learning to optimize their messages, proving their confidence "using the Euclidean distance."
But finance didn't see it in the numbers, and neither did we. As we dug into the data outside their platforms, where pixels can't track, we found the whole campaign was a net loss.
Agencies are incredibly good at concealing structural failures. When I first learned to bake cheesecakes from scratch, my very first cake cracked right down the middle. Without time to make a new one, I simply threw a can of cherries over the top so no one would notice. That is exactly what agencies do with ROAS: they pour vanity metrics over a broken data foundation to hide the structural cracks.
That's what we solve when executive teams lose trust in their reports. So what caused the data from marketing and the data in finance to drift so far apart?
By the end of this article, you'll know why most marketing attribution models mislead more than they inform and the best path toward fixing yours.
There Are No Proxy Metrics for Profitability
Here's something you need to consider. Even with industry best-practice tools, your marketing attribution can still assign credit to the wrong channels, because your marketing strategies weren't designed to be measured against financial impact.
“because your marketing strategies weren't designed to be measured against financial impact.”
Industry standard metrics track engagement and reward performance where advertising makes the least difference, such as when a prospect has already decided to purchase or already knows what they need.
On top of that, the industry ties performance to ROAS and blended CAC. ROAS conflates a multiple of ad spend with profitability. CAC requires looking at an entire marketing system with double-blind tests, but gets conflated with cost per sale. That's why, no matter how sophisticated a third-party tool or automation with AI, nothing can overcome flaws in experiment design.
You absolutely can (and should) automate attribution with in-house tools. But before you can do that, you need to prove it out in a spreadsheet first. And most importantly, prove what doesn't lift sales.
Platforms Are Incentivized to Overreport Results
Most of you already know this. Google wants credit for the sale. Meta wants credit for that same sale. TikTok wants it too. And each of them has their own attribution reporting.
We've seen a lot of attribution models come and go. Last-click. First-click. Linear. Time-decay. Data-driven. Multi-touch. Marketing mix modeling. And now incremental Return on Ad Spend⁴ (iROAS), which promises to tell you what would have happened if you hadn't run the ad.
All of them attempt to answer the same question. And all of them suffer from the same structural problems:
Platforms rely on pixels.
Their reps all tell you the importance of paying for "brand awareness," and always want you to try their new "best practices" for growing your account.
Often, all they end up growing is your costs.
They want you focused on format. Short-form, vertical video, square, UGC. The real key to connecting with audiences and driving them toward purchase has nothing to do with the format. Even print and mail ads work today.
In the worst attribution setups we've seen, the total sales reported across all channels are two or three times your actual revenue. Every one of these platforms is incentivized to get you to spend more. Their reporting is designed to show you enough positive results that you keep spending in fear that if you pause, all hell will break loose on your CAC or CPMs. Your revenue will disappear, and when you do decide to turn your ads back on, you'll restart the "learning phase."
I know what you're thinking. "You should never trust platform analytics." Or, "That's just because you didn't set up your tags correctly."
You're right on both accounts, with an important caveat.
Unless you sell only online, with only one traffic source, in an area with no privacy laws, where no one uses ad blockers, and no one uses an iPhone, then sure: you can trust your tags.
For the rest of us who live in a reality where people use multiple devices, and tracking is actively blocked by legislation and company policy, correctly tagging your site won't mean accurate attribution.
And no, unfortunately, even if moving to Google Analytics, Segment, Hyros, Funnel.io or even Triple Whale or Northbeam improves your results at first, their data is directional. But it's not causal. It doesn't account for purchases that would have happened without advertising. And it doesn't consider what forces outside your control are impacting demand.
And none of them will get you the best possible results without moving beyond quantitative data analysis.
In fact, even when implemented correctly, any of these solutions will still leave your customer acquisition cost at double what it should be.
The Data Is Getting Dirtier
As of early 2026, AI agents are estimated to account for a growing share of all Internet searches, and that number is climbing every day.
As much as 50% of traffic comes from bots. So impressions, site visits, and clicks may not even be coming from real people.
Your attribution tool counts all of these sessions the same as a real visitor, even if you have tools like Cloudflare (a tool that helps prevent bot traffic) or Akamai in place. There are tons of GitHub repos dedicated to getting past anti-bot platforms and CAPTCHAs.
Then, when a real user does reach your site, if they decide not to accept your cookie policy, or have an ad blocker, none of your tags fire. In Europe and states with stricter privacy laws, you may not even see they visited your site before clicking decline.
And many already know that Apple's Intelligent Tracking Prevention not only removed access to their data from Meta, but often strips your UTMs and metadata, which makes direct or organic channels look like they're pulling in traffic you actually paid for. That's often the case anyway, since most users hear about you from friends or ads that drove them to search for your brand in the first place.
Last year, I had an article get 270k views on Reddit, with 18k readers on Medium in the first 72 hours. In my analytics, traffic sources were coming in everywhere, from direct to organic social, email, and internal Slack. A post on one channel, but the analytics show traffic from all the others. Which channel would you attribute those views to?
But what about enriching your data with tools like Apollo and Audience Labs?
We've used the cream of the crop in B2B and ABM strategies: Demandbase. We've also helped clients implement 6Sense, Apollo, and AudienceLabs directly into their CDP or CRM. They're all great for re-marketing and customer segmentation… when they're accurate.
In my old office, our IP address was categorized in Demandbase as The University of Utah, because they had a satellite campus in the same parking lot. (As a BYU alum, I might have cared more if we'd ever had a good football team)
All of this noisy data informs metrics across your conversion rate, channel referrals, split tests, and which ads get the credit. It doesn't matter which of these platforms you choose, or which marketing attribution model you deploy if you aren't accounting for limitations in data accuracy.
Some of you notice that after you implement any of these tools, your results improve. That initial uptick comes from having better tracking, which is always better than none at all.
It's just like the canned cherries I put on my first cheesecake. Some topping is better than no topping. Anything to cover the crack underneath.
The data you're seeing doesn't tell the full story. It's helpful directionally. You can see what content users engaged with. How long they engaged with it. And what they did in the same session as the one that drove the sale. But you can't see every user. And you can't see what content they would have engaged with, if you hadn't published it in the first place.
There's one more pitfall, and it matters just as much as the metrics you choose to measure success.
Some of you have gone down the path of setting up server-side analytics. Or a 1st party-cookie. You're already ahead of the game. But if you're still modeling your attribution based on channels, your IT team is about to receive a lot more tickets.
Owned Channels Take Credit from Demand Gen
If you've ever baked a cake from scratch, you know the balance of the ingredients impacts everything from the taste to the texture. Too much flour, and it's dry. Too much salt, and it tastes like swallowing a mouthful of seawater at summer camp.
When you have the privilege of building a brand from scratch, you see marketing channels the same way.
Within days of launching our ad campaign for Transparent Labs on Facebook, searches for the brand spiked from almost nothing to nearly 30k that week. It was enough to start showing up in Google Keyword Tracker within a month.
But the purchase journey wasn't as simple as clicking on an ad, adding to cart, and checking out.
Prospects learned about the brand and a keystone product from the ad. They searched to find reviews and credibility on an affiliate site. They visited Transparent Labs for the first time as either an organic visitor to the blog or under branded PPC. So Google Analytics or any tool looking at first-visit referrals would mistakenly give credit to where the user first entered the site, not what got them to visit in the first place.
We knew this because there were 5x more visits to the site than clicks on any of our Facebook ads. And our controls showed that where we were running ads, there was also a lift on all channels in the regions where ads were active.
Most importantly, we knew this because we grew the brand from $2M to $10M in 12 months.
All of those touchpoints worked together as a system.
Without the social proof of 3rd party recommendations, one segment of the audience will feel wary of buying from a brand they've never heard of, let alone online. Without the initial ad they never hear about you to begin with. Without paying for the PPC ad, if you don't rank at the top SERP, you lose the sale to one of those "We're sooo much better than XYZ brand" ads that are sniping your sales.
If the entire customer journey were available all from a single channel, would your customer never have to hear from you outside of Meta or the place where they discover you?
That's just it. The entire customer journey was available on all platforms. We had full awareness journey coverage on Facebook and Instagram. The same on Google. And full email flows (but of course, you don't get emails until someone opts in anyway).
“The entire customer journey was available on all platforms.”
We ran the ad to problem-unaware segments to show them the harmful effects of proprietary blends in supplements. How specific dosing was required for clinical effectiveness. They learned about the problem and solution, all the way to being called to action to buy the product.
And they still needed to do their own research, then decide after visiting the website through other channels.
What about when the only ads you're running are to product-aware segments?
That only accelerates prospects bouncing across channels to get the information they need. You're forcing them to move from channel to channel by design. To get your channel mix right, your team needs to work on closing gaps in your experience, instead of thinking about channels as separate outlets for specific types of tactics.
That's why channel attribution is a myth.
Yes, some channels are better for certain stages of the customer journey than others. And yes, some aren't that effective at all. You need both eggs and flour to hold your cake together. Skip either, and you end up with a puddle dripping out of the sides of the pan (speaking from experience). But other ingredients you can skip altogether.
Building an attribution model only gets more complex when you start selling in multiple channels (website, partners, distributors, 3rd party retailers, etc.). And when sales competes with marketing for credit with your org, budget cuts lead to smaller and slower pipelines.
Let's look at two examples in completely different industries that all share the same issue.
Most Buying Decisions Happen Outside of Tag Visibility
You've probably heard "the customer journey starts and ends online" regurgitated all over LinkedIn. It's yet another myth that supports the first one about trusting your platform and attribution tool data. But even when everything from tablets to smartwatches is connected to the Internet, it's still not accurate to suggest customer journeys all start or end online.
Here are two real-world examples of how industry "best practice" on attribution falls apart at scale.
The SaaS customer journey for a CTO.
We've worked with both Digital Realty and Equinix, two of the world's largest data center providers who support all of your favorite brands from Amazon to Netflix.
We helped them go to market with new software and services aimed at decision-makers. Think about how a CTO buys a new data platform.⁵
Before they even begin their research, the journey starts with a need: increasing bandwidth and scale. But they don't immediately go online. They have friends in their space who have the answers already, so they call a friend to ask what they recommend. Or they learn about a tool at a trade show.
From here, they may go online to book a call on the website. Or they might continue to do research by going to Reddit and seeing what others are using.
They might skip all of that and go directly to AI. Then if their friend has a rep at their favorite data center, they may never even touch the website at all.
A DTC brand expanding into retail.
Because of the SaaS and e-commerce booms, a lot of marketers forget: over 83% of retail sales happen in physical stores. That means most customer journeys end offline.
Retail is a completely different game for attribution and go-to-market strategy. It's why Popcorners can win with a Super Bowl brand linking their chips to the blue-sky obsession of Breaking Bad, and why that strategy would tank brands that sell exclusively online.
As you might have read in our article on what you can learn from turnarounds, we met with a Senior Executive at a publicly traded mattress company to help them figure out why, even though they were spending 25x more on paid advertising than the category leader, they were near the bottom of all mattress sellers, losing market share every year… and losing nearly $90M in just 12 months.
The cycle started when their old marketing team had continued to use return on ad spend (ROAS) as their primary metric.
It started with their first successful campaign in 2016. By 2018, they're in stores and on the stock exchange.
They continue to expand into new retailers, but they're spending more and more on advertising. Eventually, their scale of costs is outpacing their revenue. The reason?
While people could learn about the mattress from the ads and the website, they still wanted to try it for themselves before ordering online. So they went to the mall, lay on the bed, and bought it in the store. The website showed a near-zero conversion rate, and ROAS looked miserable, even though these new channels were growing.
And consider this: a little over half of shoppers will visit a website before buying in the store. Even half of those customers will pull up the website while inside the store to shop.⁶ The customer doesn't experience your brand as separate channels: to them it's all a monolith.
But best practice tells you to track channels as if they operate in a vacuum.
Doing just that led to a series of changes in ads and their website that cost them their positioning. Instead of showcasing what made their technology superior and talking about how to know whether your current mattress is awful, they diluted their message down to "A better night's sleep," and talked about keeping cool at night. Surveys will show you that's a real customer concern, but not one you can position around for very long.
One of your agencies will tell you just to set up a geofence and track walk-ins tied to ad impressions. But it won't solve measurement issues. We used that measurement strategy for Potbelly and tied in POS data, but that data still only helps directionally. Nothing beats a double blind and tracking how all channels lift together.
But their marketing ROI issues went deeper than tracking store sales back to ad spend.
While they were losing the positioning they had earned in the first 5 years since launch, new entrants came in with the same generic messaging at less than half the cost of their flagship mattress.
Throw in the same Apple privacy and platform changes we've all seen, and you have a recipe for financial disaster. Quarter after quarter of negative EBITDA left analysts doubting they could climb out of the hole.
Using ROAS as a North Star long after it stopped reflecting the business led them to offer steep discounts online to make that channel "win."
This is exactly why we talk extensively about the importance of incentives both in and outside of your business. And just as important as aligning incentives, you've got to align metrics.
Not All Revenue Is Good Revenue
You probably already came to the conclusion based on the mattress case study that ROAS is a volatile metric. It not only can't tell you whether your channel mix works together; it sometimes points you in the opposite direction of successful messaging.
For example, when you are running ads to an audience who has never heard of you, then retarget them within a day or two with a coupon, but the decision window is six months, that first ad gets almost no credit while your margin erodes on multiple fronts.
That first ad is a critical touchpoint. It's where you have the opportunity to interrupt belief patterns. Helping the prospect to have language for how to discuss their problems.
ROAS itself is a proxy. It tells you revenue per dollar of ad spend, but it doesn't account for overhead, fulfillment costs, returns, or lifetime value. A 5:1 ROAS can be a loss if your margins are thin and the customer never comes back. Not to mention, it's a single point metric, which we've shown is one of the first missteps in strategic planning: Why Strategic Initiatives Fail. And How to Make Yours a Success.
At Old School Labs, where I joined as the CMO and lifted revenue 87% in 10 months, our most profitable cohort came in on a .6 ROAS. But because margin was so high on that product, it outpaced our second most profitable cohort by 5x.
Agencies would have cut that campaign out of fear because they only know how to look at platform data, not the business as a whole. When they aren't high-fiving over views, comments, and shares, they're falling for the ad industry psyop: more awareness means growth.
Awareness doesn't drive action. I know exactly where Chuck E. Cheese is out here, but it's not my go-to place for wings and beer with my friends.
Other proxy measurements like iROAS are supposed to measure incrementality, isolating the revenue your ad created above what would have happened without it.
Just like we talked about at the start of the article, that data is dirty. The platforms are incentivized to take credit. And it's often measuring the performance of content targeting your full audience. There are no control variables.
In practice, incrementality estimated outside of data you can audit and control is still an estimate built on assumptions the platform controls. The platform decides what the baseline would have been. The platform decides how much credit to give itself.
As my news media professor at BYU reminded us at the end of every class, "If your mom tells you she loves you, get a second source."
Customer Insights Are Not Market Insights
Take a moment to think about the strategy decks you've seen up to this point in your career. Did any of them make the mistakes that we've discussed so far today? Did they base a strategy on channels or increasing ROAS? Did they fail to demonstrate how channels should work together?
If you answered yes to any of those, then you'll know this is a very common problem.
These issues show up even in multi-million dollar strategy decks from reputable agencies. We've seen that firsthand from firms you wouldn't expect. Steve Jobs was right to criticize thinkers (consultants) who don't do the work, leading to mediocrity.
It's an industry issue in the making for the past 60 years that got worse with TV, and has only decayed with "digital marketing."
This decay is best seen in how we've bastardized the term marketing mix, which you've been told is the same thing as what channels you use for advertising and communication.
That's one-twelfth of what Neil Borden illustrated when he built the marketing mix in the 1940s. It included everything from the product to distribution channels, personal selling, advertising, servicing, fact-finding and analysis, or in other words, research.
When research gets diluted to a simple S.W.O.T. analysis, a few bullets of competitive comparisons, ads get tracked with ROAS, and discounts replace selling on the merits of the product, it's the fastest way to commoditize a brand. That's exactly what happened to the mattress company.
Their newer agencies made content they thought would be funny, without understanding the market. Digital marketing got treated as separate from marketing, leading them to focus inward, prioritizing results on digital channels, instead of anticipating consumer needs. Market intelligence got replaced with dashboards. Then company-wide messaging changed so often that they lost their positioning.
But their internal teams kept approving the changes and pushing IT to update the website, all to their detriment. They missed what the entirety of the market was doing because they were too focused on visitors, followers, and customer lists instead of the population at large.
These are all good people doing what makes sense, according to their agencies, the ad reps that advise them, and different execs cycling in and out. It's what happens when businesses scale: they get siloed, and every silo does what it can to survive. And sometimes that means quick wins in the form of tactics that break away from a strategy.
Stats Alone Can't Drive Strategy
The first question I ask executives when a business is off track: "Who do you serve, with what product, for what purpose?" If they can't answer that in a sentence or two, every plan, deck, and fire drill will only cost them more time.
That's when we roll up our sleeves and get what I like to call "a good look inside the house."
Your vendors see traffic or leads go in the front door.
Your team sees sales come out the back.
Most reports show visits, views, reads, what pages were read, but they don't give you enough to know what's going on in the house.
Week-over-week reports miss what prospects were thinking when they got to the site. What outside information they consumed. The conversations they had with their stakeholders or when they passed the baton from a junior researcher to a decision-maker.
There are a lot of stats in dashboards, but rarely any insights.
It's hard work. Even with AI. You've got to know how to structure data and think like an anthropologist to discern between a generic persona and a genuine customer cohort. You've got to completely change the paradigm from advertising is marketing to marketing is a study of human behavior responsible for driving sales.
It's a big shift. But if you can pull it off, you might just be the next Nvidia or Apple.
It's one thing to know that there's a 2% conversion rate on your site. But another thing to know what the other 98% cared about that's missing from the site.
Last year, we helped a brand with a full campaign that dropped their CAC from $52 to $13.50 in just a few weeks. But before we created any content, we filled in gaps by answering questions visitors had before visiting their site. And we did that through feature engineering and machine learning. And if that sounds intimidating, it doesn't have to be. Equivalent tools are free and work on your laptop.
But that discipline showed us the prospects didn't care what the product did. They didn't care about the temperature or volume of this product. But once they understood how it impacted their pet's quality of life, we nearly ran out of stock.
Reliable Measurement Requires Isolation and Controls
20 years since cracking my first cheesecake, I've long since mastered the key to preventing it from cracking. It took dozens of attempts, all with controlled variables: sometimes I took things away, changed the bake time, the temperature, added more flour.
Your marketing works the same way. The people, the product, the positioning, the message, the experience, and the measurement all have to work together. The biggest mistake you could make after hearing this is going back to reporting on channel performance using single-point metrics like ROAS, instead of getting to the heart of why your customers buy and why the prospects aren't.
The good news is, you don't have to rebuild anything right now. If anything, what you have is the right scaffolding. There are just gaps in the experience you can start closing today.
To get your team pointed in the right direction, consider these questions:
Are you measuring contribution margin, or ROAS?
Are you monitoring market shifts in real time, or relying on a strategy deck an agency made two years ago?
Do you have visibility into what information your ICP has or wishes they did?
Can you describe how your ideal customer sees themselves, not just their age, gender or income?
No platform can replace that level of understanding. People intelligence is the strategy that matters most when it comes to marketing. Everything else is boxed cake.
You don't have to figure it out alone. We've been through this hundreds of times and are happy to help while you enjoy your weekend or head out on vacation. You'll come back to a full plan of attack to cut waste and turn things around in weeks, not months.
Fourth Order Intel's diagnostic identifies 15 to 20 percent of operating expenses as recoverable within 30 days. The average engagement pays for itself in the first month. Run the Diagnostic →
Notes
¹ Attribution model: A set of rules or algorithms that assign conversion credit to marketing touchpoints along the customer journey.
² ROAS (Return on Ad Spend): Revenue generated per dollar spent on advertising. Typically reported by ad platforms using their own tracking data.
³ CAC (Customer Acquisition Cost): The total cost of acquiring a new customer, including advertising, sales, and onboarding expenses.
⁴ iROAS (Incremental Return on Ad Spend): A measurement approach that attempts to isolate the additional revenue generated by an ad above what would have occurred without it.
⁵ The enterprise buying cycle for technology platforms typically involves 6 to 18 months of evaluation across multiple stakeholders, during which prospects move across dozens of channels and touchpoints that no single attribution model can fully track.
⁶ Published research puts these figures higher: Bazaarvoice's ROBO (research online, buy offline) study found 82% of smartphone users consult their phones on purchases they are about to make in a store, and multiple retail studies place the share of shoppers who research online before an in-store purchase above 80%. The in-text figures are stated conservatively.
Related:
Lessons from Turnarounds: Reclaiming 15 to 20% of Operating Expenses
Why Your Vendors Win When Your Costs Go Up, and Why Your Team Won't Tell You
Why Strategic Initiatives Fail. And How to Make Yours a Success.

Founder & Revenue Architect
As the Founder of Fourth Order Intel, Omar lives a double life as a systems engineer and growth operator. To him, they're the same discipline and it's why he's driven a combined $500M in new profit for his clients, ranging from new startups to Fortune 15 companies.
Common Questions
Why is marketing attribution inaccurate?
Every platform wants credit for the same sale, and in the worst setups we have seen, the total sales reported across all channels come to two or three times actual revenue. The data underneath is also getting dirtier: before 2025, nearly half of internet traffic already came from bots and scrapers, ad blockers and declined cookie banners stop tags from firing, and Apple's Intelligent Tracking Prevention often strips UTMs so paid traffic shows up as direct or organic. It does not matter which attribution model you deploy; none of them can see the full journey.
What is incrementality in marketing?
Incrementality is the revenue your ad created above what would have happened without it. Metrics like iROAS promise to measure it, but in practice the platform decides what the baseline would have been and how much credit to give itself, so the number is an estimate built on assumptions the platform controls. Measuring it reliably requires isolation and control variables, not a platform report.
How do you measure marketing without attribution tools?
Prove it in a spreadsheet first, and most importantly, prove it in your P&L. That means controlled experiments with isolated variables, and measuring contribution margin instead of ROAS. Track what people actually do, not what they report in surveys or focus groups. You can and should automate attribution with in-house tools later, but no third-party platform can overcome flaws in experiment design.
Do customer journeys start and end online?
No, and that assumption is where most attribution breaks. Over 83% of retail sales happen in physical stores, where no pixel fires in a third-party point-of-sale system. In B2B, a CTO's journey often starts with a call to a friend, then Reddit, then AI, and may never touch your website at all. A little over half of shoppers visit a website before buying in a store, and the customer experiences all of it as one brand, not as separate channels.
Is a high ROAS always a good sign?
ROAS is a proxy. It tells you revenue per dollar of ad spend, but it does not account for overhead, fulfillment costs, returns, or lifetime value, so a 5:1 ROAS can be a loss if margins are thin and the customer never comes back. The reverse is also true. At Old School Labs, our most profitable cohort came in on a .6 ROAS, and because margin was so high on that product, it outpaced our second most profitable cohort by 5x. Agencies would have cut that campaign because they only know how to look at platform data.


