A very easy way to break this argument is to not look at huge known companies like eBay and Amazon, but brand new companies 1-2 years old that have grown almost entirely by online ads. Eventually word of mouth kicks in, but there are plenty of smart operators that built their entire brand and revenue off of ads.
Reliably someone comes along every few months to question digital ads. I always come back to analyses of incrementality as the real proof.
Take an audience of X people. Divide them in two. Show ads to your test group, don't show to control. Watch your business grow and gauge the lift between the two audiences.
The companies that know how to advertise at scale do this constantly and can gauge the real effect of their ad dollars. Facebook, Google and others make these tests possible in their platforms, while other software suites such as Impact Altitude and VisualIQ allow you to do this kind of analysis and testing as well.
In the end, most of it proves out to be incremental. There are notable exceptions of course, but when are there not?
> Show ads to your test group, don't show to control
Which is the wrong experiment to run. The old adage is that 50% of advertising works, you just don't know which part. You need an experiment to prove that ad spending scales with ROI, as ad agencies claim. That may well be completely false.
That’s the thing - you run these test with individual campaigns in many channels. Digital gives you the ability to test this at scale as you grow your advertising, thus you can gauge with high confidence exactly what advertising is scaling with positive ROI.
Incrementality testing isn’t limited to your advertising as a whole - you can get down to very fine detail as long as your experiment is correctly designed and you wait for stat-sig results.
The basic experiment can be varied to allow for that.
Specify a set of zones. Target different levels of advertising at these. Look at sales trends. Rinse, wash, repeat.
Note that major corporations often designate specific areas for product testing. The Chicago area, and Australia, see trial runs of McDonalds products and store concepts, as an example.
The fundamental concept of testing advertising effectiveness is not new. Here's an account from 1909 (from one of my faviourite sources on advertising and media, Hamilton Holt's Commercialism and Journalism):
> You need an experiment to prove that ad spending scales with ROI, as ad agencies claim
There is a limited audience that can be influenced. Just like house ads on a site (where you advertise to sell your own goods on your own site), there's only so much that is affected because you have finite traffic. There is a curve for every permutation of context (demographic, geographic, etc).
> Take an audience of X people. Divide them in two. Show ads to your test group, don't show to control. Watch your business grow and gauge the lift between the two audiences.
So advertising industries use people as guinea pigs to study the "real effect of their ad dollars". No ethics committee, no informed consent, nothing.
If you can ethically do something (show ads) or not do something (not show ads) it's equally ethical to run an experiment where you do the thing some of the time and measure the effect.
Internet companies run A/B tests all the time, and it's not controversial.
Agree. I have used the term "incrementality" to communicate the incremental benefit of a given ad compared to a control whereas the article uses "advertising effect". Measurement is also difficult because every ad platform grades their own homework (they each have analytics that attributes sales to their platforms liberally).
It is important for a brand to have their own attribution platform that measures incrementality as well as the relative contribution each ad exposure makes toward a given sale.
Both of these things are possible to measure. The problem is that the band of users that display positive ROI (when incrementality is measured) is so small that people don't believe the data.
Additionally, brand exposure is hard to measure and almost completely ignored in digital advertising. Over time I imagine that there will be more research in this area (beyond just measuring an in-view ad impression)
How do you separate "people who haven't seen an ad" into a group in Google analytics? I don't believe "organic" source does that, because that means they weren't targeted by the ad in the first place, creating a bias.
That's of course possible to measure in theory. I meant it as a response to "Facebook, Google and others make these tests possible in their platforms" since I haven't seen it exposed as an explicit option on either.
Then you haven't been talking to the right ad sales teams. Google and Facebook have entire product options built around this specific concept. You can run a "ghost ads" test on Google for as little as $20k in ad spend; it's relatively accessible even for smaller players.
For Facebook, Reach ads have a brand lift objective that will estimate for you. If you spend large amounts they have a measurement team that will run the actual study for you. Source: I'm running one right now for a CPG brand.
Facebook has this exactly this tool, aka Conversion / Brand Lift [1]. It's a real experimentation system, not a "simulated" one like Google's Ghost Ad.
Yep. Lift tests are solid gold. A lot of people pan FB ads but the reality is they can be very incremental.
The flip side is that not every campaign, targeting strategy or ad will be incremental. You have to test and retest your way to it. A blanket assumption won’t work.
Geo tests are useful for sure, but also require a lot of data to get statistically significant results. Any noise in your data (seasonality, PR, etc) has to be taken into account as well. They’re harder to execute in general but can work well.
The interest is more on markets than individuals, in general, so what you're measuring is market response given advertising exposure, or more critically, ROI given spend.
The fact that Web and AdTech allow the appearance of individual-level targeting does not necessarily make that a Good Thing.
I'm running a campaign that spends about $10,000 a day for a brand on Facebook. In fact at that level they will run said brand lift study for you. So yes, despite this articles implication the data does exist and we do know the difference between advertising to an audience and not.
The average "target" client on the lead list of your average big name advertising agency in a European country with a population of 50 million will have a yearly spend of 50-100 million across all channels, with 1-10 million going on agency fees excluding 3rd party costs. 10k per day on Facebook is a small consumer start-up levels of adspend.
1. In the grand scheme of advertising it's actually still a fairly small budget.
2. For this advertiser they really only advertise q4 so it isn't quite that much.
3. It's a CPG in a grocery store is all I can really say.
You define an audience. You split it. You test and measure the result.
What component of that strategy doesn't work for new visitors? Many eyeball vendors (Google, Facebook, heck traditional TV and other media!) are set up precisely to allow for such cases.
One tool with FB lift tests is to make a lookalike audience. FB will then split that audience in two for you so you have a test and control group.
The original test required two ad accounts and keeping your overall advertising static (not changing anything) for the duration. Today it is much easier and has a lot more features.
Google does a search lift test with YouTube as well. You can run a large set of ads against an audience in YT and google will either suppress them for a subset. Then you can see your overall organic lift based on your video ads.
FB can track ads using clicks and view through. With a control group, you can only use view through. I am just skeptical of how it is a fair test especially when FB has an interest to prove that ads work.
YouTube brand lift is an indirect measure that is hard to translate to actual sales to see if the ads were cost effective.
The math is fuzzy when measuring marketing ads and it is real hard to be truly scientific.
The concept, principles, and methods, are taught in the context of marketing and advertising academic programmes.
See, e.g., ADVT5440 and ADVT5501 at Webster University, for example:
This course emphasizes the importance of critical thinking in the planning and development of message strategy for advertising and other marketing communications tools. Class discussions explore the decision making process and development of criteria for evaluation of alternative message strategies.
This is a very interesting point, which in fact plays in defense of original article.
Bob Hoffmann, very influential figure in advertising (http://adcontrarian.blogspot.com/) likes to point out that there were not that many companies which built their strong brand with online advertising only.
OK, he is old and grumpy dude and he dislikes online ads, but this is a fair point. Once company becomes big enough, it strives to buy a Super Bowl ad spot. And we are well into 10 years of internet being mainstream media, but how many brands were built online only? Not that much, and I'm saying it as "online ads work", kind of guy.
I can name a handful that I've never seen an ad for on TV or in print (or maybe 3 or 4 years after using them). Twitter, DoorDash, Lyft...compared to SkipTheDishes in Canada, which has commercials on during SNL but maybe it's already hit peak internet marketing there, or maybe more appropriately GoDaddy which wasn't much until their Superbowl ad.
Another thing marketers in US and to a certain extent Europe fail to see is how digital has evolved in Asia and think through what it means for their own work. The same marketing giants which spend 90% of the hundreds of millions of dollars per brand per year on TV in the US spend 90% in digital in China and are increasingly shifting in other Asia markets. This reflects shifting consumer time spent on vehicle.
Now big company marketers are used to thinking of US as a homogeneous market for efficiency reasons and so TV still works in US if your target audience claims a broad demographic. However, they're beginning to learn that you'll simply not reach enough consumers if your target demographic is say young adults in the West coast if you do a TV heavy plan. US in general lags China in media landscape shift but the media behavior of the more valuable demographics are actually much closer to China than averages tell you.
the article isnt making the point that there is no value in advertising, but that it's highly overstated. One really needs ads - the 're a very effective way to reach users. But after that initial push, does spending more really return more?
One thing I've always thought about ads is the subconscious impact that they have of building brand recognition and awareness. Especially for something which would typically be purchased infrequently or irregularly.
I might be at a grocery store and I need to purchase something like dishwashing liquid. If I'm staring at two brands on the shelf priced identically (or near enough) I'm more likely to purchase the brand I recognize over a brand I've never heard of. How do I recognize the brand - from advertising.
That is not something you can measure with tracking metrics embedded into a banner ad. I'm sure there must be studies on impact this has.
The other thing I suspect online advertising works very well for is service based businesses, the kinds of things you used to look up in a phonebook. The last time I needed to find a plumber I typed my suburb name + plumber into search engine I imagine a lot of people do similar.
...there are plenty of smart operators that built their entire brand and revenue off of ads.
Can you name one?
I find it very hard to believe there are any companies that have scaled up only using online adverts. Why would the founders of a business do that when they can grow in their local market by talking to people as well as buying online ads for wider reach?
Wayfair - you can listen to the NPR podcast "How I built this" where they talk about building their entire business around domain names and pay-per-click advertising (7 billion market cap).
This wouldn't be too uncommon in branded ecommerce. If you are selling well known brands it is going to be very hard to get decent organic search rankings for them in the short term.
Works best in online direct to consumer brands.