This Just Tested: How much impact does an offline campaign have online?

One of my favorite aspects of working in a family of research companies is getting to see new theories tested. It is a core essence of our “Discover what works” tagline, and when a recent “discovery” experiment came across my desk the other day, I couldn’t help but want to share its implications with our audience. Let me explain the background and give you a little preview of the discovery that will be fully revealed in today’s web clinic.

What’s the story?

We are currently running tests with a large subscription-based news service that has a large direct mail (DM) aspect to their marketing campaigns. We saw this as an opportunity to test some of the hypotheses we have been formulating related to the connection between offline and online efforts.

Now, as with most DM efforts, their campaigns had a call-to-action that included an online option. For those interested in signing up for the offer online, they could go to a specific URL. The URL was unique, the path was clear, and the impact of the direct mail campaign would be easy to track. Right? Well…

Those DM rebels

We wondered how many DM recipients were wandering off the beaten path of a nice clean and trackable vanity URL. We questioned how many people who received the offline campaign were rebelling against the directions and forging their own way to what they wanted. And overall, how much of this company’s generic website traffic was taking part in this underground rebellion?

All these questions led us to test the notion that DM pieces might be having a greater impact than planned for and that we might be underestimating the significant opportunity created by our offline efforts

How we set up the test

So we set up a split test that would integrate some of the messaging from the offline DM campaigns into a generic, but similar product offer page on their website. The elements we tested initially were mainly images. The DM pieces relied on strong images and, to create continuity, we used similar images on the generic website pages (see below). This test was also specifically set to run during the time that the direct mail piece would be landing in mail boxes. (out of courtesy to the Research Partner, we have anonymized these pieces):

Original Offer Page:               Direct Mail Offer:                New Offer Page:

nyt1 150x150 This Just Tested: How much impact does an offline campaign have online?nyt2 150x150 This Just Tested: How much impact does an offline campaign have online?nyt4 150x150 This Just Tested: How much impact does an offline campaign have online?

Our thought here was that if there was any traffic coming from the direct mail to these generic offer pages, that the images would increase relevance and have a positive impact on conversion if many people were coming from the DM campaigns. We were hoping to see a difference in the results over time related to the offline campaign.

The Results – A 124% increase in subscriptions

The results were stunning. During the two weeks that the DM was out, we saw a 124% lift in subscriptions for the new page. After the two weeks, however, the conversion rates for the page that integrated imagery from the DM campaign went back down to its historical average.

This supported our hypothesis that offline efforts have a larger impact than might be expected and that people don’t necessarily follow the prescribed path of a DM campaign. For this company, many ended up on generic product pages.

What does this test mean for all of us? I believe we can learn two things:  1) If you are running offline campaigns, be aware that they may be having a larger impact than you think and 2) Identifying where response to your offline campaigns overlaps with your online visitor’s engagement, and establishing a connection between the two messages can generate significant response.

For this company, discovering that overlap and connecting the messages meant 124% more subscriptions. What might it mean for the rest of us?

For a deeper explanation and analysis of this experiment, activate your FREE MarketingExperiments email subscription to be notified when the replay of this web clinic is available.

Related Resources

Integrate Your Marketing: How one company combined offline and online marketing to increase subscriptions

Do you support your web site through offline media?

Should offline and online design elements be the same?

 This Just Tested: How much impact does an offline campaign have online?

Usability & Design Last

flow Usability & Design Last

Usability is common sense. Good design is common sense. After all, there is no point building a site that is unusable, or a site that isn’t designed well.

Typically, talk of usability orients around function i.e. ensuring websites are easier to use by streamlining content and making navigation clearer. The problem, like with any set of functional guidelines, is that usability is about much more than functional interaction.

Both usability and design are about communication.

The Steps You Need To Take Before You Think About Form & Function

Form and function are important.

But before form and function comes purpose. The purpose of a website is to attract and retain interested visitors. The purpose of a commercial website is to sell.

No matter how well designed, or how usable a website might be, if it doesn’t address a need, then great usability and great design will not help. The web is littered with examples of beautiful form and function that serve no purpose.

Let’s say we’ve identified a market niche. We’ve found a need in the market that isn’t met elsewhere, or we can meet that need better than competitors. Let’s look at five ways to ensure we communicate our message effectively on the web, even before we start to execute.

1. Focus On The User

Do you know who your buyers are? What they want? Where they live? How old they are? If they have credit cards or not? Are they well-off, or poor? Educated?

Usability often talks about creating personas – a characterization of different types of users. This can be a useful exercise in identifying your market, as it gets you thinking from the users point of view.

However, personas they have their limits. People aren’t cartoon characters and will act differently in different situations, so what we’re really looking for is a commonality most of your users share.

What is your core message to your typical user? Write it down. In bold. Weigh every decision you make against that core message.

Almost everything you do should enhance communication with your common user. Your terminology, graphics, pitch and approach should be in sync with your typical users. Communication, and trustworthiness, is enhanced if all aspects of your site are consistent in terms of approach.

2. It’s Not About You

A visitor does not have to be on your site. A visitor is one click away from leaving your site. A visitor has made almost no time investment in getting to your site.There are plenty of other sites.

They have all the control. If you do not meet the visitors needs, they are gone.

Makes you wonder why so many sites spend so much time talking about themselves, huh? No doubt you’ve seen such sites, where the first thing you hit is a mission statement, followed by a summary of how great the company is.

No one cares.

Do you understand what your typical visitor wants to achieve on your site? Can the visitor find what they need quickly and easily? Does you page affirm to the visitor their needs are met and they are in the right place?

3. Storyboard It

Hollywood uses storyboards to graphically show what happens now, and what happens next.

A plan for a website can be laid out in similar fashion. Map out, on sheets of paper, the steps a visitor must take in order to reach conversion. Are there too many steps? Are there any steps that are unnecessary, or divert the visitors attention? Note down at each step the internal dialogue a visitor might be having. What questions do they have in their mind? Are you “answering” them?

Relegate diversions, the equivalent of sub-plots if we’re to extend the movie metaphor, to areas on the site the user can access only if they want to – about us, mission statement, contact details, etc.

You can use flow-charts as well, of course.

4. Your Copy Is Central

Even a site based entirely around a video presentation uses copy i.e. the script.

The words you use help persuade a visitor to take action. They can just as easily put a visitor off, so must be chosen with care.

Use short sentences and paragraphs. People will not start reading a lot of dense copy unless they have an existing, positive relationship with you. Pay careful attention to the hook i.e the headline and first paragraph. Talk about the visitors needs and wants. Use the active voice. Use simple sentence constructions – verb + object. Proof read very carefully.

The copy should proceed logically from one concept to another, leading a visitor towards taking an action of some kind i.e. clicking a button, filling out a form, bookmarking, or reaching for the phone. Make sure you know what the desired action is, and – conceptually – write “backwards” from there.

5. Now Read Up On Usability & Design icon smile Usability & Design Last

Only once your user-centric concept is nailed, storyboarded, and written should you build.

A great concept can be ruined by poor execution, particularly when it comes to design and usability. A lot has been written on both topics, but the 80/20 rules applies: Keep design simple and functional. Remove anything unnecessary. Be sparing with the use of graphics, navigation options and distractions from your central message. Orient around your core message. In terms of non-core pages, people need to be able to get to your contact page easily.

Here’s a set of great design and usability resources that cover the essentials:

Day 14 – Shoemoney System Review

Time Spent: 30 minutes
$ Made: $0
Main Focus: eBay Entrepreneur Interview Video
Today’s Value (1 to 10): 2
Overall Value (1 to 10): 1
My Thoughts: Today I had just a single video waiting for me. It was an interview of an eBay entrepreneur who has built a successful drop shipping business using eBay as a sales channel [...]

Thank you for subscribing to Blueverse!

Day 14 – Shoemoney System Review

 Day 14 – Shoemoney System Review  Day 14 – Shoemoney System Review  Day 14 – Shoemoney System Review

 Day 14 – Shoemoney System Review

Rotate Header Images in Order using Atahualpa Theme

atahualpa theme hacks Rotate Header Images in Order using Atahualpa Theme

By default, Atahualpa allows you to upload multiple images and rotate through them. I was asked recently whether or not it could rotate in a specific order.

Much to my delight, the answer was easy to code. Atahualpa makes finding things you want to change easy and accessible. All I really did was add 1 short line to the the javascript code (don’t get dizzy, there’s no heavy programming at all. Just copy/paste).

In WordPress you click on the “editor” link in the “Appearances” section. This gives you a listing on the right of all of the files in the Atahualpa theme. The specific file we want to change is “js.php”.

Go ahead and click on that link and open the page within WordPress (or download and change it if you like). Find the code that looks like:
js.php random Rotate Header Images in Order using Atahualpa Theme

We want to add code right after the variables are created that sorts the pages alpha-numerically:

HeaderImages.sort()

Adding this into full code will look like:
js.php sorted Rotate Header Images in Order using Atahualpa Theme

By adding the sort() function, we now allow the ability to make the header rotate according to how we want the images to display. A good example is having images with text leading up to the tag line.
- image 1 – Wouldn’t you like,
- image 2 – To have a Theme
- image 3 – That makes life Wonderful?

- image 4 – Atahualpa is better than unicycling bears!

I like things that allow for creativity, flexibility and improvement. Atahualpa allows that. If I could become an affiliate for Atahualpa, I would, but their theme is free, so there’s not much money involved, just happiness.

Toff Ward
OpenSourceMarketer.com

Learn how to build and market your business online using open source tools.

bloglink Rotate Header Images in Order using Atahualpa Theme Join the forum discussion on this post – (1) Posts Rotate Header Images in Order using Atahualpa Theme

Day 13 – Shoemoney System Review

Time Spent: 4 hours
$ Made: $0
Main Focus: eBay Arbitrage
Today’s Value (1 to 10): 7
Overall Value (1 to 10): 1
My Thoughts: You’ll be pleased to hear we covered something of value today! 2 of the 3 videos I watched today dealt with arbitrage on eBay. Basically Jeremy walked Jamie (his model/actress “student”) through the process [...]

Thank you for subscribing to Blueverse!

Day 13 – Shoemoney System Review

 Day 13 – Shoemoney System Review  Day 13 – Shoemoney System Review  Day 13 – Shoemoney System Review

 Day 13 – Shoemoney System Review

Sacrificing Fried Chicken on the Altar of Good Design

chicken egg shell Sacrificing Fried Chicken on the Altar of Good Design

FULL DISCLAIMER: I’m not a designer, I just sleep with one.

I am capable of drawing stick figures. Yep, that’s about the extent of my drawing talent. It works for pictionary, but not for much else. I fully admit that me and color don’t get along. Once you get beyond the basics of Red, Green, Blue and Yellow I tend to just blur out (yes, I know that Green is not a primary color). Gray versus Sage completely escapes me.

The really cool thing here, is that I can still end up with a good looking site. It’s not going to win any major design competitions, but the site is professional, crisp and pleasing to the eye. I use high resolution professional photography and illustrations, yet I spend zero time behind a lens.

How do I do this?

Easy-peasy… I buy them.

I can surf through www.istockphoto.com and www.fotolia.com to find the perfect image for my header or sidebar for as little as $1.20 per image. That’s right, I can completely use the professional talent and expertise of someone else on my website for a buck twenty. Pretty cheap for such good stuff.

Not only can I prevent someone from running away from my site screaming, I no longer have any excuses for NOT having a professional looking website. The imagery is available at such low prices that i am often reminded of the phrase “starving artist” as I select yet another vector graphic to use on a website header.

Proof is in the pudding.

Toff Ward
OpenSourceMarketer.com

Accelerate your business online using Twitter.

 Sacrificing Fried Chicken on the Altar of Good Design

Multivariate Testing: Can you radically improve marketing ROI by increasing variables you test?

As I was reading a few LinkedIn discussions about multivariate testing (MVT), I began to wonder if 2010 was going to be the year of multivariate.

1,000,000 monkeys can’t be wrong

Multivariate Testing (MVT) is starting to earn a place in the pantheon of buzzwords like cloud computing, service-oriented architecture, and synergy. But is a test the same thing as an experiment? While I am not a statistician (nor did I stay at the Holiday Inn last night), working at MarketingExperiments with the analytical likes of Bob Kemper (MBA) and Arturo Silva Nava (MBA) has helped me understand the value of a disciplined approach to experimental design.

monkey2 300x196 Multivariate Testing: Can you radically improve marketing ROI by increasing variables you test?What I see out there is that a little knowledge is indeed a dangerous thing. Good intentions behind powerful and relatively easy-to-use platforms like Omniture® Test&Target™ and Google® Website Optimizer™ have generated a misleading sense that as long as a multivariate test is large enough (several hundred or more combinations being tested), at least one of the combinations will outperform the control.

This notion has become the value proposition of a growing number of companies offering services around either the big-name or their own (simpler, and often therefore easier to set up) MVT tools. They are ostensibly betting on the technology, and not on a systematic approach to experimental design or any particular UI/UX (user interface/user experience) optimization theory.

Even though, as Bob has pointed out to me, it is reasonable that an MVT setup with a billion combinations may not yield a lift over the control, my contention is that the risk-weighted business cost of a dissatisfied customer is low. Therefore, little stops the burgeoning MVT shops from safely offering a “100% lift guarantee.” Just like the proverbial million monkeys with typewriters, somewhere among thousands of spray-and-pray treatments their MVT tests are expected to produce one that’s better than the rest.

1 monkey with a stick

One major difficulty with testing in general becomes painfully obvious with MVT: the more treatments, the longer the test will run. For most companies, what looks at first like a great test may require a year’s worth of traffic to get statistically valid results.

In response, one emerging MVT service model offers getting to a “lift” faster by using adaptive elimination of likely underperformers, in exchange for the test results providing limited information beyond identifying the winner. Such test results are not as useful as their full-factorial brethren for designing subsequent tests because adaptive elimination of treatments makes it difficult to extrapolate the psychological factors and consumer preferences responsible for the test outcome. The immediate business benefits, however, are more immediate.

So, where exactly is the problem? As marketers, are we in the business of employing the scientific method to design graceful experiments or is our fiduciary duty to get measurable results? I humbly suggest that as marketing professionals, we should neither bet on nor be satisfied with just one test, no matter how successful it is.

The bad news and the good news is that we must design an experimental plan to optimize continually, to learn from preceding test results, and to respond to changes in customer preferences, market conditions, and our ability to segment data and traffic. Expertise in experimental design and understanding how to interpret results simply cannot be replaced by set-it-and-forget-it technology (yet).

Economy of testing

That is not to say that MVT provides incorrect results. The results are mathematically valid, even if they do require a long time to obtain. At the same time, from the business point of view, investment into experimental design expertise is expensive. Understanding volumes of published research consumes valuable time. The 100% guarantee sure sounds good.

And so the “guaranteed lift” offers will appeal to the spendthrift marketers who are yet to delve into the science of optimization. The critical issue in the economy of testing is whether methodical design of experiments is likely to provide greater ROI through an interpretation-driven sequence of test iterations than a successful, but terminal one-off test. Our research supports the former.

2010 may become the year of multivariate, but I hope that it will also quietly set the stage for an upcoming year of ROI-conscious design of experiments.

How do you use multivariate testing? Have you created an experimentation plan or do you rely on a series of one-off tests? Share your triumphs and concerns in the comments section of this post or start a conversation with your peers in the MarketingExperiments Optimization group.

 Multivariate Testing: Can you radically improve marketing ROI by increasing variables you test?

How To Solve Shopping Cart Abandonent

It can be frustrating, and expensive, to lose sales at the shopping cart stage.

Thankfully, shopping cart issues are typically a result of poor usability and poor process, and therefore reasonably easy to fix. The key to solving most shopping cart problems is to provide greater levels of transparency.

Let’s look at eight ways to super-charge your shopping cart conversions. We’ll use a cart you’re probably familiar with – Amazon’s – as an illustrative example.

1. Include Indication Of Progress

progress How To Solve Shopping Cart Abandonent

Without a progress report, a buyer can’t tell where they are in the shopping cart process, so it’s a good idea to spell it out.

Look at the way Amazon does their shopping cart, giving a graphic indication of the buyers position in the process. The buyer should also should be able to move forwards and backwards in the process in order to make changes.

2. Keep The Product In Front Of Buyers

keep How To Solve Shopping Cart Abandonent

When we buy in the offline world, we’re always connected to the item we’re purchasing.

It would feel strange to put a product we’ve decided to buy back on the shelf, go pay for it elsewhere, then come back to it a few days later. The disconnected feeling doesn’t provide a sense of ownership and belonging.

On the web, we can keep the product in front of buyers by providing an image/description of the product at all steps of the sale process, or a link back to the product page. When the buyer makes a purchase, send the buyer an email detailing their purchase.

Also, buyers like to re-check their purchases just before they hit the buy button, just in case they have made a mistake, or they’ve just thought of a feature they forgot to check. Make this back-navigation exercise difficult, and users will likely abandon the sales process.

3. KISS

obvious How To Solve Shopping Cart Abandonent

Keep the sales process simple and obvious.

The sales process is not the place to let your designers get creative and cryptic. It should always be clear what action the visitor needs to take next in the form of “next” buttons or text. Whenever a user sees a new screen, that should be left in no doubt where they are in the sales process.

This is where testing is important. Watch how people step through the process, watch where they look, and watch for times where they appear indecisive.

4. Be Upfront About Shipping Costs

shippingrates How To Solve Shopping Cart Abandonent

Many buyers won’t enter into a shopping process until they know the final cost in advance.

Let the buyer know the likely shipping cost before they enter the process. If shipping costs need to be calculated based on an address they give, then provide a link to a chart of typical shipping costs.

5. Make It Easy To Edit

billing How To Solve Shopping Cart Abandonent

Can the shopper edit the shopping cart?

One common reason for abandonment is the buyer feels they have made an error, but can’t see an easy way to rectify it. It’s best if the buyer can edit quantities and options at every stage, rather than having to navigate back.

If this is not possible, assure the buyer that they will be able to edit quantities etc on the final page before completion.

6. Address Security Concerns

returns How To Solve Shopping Cart Abandonent

The shopper is giving away personal information AND credit card details. A little voice inside their head will be warning them against sending such details to someone they know nothing about.

Think about ways you can reassure people. Make privacy policies available. Use secure processing. Use badges from business associations, and use third-party validation insignia. Assure shoppers with returns policies and purchase guarantees.

7. Include Your Phone Number

No matter how simple and complete you make the process, there will always be people who will be confused, or want to ask further questions.

If possible, give people the option to call. Alternatively, use a chat widget.

8. Save Option

No matter how streamlined your shopping process, people get distracted.

They may need to check some product details and come back. Does your shopping process allow people to save their progress? How about capturing their email address early, and sending them a reminder if there are items left in their cart, with instructions, and further incentives, to complete the process.

How To Solve Shopping Cart Abandonent

It can be frustrating, and expensive, to lose sales at the shopping cart stage.

Thankfully, shopping cart issues are typically a result of poor usability and poor process, and therefore reasonably easy to fix. The key to solving most shopping cart problems is to provide greater levels of transparency.

Let’s look at eight ways to super-charge your shopping cart conversions. We’ll use a cart you’re probably familiar with – Amazon’s – as an illustrative example.

1. Include Indication Of Progress

progress How To Solve Shopping Cart Abandonent

Without a progress report, a buyer can’t tell where they are in the shopping cart process, so it’s a good idea to spell it out.

Look at the way Amazon does their shopping cart, giving a graphic indication of the buyers position in the process. The buyer should also should be able to move forwards and backwards in the process in order to make changes.

2. Keep The Product In Front Of Buyers

keep How To Solve Shopping Cart Abandonent

When we buy in the offline world, we’re always connected to the item we’re purchasing.

It would feel strange to put a product we’ve decided to buy back on the shelf, go pay for it elsewhere, then come back to it a few days later. The disconnected feeling doesn’t provide a sense of ownership and belonging.

On the web, we can keep the product in front of buyers by providing an image/description of the product at all steps of the sale process, or a link back to the product page. When the buyer makes a purchase, send the buyer an email detailing their purchase.

Also, buyers like to re-check their purchases just before they hit the buy button, just in case they have made a mistake, or they’ve just thought of a feature they forgot to check. Make this back-navigation exercise difficult, and users will likely abandon the sales process.

3. KISS

obvious How To Solve Shopping Cart Abandonent

Keep the sales process simple and obvious.

The sales process is not the place to let your designers get creative and cryptic. It should always be clear what action the visitor needs to take next in the form of “next” buttons or text. Whenever a user sees a new screen, that should be left in no doubt where they are in the sales process.

This is where testing is important. Watch how people step through the process, watch where they look, and watch for times where they appear indecisive.

4. Be Upfront About Shipping Costs

shippingrates How To Solve Shopping Cart Abandonent

Many buyers won’t enter into a shopping process until they know the final cost in advance.

Let the buyer know the likely shipping cost before they enter the process. If shipping costs need to be calculated based on an address they give, then provide a link to a chart of typical shipping costs.

5. Make It Easy To Edit

billing How To Solve Shopping Cart Abandonent

Can the shopper edit the shopping cart?

One common reason for abandonment is the buyer feels they have made an error, but can’t see an easy way to rectify it. It’s best if the buyer can edit quantities and options at every stage, rather than having to navigate back.

If this is not possible, assure the buyer that they will be able to edit quantities etc on the final page before completion.

6. Address Security Concerns

returns How To Solve Shopping Cart Abandonent

The shopper is giving away personal information AND credit card details. A little voice inside their head will be warning them against sending such details to someone they know nothing about.

Think about ways you can reassure people. Make privacy policies available. Use secure processing. Use badges from business associations, and use third-party validation insignia. Assure shoppers with returns policies and purchase guarantees.

7. Include Your Phone Number

No matter how simple and complete you make the process, there will always be people who will be confused, or want to ask further questions.

If possible, give people the option to call. Alternatively, use a chat widget.

8. Save Option

No matter how streamlined your shopping process, people get distracted.

They may need to check some product details and come back. Does your shopping process allow people to save their progress? How about capturing their email address early, and sending them a reminder if there are items left in their cart, with instructions, and further incentives, to complete the process.

Day 12 – Shoemoney System Review

Time Spent: 30 minutes
$ Made: $0
Main Focus: eBay Arbitrage
Today’s Value (1 to 10): 3
Overall Value (1 to 10): 1
My Thoughts: Today was a bit of a strange day in the ol Shoemoney System. I had a couple of videos I had already watched disappear and 5 new videos appear. What’s strange is 2 of [...]

Thank you for subscribing to Blueverse!

Day 12 – Shoemoney System Review

 Day 12 – Shoemoney System Review  Day 12 – Shoemoney System Review  Day 12 – Shoemoney System Review

 Day 12 – Shoemoney System Review