Tag Archives: Field experiment

Smart home paradox: Why reviews and teasers failed

Most digital marketers rely heavily on customer reviews or teasers. However, when we collaborated with Samsung Electronics to run two field experiments, we uncovered a critical mismatch between messaging and audience.

We specifically targeted busy, dual-earner parents. Our surprising finding is that benefit-driven formats like customer reviews or teaser pages were largely ignored. Instead, clear, feature-focused messaging outperformed the popular formats.

This field experiment demonstrates why a one-size-fits-all strategy fails in the complex smart home category, providing a necessary blueprint for engaging high-intent consumers with efficient, direct communication.

**

Reference

Hwang, S., Yoon, N., & Joo, J. (2025). The impact of smart home products’ marketing messages on dual-earner parents’ willingness to pay. Journal of Product & Brand Management, 34 (5), 662-674.

Purpose: The objective of this study is to explore the effect of family and message type interactions on the sales of smart home products. The study hypothesizes that dual-earner parents, a prolific segment of consumers, will indicate a greater willingness to pay for smart home products when exposed to characteristics-related marketing messages.

Design/methodology/approach: Two quasi-experimental studies were conducted to test the hypothesis. In collaboration with Samsung Electronics, the studies utilized different smart home product bundles (Smart Air Care and Smart Safety Care), recruited distinct participant groups (parents of children aged three to five and parents of children aged zero to three), and manipulated different types of benefits-related messages (a user review video and a teaser page).

Findings: In response to smart home product messaging, dual-earner parents exhibited greater willingness to pay when exposed to characteristics-related messages compared to benefits-related messages. This difference was not found among single-earner parents.

Originality: Challenging conventional marketing assumptions, the findings demonstrate that benefits-related messages do not universally appeal to smart home product consumers, while characteristics-related messages can increase willingness to pay among dual-earner segment. The collaboration with Samsung Electronics in a quasi-experimental setting strengthens the external validity of the results, suggesting that marketers should tailor messaging strategies based on the characteristics of customer segments.

Keywords: Smart home products, dual-earner parents, message type, Samsung Electronics

“… dual-earner parents’ willingness to pay nearly doubled when presented with characteristics-related messages compared to benefits-related messages, increasing by 163% in Study 1 and 162% in Study 2. This suggests that tailoring messages to this group could significantly boost market penetration and profitability in the competitive smart home product sector.”

How to write and when to send traffic-boosting mobile coupons?

Chu, W., & Joo, J. (2024). Targeting effectiveness of mobile coupons: from exposure to purchase. Journal of Marketing Analytics, 12, 342-354.

Abstract

This research examines the effectiveness of traffic-boosting mobile coupons through a randomized field experiment of over half a million South Korean consumers. The research question analyzes the effectiveness of the content (six message types) and context (three days out of the week for coupon distribution) of mobile coupons on response-to-coupon, store visits, and purchase amount for a health and beauty retail chain. Big data on individual customers, gathered from a field experiment, was analyzed through bivariate probit, mediation analysis, and tobit regression. The results show that message content affects store visits, which was fully mediated through response-to-coupon. In particular, messages that “made the amount of discount salient” and “formed a personal connection” were more effective than other messages. In terms of context, messages sent during the weekdays were more effective in increasing store visit, than those sent during the weekend.

Keywords

Mobile promotion · Mobile coupon · Message content · Message context · Coupon distribution · Field experiment

Acknowledgements

We would like to express our deep gratitude to Hyojung Kim, Sul Namgoong, and Joongjae Lee at Shinhan Card for their assistance with the collection of our data.

Please see the case study in Korean language here

How did Samsung designers overcome an unofficial heuristic?

Hwang, S., Park, H., Oh, K., Hwang, S., & Joo, J. (2021). Rethinking a Designers’ Rule of Thumb: Influence of Information Seeking and Consumption Goals on Mobile Commerce Interface Design. Journal of Theoretical and Applied Electronic Commerce Research, 16 (5), 1631–1647.

Abstract: We investigated whether adding product information in mobile commerce improved consumers’ attitudes toward a product and whether this relationship was moderated by consumption goals. We conducted two field experiments in which we recruited parents in Korea and the USA and asked them how they evaluated two childcare hybrid products (HPs) newly developed by Samsung Electronics designers. The results revealed that participants exposed to additional information about the HPs evaluated them more favorably than those who were not exposed. However, this relationship disappeared when a consumption goal was activated. Our findings establish a dynamic relationship between information seeking and consumption goals, asking designers to rethink their rule of thumb in the mobile commerce context.

Keywords: information seeking; consumption goal; hybrid product; Samsung Electronics; mobile commerce