The Guardian newspaper’s introduction of single-layer hierarchical threading to its comment section creates a natural experiment for CSMR researchers to better understand the consequences of this design change. Consistent with the publisher’s aims, their research shows that the new design was followed by an increase in the rate of individuals returning to post again, both on any given article, and via the commenting service as a whole.
Ceren Budak, University of Michigan
R. Kelly Garrett, Ohio State University
Paul Resnick, University of Michigan
Julia Kamin, University of Michigan
The Guardian—the fifth most widely read online newspaper in the world as of 2014—changed conversations on its commenting platform by altering its design from non-threaded to single-level threaded in 2012. We studied this naturally occurring experiment to investigate the impact of conversation threading on user retention as mediated by several potential changes in conversation structure and style. Our analysis shows that the design change made new users significantly more likely to comment a second time, and that this increased stickiness is due in part to a higher fraction of comments receiving responses after the design change. In mediation analysis, other anticipated mechanisms such as reciprocal exchanges and comment civility did not help to explain users’ decision to return to the commenting system; indeed, civility did not increase after the design change and reciprocity declined. These analyses show that even simple design choices can have a significant impact on news forums’ stickiness. Further, they suggest that this influence is more powerfully shaped by affordances—the new system made responding easier—than by changes in users’ attention to social norms of reciprocity or civility. This has an array of implications for designers.