- Open Access
Associations between program outcomes and adherence to Social Cognitive Theory tasks: process evaluation of the SHED-IT community weight loss trial for men
International Journal of Behavioral Nutrition and Physical Activityvolume 11, Article number: 89 (2014)
Despite rising international rates of obesity, men remain reluctant to participate in weight loss research. There is a lack of evidence to guide the development of effective weight loss interventions that engage men. The objective of this study was to provide a comprehensive process evaluation of the SHED-IT (Self-Help, Exercise and Diet using Information Technology) weight loss program for men, as delivered in the SHED-IT community weight loss trial, and to identify key components associated with success.
In an assessor-blinded randomised controlled trial, 159 overweight and obese men (BMI 25.0-40.0 kg/m2) were randomised to one of two gender-tailored weight loss interventions with no face-to-face contact, or a control group. The interventions were informed by Bandura’s Social Cognitive Theory (SCT) with men encouraged to complete a Support Book containing SCT-based tasks including goal setting, reward setting, creation of social support strategies and self-monitoring of: i) weight, ii) physical activity, and iii) diet. At post-test, compliance with SCT tasks was examined and men also completed a process evaluation questionnaire.
Both SHED-IT intervention groups demonstrated greater weight loss during the intervention compared to the control, with no difference between intervention groups. Most men engaged with the SCT tasks although compliance declined over time and utilisation of social support networks and reward selection was poor. In a multiple regression model, the number of goals set (β [95% CI] = -0.3 [-0.6, -0.1], p = 0.01) and the number of weight records documented (β [95% CI] = -0.2 [-0.4, -0.0], p = 0.03) independently predicted weight loss. The process evaluation indicated that men found the programs to be supportive, enjoyable and beneficial.
This process evaluation provides valuable information to inform the development of obesity treatment strategies that engage men. Future studies with men should include a strong focus on self-monitoring and goal setting to enhance behaviour change and improve treatment effects.
Australian New Zealand Clinical Trials Registry ACTRN12610000699066.
Obesity is an increasingly prevalent global health problem []. Obesity more than triples the risk of developing type 2 diabetes, gall bladder disease and sleep apnoea, and doubles the risk of heart disease, hypertension and asthma [,]. This is particularly concerning for males who exhibit a visceral abdominal pattern of obesity, which further increases the risk of developing obesity-related chronic diseases []. Despite the need for weight management, men are less likely to perceive themselves as overweight [] or to participate in weight loss interventions or research []. This may arise from a lack of appeal of traditional weight loss programs and/or reduced motivation after previous failed weight loss attempts []. Previous studies indicate that face-to-face weight loss programs, particularly group-based programs, do not appeal to men [-]. Consequently, there is a need to develop weight loss programs targeted to men’s physical and psychological profile [,]. Men also report preferences for convenient programs that include personalised feedback, people they can relate to (particularly other men), the use of humour and minimal disruption to their current lifestyle [,,].
Currently, there is a lack of evidence to guide the development of effective weight loss interventions for men. Recent systematic reviews have clearly demonstrated that men are consistently under-represented in weight loss research [,]. As such, many of the current recommendations provided to men attempting weight loss are based on trials that were predominantly conducted with women. A recent systematic review of male-only weight loss studies documented the success of gender-targeted approaches, but noted more high-quality studies are required to improve understanding of how to successfully engage men with effective weight loss programs []. Process evaluation of such studies is also an integral component of intervention research as it establishes the quality of the intervention and informs the design and implementation of future trials []. Process evaluation may examine participants’ views of the program, whether the program was implemented as intended and the effectiveness of individual program components in relation to study outcomes []. As there is limited evidence regarding effective weight loss interventions for men [,], process evaluation of male-only trials is essential to determine (i) which treatment modalities are feasible and acceptable to men, and (ii) which intervention components are associated with successful treatment outcomes in men.
We developed a male-only weight loss program called the SHED-IT (Self-Help, Exercise, and Diet using Information Technology) Program that involved no face-to-face contact and was tailored for men. This program was successfully tested in a pilot study with University staff and students [,,-] and was subsequently refined and tested in an effectiveness trial with a large community sample of overweight and obese men [,]. Although both trials tested the SHED-IT program, important intervention changes were made between trials. For example, for the current trial, the face-to-face session was removed from the intervention and replaced with a DVD to improve scalability. In addition, Bandura’s Social Cognitive Theory (SCT) was more rigorously operationalised in the current intervention, with participants completing a newly developed weight loss Support Book containing SCT tasks. The study protocol [] and outcomes [] of the current trial have been reported elsewhere. The SHED-IT program targeted behaviour change mediators outlined in Bandura’s SCT [], which provides a framework for changing an individual’s cognitions in order to improve adherence with optional behaviours. Men must value the outcome (i.e. weight loss) if they are to make changes to dietary and exercise behaviours. They must believe weight loss will occur by making these changes and that they have the confidence, knowledge and skills required to implement these changes.
In the current study, we present the findings of a comprehensive process evaluation 3-months post-intervention of the SHED-IT community weight loss randomised controlled trial (RCT) []. Specifically, we investigated the following three research aims:
To report participant engagement with SCT-based program tasks including goal setting, reward setting, social support and self-monitoring of: i) weight, ii) physical activity, and iii) dietary intake;
To examine the association between compliance with SCT-based tasks and weight loss;
To examine men’s perceptions of the quality of the SHED-IT program and its impact on their weight as well as their knowledge and skills about weight loss.
The SHED-IT community trial has been described in detail previously [,]. Briefly, this assessor-blinded RCT included a community sample of overweight and obese men (BMI 25.0-40.0 kg/m2) from the Hunter region of New South Wales, Australia. Participants were randomly allocated to one of three study arms: i) SHED-IT Resources; ii) SHED-IT Online, or iii) a wait-list control group. This study was approved by the Human Research Ethics Committee, University of Newcastle and all subjects provided written informed consent. The trial was registered with the Australian New Zealand Clinical Trials Registry, Number ACTRN12610000699066.
The SHED-IT interventions were based on SCT, in which Bandura proposes that behaviour change is influenced by attributes of the behaviour itself, personal factors and environmental factors []. In order to target the key behaviour change constructs outlined in SCT, the SHED-IT interventions first aimed to educate participants about the physical, social, and self-evaluative (i.e. personal) benefits of weight loss through increased physical activity and healthy eating. In addition, the resources were designed to increase participants’ self-efficacy for performing these behaviours and assist them to develop the self-regulatory skills needed to sustain the behaviours over time and in the face of potential barriers. These self-regulatory behaviours include goal setting, self-monitoring and reward provision []. Finally, given the importance of socio-structural facilitators in establishing long-term behaviour change, the SHED-IT resources were designed to help men engage with their social networks and establish helpful social support strategies []. Both the Resources and Online SHED-IT interventions included the same core components and were based on the same theoretical constructs. Men were instructed to complete all program tasks for 3-months which, excluding data collection visits, were completed without face-to-face contact.
SHED-IT Resources intervention
Men randomised to the Resources group received a resource package containing the ‘SHED-IT Weight Loss Handbook for Blokes’, a 25-minute ‘Weight Loss DVD for Blokes’, a kilojoule counter book, a pedometer and a tape measure. These resources focused on nine key weight loss messages: 1) Read food labels, 2) Keep a healthy lifestyle diary, 3) Reduce kilojoule-dense snacks, 4) Be prepared, 5) Every step counts, 6) Reduce your sitting time, 7) Surf the urge (in reference to resisting the urge to snack unnecessarily), 8) Reduce your portion sizes, and 9) Don’t drink your kilojoules.
In addition to these resources, men also received the “SHED-IT Weight Loss Support Book for Blokes”, henceforth referred to as the Support Book, which included the following six sections:
Calculating kilojoule output
Weight and waist record charts: Participants updated charts weekly.
Pedometer diary: Participants monitored step counts four days each week, calculated the average, and plotted the weekly average on a chart.
Goal setting: Participants were advised to set three goals monthly, one for weight loss, one for physical activity and one for dietary intake. Instructions for setting SMART goals (i.e. Specific, Measureable, Attractive, Realistic and Time-targeted) and examples were provided. Men were also instructed to mark off each achieved goal and record a reward they would receive at the end of each month if they successfully achieved all three goals.
Social support strategies: Men were instructed to record one or two social support strategies each month. Instructions and examples were provided.
Healthy lifestyle diary: Instructions were provided for recording dietary intake and exercise participation on four days of each week for the 3-month intervention. This was paper-based and included space to calculate whether the daily kilojoule target for weight loss was achieved.
SHED-IT Online intervention
Those randomised to the Online group received a website user guide in addition to the resource package described above. The user guide included information on using the freely available Calorie King™ (Australia) website (http://www.calorieking.com.au) and instructed participants to record dietary intake and exercise online for four days per week, in place of the paper-based diary completed by the Resources group. Participants also had the option of self-monitoring their weight, waist and pedometer steps on the website rather than the Support Book, if they chose. Contingent on diary completion, research assistants provided men with seven individualised feedback emails based on their online food and exercise diary entries. These were provided weekly during the first month, fortnightly during the second month and once during the third month.
Men were measured at baseline, 3 months (immediate post-intervention) and 6 months (3-month follow-up). All measurements were performed by trained research assistants who were blinded to group allocation.
Measurement of anthropometrics, demographics and behaviours
Body weight (CH-150kp, A&D Mercury Pty Ltd, Australia) and height were measured, and Body Mass Index (BMI) was calculated. Waist circumference was measured at the umbilicus and the largest circumference between the umbilicus and lower costal border [] (KDSF10-02, KDS Corporation, Osaka, Japan), and body fat (kg) was determined by bio-impedance analysis (InBody720, Biospace Co., Ltd, Seoul, Korea) []. Age and socioeconomic status [] were determined by questionnaire. Dietary intake was measured using the validated Australian Eating Survey [], while physical activity levels were objectively measured via seven days of pedometry with Yamax digiwalker SW200 pedometers (Yamax Digi-Walker SW200, Kunamoto City, Japan).
Program compliance measures
Compliance with SCT-based tasks was quantified by examining adherence to each of the six Support Book components during the 3-month intervention phase. Specifically, this comprised self-monitoring of weight, waist circumference and pedometer step counts; setting of goals, rewards, and social support strategies; and monitoring dietary intake and exercise participation. Compliance with each Support Book component was defined as recording each component at least 80% of recommended reporting times. For example, compliance with monitoring waist circumference was defined as weekly recording of waist circumference measurements at least 11 times over the 3-month (13-week) period. This cut-off was chosen based on data from the SHED-IT pilot study [], where men who completed 80% of weight entries and 80% of the food and exercise diary recommendations demonstrated significantly greater program outcomes compared to those that did not. Participants were advised to set SMART goals, with examples provided, such as “this month, I will go for a half-hour walk around the neighbourhood, three times per week”. Quality social support strategies were defined as engaging a person from one’s social support network to participate in a supportive activity that would aid in successful completion of the SHED-IT program requirements.
A project-specific process evaluation questionnaire, adapted from an instrument used in previous research [], was completed at the 6-month assessments. This questionnaire measured perceptions of the SHED-IT program in general; satisfaction with the program resources including the DVD, the Handbook and the Support Book, and the effect of the program on the people around them. The Online group completed additional questions regarding perceptions of the Calorie King website and personalised feedback reports.
Data were analysed using Statistical Package for the Social Sciences (SPSS version 20.0 software; SPSS, Chicago, IL, USA) and are reported as mean (standard deviation), median (interquartile range) or the percentage of participants for each specified variable. For continuous variables, groups were compared using analysis of variance (ANOVA) with Bonferroni post-hoc testing. Proportions of subjects recording each Support Book component were examined using Pearson’s chi-squared test (Aim 1). The correlation between change in selected outcomes (e.g. weight, waist circumference, physical activity) and engagement with each Support Book component (i.e. goal setting and rewards, social support, monitoring of weight and pedometer steps, dietary intake and exercise participation) was assessed using the Spearman rank test (rs) (Aim 2). Backward stepwise regression was performed using Stata (Intercolled Stata version 11.2, Stata Corporation, College Station, TX, USA) to determine the independent effect completing each Support Book component had on weight change (kg) (Aim 2). These analyses were adjusted for age and socio-economic status (SES), which are known to interact with weight [] and treatment outcomes in previous weight loss trials with men [,]. Intervention group was also adjusted for in the analyses. In addition, the robust variance estimator was applied to account for the data being skewed. As records for waist circumference measurement and exercise participation were highly correlated with records for weight measurement and dietary intake respectively, they were not included in the regression model. Process evaluation questions were analysed by independent samples t-tests to determine the main effect of intervention allocation (i.e. Online vs. Resources) on participants’ perceptions of the SHED-IT program (Aim 3). P-values <0.05 were considered statistically significant for all analyses (Aim 3).
The high appeal of a male-only weight loss program of this nature was demonstrated by the recruitment of 159 men from more than 600 enquiries within a one-week period. A total of 53 men were randomised to the Online group, 10 of which withdrew [] and 11 did not return their Support Book, leaving 32 included in the analysis of program compliance. For the Resources group, 54 men were randomised, 11 withdrew [], and eight did not return their Support Book, totalling 35 men included in the compliance analysis. For those included in the analysis of compliance, more men of a high SES completed the Online program and returned their Support Book compared to the Resources program. However as mentioned previously, SES was adjusted for in the analyses, where significant.
At baseline, these participants (n = 67) had a mean (SD) age of 47.3 (10.9) years, BMI of 32.6 (13.5) kg/m2, walked 6950 (2962) steps per day and consumed 11547 (3496) kJ per day. The only significant difference between groups at baseline was SES, with more participants in the Resources group living in higher socio-economic areas than men in the Online group. Additional information on participants’ baseline characteristics can be found in Additional file 1: Table S1.
As previously reported, after 6 months, weight was significantly reduced (p < 0.001) in both the Online group (-4.7 kg, 95% CI -6.1, -3.2) and Resources group (-3.7 kg, 95% CI -4.9, -2.5) relative to the control group (-0.5 kg, 95% CI -1.4, 0.4), with no significant difference between intervention groups (p > 0.05) []. There was also a significant decrease in energy intake in both the Online (-1673 kJ/day, 95% CI -2268, -1078) and Resources (-1190 kJ/day, 95% CI -1924, -456) groups. In addition, significant increases in physical activity were observed for the Online group (1575 steps/day, 95% CI 753, 2397) and Resources group (1586 steps/day, 95% CI (796, 2376). As with weight, the differences between interventions were not significant for these outcomes (p > 0.05 for both) [].
Engagement with SCT-based program tasks
Table 1 shows the Online and Resources groups had similar levels of compliance with recording goals and social support strategies, and monitoring weight, waist circumference and dietary intake. Approximately half of the men set weight, exercise and nutrition-related goals during the 3-month program, with more than half of these reporting having achieved these goals. Very few participants recorded social support strategies, with compliance decreasing from month one (44%) to month three (25%). The proportion of men who were compliant with monitoring their weight (63% vs. 50%, p = 0.31), waist circumference (56% vs. 43%, p = 0.27), pedometer steps (45% vs. 49%, p = 0.78) and dietary intake (63% vs. 50%, p = 0.31) was similar for the Online and Resources groups. However, the Online group were more compliant with monitoring their exercise participation than the Resources group (41% vs. 18%, p = 0.046).
As there were essentially no differences between intervention groups for program engagement, or outcomes achieved [], data were pooled for clarity. Table 2 shows that 51% of all weight loss goals set aimed for the recommended 0.5-1.0 kg weight loss per week, although 24% of goals aimed for >1 kg of weight loss per week. Approximately 60% of all exercise goals aimed to increase walking or reach a predetermined pedometer step target, while bike riding and strength training were also popular. The proportion of SMART exercise goals decreased significantly during the third month of the program, but on average 80% of all goals were SMART. Nutrition goals were recorded approximately half of the time. However, only 56% of these goals were SMART and decreased significantly throughout the program. The most popular nutrition goals related to reducing intake of ‘junk food’ (e.g. chips, pies, soft drink) and increasing intake of fruits and vegetables. Documenting rewards for goal achievement was low, with less than one-third of men recording goal achievement in any given month. Approximately half of rewards listed related to a night out for dinner or alcohol.
Table 3 illustrates that many men did not record strategies to engage their social support networks. Only 43% of men recorded at least one social support strategy during the first month of the program, which fell to only 21% during the third month. In addition, men did not appear to grasp the concept of social support, with 34% of the men naming themselves as their support person rather than their actual support network. Thus, only 34% of men recorded ‘quality’ social support strategies in the first month and only 11% during the third month. Overall, the most popular person men recorded in social support strategies was their partner or wife, which was expected as 86% of men in the study were either married or in a defacto relationship. The most popular type of lifestyle supports were physical activity-based such as walking, sports or attending the gymnasium. The most popular activities linked to wives/partners was walking, supporting their participation in the SHED-IT program and avoiding the purchase of ‘junk food’. In contrast, the most popular activities men reported they would undertake with their children or grandchildren were walking and bike riding. Friends were most commonly enlisted to participate in sports, attend the gymnasium and assist with reducing alcohol intake. For additional detail on the link between social support strategies and the person providing the support, see Additional file 1: Table S2.
Association between compliance to SCT-based tasks and study outcomes
Table 4 presents correlations between anthropometric, dietary and physical activity outcomes, and compliance with SHED-IT program SCT-based tasks. There were strong and consistent inverse correlations between program compliance and changes to body composition, whereby those who were more compliant with recording SCT-based tasks also demonstrated greater reductions in weight, waist circumference and body fat. Additionally, there was a positive correlation between compliance with monitoring dietary intake and physical activity, as well as with changes to weight, waist circumference, fat mass and dietary fat intake.
Table 5 presents results for the associations between weight loss and Support Book compliance by utilising a multiple linear regression model. Inter-correlations between the Support Book components ranged from r = 0.21 (food diary/rewards) to r = 0.68 (goals/social support) (Additional file 1: Table S3). The number of goals set (β-coefficient [95% CI] = -0.3 [-0.6, -0.1], p = 0.01) and the number of weight records documented (β-coefficient [95% CI] = -0.21 [-0.39, -0.02], p = 0.03) were independently associated with weight loss, whereby each additional goal set and weight measurement recorded was associated with an increased weight loss of 0.32 kg and 0.21 kg, respectively (R2 = 0.37, p <0.001). This equates to an additional 2.9 kg and 2.7 kg weight loss respectively, for those who set all their goals and monitored their weight weekly, compared to those who did not engage in these activities. Age, SES and intervention group were not significant predictors of weight change in this model (p > 0.05 for each).
Participant perceptions of the SHED-IT program
A total of 38 men from the Online group (88.4%) and 37 men from the Resources group (86.0%) completed the process evaluation questionnaire at 6-months (Table 6). Overall, participants were very satisfied with the SHED-IT program. Men found the DVD and other weight loss resources engaging and enjoyable, and agreed that the program had positive effects on those around them. Although both groups indicated that the program provided them with sufficient support for weight loss, the Online group reported significantly stronger agreement than the Resources group. Most men reported reading the Weight Loss Handbook for Blokes once (26%) or 2-3 times (57%), with 91% indicating that the length of the Handbook was appropriate. Most participants (93%) felt the 25-minute DVD was an appropriate length. Sixty-five percent of men reported watching the DVD once, while 34% watched it more than once.
In the Online group, the men reported that the CalorieKing™ website was useful for weight loss and was relatively easy to understand. This group also indicated that the feedback reports were helpful and assisted them in losing weight. Two-thirds of participants reported always reading their email feedback reports, while 11% read them some of the time, 14% half the time or most of the time and 6% reported to have never read them.
Most participants reported using at least five of the nine SHED-IT weight loss tips. Overall, the most commonly used weight loss tips were ‘read food labels’ (81% of participants), ‘reduce your portion sizes’ (81% of participants) and ‘reduce kJ dense snacks’ (73% of participants). Resources group compliers were more likely than non-compliers to use the tip ‘keep a healthy lifestyle diary’ (p = 0.02), while Online group compliers were more likely to use the tip ‘surf the urge’ (p = 0.01). For more information on the SHED-IT weight loss tip results, see Additional file 1: Table S4.
The overall aim of this paper was to conduct a comprehensive process evaluation of the previously established successful SHED-IT weight loss program for men. Our findings indicate that most men undertook SCT-based tasks including goal setting and monitoring of weight, physical activity and dietary intake. However, utilisation of social support networks and reward selection was poor. Of the SCT-based tasks, the most critical for success were goal setting and weekly weight monitoring, which were independently associated with weight loss. The Online and Resources versions of the SHED-IT program performed equally well, with no differences in weight loss, engagement in SCT-based tasks, or perception of program quality or program impact. The SHED-IT program was perceived to be supportive, enjoyable and beneficial.
A major finding of our study was the association found between various program tasks and behaviour change. While monitoring of all SCT-based tasks correlated with improved body composition, a multiple linear regression model demonstrated that goal setting and weekly monitoring of weight were the most important predictors of weight loss in this cohort of men. This model found that setting all nine goals equated to an additional weight loss of 2.9 kg and those who monitored their weight every week for the 3-month intervention had a corresponding additional weight loss of 2.7 kg compared with those who did not engage in these activities. This aligns with findings from a recent meta-regression of 122 physical activity and healthy eating behaviour change interventions, in which interventions with a self-monitoring component were significantly more effective than those without []. This finding also supports Bandura’s notion within SCT that self-regulatory behaviours are an essential component of successful behaviour change. According to Bandura (1997), self-regulatory behaviours rise to become the most important component of behaviour change when the behaviour of interest involves skills that people already know or can quickly learn (e.g. the motor skills required to perform physical activity) [].
Although goal setting was an important predictor of success, it is important to note that only half of the dietary and exercise goals the men recorded were considered ‘SMART’. This is important as research has shown that setting SMART goals increases the likelihood of goal attainment whereas non-specific goals reduce self-efficacy, which has a negative impact on subsequent goal setting []. Despite explicit instructions and multiple examples, this finding suggests that men still have difficulty understanding SMART goals and will require additional support in future programs. It is plausible that men who were more ready to lose weight prior to commencing the study were more compliant with program activities, which may have created a spurious association between compliance and weight loss. However, a recent systematic review of goal setting and behaviour change in adults supported our finding, by demonstrating that goal setting leads to changes in dietary and exercise behaviours []. Similarly, regular self-weighing enables self-evaluation of progress and further reinforces desired behaviours, thus contributing to weight loss []. In addition, a number of recent papers have demonstrated that self-regulation is the most powerful construct within SCT to explain and predict physical activity behaviour [-], dietary behaviour [,] and weight loss [] across a variety of populations. Therefore, the current research supports our observation, suggesting an important role for both regular self-weighing and goal setting in promoting weight loss in men.
While, in general, men completed the designated SCT-based tasks, most did not document rewards for achieving their goals. Furthermore, the proportion of men engaging in this activity reduced by half between the first and third month of the intervention. The reason for this lack of reward documentation during the SHED-IT program is unclear, but may be because the participants did not find the activity helpful for weight loss, chose to keep the rewards to themselves, lost motivation over time, or had an initial lack of ideas for good rewards. Alternatively, some men may have viewed weight loss as the reward without needing to motivate themselves with additional extrinsic rewards. Interestingly, when men did set rewards, the majority involved going out for dinner, drinking alcohol, or having a night out. This supports previous research demonstrating that men value weight loss programs that are not overly restrictive [], and that allow them to socialise and enjoy energy-dense luxuries on occasion [].
Overall, most men did not engage with the social support task in the Support Book. Less than 25% of men recorded strategies to engage social networks, and one-third of these were deemed to be poor quality because they recorded themselves as their support person rather than other people. Although the reason for the poor uptake of this activity is not known, it is possible that its importance was not sufficiently emphasised, that the activity was not well understood, or that the men’s previous exposure to this style of documentation or thinking was limited. In addition, sociological literature on men’s health shows that men prefer to engage in lifestyle programs that they can complete independently [], and thus the men may not have valued the idea of asking for help or support. Despite this, social support has been found to increase both intervention compliance and weight loss [,]. As such, identifying strategies that improve compliance with this activity may be warranted. It is also important to note that social support is not the only socio-structural factor outlined in Bandura’s SCT. However, targeting and operationalising this construct remains a difficult task as it represents a multitude of factors above and beyond social support networks []. These include ethnic group membership, education and intelligence, socio-economic status, the built environment and access to local facilities []. To improve study outcomes, future studies should explore novel ways to operationalise this construct above engaging social support networks alone.
Compliance or adherence to program tasks has been acknowledged as a major limitation of weight loss interventions, with the Internet as an engagement medium being identified as a particular risk. Indeed, attrition rates have been reported to exceed 40% for internet-based weight loss research []. Despite this, the current study had an attrition rate of only 20% for both intervention groups, which is similar to the average attrition rate of 21% for weight loss interventions in general. This suggests that, despite having no face-to-face contact, SHED-IT is as effective as other weight loss program formats in men. In addition, this is supported by our findings that overall weight loss, program engagement, perception of program quality, and program impact were similar for both the online self-monitoring and paper-based self-monitoring versions of SHED-IT.
A significant strength of the SHED-IT weight loss community program was its theoretical structure. Most weight loss interventions are not theory-driven, or use theory only as a loose framework, which is known to weaken the intervention effects []. As noted previously, the SHED-IT program was informed by Bandura’s SCT and was constructed to explicitly target the key behaviour change mediators specified in the theory. A systematic review of studies using the Internet as a medium for delivering health behaviour change programs demonstrated that, while only 20% of interventions used or mentioned theory as an intervention technique, a greater use of theory improved effect sizes, particularly those extensively incorporating theory into their program []. This review also demonstrated that goal setting, self-monitoring, social support and reward provision all have a significant, positive influence on behaviour change []. While all SCT-based tasks correlated with improved body composition in the current study, goal setting and weight monitoring were the strongest predictors of weight loss. Therefore, the combination of SCT-tasks used in this study improved weight outcomes in men.
Overall, men found the program to be beneficial and to provide sufficient support for their weight loss endeavours. Of particular interest, the men reported that the DVD was enjoyable to watch, improved their understanding of how to lose weight and approximately one-third of men watched the DVD more than once. These are important findings, given that the DVD was introduced to improve the scalability of the intervention by replacing the face-to-face information session of the pilot study []. Of note, both groups reported similar engagement with the program and both groups indicated that they would recommend SHED-IT to a friend, suggesting that the online self-monitoring and paper-based self-monitoring versions of SHED-IT were equally effective in engaging men. Interestingly, compliance with exercise monitoring was greater for the Online group compared to the Resources group. Although this may have been a chance finding due to the number of comparisons tested, it may also have been a function of task-difficulty. The online exercise diaries utilised established exercise databases and automatically calculated kilojoules burned during exercise, which eliminated the need to perform time-consuming calculations []. Therefore, the findings of the current process evaluation support the use of the Internet as an effective medium for weight loss intervention in men and suggest further examination is warranted.
A limitation of this study is some participants did not return their Support Book and the extent to which these were completed cannot be determined. However, the overall retention of participants in the trial was strong []. In addition, this study cannot confirm whether completion of the Support Book resulted in greater weight loss, because the Support Books were collected immediately prior to the assessment and not monitored throughout the intervention period. This could be investigated in future trials. This study contained several strengths including recruitment of a community sample of men, comprehensive tailoring of intervention materials to appeal to men and use of an extensively validated behaviour change theory. Aside from assessments, the SHED-IT programs involved no face-to-face contact and were considerably lower in intervention intensity than previous male-only weight loss studies []. The current analyses allowed for a comprehensive process evaluation, which provides valuable information to inform the development of novel obesity treatment strategies that engage men.
Currently, there is a dearth of research regarding how to engage men in weight loss programs and how to create effective programs that are tailored to their interests. Although we have previously established the efficacy [] and effectiveness [] of the SHED-IT program, this was the first study to determine which program components were most strongly associated with success. In addition to informing future refinements of the program, the current findings may help to encourage and inform other weight loss interventions for men, which are urgently required [,]. In summary, based on the findings of the current process evaluation, we make the following recommendations for the development of such interventions:
Face-to-face information sessions or tailored intervention components may not be required for men to feel sufficiently supported in weight loss programs. Despite being considerably lower in intensity than other programs, men felt that the Online and Resources-only modalities provided them with sufficient support to lose weight.
The quality of strategies (e.g. gender tailoring selection of behaviour change techniques,) and information in the resources may be more important for men than a particular treatment modality. Both the Online and Resources groups were equally satisfied with the program and would have recommended the program to their friends.
Goal setting and weekly weight tracking were found to be the key program components associated with success for men.
Men may require additional information, examples or strategies to be able to successfully set S.M.A.R.T. goals, particularly for dietary and physical activity behaviours.
Future studies should pay attention to men’s initial weight loss expectations, particularly in the context of setting goals. Initially, approximately 25% of men who set a weight-related goal were aiming to lose more than the recommended ½ to 1 kg per week and 33% of men did not achieve their first target.
Despite being key behaviour change strategies outlined in Bandura’s SCT [,], setting social support strategies and rewards for success were not associated with improved treatment outcomes for men. However, it is important to note that men experienced considerable conceptual confusion with the social support task, with approximately 50% of men listing themselves as their own social support.
For men, physical activity goals were predominantly related to accessible lifestyle activities such as walking/ increasing step counts. Future studies with men should include a strong focus on these activities, which do not require specialised knowledge or skills.
When trying to improve eating habits, the most common goal for men was to reduce junk food intake, particularly in the first month. Given the large proportion of men’s energy intake that comes from non-essential foods [], this is an important finding and these goals could be encouraged in future programs
Given the increasing prevalence of overweight and obesity in men and the lack of targeted weight loss interventions conducted in this population, the design and evaluation of effective and acceptable programs is imperative. There is a need for appealing and widely accessible programs for men and this process evaluation provides strong direction for the design of such trials. This study demonstrates that Bandura’s SCT provides a useful framework to design weight loss interventions for men, and future studies should include a strong focus on self-regulatory behaviours such as self-monitoring and goal setting to enhance behaviour changes and improve treatment effects. Further investigation into the value that men place on social support during weight loss is warranted, with most men in the current study not complying with this aspect of the program. Overall, SHED-IT provides an effective medium for delivering a weight loss program tailored to men’s preferences.
Body Mass Index
Randomised Controlled Trial
Social Cognitive Theory
Self-help, Exercise and Diet using Information Technology
Specific, measurable, attractive, realistic, time-targeted
Finucane MM, Stevens GA, Cowan MJ, Danaei G, Lin JK, Paciorek CJ, Singh GM, Gutierrez HR, Lu Y, Bahalim AN, Farzadfar F, Riley LM, Ezzati M: National, regional, and global trends in body-mass index since 1980: systematic analysis of health examination surveys and epidemiological studies with 960 country-years and 9.1 million participants. Lancet. 2011, 377 (9765): 557-567. 10.1016/S0140-6736(10)62037-5.
Obesity: preventing and managing the global epidemic. 2000, Report of a WHO Consultation, Geneva
Beuther DA, Sutherland ER: Overweight, obesity, and incident asthma: a meta-analysis of prospective epidemiologic studies. Am J Respir Crit Care Med. 2007, 175: 661-666. 10.1164/rccm.200611-1717OC.
Lemon SC, Rosal MC, Zapka J, Borg A, Andersen V: Contributions of weight perceptions to weight loss attempts: differences by body mass index and gender. Body Image. 2009, 6 (2): 90-96. 10.1016/j.bodyim.2008.11.004.
Pagoto SL, Schneider KL, Oleski JL, Luciani JM, Bodenlos JS, Whited MC: Male inclusion in randomized controlled trials of lifestyle weight loss interventions. Obesity. 2012, 20 (6): 1234-1239. 10.1038/oby.2011.140.
Sabinsky MS, Toft U, Raben A, Holm L: Overweight men’s motivations and perceived barriers towards weight loss. Eur J Clin Nutr. 2007, 61: 526-531.
Sherwood NE, Morton N, Jeffery RW, French SA, Neumark-Sztainer D, Falkner NH: Consumer preferences in format and type of community-based weight control programs. Am J Health Promot. 1998, 13: 12-18. 10.4278/0890-1171-13.1.12.
Wolfe BL, Smith JE: Different strokes for different folks: Why overweight Men Do Not seek weight loss treatment. Eat Disord. 2002, 10: 115-124. 10.1080/10640260290081687.
Young MD, Morgan PJ, Plotnikoff RC, Callister R, Collins CE: Effectiveness of male-only weight loss and weight loss maintenance interventions: a systematic review with meta-analysis. Obes Rev. 2012, 13 (5): 393-408. 10.1111/j.1467-789X.2011.00967.x.
Morgan PJ, Warren JM, Lubans DR, Collins CE, Callister R: Engaging men in weight loss: experiences of men who participated in the male only SHED-IT pilot study. Obes Res Clin Pract. 2011, 5 (3): e239-e248. 10.1016/j.orcp.2011.03.002.
Morgan PJ, Lubans DR, Collins CE, Warren JM, Callister R: 12-month outcomes and process evaluation of the SHED-IT RCT: an internet-based weight loss program targeting men. Obesity. 2011, 19 (1): 142-151. 10.1038/oby.2010.119.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J: Process evaluation in randomised controlled trials of complex interventions. Br Med J. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.
Morgan PJ, Lubans DR, Collins CE, Warren JM, Callister R: The SHED-IT randomized controlled trial: evaluation of an internet-based weight-loss program for men. Obesity. 2009, 17 (11): 2025-2032. 10.1038/oby.2009.85.
Collins CE, Morgan PJ, Warren JM, Lubans DR, Callister R: Men participating in a weight-loss intervention are able to implement key dietary messages, but not those relating to vegetables or alcohol: the self-help, exercise and diet using internet technology (SHED-IT) study. Public Health Nutr. 2011, 14 (1): 168-175. 10.1017/S1368980010001916.
Lubans DR, Morgan PJ, Collins CE, Warren JM, Callister R: Exploring the mechanisms of weight loss in the SHED-IT intervention for overweight men: a mediation analysis. Int J Behav Nutr Phys Act. 2009, 6 (76): 1-8.
Morgan PJ, Collins CE, Plotnikoff RC, McElduff P, Burrows T, Warren JM, Young MD, Berry N, Saunders KL, Aguiar EJ, Callister R: The SHED-IT community trial study protocol: a randomised controlled trial of weight loss programs for overweight and obese men. BMC Public Health. 2010, 10 (701): 1-11.
Morgan PJ, Callister R, Collins CE, Plotnikoff RC, Young MD, Berry N, McElduff P, Burrows T, Aguiar EJ: The SHED-IT community trial: a randomized controlled trial of internet- and paper-based weight loss programs tailored for overweight and obese men. Ann Behav Med. 2013, 45 (2): 139-152. 10.1007/s12160-012-9424-z.
Bandura A: Social foundations of thought and action: a social cognitive theory. 1986, Prentice-Hall, Englewood Cliffs, NJ
Bandura A: Self-efficacy: The exercise of control. 1997, W.H. Freeman, New York, NY
Waist circumference and waist-hip ratio: report of a WHO expert consultation. 2008, WHO, Geneva, Switzerland
Gibson AL, Holmes JC, Desautels RL, Edmonds LB, Nuudi L: Ability of new octapolar bioimpedance spectroscopy analyzers to predict 4-component-model percentage body fat in Hispanic, black, and white adults. Am J Clin Nutr. 2008, 87 (2): 332-338.
Socio-economic indexes for areas (SEIFA) Australia- 2006: postal areas, index of relative socio-economic advantage and disadvantage. 2008, Commonwealth of Australia, Canberra
Collins CE, Boggess MM, Watson JF, Guest M, Duncanson K, Pezdirc K, Rollo M, Hutchesson MJ, Burrows T: Reproducibility and comparative validity of a food frequency questionnaire for adults. Clin Nutr. ᅟ, ᅟ: ᅟ-In press; Accepted September, 2013
Baum CL, Ruhm CJ: Age, socioeconomic status and obesity growth. J Health Econ. 2009, 28: 635-648. 10.1016/j.jhealeco.2009.01.004.
Morgan PJ, Lubans DR, Callister R, Okely AD, Burrows TL, Fletcher R, Collins CE: The ‘healthy dads, healthy Kids’ randomized controlled trial: efficacy of a healthy lifestyle program for overweight fathers and their children. Int J Obes. 2011, 35 (3): 436-447. 10.1038/ijo.2010.151.
Morgan PJ, Collins CE, Plotnikoff RC, Callister R, Burrows T, Fletcher R, Okely AD, Young MD, Miller A, Lloyd AB, Cook AT, Cruickshank J, Saunders KL, Lubans DR: The ‘Healthy Dads, Healthy Kids’ community randomized controlled trial: A community-based healthy lifestyle program for fathers and their children. Preventive Medicine. 2014, 61: 90-99. 10.1016/j.ypmed.2013.12.019.
Michie S, Abraham C, Whittington C, McAteer J, Gupta S: Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009, 28 (6): 690-701. 10.1037/a0016136.
Pearson ES: Goal setting as a health behavior change strategy in overweight and obese adults: a systematic literature review examining intervention components. Patient Educ Couns. 2012, 87: 32-42. 10.1016/j.pec.2011.07.018.
Anderson ES, Wojcik JR, Winett RA, Williams DM: Social-cognitive determinants of physical activity: The influence of social support, self-efficacy, outcome expectations, and self-regulation among participants in a church-based health promotion study. Health Psychol. 2006, 25 (4): 510-520. 10.1037/0278-6220.127.116.110.
Anderson-Bill ES, Winett RA, Wojcik JR: Social cognitive determinants of nutrition and physical activity among Web-health users enrolling in an online intervention: the influence of social support, self-efficacy, outcome expectations, and self-regulation. J Med Internet Res. 2011, 13 (1): 19-19. 10.2196/jmir.1552.
Anderson-Bill ES, Winett RA, Wojcik JR, Williams DM: Aging and the social cognitive determinants of physical activity behavior and behavior change: evidence from the guide to health trial. J Aging Res. 2011, 2011: 1-11. 10.4061/2011/505928.
Ayotte BJ, Margrett JA, Hicks-Patrick J: Physical activity in middle-aged and young-old adults: the roles of self-efficacy, barriers, outcome expectancies, self-regulatory behaviors and social support. J Health Psychol. 2010, 15 (2): 173-185. 10.1177/1359105309342283.
Dlugonski D, Wojcicki TR, McAuley E, Motl R: Social cognitive correlates of physical activity in inactive adults with multiple sclerosis. Int J Rehabil Res. 2011, 34 (2): 115-120. 10.1097/MRR.0b013e328342ddc0.
Anderson ES, Winett RA, Wojcik JR: Self-regulation, self-efficacy, outcome expectations, and social support: social cognitive theory and nutrition behavior. Ann Behav Med. 2007, 34 (3): 304-312. 10.1007/BF02874555.
Anderson-Bill ES, Winett RA, Wojcik JR, Winett SG: Web-based guide to health: relationship of theoretical variables to change in physical activity, nutrition and weight at 16-months. J Med Internet Res. 2011, 13 (1): 28-28. 10.2196/jmir.1551.
Egger G: Intervening in men’s nutrition: lessons from the GutBuster men’s ‘waist loss’ program. Aust J Nutr Diet. 2000, 57 (1): 46-49.
Lewis S, Thomas SL, Hyde J, Castle DJ, Komesaroff PA: A qualitative investigation of obese men’s experiences with their weight. Am J Health Behav Jul. 2011, 35 (4): 458-469.
McConnon Á, Kirk SFL, Ransley JK: Process evaluation of an internet-based resource for weight control: Use and views of an obese sample. J Nutr Educ Behav. 2009, 41 (4): 261-267. 10.1016/j.jneb.2008.07.008.
Livhits M, Mercado C, Yermilov I, Parikh JA, Dutson E, Mehran A, Ko CY, Shekelle PG, Gibbons MM: Is social support associated with greater weight loss after bariatric surgery? A systematic review. Obes Rev. 2011, 12 (2): 142-148. 10.1111/j.1467-789X.2010.00720.x.
Bandura A: Health promotion by social cognitive means. Health Educ Behav Apr. 2004, 31 (2): 143-164. 10.1177/1090198104263660.
Luszczynska A, Schwarzer R: Social cognitive theory. Predicting health behavior. Edited by: Connor M, Norman P. 2005, McGraw Hill International, New York, NY
Neve M, Morgan PJ, Jones PR, Collins CE: Effectiveness of web-based interventions in achieving weight loss and weight loss maintenance in overweight and obese adults: a systematic review with meta-analysis. Obes Rev. 2010, 11 (4): 306-321. 10.1111/j.1467-789X.2009.00646.x.
Webb TL, Joseph J, Yardley L, Michie S: Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, Use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010, 12 (1): e4-10.2196/jmir.1376.
Burke LA, Wang J, Sevick MA: Self-monitoring in weight loss: a systematic review of the literature. J Am Diet Assoc. 2011, 111: 92-102. 10.1016/j.jada.2010.10.008.
Blomfield RL, Collins CE, Hutchesson MJ, Young MD, Callister R, Morgan PJ: Impact of self-help weight loss resources with or without online support on the dietary intake of overweight and obese men: the SHED-IT randomised controlled trial. Obes Res Clin Pract. in press
The SHED-IT RCT is funded by a National Heart Foundation Grant-in-Aid (2010-2011). We would like to thank the participating men, Elroy Aguiar, James Dower, Bryana Melnik, Dana Williams, Alyce Cook, Trish Robson, Bronwyn Berthon, Ashlee Lucas, Roberta Asher, Sarah Costigan, Peter Nelson, Alecia Greig, Christine Young, Charlotte Bull, Amanda Williams, Erin Paul, Lachlan Collins, John Chambers and Glenys Chambers. The authors thank Professor Graham Giles of the Cancer Epidemiology Centre of the Cancer Council Victoria for permission to use the Dietary Questionnaire for Epidemiological Studies (Version 2), Melbourne: The Cancer Council Victoria, 1996. RCP is funded by a Senior Research Fellowship from the National Health and Medical Research Council of Australia. CEC is funded by a Career Development Award from the National Health and Medical Research Council of Australia.
The authors declare that they have no competing interests.
PJM, RC, CEC, RCP were responsible for identifying the research questions, design of the study, obtaining ethics approval, the acquisition of funding and overseeing study implementation. MDY contributed to development of intervention materials, recruiting participants and study implementation. HAS completed the statistical analysis for the current study. All authors were responsible for the drafting of this manuscript and have read and approved the final version.