lunes, 11 de mayo de 2015

Evaluating Diabetes Mobile Applications for Health Literate Designs and Functionality, 2014

full-text ►

Evaluating Diabetes Mobile Applications for Health Literate Designs and Functionality, 2014

CDC. Centers for Disease Control and Prevention. CDC 24/7: Saving Lives. Protecting People.



Preventing Chronic Disease Logo



Evaluating Diabetes Mobile Applications for Health Literate Designs and Functionality, 2014



Charlene A. Caburnay, PhD, MPH; Kaitlin Graff; Jenine K. Harris, PhD, MPH; Amy McQueen, PhD; Madeleine Smith, MSW; Maggie Fairchild, MPH; Matthew W. Kreuter, PhD, MPH

Suggested citation for this article: Caburnay CA, Graff K, Harris JK, McQueen A, Smith M, Fairchild M, et al. Evaluating Diabetes Mobile Applications for Health Literate Designs and Functionality, 2014. Prev Chronic Dis 2015;12:140433. DOI: http://dx.doi.org/10.5888/pcd12.140433.
PEER REVIEWED

Abstract

Introduction
The expansion of mobile health technologies, particularly for diabetes-related applications (apps), grew exponentially in the past decade. This study sought to examine the extent to which current mobile apps for diabetes have health literate features recommended by participants in an Institute of Medicine Roundtable and compare the health literate features by app cost (free or not).
Methods
We used diabetes-related keywords to identify diabetes-related apps for iOS devices. A random sample of 110 apps (24% of total number of apps identified) was selected for coding. The coding scheme was adapted from the discussion paper produced by participants in the Institute of Medicine Roundtable.
Results
Most diabetes apps in this sample addressed diabetes management and therapeutics, and paid apps were more likely than free apps to use plain language strategies, to label links clearly, and to have at least 1 feature (a “back” button) that helps with the organization.
Conclusion
Paid apps were more likely than free apps to use strategies that should be more useful and engaging for people with low health literacy. Future work can investigate ways to make free diabetes mobile apps more user-friendly and accessible.
 Top

Introduction

The expansion of health care technologies, particularly mobile health technologies, grew exponentially in the past 10 years (1). Mobile health (or mHealth) is a subset of eHealth, defined as “the use of mobile computing and communication technologies in health care and public health” (2). The expansion of mHealth applications (apps) is also documented. A systematic review of mHealth research showed a surge in the number of scientific articles on this topic from 2005 through 2011 (1). More than half of the 352 studies involved testing of a mobile app, and most (86%) studies applied a quantitative methodology (1).
The rising availability of these mobile technologies corresponds with an increase in ownership of mobile telephones and tablets and the use of apps. National surveys in 2013 found that 34% of US adults owned a tablet and 91% owned a cellular telephone (1,3). Of cellular telephone owners, 55% had a smartphone (4) and 50% downloaded apps on their phone, an increase from 22% in 2009 (5). Although smartphone and tablet ownership has increased in nearly every major demographic group, ownership varies by income and age group (3,4). For example, younger adults, regardless of income, are likely to own a smartphone, whereas older adults who own a smartphone are more likely to be in upper income levels (4).
The review of mHealth apps (1) found that, in general, mHealth research focused predominantly on chronic conditions, and of these conditions, diabetes was the most frequent focus (1). A recent review of diabetes-specific apps available in 2013 for the iOS and Android operating systems (6) evaluated range of functions, target audiences, languages, cost, ratings, interfaces, and usability and found that apps had moderate to good usability among older (aged 50 or older) adults who had diabetes when the apps had a small range of functions. The review emphasized that simplicity of use and understandable terminology is especially important for maximum usability among older populations.
The most common types of diabetes apps identified were for health tracking or self-monitoring tasks such as recording blood glucose levels, insulin levels, and medication use (7–9). Other types of apps were insulin-dose calculators (7,8), physician-directed apps, food reference databases, social forums or blogs, and exercise apps (7). These diabetes apps did not demonstrate clinical effectiveness or integrate with health care delivery systems; other limitations included potential threats to safety and privacy, usability issues, and lack of personal feedback (7,9,10).
Although the surge in the development of diabetes apps and smartphone ownership continues, it is questionable how relevant and appropriate these types of health information technologies are for people with low health literacy — people who have a limited ability to obtain, process, and understand basic health information for making health decisions (11). In general, those with low health literacy are less likely to understand health information and know how to access and obtain prevention services (11–13), have worse glycemic control (14), and have higher rates of diabetes complications (14).
People with low health literacy are less likely to access and use health information technology (15) or be computer literate (16). Having eHealth literacy promotes self-efficacy for, and use of, health apps (17). Reviews of mobile apps (18) recommend certain design features to increase effort, efficiency, and satisfaction among low-literacy users, including the following: text-based interfaces (19); graphical cues, including bigger widgets (18,19); language support in text and audio (18); “back” and “home” buttons (19); linear navigation (navigation bar and scrollbars) and minimal hierarchical structures (18,19); and avoidance of nonnumeric text input and scrolling menus (18).
A 2013 Institute of Medicine (IOM) Roundtable on Health Literacy’s Collaborative on New Technologies yielded a discussion paper in which the authors summarize and suggest strategies for improving health literacy and usability in the development of health literate apps (20). These strategies are based on those developed by the US Department of Health and Human Services (21) and adapted for the development of mHealth apps. These strategies, along with actions (20), include the following:
  • learning about users — identifying users and what they are trying to do and engaging them in the design process;
  • writing actionable content — putting the most important information first, staying positive and realistic, providing action steps, and writing in plain language;
  • displaying content clearly — using short paragraphs, large font size, white space, and clear labels;
  • organizing and simplifying — using labels and providing easy access to home pages, linear information paths, and search and browse functionality;
  • engaging users — including printer-friendly tools, simplified controls and buttons, and interactive content; and
  • evaluating and revising the site — using experienced moderators to test the site with users of low literacy and low health literacy.
These recommendations were developed for the creation of apps, but they have not yet been used to evaluate existing diabetes-related mHealth apps. The objective of this study was to evaluate diabetes-related mHealth apps according to the recommendations of the IOM Roundtable discussion paper (20). Additionally, because the cost of an app may lead a user to select a free app instead of an app that has even a minimal cost, we compared the health literate features of diabetes apps by app cost (free or not).
 Top

Methods

Sample

The keywords “diabetes,” “diabetic,” “type 1 diabetes,” and “type 2 diabetes” were entered into the search field of the Apple App Store in April 2014 to identify English-language diabetes-related apps for iOS devices (iPad and iPhone). Our search yielded 460 apps that contained keywords in the app name, description, or reviews. We randomly selected 110 (24%) apps (Appendix).

Coding

Coders first downloaded each app to an iPad and familiarized themselves with the app’s features. Next, coders entered information for each app into an electronic database. Apps were coded for general characteristics listed in the App Store. Then, coders recorded diabetes-related content and recommendations for designing health literate mobile apps as published in the IOM discussion paper (20). Trained research assistants first conducted the coding in teams while training and then coded individually. Intercoder reliability was calculated on the basis of a 10% sample and indicated substantial agreement (22): κ = 0.77 (95% confidence interval, 0.71–0.83). Each of 4 coders analyzed approximately 30 apps.

General characteristics

The Apple App Store provided the following data for each app: title, price, age rating, category, the total number of ratings provided by app users, and the number of stars (star rating), which ranged from 1 star to 5 stars (with 5 being the highest rating). The age rating was classified as 4 years or older (no objectionable material); 12 years or older (mild language, frequent/intense/realistic violence, and mild or infrequent mature or suggestive content not suitable for those <12 y); or 17 years or older (must be 17 years old to purchase, may contain frequent and intense offensive language, violence, or mature themes not suitable for those <17 y). The app category included health and fitness, medical, food and drink, education, lifestyle, social networking, business, reference, and utilities.

Public health variables

The research team developed categories for 3 public health variables and 4 health literate design strategies. For each variable, coders could select multiple categories (ie, categories were not mutually exclusive). The public health variables coded were type of diabetes, diabetes continuum, and app focus. The type of diabetes was mentioned in the app description or on the app itself and was categorized as type 1 diabetes, type 2 diabetes, prediabetes, gestational diabetes, “not specified,” or “other.” “Diabetes continuum” refers to the stage of diabetes-related behavior targeted by the app. We developed the following categories for state of behavior: prevention (eg, healthy eating, exercising); screening, diagnosis, or symptoms of diabetes (eg, getting a blood glucose check for a diagnosis of diabetes or symptoms of diabetes); management or therapeutics (eg, checking blood glucose regularly, eating healthy and exercising, preventing complications); or none (ie, no diabetes behaviors mentioned). “App focus” refers to the diabetes-related focus of the app, including primary prevention (eg, health promotion activities such as eating fruits and vegetables and regular exercise); screening (eg, blood glucose check to screen for diabetes); symptoms or diagnosis (eg, confirming diagnosis of diabetes through a blood glucose test, identifying diabetes by signs or symptoms); management or therapeutics (eg, insulin therapy for the regulation of blood glucose, lifestyle changes); complications (eg, the biological consequences of untreated diabetes, risk factors for complications); and research, science, and technology (eg, technology developed to manage or prevent diabetes).
The health literate design strategies (20) assessed by coders were 1) writing in plain language (eg, using common, everyday words; using personal pronouns such as “you”; avoiding undefined technical or medical terms; using active voice, action words, and present tense; keeping sentences short); 2) displaying content clearly (eg, limiting paragraph size by using bullets and short lists, labeling links for images and descriptions, using images that facilitate learning, using bold colors with contrast, avoiding dark backgrounds); 3) organizing and simplifying the app (eg, easy access to a homepage or menu page; a “back” button; the ability to search and browse; integration with email, calendar, and maps); and 4) engaging users (eg, printer-friendly tools and resources; interactive content; audio and visual features; connections to new media such as Twitter or text messaging).
We used SPSS v.20 (IBM Corporation) to calculate descriptive statistics and t tests to identify associations between app characteristics and price (free vs not free). Significance was determined at a level of α = .05 for 2-tailed tests.
 Top

Results

Of the 110 apps, 76 (69%) were free (Table). General characteristics were not significantly different according to whether the app was free or not. The 34 apps that were not free ranged in price from $0.99 to $29.99, with a mean price of $4.57 (interquartile range, $1.99–$5.99). User ratings were provided for 65 apps; the average number of ratings per app was 148, and the average star rating was 3.4. Most apps (78.2%) were rated for ages 4 years or older, and the categories in which the apps were placed most often were health and fitness (43.6%) and medical (43.6%).
None of the public health variables were significantly different according to whether the app was free or not. Most (87.3%) apps did not specify diabetes type. Only 5 apps specified type 1 diabetes, and only 5 apps specified type 2 diabetes. Across the diabetes continuum, most (73.7%) apps addressed behaviors related to diabetes management or therapeutics, and a third (33.3%) addressed prevention. Other apps addressed diabetes screening, diagnosis, or symptoms (10.5%), and 12.3% did not address any stage on the continuum. Consistent with our findings on continuum, 66.4% of apps focused on management or therapeutics, and 30.9% focused on primary prevention.
Using plain language. Across all plain language strategies combined, 84% of apps used at least 1 strategy, and this finding did not differ by whether the app was free or not. However, we found significant differences between the 2 types of apps according to several strategies. Paid diabetes apps were significantly more likely to use common, everyday words (91.2%, paid vs 75.0%, free; P = .05); avoid undefined technical or medical terms (85.3% vs 65.8%; P = .04); and use active voice (88.2% vs 68.4%; P = .03), action words (88.2% vs 69.7%; P = .04), and present tense (94.1% vs 75.0%;P = .02).
Displaying content clearly. Paid apps were more likely than free apps to label links clearly (100.0% vs 89.5%, P = .05). Of both kinds of apps, most (80.9%) used bold colors with contrast but only 30.9% used images that facilitated learning; we found no differences between free and paid apps for these strategies.
Organizing and simplifying. Most (83.6%) apps provided easy access to a homepage or menu page; 85.3% of paid apps had a homepage, whereas 68.0% of free apps had one (P = .06); 70.6% of paid apps had easy access to a menu page, whereas 52.0% of free apps had one (P = .07). Paid apps were significantly more likely to include a “back” button (97.1% vs 75.0%, P = .006). No other differences between free and paid apps were found for other organizing strategies. Less than half (44%) of all apps were integrated with other applications (email, calendar, or maps).
Engaging users. Most (70.0%) apps had interactive content that users could tailor, but otherwise, less than 17% of apps had other engaging features such as printer-friendly tools, audio and visual features, or integration with new media such as Twitter or texting.
 Top

Discussion

In this study, a sample of diabetes-related apps was coded for public health characteristics and health literate design strategies for mHealth apps. These apps were rated highly by users, and most were classified as appropriate for children and adults. Consistent with other studies of health apps and diabetes apps, most of the diabetes apps in this sample addressed diabetes management and therapeutics (7–9). Paid apps were more likely than free apps to use health literate design strategies such as using plain language, labeling links clearly, and having a “back” button to help with organization.
One explanation for these differences is that with paid apps, perhaps more effort was undertaken to conduct formative research and usability testing before product launch. Those activities may have identified functions in the app for which the user experience could be improved to increase understanding and ease of use.
Because low health literacy is more likely among people of low socioeconomic status (23), the cost of apps may be prohibitive for people with low health literacy. If these people are more likely to use free diabetes apps, then they are more likely to have apps that lack features that enhance usability and understanding. Further research can identify diabetes app characteristics, including functionality, cost, and ratings, that may influence potential users to pay for an app instead of downloading one for free. Because user ratings of free apps and paid apps did not differ significantly, it would also be helpful to conduct usability tests to directly compare levels of satisfaction for free and paid apps. Also, by understanding which types of diabetes apps people with low literacy would choose to use regardless of cost, we could identify where and how resources for improving the health literacy of mobile diabetes apps would be best used.
Our study has several limitations. Although we used Health Literacy Online (21) as a tool to rate existing apps, its original purpose was to help guide the design of health websites, including strategies for testing usability. Not all Health Literacy Online strategies and actions, such as those requiring knowledge of the app developers’ target users and usability processes, were included in the codebook for our study because of a lack of information. Because the information coded in our study could be ascertained only by viewing the app description and ratings information and using the downloaded app, we did not have enough background information to know the history of each app’s development or what, if any, usability testing was done before its launch. Health Literacy Online is one of several tools that can help guide the creation of health literate mHealth applications or to assess the health literacy of health information materials, including those that are digitally based (eg, mobile apps, websites, computer applications) (24,25). Using this tool for existing apps may not be as appropriate or useful for usability outcomes, but it is a starting point to help evaluate the health literacy of diabetes apps.
Another limitation of this study is the generalizability of the sample of diabetes apps selected. The use of a simple random sampling strategy yielded 4 of the top 10 most popular diabetes apps in the App Store (as of February 2015). In addition, the search terms included only diabetes-related terms, because we were interested only in apps that self-identified as diabetes-related through the app name or description. Other search terms such as “glucose” or “blood sugar” were not used. However, an additional search using the terms “glucose” or “blood sugar” yielded 294 apps, 176 of which also appeared on the list of diabetes-related apps.
Finally, the sample of apps examined included only iOS apps and did not include any Android-compatible apps. Because African American cellular telephone owners are more likely than whites or Latinos to own an Android telephone instead of an iPhone (42%, African Americans; 26%, whites; 27%, Latinos) (4), this may limit the study’s applicability to more diverse audiences.
In general, the findings of this study indicate that additional work should be done to improve mHealth apps. In particular, encouraging a development process for free diabetes-related apps to make them more user-friendly and accessible to diverse audiences could potentially increase their use and understandability among audiences, especially people with low health literacy.
 Top

Acknowledgments

This article was made possible by grant no. 1P30DK092950 from the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIDDK. We acknowledge the support of the Washington University Institute for Public Health for cosponsoring, with the Washington University Center for Diabetes Translation Research, the Next Steps in Public Health event that led to the development of this article. The authors thank Samantha Rockler and Christine Mbukwe for their assistance on this study.
 Top

Author Information

Corresponding Author: Charlene A. Caburnay, PhD, MPH, Health Communication Research Laboratory, George Warren Brown School of Social Work, and Washington University Center for Diabetes Translation Research, Washington University in St Louis, 700 Rosedale Ave, Campus Box 1009, St Louis, MO 63112-1408. Telephone: 314-935-3703. Email: ccaburnay@wustl.edu.
Affiliations: Kaitlin Graff, Amy McQueen, Madeleine Smith, Maggie Fairchild, Health Communication Research Laboratory, George Warren Brown School of Social Work, Washington University in St. Louis; Jenine K. Harris, George Warren Brown School of Social Work, and Washington University Center for Diabetes Translation Research, Washington University in St Louis; Matthew W. Kreuter, Health Communication Research Laboratory, George Warren Brown School of Social Work, and Washington University Center for Diabetes Translation Research, Washington University in St Louis, St Louis, Missouri.
 Top

References

  1. Fiordelli M, Diviani N, Schulz PJ. Mapping mHealth research: a decade of evolution. J Med Internet Res 2013;15(5):e95. CrossRef PubMed
  2. Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, et al. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med 2013;10(1):e1001363. CrossRef PubMed
  3. Zickuhr K. Pew Research Internet Project: tablet ownership 2013. http://www.pewinternet.org/2013/06/10/tablet-ownership-2013/. Accessed September 10, 2014.
  4. Smith A. Pew Research Internet Project: smartphone ownership 2013. http://www.pewinternet.org/2013/06/05/smartphone-ownership-2013/ Accessed September 10, 2014.
  5. Duggan M. Pew Research Internet Project: cell phone activities 2013. http://www.pewinternet.org/2013/09/19/cell-phone-activities-2013/. Accessed September 10, 2014.
  6. Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res 2014;16(4):e104. CrossRef PubMed
  7. Eng DS, Lee JM. The promise and peril of mobile health applications for diabetes and endocrinology. Pediatr Diabetes 2013;14(4):231–8. CrossRef PubMed
  8. Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for Android smartphones. J Telemed Telecare 2012;18(4):235–8. CrossRefPubMed
  9. El-Gayar O, Timsina P, Nawar N, Eid W. A systematic review of IT for diabetes self-management: are we there yet? Int J Med Inform 2013;82(8):637–52. CrossRef PubMed
  10. Holtz B, Lauckner C. Diabetes management via mobile phones: a systematic review. Telemed J E Health 2012;18(3):175–84. CrossRef PubMed
  11. Institute of Medicine. Health literacy: a prescription to end confusion. Washington (DC): Institute of Medicine, 2004.
  12. Davis TC, Arnold C, Berkel HJ, Nandy I, Jackson RH, Glass J. Knowledge and attitude on screening mammography among low-literate, low-income women. Cancer 1996;78(9):1912–20.CrossRef PubMed
  13. Lindau ST, Tomori C, Lyons T, Langseth L, Bennett CL, Garcia P. The association of health literacy with cervical cancer prevention knowledge and health behaviors in a multiethnic cohort of women. Am J Obstet Gynecol 2002;186(5):938–43. CrossRef PubMed
  14. Schillinger D, Grumbach K, Piette J, Wang F, Osmond D, Daher C, et al. Association of health literacy with diabetes outcomes. JAMA 2002;288(4):475–82. CrossRef PubMed
  15. Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system — results from the diabetes study of northern California (DISTANCE). J Health Commun 2010;15( Suppl 2):183–96. CrossRef PubMed
  16. Mayberry LS, Kripalani S, Rothman RL, Osborn CY. Bridging the digital divide in diabetes: family support and implications for health literacy. Diabetes Technol Ther 2011;13(10):1005–12.CrossRef PubMed
  17. Cho J, Park D, Lee HE. Cognitive factors of using health apps: systematic analysis of relationships among health consciousness, health information orientation, eHealth literacy, and health app use efficacy. J Med Internet Res 2014;16(5):e125. CrossRef PubMed
  18. Chaudry B, Connelly K, Siek K, Welch J. Mobile interface design for low-literacy populations. Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium; 2012 Jan 28–30; Miami, Florida.
  19. Medhi I, Patnaik S, Brunskill E, Gautama SN, Thies W, Toyama K. Designing mobile interfaces for novice and low-literacy users. ACM Trans Comput Hum Interact 2011;18(1):2. CrossRef
  20. Broderick J, Devine T, Langhans E, Lemerise A, Lier S, Harris L. Designing health literate mobile apps: discussion paper. Washington (DC): Institute of Medicine; 2014. http://www.iom.edu/Global/Perspectives/2014/HealthLiterateApps.aspx.
  21. Office of Disease Prevention and Public Health Promotion. Health literacy online: a guide to writing and designing easy-to-use health web sites. Washington (DC): US Department of Health and Human Services, 2010.
  22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33(1):159–74. CrossRef PubMed
  23. About health literacy. Rockville (MD): Health Resources and Services Administration. http://www.hrsa.gov/publichealth/healthliteracy/healthlitabout.html. Accessed September 17, 2014.
  24. Kaphingst KA, Kreuter MW, Casey C, Leme L, Thompson T, Cheng MR, et al. Health Literacy INDEX: development, reliability, and validity of a new tool for evaluating the health literacy demands of health information materials. J Health Commun 2012;17(Suppl 3):203–21. CrossRef PubMed
  25. Lefebvre RC, Tada Y, Hilfiker SW, Baur C The assessment of user engagement with eHealth content: the eHealth Engagement Scale 1. J Comput Mediat Commun 2010;15(4):666–81.CrossRef

No hay comentarios: