Limits...
Can examination of WWW usage statistics and other indirect quality indicators distinguish the relative quality of medical web sites?

Hernández-Borges AA, Macías-Cervi P, Gaspar-Guardado MA, Torres-Alvarez de Arcaya ML, Ruiz-Rabaza A, Jiménez-Sosa A - J. Med. Internet Res. (1999 Jul-Sep)

Bottom Line: The websites updating frequency also significantly correlated with the RESULTS of the websites evaluation by HealthAtoZ, both about their contents (p=.001) and their total values (p<.05).The number of daily visits significantly correlated (p<.05) with the Results of the evaluations by Medical Matrix.On the other hand, the citation analysis on the Web by the quantification of inbound links to medical websites could be an objective and feasible tool in rating great amounts of websites.

View Article: PubMed Central - HTML - PubMed

Affiliation: Pediatric Intensive Care Unit, Hospital Universitario de Canarias, 38005 Santa Cruz de Tenerife, Canary Islands, Spain. borges@redkbs.com

ABSTRACT

Background: The Internet offers a great amount of health related websites, but concern has been raised about their reliability. Several subjective evaluation criteria and websites rating systems have been proposed as a help for the Internet users to distinguish among web resources with different quality, but their efficacy has not been proven.

Objectives: To evaluate the agreement of a subset of Internet rating systems editorial boards regarding their evaluations of a sample of pediatric websites. To evaluate certain websites characteristics as possible quality indicators for pediatric websites.

Methods: Comparative survey of the Results of systematic evaluations of the contents and formal aspects of a sample of pediatric websites, with the number of daily visits to those websites, the time since their last update, the impact factor of their authors or editors, and the number of websites linked to them.

Results: 363 websites were compiled from eight rating systems. Only 25 were indexed and evaluated by at least two rating systems. This subset included more updated and more linked websites. There was no correlation among the Results of the evaluation of these 25 websites by the rating systems. The number of inbound links to the websites significantly correlated with their updating frequency (p<.001), with the number of daily visits (p=.005), and with the Results of their evaluation by the largest rating system, HealthAtoZ (p<.001). The websites updating frequency also significantly correlated with the RESULTS of the websites evaluation by HealthAtoZ, both about their contents (p=.001) and their total values (p<.05). The number of daily visits significantly correlated (p<.05) with the Results of the evaluations by Medical Matrix.

Conclusions: Some websites characteristics as the number of daily visits, their updating frequency and, overall, the number of websites linked to them, correlate with their evaluation by some of the largest rating systems on the Internet, what means that certain indexes obtained from the usage analysis of pediatric websites could be used as quality indicators. On the other hand, the citation analysis on the Web by the quantification of inbound links to medical websites could be an objective and feasible tool in rating great amounts of websites.

Show MeSH
Number of inbound links to websites for the total of the sample, n=363, and for the websites evaluated at least by two rating systems, n=25 (median, 25th and 75th percentiles)
© Copyright Policy
Related In: Results  -  Collection


getmorefigures.php?uid=PMC1761705&req=5

figure2: Number of inbound links to websites for the total of the sample, n=363, and for the websites evaluated at least by two rating systems, n=25 (median, 25th and 75th percentiles)

Mentions: Only 25 websites of the sample were indexed and evaluated at least by two rating systems, and none by the eight. This subset of websites showed significantly better results of the evaluation of their contents and design by HealthAtoZ, and higher grade of updating (Figure 1) and higher number of inbound links (Figure 2). When the evaluations of these 25 websites by the different rating systems were compared, no significant correlations were found. Changes regarding the average impact factor of the authors of the websites or the number of daily visits could not be demonstrated in this subset of websites.


Can examination of WWW usage statistics and other indirect quality indicators distinguish the relative quality of medical web sites?

Hernández-Borges AA, Macías-Cervi P, Gaspar-Guardado MA, Torres-Alvarez de Arcaya ML, Ruiz-Rabaza A, Jiménez-Sosa A - J. Med. Internet Res. (1999 Jul-Sep)

Number of inbound links to websites for the total of the sample, n=363, and for the websites evaluated at least by two rating systems, n=25 (median, 25th and 75th percentiles)
© Copyright Policy
Related In: Results  -  Collection

Show All Figures
getmorefigures.php?uid=PMC1761705&req=5

figure2: Number of inbound links to websites for the total of the sample, n=363, and for the websites evaluated at least by two rating systems, n=25 (median, 25th and 75th percentiles)
Mentions: Only 25 websites of the sample were indexed and evaluated at least by two rating systems, and none by the eight. This subset of websites showed significantly better results of the evaluation of their contents and design by HealthAtoZ, and higher grade of updating (Figure 1) and higher number of inbound links (Figure 2). When the evaluations of these 25 websites by the different rating systems were compared, no significant correlations were found. Changes regarding the average impact factor of the authors of the websites or the number of daily visits could not be demonstrated in this subset of websites.

Bottom Line: The websites updating frequency also significantly correlated with the RESULTS of the websites evaluation by HealthAtoZ, both about their contents (p=.001) and their total values (p<.05).The number of daily visits significantly correlated (p<.05) with the Results of the evaluations by Medical Matrix.On the other hand, the citation analysis on the Web by the quantification of inbound links to medical websites could be an objective and feasible tool in rating great amounts of websites.

View Article: PubMed Central - HTML - PubMed

Affiliation: Pediatric Intensive Care Unit, Hospital Universitario de Canarias, 38005 Santa Cruz de Tenerife, Canary Islands, Spain. borges@redkbs.com

ABSTRACT

Background: The Internet offers a great amount of health related websites, but concern has been raised about their reliability. Several subjective evaluation criteria and websites rating systems have been proposed as a help for the Internet users to distinguish among web resources with different quality, but their efficacy has not been proven.

Objectives: To evaluate the agreement of a subset of Internet rating systems editorial boards regarding their evaluations of a sample of pediatric websites. To evaluate certain websites characteristics as possible quality indicators for pediatric websites.

Methods: Comparative survey of the Results of systematic evaluations of the contents and formal aspects of a sample of pediatric websites, with the number of daily visits to those websites, the time since their last update, the impact factor of their authors or editors, and the number of websites linked to them.

Results: 363 websites were compiled from eight rating systems. Only 25 were indexed and evaluated by at least two rating systems. This subset included more updated and more linked websites. There was no correlation among the Results of the evaluation of these 25 websites by the rating systems. The number of inbound links to the websites significantly correlated with their updating frequency (p<.001), with the number of daily visits (p=.005), and with the Results of their evaluation by the largest rating system, HealthAtoZ (p<.001). The websites updating frequency also significantly correlated with the RESULTS of the websites evaluation by HealthAtoZ, both about their contents (p=.001) and their total values (p<.05). The number of daily visits significantly correlated (p<.05) with the Results of the evaluations by Medical Matrix.

Conclusions: Some websites characteristics as the number of daily visits, their updating frequency and, overall, the number of websites linked to them, correlate with their evaluation by some of the largest rating systems on the Internet, what means that certain indexes obtained from the usage analysis of pediatric websites could be used as quality indicators. On the other hand, the citation analysis on the Web by the quantification of inbound links to medical websites could be an objective and feasible tool in rating great amounts of websites.

Show MeSH