A principled way of assessing visualization literacy

IEEE Transactions on Visualization and Computer Graphics

Volumn 20, Issue 12, 2014, Pages 1963-1972

  Boy, Jeremy ^a   Rensink, Ronald A ^b   Bertini, Enrico ^c   Fekete, Jean Daniel ^d  

^a TELECOM PARISTECH   (France)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c POLYTECHNIC UNIVERSITY   (United States)

^d INRIA   (France)

Author keywords

Item response theory; Literacy; Rasch model; Visualization literacy

Indexed keywords

GRAPH THEORY; SOCIAL NETWORKING (ONLINE);

BAR CHART; DESIGN AND EVALUATIONS; ITEM RESPONSE THEORY; LINE GRAPH; LITERACY; RASCH MODELING; SCATTER PLOTS;

VISUALIZATION;

COMPREHENSION; COMPUTER GRAPHICS; HUMAN; PSYCHOLOGIC TEST; READING; TASK PERFORMANCE;

COMPREHENSION; COMPUTER GRAPHICS; HUMANS; LITERACY; PSYCHOLOGICAL TESTS; READING; TASK PERFORMANCE AND ANALYSIS;

EID: 84910012960     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2014.2346984     Document Type: Article

References (52)

1. https://github.com/INRIA/Visualization-Literacy-101.
2. D. Abilock. Visual information literacy: Reading a documentary photograph. Knowledge Quest, 36(3), January-February 2008.
3. J. Baer, M. Kutner, and J. Sabatini. Basic reading skills and the literacy of the america's least literate adults: Results from the 2003 national assessment of adult literacy (naal) supplemental studies. Technical report, National Center for Education Statistics (NCES), February 2009.
4. J. Bertin and M. Barbut. Semiologie Graphique. Mouton, 1973.
5. P. BOBKO and R. KARREN. The perception of pearson product moment correlations from bivariate scatterplots. Personnel Psychology, 32(2):313-325, 1979.
6. M. T. Brannick. Item response theory. http://luna.cas.usf.edu/~mbrannic/files/pmet/irt.htm.
7. V. J. Bristor and S. V. Drake. Linking the language arts and content areas through visual technology. T.H.E. Journal, 22(2):74-77, 1994.
8. P. Carpenter and P. Shah. A model of the perceptual and conceptual processes in graph comprehension. Journal of Experimental Psychology: Applied, 4(2):75-100, 1998.
9. W. S. Cleveland, P. Diaconis, and R. McGill. Variables on scatterplots look more highly correlated when the scales are increased. Science, 216(4550):1138-1141, 1982.
10. Cognitive testing interview guide. http://www.cdc.gov/nchs/data/washington-group/meeting5/WG5-Appendix4.pdf.
11. M. Correll, D. Albers, S. Franconeri, and M. Gleicher. Comparing averages in time series data. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, pages 1095-1104. ACM, 2012.
12. F. R. Curcio. Comprehension of mathematical relationships expressed in graphs. Journal for research in mathematics education, pages 382-393, 1987.
13. Department for Education. Numeracy skills tests: Bar charts. http://www.education.gov.uk/schools/careers/traininganddevelopment/professional/b00211213/numeracy/areas/barcharts, 2012.
14. R. C. Fraley, N. G. Waller, and K. A. Brennan. An item response theory analysis of self-report measures of adult attachment. Journal of personality and social psychology, 78(2):350, 2000.
15. E. Freedman and P. Shah. Toward a model of knowledge-based graph comprehension. In M. Hegarty, B. Meyer, and N. Narayanan, editors, Diagrammatic Representation and Inference, volume 2317 of Lecture Notes in Computer Science, pages 18-30. Springer Berlin Heidelberg, 2002.
16. S. N. Friel, F. R. Curcio, and G. W. Bright. Making sense of graphs: Critical factors influencing comprehension and instructional implications. Journal for Research in mathematics Education, 32(2):124-158, 2001.
17. A. C. Graesser, S. S. Swamer, W. B. Baggett, and M. A. Sell. New models of deep comprehension. Models of understanding text, pages 1-32, 1996.
18. Graph design i.q. test. http://perceptualedge.com/files/GraphDesignIQ.html.
19. J. Heer and M. Bostock. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, pages 203-212, New York, NY, USA, 2010. ACM.
20. How to read a bar chart. http://www.quizrevolution.com/act101820/mini/go/.
21. P. Isenberg, A. Bezerianos, P. Dragicevic, and J. Fekete. A study on dualscale data charts. Visualization and Computer Graphics, IEEE Transactions on, 17(12):2469-2478, Dec 2011.
22. Join, ACRL and Council, Chapters. Presidential committee on information literacy: Final report. Online publication, 1989.
23. I. Kirsch. The international adult literacy survey (ials): Understanding what was measured. Technical report, Educational Testing Service, December 2001.
24. N. Knutson, K. S. Akers, and K. D. Bradley. Applying the Rasch model to measure first-year students perceptions of college academic readiness. In Paper presented at the annual meeting of the MWERA Annual Meeting, 2010.
25. R. Lowe. "Reading" scientific diagrams: Characterising components of skilled performance. Research in Science Education, 18(1):112-122, 1988.
26. R. Lowe. Scientific Diagrams: How Well Can Students Read Them? [microform]: What Research Says to the Science and Mathematics Teacher. Number 3 / Richard K. Lowe. Distributed by ERIC Clearinghouse [Washington, D.C.], 1989.
27. J. Meyer, M. Taieb, and I. Flascher. Correlation estimates as perceptual judgments. Journal of Experimental Psychology: Applied, 3(1):3, 1997.
28. E. Miller. The Miller word-identification assessment. http://www.donpotter.net/pdf/mwia.pdf, 1991.
29. National Cancer Institute. Item response theory modeling. http://appliedresearch.cancer.gov/areas/cognitive/item.html.
30. National Center for Education Statistics. Adult literacy and lifeskills survey. http://nces.ed.gov/surveys/all/.
31. Numerical reasoning - table/graph. http://www.jobtestprep.co.uk/jobtestprep/testPlayer.aspx?localeSetting=en-GB&sLanguage=en-GB&&test-id=free-num-advanced&isSequence=0&testIndex=0&mode=timed&skinID=9&template=FreeTestTemplate&endURL=signout.aspx%3fReturnURL%3d..%2fnumerical-reasoning-test&endURLName=Back+to+JobTestPrep&cancelURLName=Exit+Test&cancelURL=signout.aspx%3fReturnURL%3d..%2fnumerical-reasoning-test&testTitle=Numerical+Reasoning+-+Table%2fGraph&layoutype=1&adPageID=&itemCode=FreeNum-GMAT.
32. Numerical reasoning online. http://numericalreasoningtest.org/.
33. J. Oberholtzer. Why two charts make me feel like an expert on Portugal. http://tiny.cc/ujgjdx, 2012.
34. OECD. Pisa 2012 assessment and analytical framework. Technical report, OECD, 2012.
35. OTA. Computerized Manufacturing Automation: Employment, Education, and the Workplace. United States Office of technology Assessment, 1984.
36. S. Pinker. A theory of graph comprehension, pages 73-126. Lawrence Erlbaum Associates, Hillsdale, NJ, 1990.
37. I. Pollack. Identification of visual correlational scatterplots. Journal of experimental psychology, 59(6):351, 1960.
38. R. Ratwani and J. Gregory Trafton. Shedding light on the graph schema: Perceptual features versus invariant structure. Psychonomic Bulletin and Review, 15(4):757-762, 2008.
39. R. A. Rensink and G. Baldridge. The perception of correlation in scatterplots. Comput. Graph. Forum, 29(3):1203-1210, 2010.
40. D. Rizopoulos. ltm: An R package for latent variable modeling and Item Response Analysis. Journal of Statistical Software, 17(5):1-25, 11 2006.
41. RUMMLaboratory. Rasch analysis. http://www.rasch-analysis.com/rasch-models.htm.
42. P. Shah. A model of the cognitive and perceptual processes in graphical display comprehension. Reasoning with diagrammatic representations, pages 94-101, 1997.
43. G. Sir Crowther. The Crowther Report, volume 1. Her Majesty's Stationery Office, 1959.
44. C. Taylor. New kinds of literacy, and the world of visual information. Literacy, 2003.
45. J. G. Trafton, S. P. Marshall, F. Mintz, and S. B. Trickett. Extracting explicit and implicit information from complex visualizations. Diagrams, pages 206-220, 2002.
46. S. Trickett and J. Trafton. Toward a comprehensive model of graph comprehension: Making the case for spatial cognition. In D. Barker-Plummer, R. Cox, and N. Swoboda, editors, Diagrammatic Representation and Inference, volume 4045 of Lecture Notes in Computer Science, pages 286-300. Springer Berlin Heidelberg, 2006.
47. B. Tversky. Semantics, Syntax, and Pragmatics of graphics., pages 141-158. Lund University Press, Lund, 2004.
48. UNESCO. Literacy assessment and monitoring programme. http://www.uis.unesco.org/Literacy/Pages/lamp-literacy-assessment.aspx.
49. University of Kent. Numerical reasoning test. http://www.kent.ac.uk/careers/tests/mathstest.htm.
50. H. Wainer. A test of graphicacy in children. Applied Psychological Measurement, 4(3):331-340, 1980.
51. What is media literacy? a definition... and more. http://www.medialit.org/reading-room/what-media-literacy-definitionand-more.
52. M. Wu, R. Adams, and E. M. Solutions. Applying the Rasch model to psycho-social measurement [electronic resource] : A practical approach / Margaret Wu and Ray Adams . Educational Measurement Solutions Melbourne, Vic, 2007.