{"id":4717,"date":"2023-09-12T09:00:00","date_gmt":"2023-09-12T16:00:00","guid":{"rendered":"https:\/\/blogs.oregonstate.edu\/inspire\/?p=4717"},"modified":"2023-09-14T14:10:58","modified_gmt":"2023-09-14T21:10:58","slug":"media-literacy-in-the-age-of-ai-part-ii-a-review-of-verified","status":"publish","type":"post","link":"https:\/\/blogs.oregonstate.edu\/inspire\/2023\/09\/12\/media-literacy-in-the-age-of-ai-part-ii-a-review-of-verified\/","title":{"rendered":"Media Literacy in the Age of AI, Part II: A Review of Verified"},"content":{"rendered":"\n<p>For the first part of this post, please see <a href=\"https:\/\/blogs.oregonstate.edu\/inspire\/2023\/09\/05\/media-literacy-in-the-age-of-ai-part-i-you-will-need-to-check-it-all\/\">Media Literacy in the Age of AI, Part I: \u201cYou Will Need to Check It All.\u201d<\/a><\/p>\n\n\n\n<p>Just how, exactly, we\u2019re supposed to follow Ethan Mollick&#8217;s <a rel=\"noreferrer noopener\" href=\"https:\/\/www.oneusefulthing.org\/p\/how-to-use-ai-to-do-stuff-an-opinionated#:~:text=You%20will%20need%20to%20check%20it%20all.\" target=\"_blank\">caution<\/a> to \u201ccheck it all\u201d happens to be the subject of a lively, forthcoming collaboration from two education researchers who have been following the intersection of new media and misinformation for decades.<\/p>\n\n\n\n<p>In <em><a rel=\"noreferrer noopener\" href=\"https:\/\/press.uchicago.edu\/ucp\/books\/book\/chicago\/V\/bo207015182.html\" target=\"_blank\">Verified: How to Think Straight, Get Duped Less, and Make Better Decisions about What to Believe Online<\/a><\/em> (University of Chicago Press, November 2023), Mike Caulfield and Sam Wineburg provide a kind of user\u2019s manual to the modern internet. The authors\u2019 central concern is that students\u2014and, by extension, their teachers\u2014have been going about the process of verifying online claims and sources all wrong\u2014usually by applying the same rhetorical skills activated in reading a deep-dive on Elon Musk or Yevgeny Prigozhin, to borrow from last month\u2019s headlines. Academic readers, that is, traditionally keep their attention fixed on the text\u2014applying comprehension strategies such as prior knowledge, persisting through moments of confusion, and analyzing the narrative and its various claims about technological innovation or armed rebellion in discipline-specific ways.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Problem with Checklists<\/h2>\n\n\n\n<p>Now, anyone who has tried to hold a dialogue on more than a few pages of assigned reading at the college level knows that sustained focus and critical thinking can be challenging, even for experienced readers. (A majority of high school seniors are not prepared for reading in college, according to <a href=\"https:\/\/www.nationsreportcard.gov\/highlights\/reading\/2019\/g12\/\" target=\"_blank\" rel=\"noreferrer noopener\">2019 data<\/a>.) And so instructors, partnering with librarians, have long championed checklists as one antidote to passive consumption, first among them the <a rel=\"noreferrer noopener\" href=\"https:\/\/en.wikipedia.org\/wiki\/CRAAP_test\" target=\"_blank\">CRAAP<\/a> test, which stands for currency, relevance, authority, accuracy, and purpose. (Flashbacks to English 101, anyone?) The problem with checklists, argue Caulfield and Wineburg, is that in today\u2019s media landscape\u2014awash in questionable sources\u2014they\u2019re a waste of time. Such routines might easily keep a reader focused on critically evaluating \u201cgameable signals of credibility\u201d such as functional hyperlinks, a well-designed homepage, airtight prose, digital badges, and other supposedly telling markers of authority that can be manufactured with minimal effort or purchased at little expense, right down to the blue checkmark made infamous by Musk\u2019s platform-formerly-known-as-Twitter.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Three Contexts for Lateral Reading<\/h2>\n\n\n\n<p>One of the delights in reading <em>Verified<\/em> is drawing back the curtains on a parade of little-known hoaxes, rumors, actors, and half-truths at work in the shadows of the information age\u2014ranging from a sugar industry front group posing as a scientific think tank to headlines in mid-2022 warning that clouds of \u201cpalm-sized flying spiders\u201d were about to descend on the East Coast. In the face of such wild ideas, Caulfield and Wineburg offer a helpful, three-point heuristic for navigating the web\u2014and a sharp rejoinder to the source-specific checklists of the early aughts. (You will have to read the book to fact-check the spider story, or as the authors encourage, you can do it yourself after reading, say, the first chapter!) \u201cThe first task when confronted with the unfamiliar is not analysis. It is the gathering of context\u201d (p. 10). More specifically:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li class=\"has-medium-font-size\">The context of the <em>source<\/em> \u2014 What\u2019s the reputation of the source of information that you arrive at, whether through a social feed, a shared link, or a Google search result?<\/li>\n\n\n\n<li class=\"has-medium-font-size\">The context of the <em>claim<\/em> \u2014 What have others said about the claim? If it\u2019s a story, what\u2019s the larger story? If a statistic, what\u2019s the larger context?<\/li>\n\n\n\n<li class=\"has-medium-font-size\">Finally, the context of <em>you<\/em> \u2014 What is your level of expertise in the area? What is your interest in the claim? What makes such a claim or source compelling to you, and what could change that?<\/li>\n<\/ul>\n<cite>\u201cThe Three Contexts\u201d from <em>Verified<\/em> (2023)<\/cite><\/blockquote>\n\n\n\n<p>At a regional conference of librarians in May, Wineburg shared video clips from his scenario-based research, juxtaposing student sleuths with professional fact checkers. His conclusion? By simply trying to gather the necessary context, learners with supposedly low media literacy can be quickly transformed into \u201cstrong critical thinkers, without any additional training in logic or analysis\u201d (Caulfield and Wineburg, p. 10). What does this look like in practice? Wineburg describes a shift from \u201cvertical\u201d to \u201clateral reading\u201d or \u201cusing the web to read the web\u201d (p. 81). To investigate a source like a pro, readers must first leave the source, often by opening new browser tabs, running nuanced searches about its contents, and pausing to reflect on the results. Again, such findings hold significant implications for how we train students in verification and, more broadly, in media literacy. Successful information gathering, in other words, depends not only on keywords and critical perspective but also on the ability to engage in metacognitive conversations with the web and its architecture. Or, channeling our eight-legged friends again: \u201cIf you wanted to understand how spiders catch their prey, you wouldn\u2019t just look at a single strand\u201d (p. 87).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2-1024x549.png\" alt=\"SIFT graphic by Mike Caulfield with icons for stop, investigate the source, find better coverage, and trace claims, quotes, and media to the original context.\" class=\"wp-image-4713\" width=\"768\" height=\"412\" srcset=\"https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2-1024x549.png 1024w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2-300x161.png 300w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2-768x412.png 768w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2-1536x824.png 1536w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1504\/files\/2023\/09\/osu_ecampus_inspire_you_will_need_to_check_it_all_rm_img2.png 1958w\" sizes=\"auto, (max-width: 768px) 100vw, 768px\" \/><\/figure>\n\n\n\n<p>Image 2: Mike Caulfield&#8217;s \u201cfour moves&#8221;<a href=\"https:\/\/hapgood.us\/2019\/06\/19\/sift-the-four-moves\/\"><\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Reconstructing Context<\/h2>\n\n\n\n<p>Much of <em>Verified<\/em> is devoted to unpacking how to gain such perspective while also building self-awareness of our relationships with the information we seek. As a companion to Wineburg\u2019s research on lateral reading, Caulfield has refined a series of higher-order tasks for vetting sources called SIFT, or \u201cThe Four Moves\u201d (see Image 2). By (1) Stopping to take a breath and get a look around, (2) Investigating the source and its reputation, (3) Finding better sources of journalism or research, and (4) Tracing surprising claims or other rhetorical artifacts back to their origins, readers can more quickly make decisions about how to manage their time online. You can learn more about the why behind \u201creconstructing context\u201d at Caulfield\u2019s blog, <a rel=\"noreferrer noopener\" href=\"https:\/\/hapgood.us\/2019\/06\/19\/sift-the-four-moves\/\" target=\"_blank\">Hapgood<\/a>, and as part of the OSU Libraries\u2019 <a rel=\"noreferrer noopener\" href=\"https:\/\/oregonstate.instructure.com\/courses\/1772293\/pages\/sift-ing-through-the-news?module_item_id=21916195\" target=\"_blank\">guide to media literacy<\/a>. (Full disclosure: Mike is a former colleague from Washington State University Vancouver.)<\/p>\n\n\n\n<p>If I have one complaint about Caulfield and Wineburg\u2019s book, it\u2019s that it dwells at length on the particulars of analyzing Google search results, which fill pages of accompanying figures and a whole chapter on the search engine as \u201cthe bestie you thought you knew\u201d (p. 49). To be sure, Google still occupies a large share of the time students and faculty spend online. But as in my quest for learning norms protocols, readers are already turning to large language model tools for help in deciding what to believe online. In that respect, I find other chapters in <em>Verified<\/em> (on scholarly sources, the rise of Wikipedia, deceptive videos, and so-called native advertising) more useful. And if you go there, don\u2019t miss the author\u2019s final take on the power of emotion in finding the truth\u2014a line that sounds counterintuitive, but in context adds another, rather moving dimension to the case against checklists.<\/p>\n\n\n\n<p>Given the acceleration of machine learning, will lateral reading and SIFTing hold up in the age of AI? Caulfield and Wineburg certainly think so. Building out context becomes all the more necessary, they write in a postscript on the future of verification, \u201cwhen the prose on the other side is crafted by a convincing machine\u201d (p. 221). On that note, I invite you and your students to try out some of these moves on your favorite chatbot.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Another Postscript<\/h2>\n\n\n\n<p>The other day, I gave Microsoft\u2019s AI-powered search engine a few versions of the same prompt I had put to ChatGPT. In \u201cbalanced\u201d mode, Bing dutifully recommended resources from Stanford, Cornell, and Harvard on introducing norms for learning in online college classes. Over in \u201ccreative\u201d mode, Bing\u2019s synthesis was slightly more offbeat\u2014including an early-pandemic blog post on setting norms for middle school faculty meetings in rural Vermont. More importantly, the bot wasn\u2019t hallucinating. Most of the sources it suggested seemed worth investigating. Pausing before each rabbit hole, I took a deep breath.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Related Resource<\/h2>\n\n\n\n<p>Oregon State Ecampus recently rolled out its own <a rel=\"noreferrer noopener\" href=\"https:\/\/ecampus.oregonstate.edu\/faculty\/artificial-intelligence-tools\/\" target=\"_blank\">AI toolkit for faculty<\/a>, based on an emerging consensus that developing capacities for using this technology will be necessary in many areas of life. Of particular relevance to this post is a section on AI literacy, conceptualized as \u201ca broad set of skills that is not confined to technical disciplines.\u201d As with <em>Verified, <\/em>I find the toolkit\u2019s frameworks and recommendations on <a rel=\"noreferrer noopener\" href=\"https:\/\/ecampus.oregonstate.edu\/faculty\/artificial-intelligence-tools\/literacy\/\" target=\"_blank\">teaching AI literacy<\/a> particularly helpful. For instance, if students are allowed to use ChatGPT or Bing to brainstorm and evaluate possible topics for a writing assignment, \u201cfaculty might provide an effective example of how to ask an AI tool to help, ideally situating explanation in the context of what would be appropriate and ethical in that discipline or profession.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">References<\/h2>\n\n\n\n<p>Caulfield, M., &amp; Wineburg, S. (2023). <em>Verified: How to think straight, get duped less, and make better decisions about what to believe online<\/em>. University of Chicago Press.<\/p>\n\n\n\n<p>Mollick, E. (2023, July 15). <a rel=\"noreferrer noopener\" href=\"https:\/\/www.oneusefulthing.org\/p\/how-to-use-ai-to-do-stuff-an-opinionated\" target=\"_blank\">How to use AI to do stuff: An opinionated guide<\/a>. <em>One Useful Thing<\/em>.<\/p>\n\n\n\n<p>Oregon State Ecampus. (2023). <a href=\"https:\/\/ecampus.oregonstate.edu\/faculty\/artificial-intelligence-tools\/\" target=\"_blank\" rel=\"noreferrer noopener\">Artificial Intelligence Tools<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>For the first part of this post, please see Media Literacy in the Age of AI, Part I: \u201cYou Will Need to Check It All.\u201d Just how, exactly, we\u2019re supposed to follow Ethan Mollick&#8217;s caution to \u201ccheck it all\u201d happens to be the subject of a lively, forthcoming collaboration from two education researchers who have&hellip; <a href=\"https:\/\/blogs.oregonstate.edu\/inspire\/2023\/09\/12\/media-literacy-in-the-age-of-ai-part-ii-a-review-of-verified\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":13546,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1393907,1393897,156127,1393948],"tags":[1393983,126509,1393973,1839,1393990,1393988,1393991,155],"class_list":["post-4717","post","type-post","status-publish","format-standard","hentry","category-book-review","category-research","category-resources-tools-trends","category-teaching","tag-ai","tag-book-review","tag-chatgpt","tag-ecampus","tag-library-research","tag-media-literacy","tag-misinformation","tag-oregon-state-university"],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/posts\/4717","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/users\/13546"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/comments?post=4717"}],"version-history":[{"count":15,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/posts\/4717\/revisions"}],"predecessor-version":[{"id":4760,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/posts\/4717\/revisions\/4760"}],"wp:attachment":[{"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/media?parent=4717"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/categories?post=4717"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/inspire\/wp-json\/wp\/v2\/tags?post=4717"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}