VIEW Lab's Avatar

VIEW Lab

@viewlab

341
Followers 5
Following 8
Posts 09.10.2023
Joined
Posts Following

Latest posts by VIEW Lab @viewlab

Paper abstract. It reads: Visualization items—factual questions about visualizations that ask viewers to accomplish visualization tasks—are regu-larly used in the field of information visualization as educational and evaluative materials. For example, researchers of visualizationliteracy require large, diverse banks of items to conduct studies where the same skill is measured repeatedly on the same participants.Yet, generating a large number of high-quality, diverse items requires significant time and expertise. To address the critical need for alarge number of diverse visualization items in education and research, this paper investigates the potential for large language models(LLMs) to automate the generation of multiple-choice visualization items. Through an iterative design process, we develop theVILA(VisualizationItems Generated by LargeLAnguage Models) pipeline, for efficiently generating visualization items that measure peo-ple’s ability to accomplish visualization tasks. We use the VILA pipeline to generate 1,404 candidate items across 12 chart types and13 visualization tasks. In collaboration with 11 visualization experts, we develop an evaluation rulebook which we then use to rate thequality of all candidate items. The result is theVILAbank of∼1,100 items. From this evaluation, we also identify and classify currentlimitations of theVILApipeline, and discuss the role of human oversight in ensuring quality. In addition, we demonstrate an applicationof our work by creating a visualization literacy test,VILA-VLAT, which measures people’s ability to complete a diverse set of tasks onvarious types of visualizations; comparing it to the existingVLAT, VILA-VLAT shows moderate to high convergent validity (R= 0.70).Lastly, we discuss the application areas of theVILApipeline and theVILAbank and provide practical recommendations for their use.All supplemental materials are available athttps://osf.io/ysrhq/

Paper abstract. It reads: Visualization items—factual questions about visualizations that ask viewers to accomplish visualization tasks—are regu-larly used in the field of information visualization as educational and evaluative materials. For example, researchers of visualizationliteracy require large, diverse banks of items to conduct studies where the same skill is measured repeatedly on the same participants.Yet, generating a large number of high-quality, diverse items requires significant time and expertise. To address the critical need for alarge number of diverse visualization items in education and research, this paper investigates the potential for large language models(LLMs) to automate the generation of multiple-choice visualization items. Through an iterative design process, we develop theVILA(VisualizationItems Generated by LargeLAnguage Models) pipeline, for efficiently generating visualization items that measure peo-ple’s ability to accomplish visualization tasks. We use the VILA pipeline to generate 1,404 candidate items across 12 chart types and13 visualization tasks. In collaboration with 11 visualization experts, we develop an evaluation rulebook which we then use to rate thequality of all candidate items. The result is theVILAbank of∼1,100 items. From this evaluation, we also identify and classify currentlimitations of theVILApipeline, and discuss the role of human oversight in ensuring quality. In addition, we demonstrate an applicationof our work by creating a visualization literacy test,VILA-VLAT, which measures people’s ability to complete a diverse set of tasks onvarious types of visualizations; comparing it to the existingVLAT, VILA-VLAT shows moderate to high convergent validity (R= 0.70).Lastly, we discuss the application areas of theVILApipeline and theVILAbank and provide practical recommendations for their use.All supplemental materials are available athttps://osf.io/ysrhq/

A limitless source of #dataviz questions?
📜 Yuan Cui, Lily Ge, Yiren Ding, @fumeng.bsky.social @mjskay.com @laneh.bsky.social
evaluate the use of LLMs for generating visualization questions, e.g. for literacy assessments.
📍Catch our talk on Fri, Oct. 18 at 0900a
#IEEEVIS
osf.io/preprints/os...

14.10.2024 17:05 👍 3 🔁 0 💬 0 📌 1
Post image

كيف يتم تصميم الرسوم البيانية في النصوص التي تكتب و تقرأ من اليمين إلى اليسار مثل اللغة العربية؟
📜قمنا بتحليل تصميم رسوم بيانية منشورة في الصحف العربية لنبرز الأنماط المتبعة فيما يتعلق بالاتجاهات و عكس الرسوم البيانية و أكثر
📍تابعوا عرضنا في ال١٧من أكتوبر ١٠:١٥
#ieeevis
🔗 shorturl.at/AsfLK

14.10.2024 16:58 👍 0 🔁 0 💬 0 📌 0
Post image

↔️ How are #datavis designed in RTL languages like Arabic? 📜 Muna Alebri @curiouslemur.bsky.social @laneh.bsky.social analysed charts from Arabic journals & discuss the design patterns wrt directionalities
📍Follow our talk on Thu, Oct. 17-1015 EDT #BayshoreIV 🔗https://shorturl.at/AsfLK #ieeevis

13.10.2024 12:39 👍 5 🔁 3 💬 0 📌 1

#IEEEVIS is around the corner and we are looking forward to a very productive virtual conference.
🧵Capturing our lab's contributions at #ieeevis 2024 in the upcoming posts 📣

12.10.2024 23:26 👍 3 🔁 1 💬 0 📌 0
A group photo of the reVISit team at WPI

A group photo of the reVISit team at WPI

At the reVISit retreat hacking on our study platform, this time at WPI! Check out revisit.dev @laneh.bsky.social @hilsonshrestha.bsky.social @yding.bsky.social #datavis

26.04.2024 21:14 👍 1 🔁 1 💬 0 📌 1

"The Risks of Ranking" by @mjskay.com and others is taking a much-needed look at individual variance of performance on visualization tasks. Not all people will agree on which visualization is most accurate! I'm curious to see it linked to perception work.

ieeexplore.ieee.org/document/997...

20.10.2023 18:37 👍 5 🔁 3 💬 1 📌 0
Post image

"Performance ranking of charts applies universally" or maybe not... 😏
Curious? Come discuss the topic with us in

Room 105 2pm today Oct. 26 #ieeevis

📜 The risks of ranking: Revisiting #graphicalperception to model individual differences in #datavisualization performance

arxiv.org/pdf/2212.10533

26.10.2023 00:07 👍 4 🔁 3 💬 0 📌 0
Post image

Do you think it's possible/necessary to do #datavisualization #research in languages other than #English? Is a monolingual research field exclusionary?

Check out our talk "Beyond English: Centering Multilingualism in #datavis"
Oct 23 09:35a
📍 #vis4good Workshop
#ieeevis
arxiv.org/pdf/2309.066...

22.10.2023 04:47 👍 1 🔁 0 💬 0 📌 1
VIEW Lab Data Visualization lab at WPI

Our lab has several papers at #ieeevis 2023.

Stay tuned as we share our schedule and where you can find us at the conference.
👋🏼 @laneh.bsky.social will be in #Melbourne, you can also connect w our team wpivis.github.io who will be following remotely. (Posted time will be in EADT UTC+11)

#datavis

22.10.2023 04:44 👍 0 🔁 1 💬 0 📌 0

Hello World! 🌍
We are VIEW lab, the data visualization research group at at Worcester Polytechnic Institute, directed by @laneh.bsky.social.   

✨We are excited to share our latest news and research here. ✨
Learn more about us on wpivis.github.io

19.10.2023 19:49 👍 1 🔁 1 💬 0 📌 0