About The Workshop

The evolving landscapes of user modelling, adaptation, and personalisation necessitate a nuanced exploration of context and its impact on human-computer interaction. This evolution represents a paradigm shift towards placing the user at the centre of context representation, acknowledging the multifaceted nature of context as it intertwines with user needs, environmental changes, and technological advancements.
The second edition of the Context Representation in User Modeling (CRUM) workshop, themed "Human-Centric Context", seeks to foster a comprehensive understanding of context by focusing on the dynamic interplay between subjective and objective contexts in enhancing user experience. We welcome submissions that explore the nuances of human-centric context across various domains, aiming to standardise context modelling practices that enhance user engagement, privacy, and trust in multi-stakeholder environments.

Exciting Announcement!

Our Workshop, CRUM 2024, is pleased to announce that it will be physically co-located and presented alongside the 9th International Workshop on Human Aspects in Adaptive and Personalized Interactive Environments (HAAPIE 2024), due to the similar themes and topics associated with the workshop. CRUM shall feature its papers, keynotes, and workshop activity on context representation and human aspects for the participants of the combined workshop.

2024
July 1

Cagliari,
Sardinia, Italy

List of Accepted Papers

Congratulations to the authors of the following papers, we are excited to see them be presented at CRUM 2024!
Affective News Framing: Comparing the Impact of Emotional Reframing in Economic News Between a Large Language Model and a Human Journalist
Jia Hua Jeng, Gloria Kasangu, Alain Starke, and Christoph Trattner

News media framing can shape public perception and potentially polarize views. Emotional language can exacerbate framing effects, affecting how users perceive specific news media. In turn, a user's emotional state can be an important contextual factor to use in news recommendation. Our research explores the relation between such emotional framing techniques and the emotional states of readers, as well as their perceived trust in specific news articles. We used ChatGPT-4 to reframe news articles into different emotional states (with a human journalist as a baseline). We performed a comparative analysis across four distinct framing conditions: Anger, Fear, Hope (all GPT-4) and neutral (journalist). Users (N=200) were asked to read three economic news articles from the Washington Post. Our results revealed that negative framing (Anger, Fear) elicits strong negative emotional states than the neutral baseline, while Hope led to little changes overall. Trust levels varied little across the different re-framing condition, showing little difference between ChatGPT-based framing and that of the human journalist. We discuss the implications of our findings and how emotional framing could affect societal polarization issues.

Are We Losing Interest in the Context of Recommendation?
Laurens Rook, Markus Zanker, and Dietmar Jannach

Contextual information is a prerequisite for timely offerings of personalized decision support and recommendations. Yet, research on {\it context-aware} recommender systems (CARS) does not appear to be thriving and finding public datasets containing context factors appears to be a tough task. We can make various assumptions about why this drop in research interest happens, be it ethical considerations or the popularity of opaque deep learning models, which however only consider context only in an implicit way. This is an unwelcome development. We argue that continued effort must be put on the creation of suitable datasets. Furthermore, we see significant opportunities in the development of next-generation CARS in the space of interactive AI assistants powered by Large Language Models.

Workshop Program (CRUM + HAAPIE)

Time Event
09:00 - 09:15 Welcome Note
Session 1 : Keynote & Paper Presentations Session Chair: Dipto Barman, Trinity College Dublin
09:15 - 09:40 Keynote Talk
Unraveling the Context of Context by Prof. Christine Bauer, Paris Lodron University Salzburg (PLUS), Austria.

We are increasingly developing sophisticated systems which are aware of the context that they are used in, and intelligently adapt their behavior to this context. This keynote delves into the essence of 'context', acknowledging its diverse conceptualizations in literature, ranging from 'any information' to a few categories. Despite acknowledging that the relevance of context is domain-specific, it often remains unclear what is relevant specifically. Technically, context representations aim to objectively capture measurable context elements. However, practical significance often lies at a different abstraction level, where a context element's relevance and meaning may shift based on how other context elements manifest. For instance, spacial coordinates have no immediate connection with the real word; their relevance and meaning are defined by what is there else. An individual's (past) experience further complicates relevance: Is it an arbitrary house or is the one where you grew up? Do you currently live there? It context could become more intricate if a stranger enters that house. In this keynote address, I will embrace the subtleties of context, emphasizing that the compound of context elements matters, and underscoring that objective context representations may often only serve as proxies for truly significant experienced context.

Christine Bauer is EXDIGIT Professor of Interactive Intelligent Systems at the Department of Artificial Intelligence and Human Interfaces (AIHI) at the Paris Lodron University Salzburg, Austria. Her research centers on interactive intelligent systems, where she integrates research on intelligent technologies, the interaction of humans with intelligent systems, and their interplay. Central themes in her research are context and context-adaptivity. In recent years, she worked on context-aware recommender systems in the music and media domains. The core interests in her research activities are fairness and multi-method evaluations. She has authored more than 100 papers and holds several best paper awards and many awards for her reviewing activities. She is on the Editorial Boards of ACM Transactions on Recommender Systems (TORS) and ACM Transactions on Information Systems (TOIS). Further, she is co-organizer of the Workshop series "Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES)" at RecSys 2021-2023. Further information can be found at https://christinebauer.eu
09:40 - 09:55 Characterising Gabs in Personalised Planning Support for Students with Autism (HAAPIE - F)

by Robin Cromjongh, Maria Młocka, Almila Akdag, Judith Masthoff, and Hanna Hauptmann
09:55 - 10:10 Affective News Framing: Comparing the Impact of Emotional Reframing in Economic News Between a Large Language Model and a Human Journalist (CRUM - S)

by Jia Hua Jeng, Gloria Kasangu, Alain Starke and Christoph Trattner
10:10 - 10:25 Exploring Personalized Social Comparison in Online Education (HAAPIE - F)

by Kamil Akhuseyinoglu, Emma McDonald, Aleksandra Klasnja Milicevic, Carrie Demmans Epp, and Peter Brusilovsky
10:25 - 10:55 Coffee Break
Session 2: Paper Presentations Session Chair: Ben Steichen, California State Polytechnic University, Pomona
10:55 - 11:!0 Navigating Serendipity – An Experimental User Study On The Interplay of Trust and Serendipity In Recommender Systems (HAAPIE - F)

by Irina Nalis, Tobias Sippl, Thomas Elmar Kolb, and Julia Neidhardt
11:10 - 11:20 Harmonizing Ethical Principles: Feedback Generation Approaches in Modeling Human Factors for Assisted Psychomotor Systems (HAAPIE - S)

Miguel Portaz, Angeles Manjarres, Olga C. Santos
11:20 - 11:35 Using Large Language Models for Adaptive Dialogue Management in Digital Telephone Assistants (HAAPIE - F)

by Irina Nalis, Tobias Sippl, Thomas Elmar Kolb, and Julia Neidhardt
11:35 - 11:45 Towards Integrating Human-in-the-loop Control in Proactive Intelligent Personalised Agents (HAAPIE – S)

by Awais Akbar and Owen Conlan
Session 3: Interactive, Keynote, and Closing Session Chair: Alok Debnath, Trinity College Dublin & Marko Tkalčič, University of Primorska
11:45 - 12:10 Are We Losing Interest in the Context of Recommendation? (CRUM – Poster)

by Laurens Rook, Markus Zanker, and Dietmar Jannach

Bursts and Layers: Engage & Interact

A workshop activity on the human aspects of context and its representation.
12:10 - 12:20 Keynote Talk
Context Representation in User Modelling by Prof. Judy Kay, Human Centred Technology Research Cluster, in the Faculty of Engineering at the University of Sydney, Australia.

There has been a huge amount of research on personalisation. It has also moved well beyond the research lab and is widely used in real world applications, websites, and much more. A model of the user and their context drives that personalisation. This, like many other forms of AI, have typically been inscrutable. This is because system builders have failed to prioritise the design of their systems so that the user can scrutinise the key elements of the personalisation process: the data used, the time and context of that data, the user modelling process and the personalisation. As the broad public increasingly calls for better understanding and control of smart systems, we need to establish ways for system builders to focus on scrutability from the design foundations, right through to system building and deployment. This talk will outline a vision for ways to do this, drawing on my team's previous work across diverse areas, ranging from learning, recommenders and smart buildings.

Judy Kay is a Professor of Computer Science. She leads the Human Centred Technology Research Cluster, in the Faculty of Engineering at the University of Sydney. A core focus of her research has been to create infrastructures and interfaces for personalisation so that people can scrutinise and control them. She has created such systems to support people in lifelong, life-wide learning. This ranges from formal education settings to supporting people in using their long-term ubicomp data to support self-monitoring, reflection and planning and includes medical contexts such as learning communication skills in medical settings. She has integrated this into new forms of interaction including virtual reality, surface computing, wearables and ambient displays. Her research has been commercialised and deployed and she has extensive publications in leading venues for research in user modelling, AIED, human computer interaction and ubicomp. She has held leadership roles in top conferences in these areas and is Editor-in-Chief of the IJAIED, International Journal of Artificial Intelligence in Education (IJAIED), recent Editor and now Advisory Board member of IMWUT, Interactive Mobile Wearable and Ubiquitous Technology (IMWUT) and Advisory Board member of ACM Transactions on Interactive Intelligent Systems TiiS).
12:20 - 12:30 Final Discussion & Best Paper Announcement

Call for Papers

The goal of CRUM 2024 is to consolidate the various ways in which context is stored, retrieved, used, analysed, and interpreted by academicians, researchers, and users of a variety of user-facing systems. In that vein, we introduce the theme of this workshop: Representation of Human-Centric Context. "Human-centric context" can be defined as understanding and accounting for the dynamic interaction between the user model and the contextual environment. Such a paradigm shift aims to redefine the contextual landscape, a dynamic and multifaceted environment where contextual elements – ranging from physical settings over social dynamics to technological interfaces – interact and influence user experiences and behaviour. This landscape evolves with user needs, environmental changes, and technological advancements, representing the intricate web of variables that define human-computer interactions and user modelling. CRUM 2024 will explore the subjectivity of contextual information in anthropocentric technologies across various domains.

Evolving from last year's workshop, CRUM 2024 invites multiple submission types. We welcome long papers (up to 7 pages) and provocation/opinion papers (up to 2 pages). Details on the content expectation for both submission types are provided below.

Topics considered relevant to the theme of this workshop include, but are not limited to:

  • Capturing and storing contextual information;
  • Situation-aware user modelling and adaptive system;
  • Algorithmic relevance of situational, temporal, location, and hypermedia context;
  • Context representation for personalisation;
  • Adaptation of user models based on spatial, temporal, or situational context;
  • Capturing and ranking application-specific context in hypermedia user applications;
  • Context as relevance of static and dynamic external characteristics within recommendation systems;
  • Contextualising proactive behaviour;
  • Context-aware personalised pervasive computing;
  • The role of context for user modelling in recommender systems;
  • Evaluation frameworks for capturing, representing, and using contextual information in agent decision-making;
  • Role of context and context representation within explainable adaptation;
  • Scrutability of contextual representation in personalised systems; and

Additionally, topics considered relevant to the theme of this workshop include, but are not limited to:

  • Representing human-specific context information;
  • Examining human- and domain-specific context, including similarities and differences in how it is captured, stored, or represented;
  • Privacy and context;
  • User control and management of context-aware systems;
  • Evaluation frameworks for human-centred context;
  • Impact on performance, efficiency, and usability based on context;and
  • Role of context information in natural language processing, information retrieval, human-agent interaction, and robotics.

Important Dates

May 3, 2024
April 24, 2024

Submission Deadline

May 10, 2024

Author Notification


May 18, 2024

Camera Ready Deadline

July 1, 2024

Workshop Date

Paper Formatting and Submission Information

CRUM 2024 accepts long papers (up to 7 pages excluding references and appendices).

In line with UMAP 2024's content expectation, papers should aim to report on original contributions in the field of the understanding and representation of context as well as the use of contextual information within the framework of user modeling, adaptive agents, personalization, and intelligent systems. Papers showcasing innovation within explainability and vulnerability analysis in agents which process and use contextual information are welcome.

Evaluations of proposed applications must be commensurate with the claims made in the paper. Depending on the intended contribution, this may include simulation stidies, offline evaluation, A/B tests, controlled user experiments, or human evalution, which is subject to ACM guidelines involving human participants.

Research procedures and technical methods should be presented in sufficient detail to ensure scrutiny and reproducibility. We recognize that user data may be proprietary or confidential, but we encourage the sharing of (anonymized, cleaned) data sets, data collection procedures, and code. Results should be clearly communicated and implications of the contributions/findings for UMAP and beyond should be explicitly discussed.

CRUM 2024 accepts provocation/opinion papers (up to 2 pages excluding references and appendices).

Provocation and opinion papers are meant to challenge the status quo and present novel, radical, or alternative methods of understanding and representing context as well as the use of contextual information within the framework of user modeling, adaptive agents, personalization, and intelligent systems. Papers showcasing innovation within explainability and vulnerability analysis in agents which process and use contextual information are welcome.

Authors are asked to provide a clear and concise argument for their position and claims alongwith preliminary evidentiary support, if possible. Authors are also encouraged to provide an analysis of the implications of their position for UMAP and beyond. Provocation pieces should consider aspects of viability, desirability, and feasibility of the proposed ideas.

Challenges and limitations of the proposed ideas should also be discussed in sufficient detail. We encourage new perspectives and analyses of existing limitations within the field, as well as the identification of novel challenges. Additionally, thought-provoking alternative viewpoints and perspectives on the future of human-centric context are also welcome.

All submissions to the workshop should use the same ACM template (single-column format) and formatting adopted by the main UMAP conference. The templates and instructions are available here.
We encourage authors to submit works in progress, negative results, insights, position papers, as well as case studies on context and its role in user modeling and adaptive systems.
CRUM follows a rigorous double-blind peer review policy. Please ensure that all workshop submissions are anonymized.

CRUM 2024 has no dual submission policy, and works previously published elsewhere should not be submitted. Submitted manuscripts should also not currently be under review at another publication venue. ACM's publication policy is detailed below:

  1. "By submitting your article to an ACM Publication, you are hereby acknowledging that you and your co-authors are subject to all ACM Publications Policies, including ACM's new Publications Policy on Research Involving Human Participants and Subjects. Alleged violations of this policy or any ACM Publications Policy will be investigated by ACM and may result in a full retraction of your paper, in addition to other potential penalties, as per ACM Publications Policy.”
  2. "Please ensure that you and your co-authors obtain an ORCID ID, so you can complete the publishing process for your accepted paper. ACM has been involved in ORCID from the start and we have recently made a commitment to collect ORCID IDs from all of our published authors. The collection process has started and will roll out as a requirement throughout 2022. We are committed to improve author discoverability, ensure proper attribution and contribute to ongoing community efforts around name normalization; your ORCID ID will help in these efforts."
All accepted papers will be published in an ACM UMAP adjunct publication and will be included in the ACM Digital Library.
For any queries regarding the paper submission, instructions for paper formatting, content expectations, paper length, or deadlines, please contact the official workshop email address at: crum.workshop@gmail.com or any of the workshop organizers

Submit Your Work!

Papers will be submitted through EasyChair, selecting the track associated with Context Representation in User Modeling.

Submit

Keynote Speakers

Opening Keynote

Unraveling the context of context

Talk Abstract

We are increasingly developing sophisticated systems which are aware of the context that they are used in, and intelligently adapt their behavior to this context. This keynote delves into the essence of 'context', acknowledging its diverse conceptualizations in literature, ranging from 'any information' to a few categories. Despite acknowledging that the relevance of context is domain-specific, it often remains unclear what is relevant specifically.
Technically, context representations aim to objectively capture measurable context elements. However, practical significance often lies at a different abstraction level, where a context element's relevance and meaning may shift based on how other context elements manifest. For instance, spacial coordinates have no immediate connection with the real word; their relevance and meaning are defined by what is there else. An individual's (past) experience further complicates relevance: Is it an arbitrary house or is the one where you grew up? Do you currently live there? It context could become more intricate if a stranger enters that house.
In this keynote address, I will embrace the subtleties of context, emphasizing that the compound of context elements matters, and underscoring that objective context representations may often only serve as proxies for truly significant experienced context.

Speaker Bio

Christine Bauer is EXDIGIT Professor of Interactive Intelligent Systems at the Department of Artificial Intelligence and Human Interfaces (AIHI) at the Paris Lodron University Salzburg, Austria.
Her research centers on interactive intelligent systems, where she integrates research on intelligent technologies, the interaction of humans with intelligent systems, and their interplay. Central themes in her research are context and context-adaptivity. In recent years, she worked on context-aware recommender systems in the music and media domains. The core interests in her research activities are fairness and multi-method evaluations. She has authored more than 100 papers and holds several best paper awards and many awards for her reviewing activities. She is on the Editorial Boards of ACM Transactions on Recommender Systems (TORS) and ACM Transactions on Information Systems (TOIS). Further, she is co-organizer of the Workshop series "Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES)" at RecSys 2021-2023. Further information can be found here.

Christine Bauer

Judy Kay

Closing Keynote

To Be Announced

Speaker Bio

Judy Kay is Professor of Computer Science. She leads the Human Centred Technology Research Cluster, in the Faculty of Engineering at the University of Sydney.
A core focus of her research has been to create infrastructures and interfaces for personalisation so that people can scrutinise and control them. She has created such systems to support people in lifelong, life-wide learning. This ranges from formal education settings to supporting people in using their long-term ubicomp data to support self-monitoring, reflection and planning and includes medical contexts such as learning communication skills in medical settings. She has integrated this into new forms of interaction including virtual reality, surface computing, wearables and ambient displays. Her research has been commercialised and deployed and she has extensive publications in leading venues for research in user modelling, AIED, human computer interaction and ubicomp. She has held leadership roles in top conferences in these areas and is Editor-in-Chief of the IJAIED, International Journal of Artificial Intelligence in Education (IJAIED), recent Editor and now Advisory Board member of IMWUT, Interactive Mobile Wearable and Ubiquitous Technology (IMWUT) and Advisory Board member of ACM Transactions on Interactive Intelligent Systems TiiS).

Organizers and Program Committee

Workshop Chairs

Owen Conlan

Professor in Computer Science,
ADAPT Centre, Trinity College Dublin.

Judy Kay

Payne-Scott Professor
School of Computer Science, University of Sydney.

Workshop Organizing Committee

Dipto Barman

Trinity College Dublin

Jovan Jeromela

Trinity College Dublin

https://twitter.com/djinn_anthrope

Alok Debnath

Trinity College Dublin

Anouk van Kasteren

Utrecht University

Marloes Vredenborg

Utrecht University

Program Committee

  • Peter Knees, Technische Universität Wien
  • Hanna J. Hauptmann, Utrecht University
  • Ivana Dusparic, Trinity College Dublin
  • Gabriele Civitares, Università degli Studi di Milano
  • Moshe Unger, Tel Aviv University
  • Jeffrey Sardina, Trinity College Dublin
  • Eelco Herder, Utrecht University
  • Prakash Jamakatel, Universität der Bundeswehr München
  • Piek Th.J.M. Vossen, Vrije Universiteit Amsterdam
  • Selene Baez Santamaria, Vrije Universiteit Amsterdam
  • Yong Zheng, Illinois Tech
  • Tsvi Kuflik, University of Haifa
  • Jasmina Gajčin, Trinity College Dublin
  • Anind K. Dey, University of Washington
  • Christine Bauer, Paris Lodron University Salzburg
  • David Millard, University of Southampton
  • Marko Tkalčič, University of Primorska
  • Amra Delić, Univerzitet u Sarajevu
  • Samuel Rhys Cox, National University of Singapore
  • Joel Wester, Aalborg Universitet
  • Andreas Brännström, Umeå Universitet
  • Julia Neidhardt, Technische Universität Wien
  • Francesco Barile, Maastricht University
  • Rachid Alami, LAAS, CNRS
  • Justin Edwards, University of Oulu

Sponsors

Contact Us

Event Location

Campus Sant’Ignazio (St. Ignatius Campus)
Via Sant’Ignazio da Laconi,
76, Cagliari, Sardinia (Italy)

Contact Details

Email address: crum.workshop@gmail.com
Twitter: https://twitter.com/CrumWorkshop