Interacting with computers is an important part of modern life, from driving a car safely to using all the features your phone can deliver, to being able to work productively and creatively. Interactive computing studies how computers and people can cooperate effectively on any number of tasks.
Our work targets problems in social computing, design and creativity, decision making, intelligent systems, and cognitive modeling. For example, we study the transparency of algorithms controlling social media feeds, the use of robotics in domestic environments to support aging in place, and the application of crowdsourcing for creative work. Working at times with companies like Adobe, Facebook, Google, Intel, Microsoft, NVidia, and Tableau, our research synthesizes knowledge from machine learning, psychology, design, and the learning sciences to study and address important problems in society. We also work on the presentation of and interaction with information, ranging from dashboards of visualizations to VR displays of photorealistic video games.
Strengths and Impact
The interactive computing area comprises scholars with diverse preparation, methodologies, and perspectives spanning interaction design, visualization, applied machine learning, decision sciences, and social computing. These scholars share the common goal of designing computational artifacts and developing pedagogy to address important questions that arise when algorithms mediate (and influence) individual and group decision-making; team formation or collectives; interaction design; and mechanisms that influence online behavioral norms. The group’s intellectual diversity is critical to address these questions, provides group synergies, and facilitates meaningful collaboration with scholars across other units across campus.
The interactive computing group’s groundbreaking research develops algorithms, designs experiments, and builds systems to answer research questions at different scales: individuals, small groups, and large groups. At the individual level, the group has examined research questions around personal health, supporting work, and, more broadly, the design of just, equitable infrastructures. Our focus on individual health has led to the creation of tools to elicit communication in children and adults diagnosed with Autism Spectrum Disorders (ASD); the creation of environments to support adherence to medical regimens for children with asthma; the development of embodied, mixed-reality rehabilitation systems; the design of algorithmic synthesis of messages; and the development of domestic robots to help aging-in-place. Our research on work environments has resulted in the development of algorithms for opportune notification management, design of decision control and automation systems; the design of visual analytics engines; and the creation of virtual environments for safety. Our emphasis on equity and jus tice has led to the development of contestable machine learning systems; the design of interfaces to communicate algorithmic knowledge and process; the creation of tools that democratize visualization for non-experts; methods to hide on the internet; and the design of adversarial bargaining systems. Our work has led to the creation of the term “algorithmic auditing”, and an increased focus on the ethical implications of the use of algorithms in online platforms. At the small group level, we have examined algorithmic team formation, visualization of group conversations, and public visualizations that incentivize workplace collaboration. At a large scale, our work has examined crowdsourced design critiques and develops educational technologies for remote learning and identifying coordinated behavior. We are exploring novel approaches to online moderation and developing new AI-backed socio-technical systems. Our research pioneered the concept of design mining: using data mining and machine learning to capture and index large repositories of existing designs and correlate the design patterns found in these repositories with performance metrics to understand best practices. We are also building novel data-driven tools for creating and evaluating digital design (developing generative model approaches for predictive design; designing effective user experiences powered by machine learning models; how the design of ranking and rating systems on social platforms can incentivize users to engage more meaningfully with content, to the benefit of everyone).
The group, which comprises senior, mid-career, and junior faculty, including three ACM distinguished members, shows leadership in research, teaching, and service to the community. We publish at leading human-computer interaction and social computing conferences, and the community has recognized our work with best-paper awards and honorable mentions at these conferences. Our scholarship has also been recognized through highly visible external fellowships and with prominent awards within the university. Funding from federal agencies and industry support our work. The group has received acclaim for its teaching and student mentoring. Our faculty have been honored with teaching excellence awards within the university. Our mentoring efforts have led to our undergraduates receiving CRA honorable mentions and our PhD students taking faculty positions at top-tier peer institutions and prominent industry research labs. As part of broader service to the community, we help organize major conferences, associate editors of prominent journals in the field, and as series editors of distinguished academic book collections. Our faculty are leading the Just Infrastructure center that interrogates the complex interactions between people, systems, and algorithms. Our senior faculty are also in leadership positions within the university and have been instrumental in developing the online master’s data science program.
Our public engagement has led to creating public datasets, startups, and to changes in online governance. As part of a collaboration with Google, our faculty have released and maintained the Rico dataset—the largest repository of mobile app designs collected to date—comprising more than 72k unique UI screens and 3M UI elements mined from 9.7k Android apps. This dataset’s scale and its semantic classification of UI components have made it possible for researchers in academia and industry to train deep neural models for mobile task automation, app testing, and UI layout generation. Our work on design mining the Web led to a startup (Apropose, Inc.) that raised significant capital from prominent venture capital funds. We have worked with large-scale Internet platforms, including Twitter, Reddit, and Facebook, to improve online governance. This work led to the ban of hate groups in several online forums and received considerable press coverage—e.g., The New York Times, The Verge, MIT Technology Review, TechCrunch and Motherboard.
Research Efforts and Groups
- Center for People and Infrastructure in the Coordinated Science Laboratory
- Computer Graphics Illinois
- Illinois HCI
- The HCI seminar brings in emerging and established intellectual leaders in the field of human-computer interaction to present their latest research findings and visions. It also provides a lively forum for our students to practice conference, defense, and job talks and for colleagues to seek collaborators. Subscribe to the mailing list for the seminar.
- Illinois Computer Science Speaker Series: brings prominent leaders and experts to campus to share their ideas and promote conversations about important challenges and topics in the discipline.
Faculty & Affiliate Faculty
Human-Computer Interfaces, Design Thinking, Creativity, Crowdsourcing, Teamwork
Social Computing, Human-Centered AI, Data Science, Online Moderation
Usable Security & Privacy
Scientific Visualization, Computer Graphics, Information Design
Graphics, Projection Mapping
Data Visualization, Computer Graphics, Virtual Reality
Social Computing, Mobile Computing, Computer Supported Cooperative Work, and Crowdsourcing
Social Computing, Human Computer Interaction, Social Visualization, Assistive Technologies, Fairness and Bias in Computing
Human-Computer Interaction, Human Factors, Cognitive Science and Engineering, Modeling and Supporting Human Judgment and Decision Making, Human-Automation Interaction
Data-Driven Design, Design Mining, User-Centered Machine Learning, UI/UX, Mobile/Web Applications, Social Networks, Fashion, Emoji
AI in Education, Educational Games, Affective Computing, Intelligent Tutoring Systems
Quality of Experience, Tele-Immersion, Multi-View Visualization, Embedded Sensors, Distributed and Parallel Systems
Data Visualization, Computer Graphics, Virtual Reality, Game Development
Human-Computer Interaction, Creativity Support Tools, Documentation, Education, Maker Culture
Voting, Improving Individual and Collective Decision Making, Information Asymmetry, MOOCs
Computer Supported Collaboration
Usable Privacy and Security, Social Computing, Accessibility, Explainable AI