Off-Screen Desktop


Erik Paluka, Christopher Collins


We present Off-Screen Desktop, spatial navigation techniques that make use of the space around the display to extend direct manipulation beyond the desktop screen. To enable off-screen direct manipulation, these techniques visually transform the information space without affecting its interaction space. This allows a person to interact with the information space as if it physically extended beyond the boundaries of the display. Off-Screen Desktop is characterized by its implicit transience where the applied visual transformations are automatically reverted when the hand leaves the associated spatial interaction space. We illustrate Off-Screen Desktop with the design of three different techniques, which include Dynamic Distortion, Spatial Panning, and Dynamic Peephole Inset, as well as their evaluation in a comparative study with standard mouse panning. We also demonstrate their applicability with a number of use cases. Study results show that Spatial Panning was overall significantly faster than the other Off-Screen Desktop techniques when employed in two different navigation tasks.


GitHub Repository


  • [IMG]
    E. Paluka, “Spatial Peripheral Interaction Techniques for Viewing and Manipulating Off-Screen Digital Content,” Master Thesis, 2015.
    [Bibtex] [PDF]

      author =    {Erik Paluka},
      title =    {Spatial Peripheral Interaction Techniques for Viewing and Manipulating Off-Screen Digital Content},
      school =    {University of Ontario Institute of Technology},
      year =    2015



Learn, Generate, Rank, Explain: A Case Study of Visual Explanation by Generative Machine Learning

Professional Differences: A Comparative Study of Visualization Task Performance and Spatial Ability Across Disciplines

Card-IT: a Dynamic FSM-based Flashcard Generator for Learning Italian Verb Morphology

Visual Analytics Tools for Academic Advising

Érudit and Vialab Collaboration Projects

Academia is Tied in Knots

Tilt-Responsive Techniques for Digital Drawing Boards

Textension: Digitally Augmenting Document Spaces in Analog Texts

Eye Tracking for Target Acquisition in Sparse Visualizations

Guidance in the human–machine analytics process

H-Matrix: Hierarchical Matrix for Visual Analysis of Cross-Linguistic Features in Large Learner Corpora

A Visual Analytics Framework for Adversarial Text Generation

Design by Immersion: A Transdisciplinary Approach to Problem-Driven Visualizations

Semantic Concept Spaces: Guided Topic Model Refinement using Word-Embedding Projections

Discriminability Tests for Visualization Effectiveness and Scalability

Saliency Deficit and Motion Outlier Detection in Animated Scatterplots

ActiveInk: (Th)Inking with Data

Visual Analytics for Topic Model Optimization based on User-Steerable Speculative Execution

ThreadReconstructor: Modeling Reply-Chains to Untangle Conversational Text through Visual Analytics

Detecting Negative Emotion for Mixed Initiative Visual Analytics

EduApps – Supporting Non-Native English Speakers to Overcome Language Transfer Effects

Metatation: Annotation as Implicit Interaction to Bridge Close and Distant Reading

DataTours: A Data Narratives Framework

Perceptual Biases in Font Size as a Data Encoding

Progressive Learning of Topic Modeling Parameters: A Visual Analytics Framework

Abbreviating Text Labels on Demand

NEREx: Named-Entity Relationship Exploration in Multi-Party Conversations

ConToVi: Multi-Party Conversation Exploration using Topic-Space Views

PhysioEx: Visual Analysis of Physiological Event Streams

Using Visual Analytics of Heart Rate Variation to Aid in Diagnostics

Off-Screen Desktop


Reading Comprehension on Mobile Devices

#FluxFlow: Visual Analysis of Anomalous Information Spreading on Social Media

Balancing Clutter and Information in Large Hierarchical Visualizations

Lexichrome: Text Construction and Lexical Discovery with Word-Color Associations Using Interactive Visualization

SentimentState: Exploring Sentiment Analysis on Twitter

Facilitating Discourse Analysis with Interactive Visualization




Simple Multi-Touch Toolkit

Exploring Text Entities with Descriptive Non-photorealistic Rendering

Investigating the Semantic Patterns of Passwords

Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations

Parallel Tag Clouds to Explore Faceted Text Corpora

VisLink: Revealing Relationships Amongst Visualizations

DocuBurst: Visualizing Document Content using Language Structure

Tabletop Text Entry Techniques

Lattice Uncertainty Visualization: Understanding Machine Translation and Speech Recognition

WordNet Visualization

// Where the sidebar information is stored
| © Copyright vialab | Dr. Christopher Collins, Canada Research Chair in Linguistic Information Visualization |