Visualization Software Architectures for Arts, Humanities, and STEM Integration

Artifact-Based Rendering

Artifact-Based Rendering

Artifact-Based Rendering (ABR) is a framework that includes tools and processes that enable digital visualizations to incorporate physical media. Created with artists and designers in mind, ABR is a technical foundation and the input channel for Sculpting Visualization’s project to enrich the visual vocabulary of scientific visualization through hand-crafted or naturally occurring objects. Read the full paper

Sculpting Visualizations - AGU 2020 from Francesca Samsel on Vimeo.

ABR Interface

Artifact-Based Rendering is grounded in metaphors of printmaking, connecting our work in complex graphics processes with the practices of the artistic community. ABR layers glyphs, lines, and surfaces with color and shape the way a printmaker might approach image-making in their studio.

The user interface has five primary workable components:

  • Key Data: geometric representations of your data (points, lines, surfaces), loaded from VTK unstructured grid files, each piece of key data has associated scalar & vector variables
  • Data Impressions: your “layers” of data in the visualization. Apply variables and visual elements to each data impression, and watch as they are composed in real time in your visualization.
  • Data Palette: the panel on the left-hand side which displays data impressions and loaded variables for your data.
  • Composition Panel: the central window into which data impressions are dragged. Each set of data impressions + colormaps, glyphs, streamlines, etc. is called a “plate,” sticking with the printmaking metaphors. Use this panel like you would in Photoshop, adding visual elements as you see fit. More information on this can be found further along in this instructional guide.
  • Design Palette: the panel on the right-hand side which displays all design options for the elements that comprise your visualization.

Expanded Visualization Vocabularies

ABR enables artists and designers to leverage their practices in the visualization space. This capability includes expanding the visual vocabulary of scientific visualization—redefining the visual components used in data representations in a shift toward human- and nature-made glyphs, textures, lines and colors. This shift shortens the distance between data and the natural phenomena they represent and opens new possibilities for visually distinguishing and communicating intra-variate dynamics in complex visualizations.

Hand-drawn and painted lines and line-components in the center of this image are applied to visualized Antarctic data, generated as data-mapped streamlines in ABR. The final visualizations can be seen on the far left and right of the image above.
Here, hand-sculpted glyphs create a wide variety of both shape and texture (center), which can be imported as data-mapped objects into ABR and used in complex, multivariate visualizations, such as those shown in the left and right images above.
By drawing color from natural imagery using ColorLoom, we can more effectively connect environmental data with the physical phenomena it represents, creating Affective visualizations that are intuitive and easy to parse. Here, the leftmost image shows an iPhone photo taken of the New Mexico landscape. The central image shows a palette of colors taken directly from the New Mexico landscape image. The rightmost image shows a visualization of Southern Ocean data using these colors.

ABR Libraries

The ABR library catalogues glyphs, lines, colormaps, and textures created by Francesca Samsel, professional artist and co-PI of the Sculpting Vis Collaborative. Each of these assets is usable in the Artifact-Based Rendering program. Click here to access the online library of vis assets.

Applets

Infinite Line

Hand-drawn and painted lines and line-components used to generate data-mapped streamlines in ABR.

Infinite Line brings the physical artistic process into the visualization generation pipeline by allowing a user to sketch a line segment, upload an image of the sketch, and turn that sketch into a continuous, unbroken, patterned streamline. The output file can be dragged directly into ABR for immediate use.

Glyph Aligner

A wide variety of both shape and texture in hand-made objects, which are then imported into ABR and mapped to data

Glyph Aligner like Infinite Line, connects the physical artistic process with the digital. When an artist creates a three-dimensional object, such as a small clay sculpture, they can 3D scan this object and drag it into Glyph Aligner. Glyph Aligner allows users to give this 3D scan a directional quality. The output file can be dragged directly into ABR for immediate use as a glyph.

ColorLoom

By drawing color from nature / natural imagery, using ColorLoom, we can more effectively connect environmental data with the physical phenomena it represents, creating Affective visualizations that are intuitive and easy to parse.

ColorLoom allows a user to generate custom colormaps with hues automatically pulled from imported images. This applet gives users looking to design a custom colormap a dynamic starting point, and allows them to pull hues from imagery directly related to the dataset they are visualizing.

Texture Mapper

Texture Mapper shortens the space between the texture of the physical and digital worlds. A user may simply take a photo of any surface and upload that photo to texture mapper. The program automatically extracts the texture of the photo and produces a file output that can be dragged directly into ABR for immediate use as a texture for data surfaces in a visualization.

Publications

Affective Palettes

BibTeX Citation

Affective Palettes for Scientific Visualization: Grounding Environmental Data in the Natural World
Samsel, Francesca and Abram, Greg and Zeller, Stephanie and Keefe, Daniel (2021). 2021 IEEE VIS Arts Program (VISAP) (20-34)

(cite)

Antarctic_Water_Masses

BibTeX Citation

Antarctic Water Masses and Ice Shelves: Visualizing the Physics
Abram, Greg and Samsel, Francesca and Petersen, Mark R. and Asay-Davis, Xylar and Comeau, Darin and Price, Stephen F. and Potel, Mike (2021). IEEE Computer Graphics and Applications vol. 41 no. 1 (35–41)

(cite)

FromHumanHands

BibTeX Citation

From Human Hands
Singh, Gary (2021). IEEE Computer Graphics and Applications vol. 41 no. 1 (5-7)

(cite)

EnviroVis

BibTeX Citation

Environmental Visualization: Moving Beyond the Rainbows
Zeller, Stephanie and Samsel, Francesca and Nav\'{a}rtil, Paul (2020). Practice and Experience in Advanced Research Computing (321–326)

(cite)

HumanFingerprints

BibTeX Citation

Poster: Human Fingerprints and Artistic Vocabulary; Rendering Data, Creating Engagement, Connection and Context to Earth System Models
Francesca Samsel, Daniel Keefe, Bridger Herman, Greg Abram (2020). Poster at AGU'20

(cite)

PrintmakingPuzzles

BibTeX Citation

Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations
Herman, Bridger and Samsel, Francesca and Bares, Annie and Johnson, Seth and Abram, Greg and Keefe, Daniel F. (2020). 2020 IEEE VIS Arts Program (VISAP) (19-28)

(cite)

SethDiss

BibTeX Citation

Palpable Visualizations: Techniques for Creatively Designing Discernible and Accessible Visualizations Grounded in the Physical World
Johnson,Seth A. (2020). ProQuest Dissertations and Theses (217)

(cite)

VisIceSheets

BibTeX Citation

Scientific Visualization of Antarctica Ice Sheet and Southern Ocean Evolution
J. Patchett, F. Samsel, K. Rigel, G. Abram, N. Woods, D. Lipsa, M. Hoffman, S. Price, M. Petersen, T. Zhang, X. Asay- Davis (2020).

(cite)

AutoGenLegend

BibTeX Citation

Poster: Automatic Generation of Data Legends for 3D Multi-Variate Artist Driven Visualizations
Weissman, Claire and Herman, Bridger and Zeller, Stephanie and Samsel, Francesca and Keefe, Daniel F (2020). IEEE Visualization

(cite)

ABR

BibTeX Citation

Artifact-Based Rendering: Harnessing Natural and Traditional Visual Media for More Expressive and Engaging 3D Visualizations
Seth Johnson and Francesca Samsel and Gregory Abram and Daniel Olson and Andrew J. Solis and Bridger Herman and Phillip J. Wolfram and Christophe Lenglet and Daniel F. Keefe (2019). IEEE Transactions on Visualization and Computer Graphics

(cite)

Art, Affect, Color

BibTeX Citation

Art, Affect and Color: Creating Engaging Expressive Scientific Visualization
Samsel, Francesca and Bartram, Lyn and Bares, Annie (2018). 2018 IEEE VIS Arts Program (VISAP) (1-9)

(cite)

EnrichVocab

BibTeX Citation

Enriching Vocabulary via the Human Hand
Francesca Samsel and Annie Bares and Seth Johnson and Daniel F. Keefe (2019).

(cite)

HumanitiesInLoop

BibTeX Citation

Using Close Reading as a Method for Evaluating Visualizations
Bares, Annie and Zeller, Stephanie and Jackson, Cullen and Keefe, Daniel and Samsel, Francesca (2020). (29-37)

(cite)

Sculpting Visualizations © 2021