Replicability and Reproducibility in Geospatial Research: A SPARC Workshop

ASU's Spatial Analysis Research Center (SPARC) is very excited to host its first Replicability and Reproducibility Workshop, taking place at Arizona State University on February 11 and 12, 2019. Please see below for workshop information, including program of events, accommodation information and list of workshop participants.

About the workshop:

Replicability and reproducibility (R&R) have always been core requirements of scientific research. Recently, cases of failure to replicate previously published findings have received widespread public attention. As research grows more complex and increasingly reliant on data and software, concerns about replicability will grow rather than diminish. For example, different software packages may produce different results even when the same technique of spatial analysis is applied to the same data or analysis results cannot be reproduced by the same software due to the lack of proper metadata or provenance documenting the spatial processing and parameters used. Geospatial researchers may need to be especially concerned about replicability, such as when results from one geographic area fail to be replicated in other geographic areas.

This small and focused workshop will address the following questions and related issues:

What forms of failure to replicate exist in the geospatial sciences? Can a formal framework be devised?
In what areas of geospatial research is the danger of non-replicability most severe?
What mechanisms can be used to avoid or minimize the danger of such failures?
Do we expect the results of model calibrations to be constant over space and if not, what are the implications for spatial analysis?
How should R&R be incorporated into the design and implementation of future spatial software?
How should students be made aware of these issues?
What follow-on activities might draw greater attention to these issues?

Program of events

Sunday, February 10, 2019 - Arrival

6:00 p.m.Meet in the Tempe Mission Palms Hotel lobby to head for informal drinks and dinner

Monday, February 11, 2019

7:40 a.m.Meet in the lobby of Tempe Mission Palms Hotel to walk to ASU's Memorial Union
8:00 a.m.Breakfast
9:00 a.m.Welcome and Introductions, featuring Trisalyn Nelson and Mike Goodchild
9:45 a.m.Presentation #1, featuring Daniel Nüst from the University of Münster
10:30 a.m.Break
11:00 a.m. Presentation #2, featuring Peter Kedron from Arizona State University
11:45 a.m. Plenary discussion
12:30 p.m. Lunch and remarks from Elizabeth Wentz, dean of social sciences at Arizona State University
1:30 p.m. Lightning talks
3:00 p.m. Break
3:30 p.m. Small group discussions
4:15 p.m.

Reports from small groups

6:00 p.m.

Reception and dinner at Tempe Mission Palms Hotel, Abbey Patio

Tuesday, February 12, 2019

7:40 a.m.Meet in the lobby of Tempe Mission Palms Hotel to walk to ASU's Memorial Union
8:00 a.m.Breakfast
9:00 a.m.Presentation #3, featuring Dan Sui from the University of Arkansas
9:45 a.m.

Presentation #4, featuring Kevin Butler and Dawn Wright from ESRI

10:30 a.m.Break
11:00 a.m.Wrap-up, featuring Stewart Fotheringham from Arizona State University
11:30 a.m.Annals discussion, featuring Ling Bian from SUNY Buffalo
11:45 a.m.Discussion
12:30 p.m.Lunch
1:30 p.m.Depart ASU for Tempe Mission Palms Hotel
2:15 p.m.Depart for hike on Sunrise Trail in Fountain Hills
6:00 p.m.Dinner at TBD
8:30 p.m.Return to Tempe Mission Palms Hotel

 

Participants

Vanessa Bastos, Arizona State University

Ling Bian, The University at Buffalo

Kevin Butler, Esri

Dylan Connor, Arizona State University

Mark Gahegan, University of Auckland

Song Gao, University of Wisconsin Madison

Mike Goodchild, Arizona State University and UC Santa Barbara

Stewart Fotheringham, Arizona State University

Amy Frazier, Arizona State University

Yingjie Hu, The University at Buffalo

Bandana Kar, Oak Ridge National Laboratory

Peter Kedron, Arizona State University

Mike Kuby, Arizona State University

Wenwen Li, Arizona State University

Alan Murray, University of California Santa Barbara

Soe Myint, Arizona State University

Trisalyn Nelson, Arizona State University

Daniel Nüst, University of Münster

Vaclav Petras, North Carolina State University

Nathan Piekielek, Pennsylvania State University

Alex Sorokine, Oak Ridge National Laboratory

Daniel Sui, University of Arkansas

Daoqin Tong, Arizona State University

Matthew Toro, Arizona State University

Jason Tullis, University of Arkansas

Shaowen Wang, University of Illinois at Urbana-Champaign

Elizabeth Wentz, Arizona State University

John Wilson, University of Southern California

Dawn Wright, Esri

 

Organizing committee

The R&R Workshop is possible thanks to the hard work of the organizing committee, including: Mike Goodchild, Arizona State University and UC Santa Barbara; Stewart Fotheringham, Arizona State University; Wenwen Li, Arizona State University; and Peter Kedron, Arizona State University. Logistical planning for the workshop was made possible thanks to the work of Nick Ray, assistant director of operations to the School of Geographical Sciences and Urban Planning and executive assistant to the Spatial Analysis Research Center.

Accommodations

Participants of the R&R Workshop will be staying at Tempe Mission Palms, conveniently located near Mill Avenue – the heart of Tempe and a short walk from Arizona State University's Tempe campus.

Hotel website
Shuttle information
Hotel map

Around town

While you are in town, be sure to take advantage of what the area has to offer. Tempe is home to great restaurants, shopping and hiking – something to fit everyone's style.

Things to do in Tempe

Arizona State University

The R&R Workshop will be taking place in the university's Memorial Union in the Alumni Room (located on the 2nd floor, above the Starbucks).

Interactive map of the ASU campus

Map of the Memorial Union