Tag Archives: Data

“Doing Data”: Methodography in and of STS

How does STS ethnography meet what it researches? Not prescriptive methodology – we were interested in methodography, describing and problematising how methods shape data. 2018 saw three research events that focused on data infrastructures and practices in participant observation and in collaborating with other actants in & around the field. With this focus, we turned back and looked at our own research practices. This meant exploring what kind of performative relations arise between STS and our topics of research and how these relations were materially and otherwise shaped.

Amidst today’s conversations about what data (big or small) might be, or could do, a reflexive moment has arisen within STS. Whilst STS scholars have been foundationally studying research practices – data handling and processing, translations, semiotic and material practices, epistemic and ontological shifts – these have been almost exclusively in fields of scholarship outside of STS. We have studied knowledge practices across the sciences, in spaces of engineering, technology, from laboratories to fields, governance practices to evidence regimes. But what happens when we turn back and look at our own research practices? In the take-up of ethnography within STS, what kind of performative relations arise between STS and its topics of research? 

The Spring and Summer of 2018 saw three interrelated research events on these questions. They took form as a series of conversations in Berlin and Lancaster, organised by Ingmar Lippert, Rachel Douglas-Jones, Tahani Nadim, Jörg Niewöhner as well as Julie Sascia Mewes (and supported by Göde Both).[1]

 

Fig 1: Workshop introduction (left: John Law; center: Ingmar Lippert)
Source: Ildikó Plájás

Critique of method is not without precedence, and a series of important moments from different eras informed our discussions. In 1975, Paul Feyerabend wrote Against Method, setting the tone for the questioning to come. His rallying cry opposed the strict constraints that methods can impose, which Feyerabend considered weakening epistemological openness. Down the decades, John Law’s 2004 After Method speculated on the practices of analysis and writing in the wake of methods deconstruction, questioning stereotypical UK social science methods training. Inventive Methods by Lury and Wakeford (2012) is an inheritor to these questions, turning to specific devices in the doing of epistemic work. Their range of method devices ran from tape recorders to the conceptual work of “configuration”, elaborated by Lucy Suchman. Even though these texts were very much about the relation between methods and the making of worlds, the collection did not focus on narratives of how certain kinds of method assemblages, used in specific places at specific times, produced researchers’ own particular accounts.

The term methodography arises in the work of STS ethnomethodologists Christian Greiffenhagen, Michael Mair and Wes Sharrock (2011) which contemplates the difference between methodologies that are prescriptive and studies that allow for the problematisation of qualitative research method within the account given. At that point, STS and its methods did not arise as an empirical field for their questions – something that arose as a point of discussion at the EASST/4S Roundtable ‘Does STS have problems?’, organised by Noortje Marres and Endre Dányi in 2016[2] . Yet typically texts that question STS methods waver between a prescriptive-normative take and a descriptive problematisation (e.g. Hyysalo, Pollock and Williams, forthcoming; Lippert 2014). 

Focussing on descriptive problematisation of STS methods-in-action, Lippert and Verran’s (2018) special issue in the EASST Journal Science & Technologies Studies highlights how different modalities of performing an analytics produce different accounts. Such contemporary scholarship increasingly calls for more detailed engagement with how STS researchers do and interpret specific methods, research designs and analytics. 

Answering this call, the three events of 2018 wove conversations across twenty authors, six commenting contributors, a roundtable with five scholars, [3] a keynote by John Law and a writing methodography session chaired by Rachel Douglas-Jones and Estrid Sørensen.

 

Fig 2: Lively discussion within Humboldt University STS Lab’s meeting space
Source: Alexandra Endaltseva

Devices and Collaborations

Papers at these events ranged vastly in terms of their empirical focus. From archives to borders, policing to residential care, Internet of Things device use at home to public environmental agencies, call centers to tourism, the contributions all attended to how methods shaped the STS analyst’s epistemic practices.

Themes that arose in discussion were those that discussions of ethnography often produce: the responsibilities of researchers, anxieties about interventions, the work of description, and the politics of collaboration. But in the ‘graphic’ component of methodography, participants sought not introspective accounts of method but extrospective ones, resulting in ethnographic accounts of what researchers actually do in the field. Method came to be a defamiliarization technique, allowing for (amongst other things) attention to performativity and materiality.

Inspired by Farías (2016), and by the EASST2018 theme of meetings, collaboration arose as a focusing term. It was also a contested term. In research, researcher and researched meet, and participants were encouraged to consider meetings of humans and nonhumans, their concerns, voices, material or immaterial presences or absences. In research, devices are met and employed, though these might be unruly, too. Discussion ranged from the implied positivity of collaboration (“do-gooder consensuality”) versus its potential to allow friction within forms of collective that do not need or presume “common ground”. We discussed differing degrees of togetherness, with other researchers and those participating in the field, including those with whom we might write.

Several papers highlighted the configuration and shaping of roles in the network of socio-material relations between researcher, artefacts, devices, human interlocutors. This resonated well with method devices, found in Lury and Wakeford’s book, which include invitations to engage material, tangible entities like photo-images, cameras, lists, screens but also categories, research protocols and modes of relating. In discussions, participants speculated that STS, which has honed its attention on the politics of classification, categories and ordering, may need to think differently about the ethnographic openness, embodied learning, and knowledges of others that are brought together in moments of analysis. Several papers found spaces to describe the openness they had sought through methods, whether in “pausing” (Melina Antonakaki) or in “experiment” (Ryanne Bleumink, Lisette Jong and Ildikó Plájás), as students set the knowledge practices that they were studying against the knowledge practices they were using in their analyses. 

Material devices were also foregrounded to tell and explicate methodography. Stefan Laube, for example, turned to clothing and costumes as participants in material practices that configured his ethnographic presence. A range of papers engaged with how rooms and scapes took part in configuring epistemic work, such as the location of a cab (Alexandra Endaltseva), snowy landscape (Eva Kotaskova) or a room at a home (Christine Hine). The papers showed how materiality – in both the seemingly well controllable research devices like a shirt or a camera as well as the rooms and landscapes encountered or tactically employed – was taking on multiple roles, such as of affordance and of obstacle. 

Fig 3: Round of introductions between junior and senior STS researchers
Source: Ingmar Lippert

Those with a background in anthropology brought a range of references to the table, from explicit reflections in that discipline on how ethnographers produce knowledge, and the legacies of Writing Culture. However, participants agreed that it was worth considering the specifics of STS ethnographic practices, from the kinds of situations where researchers do their work, to those where they are in co-presence with those they study, while then producing material about it. Along these lines, John Law’s workshop keynote illustrated how being ethnographic about ethnography permits descriptions of research practices. He argued that what we do in the field interferes in field spaces, and working with others in the field allows us to attend to how different peoples’ sensibilities inform the making of the work that emerges. Using stories of fieldwork with Marianne Lien in Norwegian Salmon fisheries, Law’s paper highlighted his interest in ontological politics, the differences that are important to different people. Is it possible, he asked, to generate practices that are open to the possibility of going on well together in difference in particular contexts. Can we observe and write small stories, grounded in practices, that do not aim to bring differences ‘together’? Not resolve ‘away’ ontological divergences, but work with the power and limitation of words to make evident differences that may operate outside of language.   

The Berlin workshop closed with a practical writing activity called Writing Methodography, which involved writing and re-writing texts prepared for the workshop. The conveners, Douglas-Jones and Sørensen, acknowledged the challenge for junior scholars, whose initial writing task of bringing forth research and fieldwork, is reflexively compounded by the task of producing text that brings both the field and method’s research effects into being simultaneously. From discussions of what ethnographies of observation look like to close readings of section of ethnographic texts and a ‘walk and talk’ around Berlin’s Deutsche Dom, the workshop focused on what students had brought with them to the workshop. Post-walk exercises practiced the use of words in making worlds, holding the capacity to bring forward both field and methods together in description. 

A fascinating thread in the closing discussions questioned what a focus on writing about method in an analytically descriptive rather than prescriptive sense does for STS. Scholars contemplated the potential for greater accountability through explicitness (Nadim), or voiced the desire for greater formalisation of STS’s methods in a time of ‘alt’ facts and post-truths (Niewöhner). What it means to do ethnography in STS settings, and as reflexive STS scholars is not a topic that offers simple answers. It taps the basic questions that fascinate STS scholars – ‘how do we know’ and returns the ‘we’ to a disciplinary conversation.

Join the methodography conversation and exploration!

We invite public conversation on the theme via Twitter’s #STSethnography hashtag and we expect a Call for Papers in spring 2019 for a special issue on ‘Ethnographic data generation in STS collaboration’ in Science & Technology Studies. [4] This SI is going to zoom in on STS scholars who engage in collaborative research, as groups of STS scholars as well as in collaborations with colleagues in other fields or non-academics. So we invite contributions on how ethnographic data is generated and transformed for and in STS analysis across a range of such collaborative contexts. The SI aims to lead beyond reflexivity accounts of positionality in STS ethnography and to establish a benchmark for the STS ethnographic study of how ethnographic collaboration configures its data. Julie Sascia Mewes joins Ingmar Lippert as co-editor and we gladly contribute to strengthening the journal’s trajectory of exploring STS methods and analytical devices.

 

[1]    The conversations extended across a half-day workshop Speculative Instruments meet Ethnographic Data, hosted by Humboldt University’s Media & Digital Anthropology Lab (MeDiA Lab) on 12/4/18, continued with the workshop Participant Observation and Collaboration in STS Ethnography: Generating Methodographic Sensibilities for Science & Technology Studies at the same university’s Science and Technology Studies Lab (13-14/4/18) and became more public as an EASST2018 conference panel Methodography of data practices in STS’s ethnographic collaboration and participant observation (26/7/18). The first two events were financed by EASST, the Museum für Naturkunde Berlin and the IT University of Copenhagen’s ETHOS Lab and their Data as Relation project.

[2]    https://stsproblems.wordpress.com/

[3]    Including Charles Hahn, Sarah Inman, David Ribes, Stephen Slota, Andrew Hoffman, Cornelius Schubert, Judith Willkomm, Alexandra Endaltseva, Eva Kotaskova, Sofia Bento, Raquel Carvalheira, Catharina Lüder, Jonas Müller, Ryanne Bleumink, Lisette Jong, Ildikó Plájás, Leyla Safta-Zecheria, Stefan Laube, Christine Hine, Christoph Bareither, Hilde Thygesen and Tomás Criado.

[4]    See https://www.researchgate.net/project/Methodography-of-STS-ethnography for updates

 

References

Farías I (2016) A collaborative turn in STS?. EASST Review 35(1).

Feyerabend P (1975) Against Method. Brooklyn and London: Verso.

Greiffenhagen C, Mair M and Sharrock W (2011) From Methodology to Methodography: A Study of Qualitative and Quantitative Reasoning in Practice. Methodological Innovations Online 6(3):93-107.

Hyysalo S, Pollock N and Williams R (forthcoming) Method Matters in the Social Study of Technology: Investigating the Biographies of Artifacts and Practices.  Science & Technology Studies.

Law J (2004) After Method: Mess in Social Science Research. London: Routledge.

Lippert I (2014) Studying Reconfigurations of Discourse: Tracing the Stability and Materiality of ‘Sustainability/Carbon’. Journal for Discourse Studies 2(1): 32–54.

Lippert I and Verran H (2018) After Numbers? Innovations in Science and Technology Studies’ Analytics of Numbers and Numbering. Science & Technology Studies 31(4): 2–12. 

Lury C and Wakeford N (2012) Inventive methods: The Happening of the Social. London: Routledge. 

Towards data sharing in STS

Let me start this new edition of the EASST Review by thanking Ignacio for his superb work in leading its recent transformations, and making it such an exciting platform for information and exchange about the STS community in Europe and beyond, while also rejuvenating the outlook. As such, I did not hesitate for a second when he asked me to join the editorial board, and it is a pleasure to work with him and the others of the Review and EASST to generate ideas and topics for future publications. This edition features the PAST centre in Syberia, the feminist journal Catalyst, Latour’s Reset Modernity! exhibition, as well as two events partially funded by EASST. Many thanks to everyone contributing and we hope you will enjoy reading.

Building on Ignacio’s previous editorial that diagnosed a collaborative turn in STS, I would like to point at the important new development of data sharing in STS, which can also enhance the collaborative spirit of our field. Many STS scholars are studying transforming scientific practices around data collection, curation and preservation, and how these are changing scientific collaboration and data sharing, but we are just starting to think of the implications of this for our own research practice. How do we as STS colleagues share our data, not only with our close collaborators, but also within our field – with current colleagues and future generations of scholars – and beyond the borders of our own community, with stakeholders and various publics?

This topic has been on the agenda of the science and technology studies community for a while, especially since the US National Science Foundation now requires proposal applicants to include a data management plan. This resulted in a workshop in which colleagues from history, philosophy, and social studies of science and technology1 met last year at the National Science Foundation to discuss the opportunities and challenges of storing and sharing data in science and technology studies (involving two EASST members, Sally Wyatt and I). Workshop members reported on their work during the Denver 4S meeting and also discussed the need for a European discussion on this topic, in line with requests from various national councils and European funding bodies regarding data management and our own wishes as a community. However, as the European STS landscape and its funding sources are quite diverse, we will need to find ways to deal with national diversity, so national STS organization may also provide a role in forwarding these discussions, along with EASST.

What follows is a short summary of findings from the US National Science Foundation workshop2 to serve as a starting point for framing European discussions within this more global initiative on data sharing in STS.

The 4S/NSF Workshop participants identified four main benefits of data sharing for STS which are summarized as follows in the report:

 

The National Science Foundation Report on Data Sharing in Science and Technology Studies (2015). 

First, data sharing has the potential to transform the practice, substance, and scope of science and technology studies. This includes allowing scholars to ask broader research questions, conduct large-scale and cross-case comparisons, and create more rigorous and replicable methods, while also enabling the systematic accumulation of STS knowledge via analysis and synthesis of existing data. Such efforts may also enhance the value of STS data and scholarship for policymakers.

Second, data sharing has the potential to advance STS methodology and data curation practices. This includes improvement of measurement and data collection methods to ensure reuse and replicability, protection against faulty data, and archiving and making sustainable STS data rather than allowing them to decay and disappear at the end of a research project or professional career.

Third, data sharing has the potential to provide professional development opportunities. This includes new research training opportunities for advanced techniques for data sharing, synthesis, and reuse, and facilitating scholars’ abilities to meet granting requirements. New training programs may also help establish a cultural shift in STS whereby datasets, data preparation, and data sharing come to be valued as important scholarly products worthy of professional recognition.

Fourth, data sharing has the potential to make STS research more engaged, democratic, and practically relevant by making data and research findings available to scholars and citizens without access to funding and research materials.

 

We also discussed ways in which this cultural shift towards sharing can be stimulated, recognizing the value of data sharing while also safeguarding the diversity of data produced in different fields and specialties, and via different research methods. Most importantly, it seems necessary that different forms of data can have different levels of openness or access, with some data not being suited for actual sharing due to ethical considerations and anonymity. Moreover, and to promote a culture of data sharing within STS, the topic should become part of the agenda of workshops and projects in STS, as well as the training of (young) scholars. In this context, the development and sharing of example data management plans might also be helpful. In order to enable sharing efforts, alliances with publishers, libraries, archives, and museums can be useful to share expertise about data curation and management.

Last but not least, the topic of data sharing within STS is deeply embedded in existing discussions about open data that are taking place in our EASST community, and it is also quite visible in the 4S/EASST Barcelona programme. Tracks on ‘The Lives and Deaths of Data’, ‘Open science in practice’ and ‘Critical data studies’ will certainly be showing various ways in which we are already engaging with this topic, and can perhaps also provide opportunities to discuss these topics in relation to our own work and interests.