Launch of Towards a National Collection discovery projects

£14.5m awarded to transform online exploration of UK’s culture and heritage collections through harnessing innovative AI

The Arts and Humanities Research Council (AHRC) has awarded £14.5m to the research and development of emerging technologies, including machine learning and citizen-led archiving, in order to connect the UK’s cultural artefacts and historical archives in new and transformative ways.

Image by Colin McDowall, courtesy of Towards a National Collection. (Young woman winding bobbins on wheel in the loom shop, 1898 Blanket factory, Witney, Oxfordshire © Historic England Archive CC73_00946 | Indian laundry couple with the man ironing clothes. Attributed to a painter from Tanjore (Thanjavur), ca. 1840. Gouache drawing. 32247i © Wellcome Collection | Sir Hans Sloane (1660–1753) Stephen Slaughter (1697–1765) (attributed to) © The Trustees of the Natural History Museum, London | A starboard bow view of the three-masted barque Glenbervie (1866) with crowds of people, on the rocks at Lowland Point. G14146. © National Maritime Museum, Greenwich, London, Gibson’s of Scilly Shipwreck Collection | Artwork by Peter Morphew illustrating the repositories of the University of Glasgow Archives and Special Collections.)

The Archives Hub is pleased to announce that we will be a project partner in one of five major projects being launched today. The projects form the largest investment of Towards a National Collection, a five-year research programme. Today’s launch reveals the first insights into how thousands of disparate collections could be explored by public audiences and academic researchers in the future.

The five ‘Discovery Projects’ will harness the potential of new technology to dissolve barriers between collections – opening up public access and facilitating research across a range of sources and stories held in different physical locations. One of the central aims is to empower and diversify audiences by involving them in the research and creating new ways for them to access and interact with collections. In addition to innovative online access, the projects will generate artist commissions, community fellowships, computer simulations, and travelling exhibitions. The projects are:

● The Congruence Engine: Digital Tools for New Collections-Based Industrial Histories

● Our Heritage, Our Stories: Linking and searching community-generated digital content to develop the people’s national collection

● Transforming Collections: Reimagining Art, Nation and Heritage

● The Sloane Lab: Looking back to build future shared collections

● Unpath’d Waters: Marine and Maritime Collections in the UK

The investigation is the largest of its kind to be undertaken to date, anywhere in the world. It extends across the UK, involving 15 universities and 63 heritage collections and institutions of different scales, with over 120 individual researchers and collaborators.

Together, the Discovery Projects represent a vital step in the UK’s ambition to maintain leadership in cross-disciplinary research, both between different humanities disciplines and between the humanities and other fields. Towards a National Collection will set a global standard for other countries building their own collections, enhancing collaboration between the UK’s renowned heritage and national collections worldwide.

Archives Hub and the Transforming Collections: Reimagining Art, Nation and Heritage project

Donald Locke 1972-4, Trophies of Empire © Estate of Donald Locke Courtesy of Tate | Claudette Johnson, Figure in Blue, 2018. © Claudette Johnson. Image Credit: Arts Council Collection, Southbank Centre | Iniva_Rivington Place: Photograph by Carlos Jimenez, 2018 | Rachel Jones, lick your teeth, they so clutch, 2021. Arts Council Collection, Southbank Centre, London © the artist.
Donald Locke 1972-4, Trophies of Empire © Estate of Donald Locke Courtesy of Tate | Claudette Johnson, Figure in Blue, 2018. © Claudette Johnson. Image Credit: Arts Council Collection, Southbank Centre | Iniva_Rivington Place: Photograph by Carlos Jimenez, 2018 | Rachel Jones, lick your teeth, they so clutch, 2021. Arts Council Collection, Southbank Centre, London © the artist. Image courtesy of the artist and Thaddaeus Ropac, London.

The Archives Hub at Jisc will be working with fellow project partners:

susan pui san lok, 2021
susan pui san lok, 2021: Courtesy the artist
  • Tate
  • Arts Council Collection
  • Art Fund
  • Art UK
  • Birmingham Museums Trust
  • British Council Collection
  • Contemporary Art Society
  • Glasgow Museums
  • Iniva (Institute of International Visual Art)
  • Manchester Art Gallery
  • Middlesbrough Institute of Modern Art
  • National Museums Liverpool
  • Van Abbemuseum (NL)
  • Wellcome Collection

The Principal investigator for Transforming Collections: Reimagining Art, Nation and Heritage project is Professor susan pui san lok, University of the Arts London.

More than twenty years after Stuart Hall posed the question, ‘Whose heritage?’, Hall’s call for the critical transformation and reimagining of heritage and nation remains as urgent as ever. This project is driven by the provocation that a national collection cannot be imagined without addressing structural inequalities in the arts, engaging debates around contested heritage, and revealing contentious histories imbued in objects.

An arrangement of different castes including snake charmer, brick-layer, basket-maker, potter and wives. Gouache drawing. 28438i © Wellcome Collection.

Transforming Collections aims to enable cross-search of collections, surface patterns of bias, uncover hidden connections, and open up new interpretative frames and ‘potential histories’ (Azoulay, 2019) of art, nation and heritage. It will combine critical art historical and museological research with participatory machine learning design, and embed creative activations of interactive machine learning in the form of artist commissions.

Untitled 1986 1987.21, Manchester Art Gallery © Keith Piper.

Among the aims of this project are to surface suppressed histories, amplify marginalized voices, and re-evaluate artists and artworks ignored or side-lined by dominant narratives; and to begin to imagine a distributed yet connected evolving ‘national collection’ that builds on and enriches existing knowledge, with multiple and multivocal narratives.

The role of the Archives Hub will centre around:

  • Disseminating project aims, developments and outcomes to our contributors, through our communication channels and our cataloguing workshops, to encourage a wide range of archives to engage with these issues.
Glasgow Women’s Library, Museum of the Year finalist, 2018. Art Map 2019. © Marc Atkins / Art Fund 2018
  • Working with the Creative Computing Institute, at the University of the Arts London, to integrate the Machine Learning (ML) processing into the Archives Hub data processing workflows, so that it can benefit for over 350 institutions, including public art institutions.
Mick Grierson, Exploring the Daphne Oram Collection using 3D visualisation and machine learning (screenshot). 2012. Mick Grierson, Parag MitalLondon © the artist.
  • Providing expertise from over 20 years of running an archival aggregator and working with a whole range of UK archive repositories, particularly around sustainability and the challenges of working with archival metadata.

International archival standards: living in perfect harmony?

The International Council on Archives Committee on Best Practices and Standards met recently to look at the four ICA descriptive standards: ISAD(G), ISAAR(CPF), ISDF and ISDIAH. It was agreed at this meeting to delay a full review that might lead to more substantial changes and to concentrate on looking at harmonization.
On the Hub we use ISAD(G), which has become very widely recognised and used. ISAAR(CPF) is something that would be important if we started to think about implementing EAC-CPF, enabling our contributors to create authority records for creators of archives. We think that this is the sort of development that should have cross-sectoral agreement, and we are actively involved in the UK Archives Discovery Network (UKAD), which provides a means for us to discuss these sorts of issues across the archives community in the UK.
As far as the International Description for Descriptive Function (ISDF) is concencerned, I feel that a great deal more work is needed to help archivists understand how this can be practically implemented. Our new EAD Editor does allow contributors to add functions to their descriptions, but this is just using the EAD tag for functions. To me, the whole issue of functions and activities is problematic because I am looking at it from the perspective of aggregation. It is all very well for one institution to define their own functions and activities, but how does this translate into the wider environment? How do we successfully enable researchers to access archives by searching functions and activities across diverse institutions?
I have not really given any thought at all to the International Standard Description for Institutions with Archival Holdings (ISDIAH) other than to basically familiarise myself with the standard. For us, the unique code that identifies the institution and the institution’s name is all that we require within our descritions. We link to the Archon details for the institution, and maybe it is in the Archon directory of UK archives, that ISDIAH should be implemented? I am not sure that it would be appropriate to hold detailed information about individual institutions on the Hub.
I will be interested to see what the outcomes of the Committee’s work are. I wonder whether we need a greater understanding of the standards themselves before we try to understand how they work together? Maybe adopting more consistent terminology and providing a conceptual framework will help archivists to appreciate what the standards are trying to achieve and encourage more use, but I am doubtful. I think that a few training days: ‘Understanding the ICA Descriptive Standards’ wouldn’t go amiss for many archivists, who may have only recently adopted ISAD(G), let alone thought about the implications of the other standards.
In the appendices to the minutes, there are some interesting points of discussion. Even some of the assumptions seem to be based on a greater understanding of the standards than most archivists have. For example, ‘if you use ISAD(G) in conjuction with ISAAR, the Admin/Biog history element of ISAD(G) becomes useless because the description of the record creator is managed by ISAAR’. Well, yes, but I’m not sure that this is so clear cut in practice. It makes sense, of course, but how do we relate that to all the descriptions we now have? Also, ‘ISAAR can be used to structure the information contained in the Admin/Biog history element of ISAD(G)’ – that makes sense, but I know of no practical examples that show archivists are doing this.
I wonder if we really need to help archivists to understand the standards – what they are, what they do, how they work, how they can benefit resource discovery – before we throw a conceptual framework at them. At the same time, I increasingly feel that ISAD(G) is not relevant to the modern environment and therefore I think there is a pressing need to review ISAD(G) before looking at how it relates to other standards.

Democratising context?


As I reported in a previous blog, the Archives 2.0 conference threw up and tossed about a whole host of issues. Geoffrey Yeo from University College London talked about archival description and how this might need to change, and he made me start to think about what we mean when we talk about the context of an archive collection.

As an archive student I was taught about the vital importance of the archival context. This is seen as providing important evidence for users of the archive, enabling them to place the materials within the context of their creation. The context gives the material meaning. We generally catalogue from the collection level down to the item level, and we tend to impose this route on our users – our websites often compel them to go to the collection and drill down to find specific items.

The Archives Hub generally takes this approach: an initial search results in a hit list of collection level descriptions. Advanced searches by default include both collection and lower level descriptions. We are very aware of the advantages of taking users to individual item descriptions, especially now that we are planning to add images and links to content. It would be great to add images to individual descriptions. One of the challenges is to present the user with collection and item-level descriptions in such as way that they understand the principle of the archival description – from the general down to the specific.

At the Archives 2.0 Conference, Jon Newman talked about the MLA London Revisiting Archive Collections project. Having struggled to find anything useful about the project on the MLA London Website, I’ll just refer to a previous Hub Blog post to describe it: “Focus groups of diverse groups of people, generally unfamiliar with archives, were set up in three different London institutions. They were asked to look at and provide feedback on specially selected archives that were chosen because they might resonate with the groups, having relevance to their lives and experiences. For example, a Tanzanian women’s group was commenting on photographs and manuscripts relating to Tanzania and a group of cleaners and security staff, many of west African origin, were looking at Somalian and Nigerian material.”

Jon gave some examples of how participants gave different contexts to images by providing additional information about them. For example, a participant commented on a photograph of two women from a Nigerian tribe. She was originally from a neighbouring tribe and remembered details about clothing and how the tribes had a tradition of gently mocking eachother.

This project essentially broke away from the archival context to create other contexts for the archives. It showed how they can have different meanings to different people, depending upon their perspective, and gave the archives new contexts that other researchers could benefit from.

My feeling is that the archival profession is moving from a situation in which we very much saw archival context as THE context to a position where we are starting to appreciate and encourage other contexts. I wonder whether we will start to accept that all contexts are, or can be seen as, equally important, or are some more important than others?

I am sure that we don’t want to neglect the archival context because once gone, it is almost impossible to recover, and valuable evidence that can aid interpretation is lost. But maybe we should be less inclined to make the archival context primary and actually think in terms of flexible access to archives through descriptions that give equal weight to the individual item, the various contexts within which that item might be seen, and the evidential value of the item as part of a whole collection?

Whilst thinking about this whole issue, I couldn’t help but reflect that there is an increasing tendency to display isolated ‘treasures’ on the Web, and actually neglect context altogether. Many websites, it seems to me, get funding to create an attractive interface to display images, but give little attention to metadata, connections, contexts and sustainability.

So, are we moving towards a myriad of contexts, or are we in danger of losing context altogether?

Image of salt: From Flickr courtesy of kevindooley’s photostream

Its a matter of research

I’ve just been reading an article by Elizabeth Shepherd in the December 2008 ARC magazine, asking whether research matters within archives and records management. The ‘anti-intellectualism’ that Terry Cook refers to is something that I can recognise, not least because I was that way inclined as a younger archivist. I remember wanting the MA course to give me the practical skills necessary to become an archivist, and wanting to get on with the real hands-on stuff of collecting, appraising, cataloguing and preserving, once I started work. It seemed to me at the time that this was what was important – ‘its all very well theorising, but you need to get on and do it’ kind of attitude. It took me quite a few years to realise that this was a misplaced notion. It seems obvious to me now that you need to ask yourself ‘why’ you are doing something as a fundamental part of the process.

To take EAD as an example, when I talk to students about using EAD, I think that what is most important is to impress upon them why they might use it – why it is of benefit, and, indeed, what its shortcomings might be. The ‘why’ needs to come before the ‘how’. It is so important to have a firm understanding, which helps to facilitate the proper evaluation and application of a standard. The idea of just going ahead and doing something because its always been done, or because most people are doing it, just seems anathema to me now.

I absolutely agree with Elizabeth that we have to think in terms of working on the mindset of the archivist or records manager. This is something I’ve written about in a chapter for a recent book, What Are Archives? Cultural and Theoretical Perspectives: A Reader. In terms of issues like data structure, format, cataloguing, and dissemination, archivists and records managers need to understand the benefits and the wider implications of the various options available. It seems hardly worth saying that archivists should think about sustainability and think long-term (although clearly this is not always easy). We need to be open to the possibilities of new technologies and see them as exciting opportunities – which is not to say that we should adopt them simply because they are new and novel – but sticking with old methods and ways of thinking in a fast changing world may leave us disengaged, and separated from our stakeholders and users.

Whilst the Archives Hub has a very practical raison d’etre, we do also involve ourselves in research, and this is essential when you are looking to harness new technologies for the benefit of effective cross-searching and dissemination of information. Whilst we are, I am sure, as guilty as many people, of introducing the odd feature without proper critical thought about why, about the wider implications, about things like sustainability and future planning, we generally do endeavour to operate on a sound theoretical basis.

I think that it would be worth services, like the Archives Hub, thinking about working more closely with researchers on topics like the evaluation of online services, the changing patterns of user behaviour, the benefits of a National Archives Network, the use of EAD…there are many options, but all of them would be of benefit in helping us to gain a greater sense of WHY.

Thoughts on context and bias

The importance of context is always emphasised when thinking about how to present archives to researchers. At a recent seminar series I attended in the beautiful town of Lewes, East Sussex (pictured), Mike Savage of the University of Manchester talked about a well-known social survey by Elizabeth Bott, carried out in the 1950s, where 32 couples were interviewed about their relationships. Much of the contextual material was left out of the resultant book, so it was effectively stripped away from the findings. But closer analysis of the survey shows that the selection of the couples themselves was significant – the notes (unpublished) reveal why people volunteered for the study. There was quite a long process of application and most people who ended up taking part had interest in the research as a social activity. This is an important piece of the whole picture and would have had an effect on the findings. The research process itself is an important part of the whole picture.

Social scientists need to find methods to extract key findings from diverse archive sources, often covering long periods. Mike referred to the need to avoid the ‘juicy quotes syndrome’ and talked in detail about sampling methods, all of which have their pros and cons. He referred, for example, to ‘trend analysis’, which strips out the contextual detail (e.g. economic indicators, studies of changing attitudes). Processes and methods get forgotten about.

Archived qualitative data does not allow this abstraction from context and hence cannot deploy representative or aggregate findings. In this sense, qualitative data may have something to teach the social scientist in terms of the importance of context.

Archivists need to think carefully about the whole picture: what they are presenting to users and what they are leaving out. The whole question of subjectivity is a complex one. The social scientist must build the biases of inquiry into their analysis of qualitative data, and this distinguishes it from quantitative data. There is a need to develop clear analytical strategies to allow rigorous yet partial examination of such data – it is important not to give a false sense of the completeness of the data.

At the seminar, there was a great deal of discussion about methodology, the bias of the archive and the life of the archive itself. A particularly interesting talk from Carolyn Hamilton of the University of Cape Town referred to ways of using archival sources to study pre-colonial South Africa. The colonial archive is itself an expression of the power and dominance of the ruling elite – so what can it meaningfully say about the indigenous population? It is profoundly contaminated as evidence, and yet by the very act of proclaiming their dominance, the rulers shed light on those they claim the right to rule. In fact, the colonial archive brims with material germane to the pre-colonial past, but it is important to think about how to approach it and analyse it. Historians tend to study the archive ‘against the grain’ in order to mine it against its basic bias.

A similar situation of bias, although in a very different context, occurs with a community ‘archive’ website such as MyBrightonAndHove: www.mybrightonandhove.org.uk. Jack Latimer of QueenSpark Books talked about how this Website has become a very successful community website where people post images, stories and comments about their local community and history. It is very active, with around 1,300 visits per day and around 10-20 comments put up per day. But of course, this is also a skewed history – maybe a history that is born out of nostalgia, and obviously a self-selecting group of people.

John Hay, of the University of Wolverhampton, gave us a very engaging presentation about archives relating to deaf people and deaf culture. One thing that struck me was his wish to have an archive that represents the achievements of deaf people within society – here we come to another sort of bias. This does, of course, sound like a very worthwhile idea, especially, as John explained, when you consider how the deaf have been treated in the past, pretty much as second class citizens and victims of an affliction. But it does raise the question of whether an archive should have a goal of celebration or creating a certain image. Should it actually seek to gather any and all materials and artefacts that reflect the history of deaf people in the UK? Or is it perfectly valid to want to create something that is intended to be positive and affirming?

Archives may be a result of discourses and may in turn mould discourses, which in turn may give shape to practices that shape the archive. This, as Ann Cvetkovich of the University of Texas postulated, could be thought of as the public life of archive. If we accept that the archive has public life, then maybe it requires methodologically its own biography. The Archive acquires a provenance, is a part of the history of institution housing it. The Archive itself could be seen as a biographical subject.


Use of archives by social scientists

I have just attended two seminars as part of a project on Archiving and Reusing Qualitative Data: Theory, Methods and Ethics Across Disciplines. They provided a great deal of food for thought, as seminars like this so often do. These seminars were particularly valuable because they drew together academics, particularly social scientists and archivists. Many of the participants were oral historians, and the challenges of oral history ran through many of the talks.

When archivists think about archival theory and description, they are generally thinking about archives as materials ‘created by an individual or organisation in the course of their life or work and considered worthy of permanent preservation’ (my quotes, to indicate that this is a classic definition of archives). But if we think about archives as any records considered worthy of preservation and with value for future researchers, then we can expand the definition to include records that social scientists refer to as archives. For them, archives are often data sets, created by researchers in the course of their research and then, possibly, reused.

Social scientists do not necessarily think in terms of business records or personal letters, or archives as a reflection of personal or organisational activity. They think in terms of longitudinal studies and oral histories; quantitative and qualitative data. These are archives that generally are created for the purposes of research, and so the perspective is rather different to those created in the course of individual or organisational activity. We have the UK Data Archive which has ‘the largest collection of digital data in the social sciences and humanities in the UK’, and this houses the History Data Service which ‘promotes the use of digital resources, which result from or support historical research, learning and teaching’, but I don’t think that there is a general sense amongst archivists that these are part of the archive community, in the sense that trainee archivists don’t really think about working for a data archive, and arhcival theory doesn’t appear to really encompass this type of archive. Certainly social scientists clearly see archives as both data archives (data sets) and traditional archives (archives as reflections of past activity), and the fact that the two were not explicitly distinguished during the seminars was striking in itself.

It may be that data archives require different ways of thinking to ‘historical archives’, in terms of how they are organised and managed, but now that archives are increasingly digital, and as all archives are a valuable source for research, surely there is sense in the two communities moving closer together?