London Lives Pauper Examinations Data

Description

Textual data and documentation relating to approximately 28000 individuals in 10700 examinations, originally digitised as part of London Lives.

Background

London Lives 1690-1800: Crime, Poverty and Social Policy in the Metropolis is an online resource providing ‘a wide range of primary sources about eighteenth-century London, with a particular focus on plebeian Londoners’. It contains more than 240,000 manuscript and printed pages from eight London archives, including parochial Pauper Settlement, Vagrancy and Bastardy Examinations.

Individual parishes used examinations conducted by one or two Justices of the Peace for three distinct purposes:

  • to determine the settlement of an individual (a claim to a right of legal residence and relief in a parish)
  • to police bastardy, and as a basis for reclaiming the costs of supporting illegitimate children from the father
  • as a contribution to the wider county prosecution of vagrancy.

The vast majority of examinations concerned pauper settlements (and most bastardy examinations were of poor women, whose offspring were ‘likely to become chargeable’ to a parish), and so this project uses the more concise term pauper examinations even though it’s not technically accurate in all cases.

London Lives has two series of pauper examinations, from the parishes of St Botolph Aldgate and St Clement Danes. It also contains pauper and vagrant examinations in other series of records (particularly the Sessions Papers), but I have not (yet) attempted to extract these.

Methods and caveats

Essential background reading:

See also: Settlement - Bastardy - Vagrancy

The source data

51 XML files, part of the data for the searchable online resource at www.londonlives.org (v1.1, released April 2012). These files represent examinations from two parishes, St Botolph Aldgate (BA) and St Clement Danes (CD).

The material in London Lives was transcribed using a method known as double rekeying, in which two (non-academic) typists transcribe text, the two versions are compared and only where they differ does any further manual checking take place. It is not as accurate as traditional academic standards of transcription and proofreading, but unfortunately that is not a practical option for transcription of such large amounts of text. The accuracy rate for London Lives is approximately 98-99% (at character level), but it can vary considerably between documents.

The rekeyed texts were then marked up for searching, using a combination of automated and manual tagging, for various types of information: the names of people and places, occupations and dates. There is also structural markup for features such as text in margins, deleted, obscured or illegible text, text continuing across page breaks, and so on.

The markup did not, however, include information about document structures. File categorisation was based on the original document series’ archival organisation; there is no real structuring information between this type of generic classification and the single page.

Data collection

Locating examinations

The majority of pauper examinations consist of a single page in the original bound volumes - but not all of them. Some take up multiple pages; conversely some are very short and more than one examination (not necessarily related in any way) can appear on a single page. So, in order to group the subjects of each examination together accurately, the first task is to find both the beginning and end of every examination.

Fortunately, the examinations - as legal documents - followed some strict conventions, and most of the examinations were written by well-trained scribes using consistent spelling forms. There were, however a number of possible minor variants (and identifying the end of an examination could be slightly trickier than finding the starting point).

Opening examples:

  • Middlesex Richard Macguir Maketh oath That…
  • Middlesex ss Catherine Small the widow of William Small maketh Oath that…
  • Middlesex Margt Doleman Wido. of John Doleman who hath been dead upwards of three Years upon Oath saith…
  • Middlesex ss. The Examination of Sarah Mills of the Parish of Saint Botolph without Aldgate in the said County Singlewoman taken on Oath…
  • Middx & Westmr John Herbert aged about Thirty Nine years on his Oath says…

Characteristics:

  1. The majority of examinations begin with “Middlesex” or “Middlesex and Westminster” (or abbreviated forms). Following this:
  2. The examinant almost always “saith”, “upon his/her oath says” or “maketh oath”.
  3. In some cases (usually bastardy or vagrancy exams), the text begins “The examination of …” or “The voluntary examination of…”

Closure:

Normally, the end of an examination can simply be located just before the beginning of the next one. But this could not always be assumed, as sometimes examinations were interspersed with other notes about cases, names that might or might not be related, and so on. There were also indexes at the end of some volumes. So a certain amount of care could be needed to ensure the end of examinations was identified accurately.

Not all examinations were signed, but nearly all (apart from a very few fragmentary examinations) contained slight variants of the lines below at the end of the main text, and just before signatures (or the space where signatures would have been filled in).

Examples:

  • Sworn the 10th. Day of May 1756 before}
  • Sworn this. 30. day of Novemr 1786 before

Disambiguation of names

Initial identification of names in examinations was straightforward, using the existing London Lives tagging. Almost all full names (names that have at least one given and one surname present) in these files have been accurately tagged, although there are occasional omissions. The omissions, when spotted, have only been rectified for examinants and other significant individuals.

The next task (which turned out to be far more time-consuming than expected) was to remove duplicate mentions of the same person within each examination, whilst ensuring I retained different individuals who shared the same name. I underestimated initially the extent to which 18th-century parents named their children after themselves.

There may have been a few errors along the way, either in failing to identify a duplicate or deleting a non-duplicate.

Identification of examinants and other people

The structure of the examinations also made it easy to identify examinants. However, something I also underestimated at the beginning of the project was the number of examinations in which the examinant was not the pauper who was the actual subject of the examination (most often because the pauper was a young child, physically ill or mentally incapacitated). This proved less straightforward than initially anticipated since the examinations don’t always explicitly state that the examination was “on behalf of” the pauper concerned. An alternative wording was that the examinant “well knows” the pauper, but there are other less identifiable cases, and probably still some in the data that I failed to identify.

Occasionally an examinant was examined both for him/herself and on behalf of another individual, or conversely an examination could have both the pauper and a witness on their behalf speaking.

Some of the witness-examinants were parish officials, in which case I’ve removed them from the dataset altogether. Others have been retained (often they’re relatives) but identified as such.

The examinations contain many more names than those of the examinants - parents, children, siblings, employers, the alleged fathers of bastards, and so on. At the moment only some of these are specifically labelled, where it’s fairly straightforward to do so (children, employers). I’m working on relationships data for future releases.

Excluding magistrates and parish officials

The names of magistrates, if present, appear in very predictable places (usually at the very end of the examination). Parish officials are less common but usually fairly straightforward to identify. Wherever possible, these have been removed from the dataset. (If requested, a version of the data that includes them can be made available.)

Finding additional information about examinations and individuals

  • Using existing London Lives tagging and user-contributed roles

The St Botolph Aldgate examinations were the very first documents the London Lives project tagged, as a test run for manual tagging and as training data for automated tagging. As a result, they were checked and marked up more exhaustively than most other documents. In particular, place and occupation/status tagging were comprehensively tagged and manually linked to individual names to an extent that turned out to be impracticable for the project as a whole. All of this information could be imported directly into the dataset.

Dates were also tagged well in both sets of examinations, but a little care was needed to identify the date of an examination (usually by positioning in the text) rather than earlier dates mentioned by an examinant.

Some tagged names in London Lives have had “roles” assigned to them manually by project members and site users. (This information is not part of the XML markup.) This was particularly useful in the case of the mothers of bastard children, and less systematically so in other cases.

  • Keyword and proximity searches around tagged names

Additional information (or information missed by the original tagging) was obtained primarily by used of keyword searches in proximity to a tagged name: eg, “widow”, “spinster/single woman” or “wife of” immediately after a woman’s name, and occupations after a man’s name.

Because pauper examinations are relatively formulaic, it was possible to use this to extract a variety of kinds of information with some confidence in reliability of the information found (and that it was associated with the right person), although if the information was written down in less standard ways it would be less likely to be found, eg:

  • Ages
  • Bastardy
  • Information about settlements (work in progress)
  • Relationships (too unreliable and messy to release at present)

Some other information - eg, about irregular marriages and separations, and most tagged place names - has not (yet) been associated with specific individuals but is made available as examination-level data. Only a small proportion of all tagged place data (primarily parishes and towns) in the XML files has been included here.

Further datasets

St Clement Danes Removal Orders

This is a dataset of 3180 names of paupers and vagrants ordered to be removed from the parish of St Clement Danes between 1752 and 1793, from the London Lives Registers of Removed Paupers. The Orders are an important supplement to the Examinations because the latter don’t tell us which examined paupers were ordered to be removed.

The dataset includes links to a) the Pauper Examinations data and b) related parish petitions (appealing removal decisions) in the [London Lives petitions data] link needed.

Get the data

The latest version of the Examinations and Removal Orders data can be downloaded here.

If you only want the smaller Removal Orders dataset, you can also get it on github.

The datasets and all accompanying documentation (unless otherwise specified) are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Acknowledgments

The dataset has been created using the transcriptions of the Sessions Papers published at London Lives. I am deeply grateful to Tim Hitchcock and Bob Shoemaker, the London Lives project directors, for agreeing to share the data.

The original documents are held at the London Metropolitan Archives and the Westminster Archives Centre.

The London Lives project (under the name Plebeian Lives) was funded by the Economic and Social Research Council between 2006-2010.

Future plans

  • Completion of settlement data
  • Addition of data about regular marriages (hopefully including dates and places)
  • Relationships data
  • Identify and extract pauper examinations and related material in the London Lives Sessions Papers
  • Linkage to further related documents in London Lives, such as Bastardy Bonds