CLARA

Communication of Local German Party Associations, Recorded Annually
A chapter-year panel dataset, 2015–2025 · Version 1.0.0 · Hanno Hilbig, University of California, Davis

Local party websites contain detailed information about local organizations, but they are a difficult source for historical research. Formats differ across chapters, pages disappear, and many sites were not archived consistently. CLARA uses archived versions of these websites to build an annual panel of 2,635 local chapters of the seven main German parties from 2015 to 2025, for a total of 28,985 chapter-years. The unit is the Kreisverband, the county-level organization of each party.

How the data were built

I reconstruct each chapter's website separately for each year using Internet Archive snapshots. The release draws on about 1.03 million archived pages. A locally hosted open-weight language model extracts structured variables from these pages. No commercial model was used to produce the released data.

For news pages, duplicate archived versions are collapsed to one record per article. The resulting file contains 237,399 articles dated between 2015 and 2025. Each article is classified by policy topic, function, and geographic focus. The data report documents the sampling frame, website discovery, and extraction procedure.

What the data measure

Coverage and limitations

Coverage is not random. Of the 25,509 chapter-years in the recommended analysis scope, 17,989 are usable. About one quarter have no Internet Archive snapshot for the relevant year; those observations cannot be recovered. The panel includes source and coverage indicators, so users can impose stricter coverage requirements. When an archived page of the relevant type exists, extraction almost always succeeds.

Small multiples: usable structured coverage by year for each of the seven parties, rising over time with clear party differences.
Usable structured coverage by party and year.

Selection enters at two points. The roster was assembled from chapters whose websites were still online in early 2026, so chapters whose websites disappeared before then are absent from the dataset, especially in the earlier years. Within the roster, a chapter is observed in a given year only if the Internet Archive captured its website that year.

These gaps matter most for news counts. A low count can mean that a chapter posted little, that the Internet Archive captured little, or both. I would therefore treat comparisons across chapters and multi-year averages as more reliable than annual changes within a chapter. The codebook identifies the variables that describe coverage.

Validation

I manually compared extracted records with their source pages in five stratified samples. In the sample drawn directly from the released records, 45 of 48 records were confirmed. As a separate check, a second open-weight model from a different model family evaluated a new sample against the source pages. The deposit reports the results of both checks.

The classifier does not receive the year as an input. Nevertheless, the share of articles classified as election campaigning rises in federal and European election years.

Line chart: share of local party news articles classified as campaign content by year, peaking in German federal and European election years, which are marked by shaded bands.
Share of news articles classified as election campaigning, by year. Shaded bands mark election years (BTW = federal election, EP = European election).

The topic series also track major events. Migration, climate, health, and energy reach their highest or near-highest levels of attention around the refugee crisis, the 2019 climate protests, the COVID-19 pandemic, and the 2022 energy crisis.

Four line charts: the share of classified news topics devoted to integration and migration, environment and climate, health, and energy, by year from 2015 to 2025, each peaking during or at the edge of the shaded period when that issue was nationally salient.
Share of classified news topics by year for four policy families. The shaded bands mark the 2015–16 refugee crisis, the 2019 climate protests, the 2020–21 pandemic, and the 2022 energy crisis; the labeled point in each panel is that family's maximum.

Parties differ as well. In every year from 2015 to 2025, migration accounts for a larger share of AfD news topics than of any other party's.

Line chart: share of news topics about integration and migration by year, with the AfD line above the lines for all other parties throughout, peaking in 2015 and rising again around the 2023 migration debate.
Share of classified news topics in the integration and migration family, by year. The dark line is the AfD, the grey lines the other parties; the shaded bands mark the 2015–16 refugee crisis and the 2023 migration debate.

Data and documentation

The Dataverse deposit contains the chapter-year panel and its enriched version, the chapter roster, long-format topic and news files, a per-row provenance file, and crosswalks to the Comparative Agendas scheme and Bundestag electoral districts. It also contains the codebook, data report, coverage diagnostics, validation summaries, and minimal R and Python load scripts. The core panel is mirrored here as chapter_year_panel.csv (13 MB). The Harvard Dataverse deposit is the citable version.

The public release excludes person-level records and page text. The records are personal data under the GDPR; the text was written by the parties and may be protected by copyright. A controlled-access version of this material is in preparation. Data and documentation are CC-BY-4.0. Pipeline code is available from the author on request.

Citation

Hilbig, Hanno (2026). CLARA: Communication of Local German
Party Associations, Recorded Annually (2015-2025). Version 1.0.0.
Harvard Dataverse. https://doi.org/10.7910/DVN/2KJSCO