Democracy's Library facts
x_dl_factsrelease v0.7.1CC0 1.0
About
Facts read from Democracy's Library documents about SF places (a model run on the pages of DL items: costs, units, dates, places), one row per fact.
- Where it comes from
- Documents about San Francisco places in Democracy's Library on the Internet Archive.
- How it was read
- Facts (costs, units, dates, places) read from the pages by a language model (Claude Haiku), one row per fact.
- How far to trust it
- The release passed its automatic checks before it was published (what is checked). A hand check by the editor of qipu data is under way: 36 of 38 items checked so far were right, on votes, money, places and the map. A row says what the record states; the scanned page is the authority. Details
- Licence
- CC0 1.0: use it for anything, no permission needed. The scans and other sources keep their own rights.
- Version
- v0.7.1, published 21 October 2026. A published release is never changed; corrections come as a new release.
Technical details
- Table
- x_dl_facts
- Rows
- 150,446
- Columns
- 30
- Parquet
- x_dl_facts.parquet, 11.9 MB
- Version
- v0.7.1, 21 October 2026
- Licence
- CC0 1.0. Sources keep their own rights.
Rows
Rows by doc_type
| Value | Rows | Share | |
|---|---|---|---|
| study or report | 57,080 | 37.9% | |
| annual report | 23,613 | 15.7% | |
| environmental impact report | 18,424 | 12.2% | |
| plan | 18,397 | 12.2% | |
| audit | 8,887 | 5.9% | |
| city-owned property report | 8,568 | 5.7% | |
| other | 7,866 | 5.2% | |
| ordinance or legislation | 7,302 | 4.9% | |
| minutes or proceedings | 266 | 0.2% | |
| permit list | 43 | < 0.1% |
Rows by kind
| Value | Rows | Share | |
|---|---|---|---|
| finding | 38,142 | 25.4% | |
| property_record | 34,638 | 23.0% | |
| site | 12,254 | 8.1% | |
| recommendation | 12,142 | 8.1% | |
| project | 12,107 | 8.0% | |
| measure | 11,642 | 7.7% | |
| event | 7,577 | 5.0% | |
| building | 6,493 | 4.3% | |
| agency | 6,330 | 4.2% | |
| action | 4,703 | 3.1% | |
| alternative | 4,418 | 2.9% |
Rows by property
| Value | Rows | Share | |
|---|---|---|---|
| other | 46,541 | 30.9% | |
| owned_by_city | 31,642 | 21.0% | |
| finding | 21,527 | 14.3% | |
| recommendation | 9,862 | 6.6% | |
| cost_usd | 9,045 | 6.0% | |
| proposes | 7,571 | 5.0% | |
| event | 4,061 | 2.7% | |
| units | 2,227 | 1.5% | |
| use | 2,017 | 1.3% | |
| alternative | 1,973 | 1.3% | |
| jobs | 1,750 | 1.2% | |
| floor_area_sqft | 1,450 | 1.0% |
Method and accuracy
Facts (costs, units, dates, places) read from the pages by a language model (Claude Haiku), one row per fact.
No accuracy measure for this table yet.
The release passed its automatic checks before it was published (what is checked). A hand check by the editor of qipu data is under way: 36 of 38 items checked so far were right, on votes, money, places and the map. A row says what the record states; the scanned page is the authority.
Columns 30
| Column | Type | Can be empty | Privacy | Public copy | Description |
|---|---|---|---|---|---|
| run_id | VARCHAR | yes | none | as is | The DL facts run. |
| page_id | VARCHAR | yes | none | as is | The archive.org page (<identifier>:<leafNum>). nopage:<seq> where the source gives no page number (sfbos rows without one): the row is kept, page_url is NULL.Values e.g. journalofproceed30sanfrich:1 |
| page_url | VARCHAR | yes | none | as is | Opens the page: archive.org BookReader link built from the leaf map (audited against IA's scandata), or <pdf url>#page=<n> for a PDF. NULL only where page_id is nopage:<seq>.Values e.g. https://archive.org/details/journalofproceed30sanfrich/page/n1 |
| seq | BIGINT | yes | none | as is | Row number inside the run. |
| row_key | VARCHAR | yes | none | as is | Stable row key. |
| item_id | VARCHAR | yes | none | as is | The archive.org item. |
| doc_type | VARCHAR | yes | none | as is | Document type of the item (plan, report, EIR ...). |
| item_title | VARCHAR | yes | catalogue text | as is | The item's catalogue title. |
| item_year | BIGINT | yes | none | as is | The year of the item. |
| kind | VARCHAR | yes | none | as is | Kind of fact. |
| subject | VARCHAR | yes | free text | private people's names withheld under the embargo | What the fact is about, as read. |
| property | VARCHAR | yes | none | as is | The property read (cost, units, built ...). |
| value_text | VARCHAR | yes | free text | private people's names withheld under the embargo | The value as read. |
| value_num | DOUBLE | yes | none | as is | The value as a number. |
| unit | VARCHAR | yes | none | as is | Unit of value_num (USD, units, acres ...). |
| date | VARCHAR | yes | none | as is | A date printed with the fact. |
| quote | VARCHAR | yes | raw text | private people's names withheld under the embargo | Short quote of the page (raw text; names of private people withheld under the embargo). |
| place_text | VARCHAR | yes | free text | private people's names withheld under the embargo | The place as printed. |
| place_number | VARCHAR | yes | none | as is | House number. |
| place_street | VARCHAR | yes | none | as is | Street. |
| place_cross_street | VARCHAR | yes | none | as is | Cross street. |
| place_block | VARCHAR | yes | none | as is | Assessor block. |
| place_lot | VARCHAR | yes | none | as is | Assessor lot. |
| place_area | VARCHAR | yes | free text | private people's names withheld under the embargo | A named area. |
| place_precision | VARCHAR | yes | none | as is | How exactly the page places it. |
| place_id | VARCHAR | yes | none | as is | The qipu place it was resolved to. |
| resolved_by | VARCHAR | yes | none | as is | How it was resolved. |
| value_year | INTEGER | yes | none | as is | The year the amount is in (for amount_2026). |
| amount_2026 | DOUBLE | yes | none | as is | value_num in 2026 dollars (CPI). |
| index_used | VARCHAR | yes | none | as is | The price index and years behind amount_2026. |
Privacy: what kind of text the column holds. Public copy: what the published file does with it; the embargo covers records after 1951.
Preview
| run_id | page_id | page_url | seq | row_key | item_id | doc_type | item_title |
|---|---|---|---|---|---|---|---|
| dl-sf-facts-v…iku55-2026-10 | igsl_san-fran…1935-1954:259 | archive.org/deta…5-1954/page/n258 ↗ | 7 | dl-sf-facts-v1.1-haiku55-2026-10/igsl_san-francisco-real-p… | igsl_san-francisco-real-prop-report_1935-1954 | annual report | Valuation of real property owned by city and county of San… |
| dl-sf-facts-v…iku55-2026-10 | igsl_san-fran…1935-1954:383 | archive.org/deta…5-1954/page/n382 ↗ | 6 | dl-sf-facts-v1.1-haiku55-2026-10/igsl_san-francisco-real-p… | igsl_san-francisco-real-prop-report_1935-1954 | annual report | Valuation of real property owned by city and county of San… |
| dl-sf-facts-v…iku55-2026-10 | C124919111:51 | archive.org/deta…4919111/page/n49 ↗ | 2 | dl-sf-facts-v1.1-haiku55-2026-10/C124919111:51/2 | C124919111 | plan | The Port of San Francisco waterfront design & access : an … |
| dl-sf-facts-v…iku55-2026-10 | C124925135:205 | archive.org/deta…925135/page/n204 ↗ | 5 | dl-sf-facts-v1.1-haiku55-2026-10/C124925135:205/5 | C124925135 | plan | Presidio Trust draft implementation plan : an updated plan… |
| dl-sf-facts-v…iku55-2026-10 | C124877653:19 | archive.org/deta…4877653/page/n18 ↗ | 7 | dl-sf-facts-v1.1-haiku55-2026-10/C124877653:19/7 | C124877653 | study or report | Men, money and mud : the story of the San Francisco Intern… |
| dl-sf-facts-v…iku55-2026-10 | C101747259:165 | archive.org/deta…747259/page/n164 ↗ | 3 | dl-sf-facts-v1.1-haiku55-2026-10/C101747259:165/3 | C101747259 | study or report | A Report based on a study of the San Francisco Department … |
| dl-sf-facts-v…iku55-2026-10 | C123307279:14 | archive.org/deta…3307279/page/n13 ↗ | 1 | dl-sf-facts-v1.1-haiku55-2026-10/C123307279:14/1 | C123307279 | study or report | San Francisco arts policy : a background paper |
| dl-sf-facts-v…iku55-2026-10 | C124889945:20 | archive.org/deta…4889945/page/n19 ↗ | 2 | dl-sf-facts-v1.1-haiku55-2026-10/C124889945:20/2 | C124889945 | study or report | San Francisco water & power : a history of the Municipal W… |
8 of 30 columns shown. Eight rows sampled at build time, from the years up to 1951. Hover a shortened value for all of it.
Download
| Format | File | Size |
|---|---|---|
| Parquet | x_dl_facts.parquet ↗ | 11.9 MB |
| SQLite (all tables) | qipu_sf.db ↗ | 6.44 GB |
SQL
SELECT *
FROM x_dl_facts
LIMIT 100
Run in the SQL console (DuckDB in the browser, over the Parquet file).
Python
import duckdb
duckdb.sql("SELECT * FROM 'https://tiles.qipu.org/data/releases/v0.7.1/parquet/x_dl_facts.parquet' LIMIT 5").show()