Outside identifiers
xrefrelease v0.7.1CC0 1.0
About
Crosswalk: one row per outside id of a qipu record, so the people who use those ids can reach qipu (Planning and the Assessor by block and lot, DataSF by EAS id, the Clerk by ordinance number, Wikidata by QID, the Internet Archive by item, page and IIIF canvas, census tables by tract). Built by qipu_data/xref.py from the release's own tables; it adds no qipu ids. The schemes are a closed list (legistar_file and legistar_matter are reserved for a later release).
- How far to trust it
- The release passed its automatic checks before it was published (what is checked). A hand check by the editor of qipu data is under way: 36 of 38 items checked so far were right, on votes, money, places and the map. A row says what the record states; the scanned page is the authority. Details
- Licence
- CC0 1.0: use it for anything, no permission needed. The scans and other sources keep their own rights.
- Version
- v0.7.1, published 21 October 2026. A published release is never changed; corrections come as a new release.
Technical details
- Table
- xref
- Rows
- 1,320,115
- Columns
- 8
- Parquet
- xref.parquet, 4.0 MB
- Version
- v0.7.1, 21 October 2026
- Licence
- CC0 1.0. Sources keep their own rights.
Rows
Rows by scheme
| Value | Rows | Share | |
|---|---|---|---|
| blklot | 446,252 | 33.8% | |
| eas | 224,390 | 17.0% | |
| ia_display_n | 183,882 | 13.9% | |
| iiif_canvas | 183,880 | 13.9% | |
| ia_page | 182,949 | 13.9% | |
| enactment | 72,173 | 5.5% | |
| census_tract_2000 | 5,102 | 0.4% | |
| census_tract_2010 | 5,102 | 0.4% | |
| census_tract_2020 | 5,102 | 0.4% | |
| census_tract_1990 | 5,083 | 0.4% | |
| ia_item | 3,364 | 0.3% | |
| lpf | 2,534 | 0.2% |
Rows by source
| Value | Rows | Share | |
|---|---|---|---|
| DataSF EAS (3mea-di5p) | 591,930 | 44.8% | |
| archive.org BookReader | 183,882 | 13.9% | |
| Internet Archive IIIF v3 | 183,880 | 13.9% | |
| archive.org hOCR page index | 182,949 | 13.9% | |
| DataSF parcels | 78,712 | 6.0% | |
| Journal of Proceedings (printed number) | 72,173 | 5.5% | |
| US Census Bureau tract map 2020 | 5,102 | 0.4% | |
| US Census Bureau tract map 2010 | 5,102 | 0.4% | |
| US Census Bureau tract map 2000 | 5,102 | 0.4% | |
| US Census Bureau tract map 1990 | 5,083 | 0.4% | |
| archive.org | 3,364 | 0.3% | |
| qipu data Linked Places export (exports/places_lpf.geojson) | 2,534 | 0.2% |
Rows by method
| Value | Rows | Share | |
|---|---|---|---|
| block || lot | 440,583 | 33.4% | |
| EAS base address id | 224,390 | 17.0% | |
| page_id | 182,949 | 13.9% | |
| leaf map | 179,040 | 13.6% | |
| iiif_manifest | 108,101 | 8.2% | |
| bookreader_n | 75,779 | 5.7% | |
| number and year printed | 64,620 | 4.9% | |
| majority of the block's EAS address points | 20,389 | 1.5% | |
| number printed, year assumed from the Journal volume | 7,553 | 0.6% | |
| block || lot (not in the DataSF parcel layer: a lot created or retired since) | 5,669 | 0.4% | |
| leaf map (unchecked volume) | 4,842 | 0.4% | |
| identifier | 3,364 | 0.3% |
Method and accuracy
No accuracy measure for this table yet.
The release passed its automatic checks before it was published (what is checked). A hand check by the editor of qipu data is under way: 36 of 38 items checked so far were right, on votes, money, places and the map. A row says what the record states; the scanned page is the authority.
Columns 8
| Column | Type | Can be empty | Privacy | Public copy | Description |
|---|---|---|---|---|---|
| qipu_id | VARCHAR | no | none | as is | The qipu record: a place, person, instrument, archive.org source (its identifier) or page (<identifier>:<leaf>). |
| scheme | VARCHAR | no | none | as is | ia_item (archive.org identifier), ia_page (hOCR page index, 0-based), ia_display_n (the n of archive.org /page/n<n>), iiif_canvas (IA's IIIF v3 canvas id), blklot (Assessor block and lot, 0847019), eas (DataSF EAS base address id), wikidata (QID), enactment (Ord. 338-75, Res. 273-64; series forms Ord. 8727 (N.S.), Res. 15288 (Series of 1939)), census_tract_<map year> (6-digit tract code), analysis_nbhd (DataSF Analysis Neighborhood), sup_district_2022 (reserved), lpf (the Linked Places / World Historical Gazetteer @id).Values ia_item, ia_page, ia_display_n, iiif_canvas, blklot, eas, wikidata, enactment, census_tract_1990, census_tract_2000, census_tract_2010, census_tract_2020 ... |
| value | VARCHAR | no | none | as is | The outside id. |
| valid_from | VARCHAR | yes | none | as is | When the id starts to apply, where known (the year of an ordinance or resolution). |
| valid_to | VARCHAR | yes | none | as is | When the id stops applying, where known. |
| source | VARCHAR | yes | catalogue text | as is | Where the outside id comes from. |
| method | VARCHAR | yes | none | as is | How the row was made (iiif_manifest = read from the item's cached IIIF manifest; bookreader_n = the manifest's canvas id form for the BookReader page; number printed, year assumed from the Journal volume ...). |
| confidence | DOUBLE | yes | none | as is | 1 when the id is read or printed as is; lower when part of it is inferred (the method says which part). Values 0..1 |
Privacy: what kind of text the column holds. Public copy: what the published file does with it; the embargo covers records after 1951.
Preview
| qipu_id | scheme | value | valid_from | valid_to | source | method | confidence |
|---|---|---|---|---|---|---|---|
| place/address/eas-284136 | blklot | 0520020 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-284582 | blklot | 0535034 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-292280 | blklot | 0995009 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-295230 | blklot | 1129023 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-299940 | blklot | 1288022 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-302775 | blklot | 1411007A | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-304949 | blklot | 1466038 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
| place/address/eas-307375 | blklot | 1540024 | — | — | DataSF EAS (3mea-di5p) | block || lot | 1.0 |
Eight rows sampled at build time. Hover a shortened value for all of it.
Download
| Format | File | Size |
|---|---|---|
| Parquet | xref.parquet ↗ | 4.0 MB |
| SQLite (all tables) | qipu_sf.db ↗ | 6.44 GB |
SQL
SELECT *
FROM xref
LIMIT 100
Run in the SQL console (DuckDB in the browser, over the Parquet file).
Python
import duckdb
duckdb.sql("SELECT * FROM 'https://tiles.qipu.org/data/releases/v0.7.1/parquet/xref.parquet' LIMIT 5").show()