Japanese Farmland Parcel Polygons

Japanese Farmland Parcel Polygons (筆ポリゴン / Fude Polygons) are nationwide farmland parcel boundary datasets for Japan, manually digitized from aerial and satellite imagery by the Ministry of Agriculture, Forestry and Fisheries (MAFF). Each polygon carries land-type classification (rice field or upland field), centroid coordinates, municipality code, and change-history linkage to prior years. Coverage spans fiscal years 2021–2024.

agriculture field-boundaries land-parcels land-use lpis remote-sensing arable-land

jp_field_polygons_2021.parquet

[admin_code] Municipality code (Ministry of Internal Affairs and Communications standard) for the polygon centroid

GEOM

[geometry] Farmland parcel polygon geometry (EPSG:6668, JGD2011)

jp_field_polygons_2022.parquet

jp_field_polygons_2023.parquet

jp_field_polygons_2024.parquet

Source Cooperative product page

## README.md
## Introduction
Japanese Farmland Parcel Polygons (Fude Polygons in Japanese) represent parcel information of farmland. The polygons are manually digitized data derived from aerial imagery, such as satellite images. Since no on-site verification or similar procedures have been conducted, the data may not necessarily match the actual current conditions. Fude Polygons are created for the purpose of roughly indicating the locations of farmland.

## Data Processing
The original data was downloaded from the Ministry of Agriculture, Forestry and Fisheries (MAFF) website (https://www.maff.go.jp/j/tokei/porigon/index.html) and processed as follows:

- Downloaded all prefecture-level data provided for each year from 2021 to 2024.
- Processed the data for each year to create a nationwide dataset in GeoParquet format:
  - Renamed attributes:
    - Changed history to history_ja.
    - Translated attribute values:
  - Converted the land_type_ja column values:
    - 100 → “田” (rice field)
    - 200 → “畑” (field).
  - Added the following columns:
    - history_en: Translated values from the history attribute into English.
    - land_type_en: Translated values from the land_type attribute into English.
  - Validated geometry: Ensured compliance with OGC standards, version 1.2.0.
- Merged prefecture-level data into a single nationwide dataset.

The file names follow the naming convention below:
- jp_field_polygons_xxxx
  - xxxx represents the fiscal year of the data.

The data can be used under the CC BY license. Since this dataset is a processed version of the original data, please include the following citation when using it:

- Fude Polygon Data (published for the fiscal years 2021, 2022, 2023, and 2024) provided by the Ministry of Agriculture, Forestry and Fisheries, processed by Pacific Spatial Solutions, Inc.

## Prepared Datasets:
|File Name|Description|
|---------|-----------|
|jp_field_polygons_2021.parquet|Nationwide farmland polygon data created from the 2021 dataset.|
|jp_field_polygons_2022.parquet|Nationwide farmland polygon data created from the 2022 dataset.|
|jp_field_polygons_2023.parquet|Nationwide farmland polygon data created from the 2023 dataset.|
|jp_field_polygons_2024.parquet|Nationwide farmland polygon data created from the 2024 dataset.|

## Data Schema and Descriptions

| Field Name             | Data Type | Description_en                                                                                | Description_ja                                                                                |
|------------------------|-----------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------|
| polygon_uuid           |  string   | Fude Polygon ID (UUID ver. 4)                                                                                | 筆ポリゴンID（UUID ver. 4）                                                                                |
| land_type              |  string   | Land use code (rice field or field) determined by visual interpretation of satellite imagery                                                                                | 衛星画像の目視判読による田、畑の地目コード                                                                     |
| issue_year             |  string   | Year of publication on the site                                                                                | サイトに公開した年度                                                                                |
| edit_year              |  string   | Year of creation or update                                                                                | 新規作成、更新した年度                                                                                |
| history_ja             |  string   | Information indicating the relationship with previously published field polygons (in JSON format)                                                                                | 過去に公開した筆ポリゴンとの関係を示した情報（JSON形式）                                                       |
| history_en             |  string   | English translation of the attribute values in history_ja                                                                                | history_jaの属性値の英語訳                                                                                |
| last_polygon_uuid      |  string   | If the data is the same as the previous year,  the polygon_id of the previous year. If there are changes,  it is set to NULL.                                                                           | 前年度のデータと同一の場合は前年度のpolygon_id。変更があった場合はNULL                                         |
| prev_last_polygon_uuid |  string   | If the data is the same as both the previous year and the year before,  the polygon_id of the previous year. If changes occurred between the year before last and the current year,  it is set to NULL. | 前年度、前々年度のデータと同一の場合は前年度のpolygon_id。前々年度から当該年度までの間に変更があった場合はNULL |
| local_government_cd    |  string   | Code of the municipality,  as defined by the Ministry of Internal Affairs and Communications,  where the centroid of the polygon overlaps.                                                              | ポリゴンの重心点と重なる市区町村の総務省地方公共団体コード                                                     |
| point_lng              |  string   | Longitude of the polygon’s centroid                                                                                | ポリゴン重心点の経度                                                                                |
| point_lat              |  string   | Latitude of the polygon’s centroid                                                                                | ポリゴンの重心点の緯度                                                                                |
| old_polygon_id         |  string   | polygon_id of the data published in 2021                                                                                | 2021年公開データのpolygon_id                                                                                |
| land_type_ja           |  string   | Japanese notation for land_type code (田 for rice field,  畑 for field)                                                                                | land_typeコードの日本語表記（田、または畑）                                                                    |
| land_type_en           |  string   | English notation for land_type code (rice_field for rice field,  field for field),                                                                                | land_typeコードの英語表記（rice_field または field）                                                           |

## English Translations for the Attribute Values
|Japanese | English|
|---------|--------|
|筆ポリゴン|field_polygon_id|
|更新年度|fy_updated|
|前年同一|same_prev_fy|
|発生年度|fy_occurence|
|関連|related|
|発生|appeared|
|消滅|disappeared|

# 日本語での説明文

筆ポリゴンとは、農地の区画情報です。ポリゴンは、衛星画像などの空中写真データから手作業でデジタイジングしたデータで、現地確認作業などは行なっていないため、現況とは必ずしも一致しない場合があります。筆ポリゴンは、大まかな農地の位置を示す目的で作成されています。

データは、農林水産省のサイト (https://www.maff.go.jp/j/tokei/porigon/index.html) からダウンロードし、以下の処理を行いました。

- 2021年から2024年までの各県ごとに提供されているデータを全てダウンロード
- 年度ごとに以下の処理を行い、全国データをGeoParquet形式で作成
	- 属性名の変更
		- history --> history_ja
	- 属性値のコードを翻訳
		- land_type_ja --> land_type列の値100を「田」、値200を「畑」に変換
	- 以下の列を追加
		- history_en : history属性を英語に翻訳
		- land_type_en : land_type属性を英語に翻訳
- ジオメトリのValidation：OGC Compliant, ver. 1.2.0
- 各県のデータを全国データとしてマージ

ファイル名は、以下の命名ルールに従いました。
- jp_field_polygons_xxxx
	- xxxx は、データの対象年度

本データは、CC BYに従うことで利用することができます。このデータはオリジナルデータを加工したデータであるため、利用に際しては、以下の出典を記載して下さい。
- 筆ポリゴンデータ（2021, 2022, 2023, 2024年度公開）農林水産省、をPacific Spatial Solutions株式会社が加工して作成

## ダウンロード可能なデータ

|ファイル名|説明|
|--------|---|
|jp_field_polygons_2021.parquet|2021年度に公開されたデータから作成した全国農地ポリゴンデータ|
|jp_field_polygons_2022.parquet|2022年度に公開されたデータから作成した全国農地ポリゴンデータ|
|jp_field_polygons_2023.parquet|2023年度に公開されたデータから作成した全国農地ポリゴンデータ|
|jp_field_polygons_2024.parquet|2024年度に公開されたデータから作成した全国農地ポリゴンデータ|

license: README states 'CC BY' without specifying a version number; 4.0 assumed as the current standard version.

extent.spatial.bbox: omitted; spatial reference is categorical via [jp_field_polygons_2021.GEOM (geometry), jp_field_polygons_2021.point_lng / point_lat (latlon), jp_field_polygons_2021.local_government_cd (admin_code), jp_field_polygons_2022.GEOM (geometry), jp_field_polygons_2022.point_lng / point_lat (latlon), jp_field_polygons_2022.local_government_cd (admin_code), jp_field_polygons_2023.GEOM (geometry), jp_field_polygons_2023.point_lng / point_lat (latlon), jp_field_polygons_2023.local_government_cd (admin_code), jp_field_polygons_2024.GEOM (geometry), jp_field_polygons_2024.point_lng / point_lat (latlon), jp_field_polygons_2024.local_government_cd (admin_code)]. Add bbox once a placename → bbox gazetteer is available.


Flateau (Building footprint data in Japan)

Flateau is a derived dataset of 2D building footprint polygons (LOD0) extracted from Japan's national PLATEAU CityGML 3D city model project, covering 211 municipalities. Each building record includes footprint geometry, centroid point, physical attributes (height, storeys, usage), and optional ancillary tables for disaster risk (flooding, tsunami, high tide, inland overflow, landslide) and data quality. Data are distributed as GeoParquet and GeoPackage files per city, plus merged national Parquet files.

building-footprints citygml 3d-city-model disaster-risk plateau

Japan Ministry of Land, Infrastructure, Transport and Tourism (PROJECT PLATEAU)

prefecture

[placename] Japanese prefecture name of building location

[admin_code] JIS prefecture code (2-digit)

city

[placename] Municipality name of building location

[admin_code] JIS municipality code (5-digit)

GEOM

[geometry] Centroid point geometry of building footprint polygon (EPSG:4326)

01100_sapporo-shi_2020_building_data_quality.parquet

01100_sapporo-shi_2020_building_detail.parquet

47201_naha-shi_2020_building_lod0.parquet

[geometry] Building footprint 2D polygon geometry (EPSG:4326)

47201_naha-shi_2020_building_risk_flooding.parquet

47201_naha-shi_2020_building_risk_high_tide.parquet

47201_naha-shi_2020_building_risk_land_slide.parquet

47201_naha-shi_2020_building_risk_tsunami.parquet

Source Cooperative product page

## README.md
# Japanese Building Footprint Data (a.k.a Flateau :wink:)

Original PLATEAU (National Government 3D project) building data are provided as the CityGML 3D format. We extracted LOD0 geometries (footprint 2D polygon) and their attributes and exported as GeoParquet and GeoPackage files. We used FME for this process and internally called Project **Flateau**. We kept attributes as much as possible, however, we omitted some of them based on our judgements. We addes several attributes such as heights and areas from the original 3D geometris. Japanese national and local government keep expanding data coverage, however, PLATEAU data don't cover the all cities in Japan (211 cites out of about 1720 cities). I hope the coverage will expand and cover the entire nation sometime.

There are lots of attributes in this dataset. We separated ancillary data from the main data, 2D polygon and centroid point data.

You can download and use our data freely under CC-BY 4.0 license. We used PLATEAU data so you also need to follow [their term of use](https://www.mlit.go.jp/plateau/site-policy/).

- (c) [Pacific Spatial Solutions, inc.](https://pacificspatial.com) 2023 CC-BY. This data is made available under a Creative Commons Attribution 4.0 International license. Original building data are from PROJECT PLATEAU (https://www.mlit.go.jp/plateau/)

Polygon and Centroid data have gml_id columns which you can use to join attributes from other tables.

Directories are organized by data types.
```
root/
|─ gpkg/
|  |─ geopackage files for each city
|─ merged/
|  |─ merged_building_centroid_lod0.parquet
|  |─ merged_building_lod0.parquet
|─ parquet/
|  |─ parquet files for each city
|─ README.md
```

データは自由にお使いいただけますが、[CC BY 4.0ライセンス]（https://creativecommons.org/licenses/by/4.0/legalcode.ja） に従います。

- 出典：国土交通省PLATEAU (https://www.mlit.go.jp/plateau/)
「3D都市モデル（Project PLATEAU）」（国土交通省）(https://www.geospatial.jp/ckan/dataset/plateau） をもとにジオメトリから各種統計データを算出しオンラインまたはGISソフトウェアで利用しやすいフォーマットに変換。 [Pacific Spatial Solutions株式会社](https://pacificspatial.com) 作成

各種属性ファイルのデータは、gml_idを使ってポリゴンとセントロイドのデータに紐づけすることができます。

## 2023 building data

### Prepared data (整備したデータ)
We prepared data for each city where Plateau data are available on 2024/05. Plateau project keeps adding more cities every year. So, hopefully we can keep adding more cities in the future.

2023年度のPlateauの建物データの変換を行いました。毎年整備対象都市が増えているのでできれば毎年追加していきたいと考えています。

### Prepaed data fromat（整備したデータのフォーマット）
We prepared our data in two data formats and host at [Source Cooperative](https://beta.source.coop/). If you click the following download page links, you will open the data download pages.
- GeoParquet/Parquet ([download page](https://beta.source.coop/pacificspatial/flateau/parquet/))
  - Footprint polygons and their centroid data as well as other ancillary data which don't have geometry information. You can join these data to GeoParquet data using gml_id column.
- GeoPackage ([download page](https://beta.source.coop/pacificspatial/flateau/gpkg/))
  - All with or without geometry data are in this file.

### File naming convention (ファイルの命名規則)
- GeoParquet and Parquet files
  - citycode_cityname_year_filename.parquet
  - example: 01100_sapporo-shi_2020_building_centroid_lod0.parquet
- GeoPackage files
  - citycode_cityname_year.gpkg
  - example: 01100_sapporo-shi_2020.gpkg

### File names（今回整備したファイル名一覧）

We prepared the following files/layers for each city. Available data files/layers vary depend on its availability. We prepared polygon and centroid data are in GeoParquet format and other data are in Parquet. GeoPackage files include all data as one file.

|filename                        |type   |description                                 |description_ja                           |
|--------------------------------|-------|--------------------------------------------|-----------------------------------------|
|building_lod0                   |polygon|Building footprint 2D polygons.             |建物フットプリント2Dポリゴンとその属性                     |
|building_centroid_lod0          |point  |Centroid points of 2D footprint polygons.   |建物フットプリントポリゴンのセントロイドとその属性                |
|building_detail                 |table  |Basic information of buildings.             |建築物に関する基礎的な情報                            |
|building_large_customer_facility|table  |Basic information of large size buildings.  |大規模小売店舗や大規模集客施設に関する基礎的な情報                |
|building_data_quality           |table  |Data quality of each building data.         |地物インスタンスごとのデータの作成情報                      |
|building_risk_flooding          |table  |Flooding zone attributes.                   |洪水浸水想定区域内に存在する建築物に付与された浸水想定区域がもつ属性       |
|building_risk_tsunami           |table  |Tsunami zone attributes.                    |津波洪水浸水想定の区域内に存在する建築物付与した津波浸水想定の区域の属性     |
|building_risk_high_tide         |table  |High tide zone attributes.                  |高潮浸水想定区域に存在する建築物に付与した高潮浸水想定区域の属性を        |
|building_risk_internal_overflow |table  |Inland water inundation zone attributes.    |内水浸水想定区域に存在する建築物に付与した内水浸水想定区域の属性         |
|building_risk_land_slide        |table  |Land slide zone attributes.                 |土砂災害警戒区域及び土砂災害特別警戒区域に存在する建築物に付与した区域に関する属性|

### Data Schema for each file (各データのスキーマ)

#### building_lod0 and building_centroid_lod0（建物ポリゴンとそのセントロイドデータのスキーマ）

|attribute_name                 |type     |sample data                                 |Definition                                                           |
|-------------------------------|---------|--------------------------------------------|---------------------------------------------------------------------|
|source_filename                |char(32) |53392546_bldg_6697_2_op.gml                 |Original data source file name                                       |
|gml_id                         |char(64) |bldg_fc50c7d9-76ac-4576-bfbd-f37c74410928   |Unique ID                                                            |
|building_id                    |char(32) |13111-bldg-524                              |Unique building ID in the municipality                               |
|branch_id                      |smallint |NULL                                        |Branch ID for Warehouses and sheds associated with the main building.|
|part_id                        |smallint |NULL                                        |Building area of a footprint polygon.                                |
|prefecture                     |char(5)  |東京都                                         |Prefecture name of the building location.                            |
|prefecture_code                |char(2)  |13                                          |Prefecture code number                                               |
|city                           |char(32) |東京都大田区                                      |City name of the building location.                                  |
|city_code                      |char(5)  |13111                                       |City code number                                                     |
|gml_description                    |char(64) |NULL                                        |                                                                     |
|gml_name                           |char(64) |六郷土手郵便局                                     |building name                                                        |
|address                        |char(64) |東京都大田区東六郷三丁目                                |building address                                                     |
|creation_date                  |date     |20230322                                    |                                                                     |
|termination_date               |date     |NULL                                        |                                                                     |
|class                          |char(32) |普通建物             |                                              |
|class_code                     |smallint |3001                                        |                                                                     |
|usage                     |char(128)|工場      |      |
|usage_code                     |smallint |441                                        |                                                                     |
|year_of_construction           |smallint |1985                                        |                                                                     |
|year_of_demolition             |smallint |NULL                                        |                                                                     |
|roof_type                      |char(32) |NULL                                        |                                                                     |
|roof_type_code                 |smallint |NULL                                        |                                                                     |
|measured_height                |double   |8.3                                         |measured building height in meter                                    |
|measured_height_uom            |char(8)  |m                                           |unit of height measurement                                           |
|storeys_above_ground           |smallint |3                                        |                                                                     |
|storeys_below_ground           |smallint |1                                        |                                                                     |
|address    |text|NULL                                        |                                                                     |
|real_estate_id_of_building|text  |4307000240386-000B  | |
|number_of_building_unit_ownership    |text |1                                        |  |
|real_estate_id_of_building_unit_ownership|text |1                                        |                                                                     |
|number_of_real_estate_id_of_land     |text|4313000119863-0000                                        | |
|matching_score                  |text     |97  |
|cal_area_m2                    |double   |40.445643597318096                          |polygon areas in square meters                                       |
|cal_xmin                       |double   |139.71218932484814                          |minimum longitude of footprint polygons                              |
|cal_xmax                       |double   |139.71218932484814                          |maximum longitude of footprint polygons                              |
|cal_ymin                       |double   |35.54154939251641                           |minimum latitude of footprint polygons                               |
|cal_ymax                       |double   |35.54160749301028                           |maximum latitude of footprint polygons                               |
|cal_zmin_m                     |double   |2.406                                       |minimum height value from 3D geometries                              |
|cal_zmax_m                     |double   |9.141                                       |maximum height value from 3D geometries                              |
|cal_height_m                   |double   |6.734999999999999                           |building height based on the min and max height                      |

## building_detail
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |53392546_bldg_6697_2_op.gml              |                                                                                |
|gml_id                                 |text     |bldg_fc50c7d9-76ac-4576-bfbd-f37c74410928|                                                                                |
|building_id                            |text(200)|13111-bldg-524                           |Unique building ID in the municipality                                             |
|branch_id                              |text(200)|NULL                                     |Branch ID for Warehouses and sheds associated with the main building.              |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|serial_number_of_building_certification|text(200)|NULL                                     |Serial number of the building certification.                                       |
|site_area                              |text(200)|NULL                                     |Site area of a building.                                                           |
|site_area_uom                          |text(200)|NULL                                     |                                                                                |
|total_floor_area                       |text(200)|NULL                                     |Total floor area.                                                                  |
|total_floor_area_uom                   |text(200)|NULL                                     |                                                                                |
|building_footprint_area                |text(200)|NULL                                     |Area of the wall outline of the building.                                          |
|building_footprint_area_uom            |text(200)|NULL                                     |                                                                                |
|building_roof_edge_area                |text(200)|40.43768                                 |Area of the roof outline of the building.                                          |
|building_roof_edge_area_uom            |text(200)|m2                                       |                                                                                |
|development_area                       |text(200)|NULL                                     |Area of development.                                                               |
|development_area_uom                   |text(200)|NULL                                     |                                                                                |
|building_structure_type                |text(200)|NULL                                     |Building stcutture type based on standard codes.                                   |
|building_structure_type_code           |text(200)|NULL                                     |                                                                                |
|building_structure_org_type            |text(200)|NULL                                     |Building stcutture type based on the code set by the municipality                  |
|building_structure_org_type_code       |text(200)|NULL                                     |                                                                                |
|fireproof_structure_type               |text(200)|NULL                                     |Fireproof structure type of the building.                                          |
|fireproof_structure_type_code          |text(200)|NULL                                     |                                                                                |
|implementing_body                      |text(200)|NULL                                     |Implement body of the building.                                                    |
|urban_plan_type                        |text(200)|NULL                                     |Type of the building location designated by Urban Plan                             |
|urban_plan_type_code                   |text(200)|NULL                                     |                                                                                |
|area_classification_type               |text(200)|NULL                                     |Type of the building location designated by Area classification.                   |
|area_classification_type_code          |text(200)|NULL                                     |                                                                                |
|districts_and_zones_type               |text(200)|NULL                                     |Type of the building location designated by Districts and Zones.                   |
|districts_and_zones_type_code          |text(200)|NULL                                     |                                                                                |
|land_use_type                          |text(200)|NULL                                     |Type of the building location designated by Land Use Plan.                         |
|land_use_type_code                     |text(200)|NULL                                     |                                                                                |
|major_usage                            |text(200)|NULL                                     |Major classification of building usage based on the code set by the municipality.  |
|major_usage_code                       |text(200)|NULL                                     |                                                                                |
|major_usage2                           |text(200)|NULL                                     |Major classification of building usage 2 based on the code set by the municipality.|
|major_usage2_code                      |text(200)|NULL                                     |                                                                                |
|org_usage                              |text(200)|NULL                                     |Building usage based on the code set by the municipality.                          |
|org_usage_code                         |text(200)|NULL                                     |                                                                                |
|org_usage2                             |text(200)|NULL                                     |Building usage 2 based on the code set by the municipality.                        |
|org_usage2_code                        |text(200)|NULL                                     |                                                                                |
|detailed_usage                         |text(200)|NULL                                     |Building detailed usage based on the code set by the municipality.                 |
|detailed_usage_code                    |text(200)|NULL                                     |                                                                                |
|detailed_usage2                        |text(200)|NULL                                     |Building detailed usage 2 based on the code set by the municipality.               |
|detailed_usage2_code                   |text(200)|NULL                                     |                                                                                |
|detailed_usage3                        |text(200)|NULL                                     |Building detailed usage 3 based on the code set by the municipality.               |
|detailed_usage3_code                   |text(200)|NULL                                     |                                                                                |
|ground_floor_usage                     |text(200)|NULL                                     |Usage of the ground floor of the building                                          |
|ground_floor_usage_code                |text(200)|NULL                                     |                                                                                |
|second_floor_usage                     |text(200)|NULL                                     |                                                                                |
|second_floor_usage_code                |text(200)|NULL                                     |                                                                                |
|third_floor_usage                      |text(200)|NULL                                     |                                                                                |
|third_floor_usage_code                 |text(200)|NULL                                     |                                                                                |
|basement_usage                         |text(200)|NULL                                     |                                                                                |
|basement_usage_code                    |text(200)|NULL                                     |                                                                                |
|basement_first_usage                   |text(200)|NULL                                     |                                                                                |
|basement_first_usage_code              |text(200)|NULL                                     |                                                                                |
|basement_second_usage                  |text(200)|NULL                                     |                                                                                |
|basement_second_usage_code             |text(200)|NULL                                     |                                                                                |
|vacancy                                |text(200)|NULL                                     |                                                                                |
|vacancy_code                           |text(200)|NULL                                     |                                                                                |
|building_coverage_rate                 |text(200)|NULL                                     |                                                                                |
|floor_area_rate                        |text(200)|NULL                                     |                                                                                |
|specified_building_coverage_rate       |text(200)|NULL                                     |                                                                                |
|specified_floor_area_rate              |text(200)|NULL                                     |                                                                                |
|standard_floor_area_rate               |text(200)|NULL                                     |                                                                                |
|building_height                        |text(200)|NULL                                     |                                                                                |
|building_height_uom                    |text(200)|NULL                                     |                                                                                |
|eave_height                            |text(200)|NULL                                     |                                                                                |
|eave_height_uom                        |text(200)|NULL                                     |                                                                                |
|note                                   |text(200)|NULL                                     |                                                                                |
|survey_year                            |text(200)|2016                                     |                                                                                |

## building_large_customer_facility
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |49300574_bldg_6697_op.gml                |                                                                                |
|gml_id                                 |text     |bldg_154b30dc-1a6b-4af0-a9d8-5c99d8bba147|                                                                                |
|building_id                            |text(200)|43100-bldg-3478                          |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|class                                  |text(200)|大規模小売店舗（その他）|                                                                                |
|class_code                             |text(200)|4                                        |                                                                                |
|name                                   |text(200)|TSUTAYA　むつ店|                                                                                |
|capacity                               |text(200)|NULL                                     |                                                                                |
|owner                                  |text(200)|NULL                                     |                                                                                |
|total_floor_area                       |text(200)|2750                                     |                                                                                |
|total_floor_area_uom                   |text(200)|m2                                     |                                                                                |
|total_store_floor_area                 |text(200)|NULL                                     |                                                                                |
|total_store_floor_area_uom             |text(200)|NULL                                     |                                                                                |
|inaugural_date                         |text(200)|NULL                                     |                                                                                |
|year_opened                            |text(200)|NULL                                     |                                                                                |
|year_closed                            |text(200)|NULL                                     |                                                                                |
|key_tenants                            |text(200)|NULL                                     |                                                                                |
|availability                           |text(200)|NULL                                     |                                                                                |
|urban_plan_type                        |text(200)|都市計画区域                              |                                                                                |
|urban_plan_type_code                   |text(200)|21                                     |                                                                                |
|area_classification_type               |text(200)|NULL                                     |                                                                                |
|area_classification_type_code          |text(200)|NULL                                     |                                                                                |
|districts_and_zones_type               |text(200)|NULL                                     |                                                                                |
|districts_and_zones_type_code          |text(200)|NULL                                     |                                                                                |
|land_use_type                          |text(200)|NULL                                     |                                                                                |
|land_use_type_code                     |text(200)|NULL                                     |                                                                                |
|reference                              |text(200)|NULL                                     |                                                                                |
|note                                   |text(200)|NULL                                     |                                                                                |
|survey_year                            |text(200)|2017                                     |                                                                                |

## building_data_quality
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |53392546_bldg_6697_2_op.gml              |                                                                                |
|gml_id                                 |text     |bldg_fc50c7d9-76ac-4576-bfbd-f37c74410928|                                                                                |
|building_id                            |text(200)|13111-bldg-524                           |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|src_scale                              |text     |地図情報レベル2500                              |                                                                                |
|src_scale_code                         |text     |1                                        |                                                                                |
|geometry_src_desc                      |text     |空中写真測量                                   |                                                                                |
|geometry_src_desc_code                 |text     |5                                        |                                                                                |
|thematic_src_desc                      |text     |都市計画基礎調査                                 |                                                                                |
|thematic_src_desc_code                 |text     |1                                        |                                                                                |
|appearance_src_desc                    |text     |空中写真                                     |                                                                                |
|appearance_src_desc_code               |text     |1                                        |                                                                                |
|lod_type                               |text     |2.0                                      |                                                                                |
|lod1_height_type                       |text(200)|点群から取得_中央値                               |                                                                                |
|lod1_height_type_code                  |text(200)|2                                        |                                                                                |

## building_risk_flooding
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |53392546_bldg_6697_2_op.gml              |                                                                                |
|gml_id                                 |text     |bldg_fc50c7d9-76ac-4576-bfbd-f37c74410928|                                                                                |
|building_id                            |text(200)|13111-bldg-524                           |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|description                            |text(200)|城南地区河川流域                                 |                                                                                |
|description_code                       |text(200)|3                                        |                                                                                |
|rank                                   |text(200)|0.5m未満                                   |                                                                                |
|rank_code                              |text(200)|1                                        |                                                                                |
|rank_org                               |text(200)|NULL                                     |                                                                                |
|rank_org_code                          |text(200)|NULL                                     |                                                                                |
|depth                                  |text(200)|0.092                                    |                                                                                |
|depth_uom                              |text(200)|m                                        |                                                                                |
|admin_type                             |text(200)|都道府県                                     |                                                                                |
|admin_type_code                        |text(200)|2                                        |                                                                                |
|scale                                  |text(200)|L2（想定最大規模）                               |                                                                                |
|scale_code                             |text(200)|2                                        |                                                                                |
|duration                               |text(200)|14.55                                    |                                                                                |
|duration_uom                           |text(200)|hour                                     |                                                                                |

## building_risk_tsunami
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |52362499_bldg_6697_op.gml                |                                                                                |
|gml_id                                 |text     |bldg_92f5c8b4-2e54-4c21-b93b-2119ca62c846|                                                                                |
|building_id                            |text(200)|24202-bldg-169103                        |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|description                            |text(200)|1                                        |                                                                                |
|description_code                       |text(200)|1                                        |                                                                                |
|rank                                   |text(200)|3                                        |                                                                                |
|rank_code                              |text(200)|3                                        |                                                                                |
|rank_org                               |text(200)|NULL                                     |                                                                                |
|rank_org_code                          |text(200)|NULL                                     |                                                                                |
|depth                                  |text(200)|0.13                                     |                                                                                |
|depth_uom                              |text(200)|m                                        |                                                                                |

## building_risk_high_tide

| column           | data_type | details            | example                                   |
|------------------|-----------|--------------------|-------------------------------------------|
| source_filename  | String    | source file name   | 53394539_bldg_6697_2_op.gml               |
| gml_id           | String    | building unique ID | bldg_d36d2972-098d-4be1-b595-7fe8cd79994b |
| building_id      | String    | building ID        | 13101-bldg-9339                           |
| branch_id        | String    |                    |                                           |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
| description      | String    | description        | 高潮浸水想定区域図                                 |
| description_code | String    | 1                  |                                           |
| rank             | String    | tide rank          | 0.5m未満                                    |
| rank_code        | String    | tide rank code     | 1                                         |
| rank_org         | String    |                    |                                           |
| rank_org_code    | String    |                    |                                           |
| depth            | String    | tide depth         | 0.43                                      |
| depth_uom        | String    | unit               | m                                         |
| id               | Integer64 | sequential number  | 1                                         |

## building_risk_internal_overflow
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |52362487_bldg_6697_op.gml                |                                                                                |
|gml_id                                 |text     |bldg_7a69ff2f-a672-45e8-b743-b0323014ed46|                                                                                |
|building_id                            |text(200)|24202-bldg-175892                        |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|description                            |text(200)|1                                        |                                                                                |
|description_code                       |text(200)|1                                        |                                                                                |
|rank                                   |text(200)|3                                        |                                                                                |
|rank_code                              |text(200)|3                                        |                                                                                |
|rank_org                               |text(200)|NULL                                     |                                                                                |
|rank_org_code                          |text(200)|NULL                                     |                                                                                |
|depth                                  |text(200)|0.076                                    |                                                                                |
|depth_uom                              |text(200)|m                                        |                                                                                |

## building_risk_land_slide
|attribute_name                         |type     |sample data                              |Definition                                                                         |
|---------------------------------------|---------|-----------------------------------------|-----------------------------------------------------------------------------------|
|source_filename                        |text     |53392584_bldg_6697_2_op.gml              |                                                                                |
|gml_id                                 |text     |bldg_ad10f991-e3ca-4cbb-87f4-161e7065943b|                                                                                |
|building_id                            |text(200)|13111-bldg-67878                         |                                                                                |
|branch_id                              |text(200)|NULL                                     |                                                                                |
|prefecture|text|北海道|Prefecture name|
|prefecture_code|text|01|Prefecture code|
|city|text|北海道札幌市南区|City name|
|city_code|text|01106|City code|
|description                            |text(200)|急傾斜地の崩落                                  |                                                                                |
|description_code                       |text(200)|1                                        |                                                                                |
|area_type                              |text(200)|土砂災害警戒区域（指定済）                            |                                                                                |
|area_type_code                         |text(200)|1                                        |                                                                                |

license: Data also requires compliance with PROJECT PLATEAU's own terms of use (https://www.mlit.go.jp/plateau/site-policy/), which apply to the underlying source CityGML data.

extent.spatial.bbox: omitted; spatial reference is categorical via [01100_sapporo-shi_2020_building_centroid_lod0.GEOM (geometry), 01100_sapporo-shi_2020_building_centroid_lod0.prefecture (placename), 01100_sapporo-shi_2020_building_centroid_lod0.prefecture_code (admin_code), 01100_sapporo-shi_2020_building_centroid_lod0.city (placename), 01100_sapporo-shi_2020_building_centroid_lod0.city_code (admin_code), 47201_naha-shi_2020_building_lod0.GEOM (geometry), 47201_naha-shi_2020_building_lod0.prefecture (placename), 47201_naha-shi_2020_building_lod0.prefecture_code (admin_code), 47201_naha-shi_2020_building_lod0.city (placename), 47201_naha-shi_2020_building_lod0.city_code (admin_code)]. Add bbox once a placename → bbox gazetteer is available.


Japanese Vegetation Map (1/25,000)

The most detailed vegetation map covering all of Japan at 1:25,000 scale, based on the Natural Environment Conservation Basic Survey conducted by Japan's Ministry of the Environment Biodiversity Center. Original shapefiles divided by standard mesh areas were downloaded, merged into a single GeoParquet file, schema anomalies corrected, and adjacent cross-mesh polygons unified. Categorical attribute values were translated from Japanese to English using ChatGPT-4o.

land-cover biodiversity natural-environment vegetation-classification

Biodiversity Center, Ministry of the Environment (Japan)

[spatial_index] Japanese standard 2nd-level mesh code identifying source tile

[geometry] Polygon geometry of vegetation areas, EPSG:4326

Source Cooperative product page

## README.md
# Japanese Vegetation Map (1/25,000)

This is the most detailed vegetation map covering all of Japan. The Ministry of the Environment has been conducting the Natural Environment Conservation Basic Survey. The vegetation survey is a part of this extensive nationwide natural environment survey (http://gis.biodic.go.jp/webgis/sc-043.html).

The original data was prepared as shapefile and was divided into Japanese standard mesh areas. We downloaded all data files and merged into one GeoParquet file. During this merging process, we fixed a data schema anomaly. We also merged adjacent polygons from different mesh areas based on their attribute values.

All descriptive attribute values were in Japanese. So we extracted all unique attribute values and translated into English. We used ChatGPT4o for this translation. We cannot guarantee the translation accuracy, so please use these English descriptions at your own risk.

## Data attribution (en):
1/25,000 scale vegetation maps (Biodiversity Center, Ministry of the Environment) were download and processed by Pacific Spatial Solutions inc. ([Vegetation map data download site](http://gis.biodic.go.jp/webgis/sc-025.html?kind=vg67))

## データの出典記載 (ja)：
1/25,000植生図 全県分GISデータ(環境省生物多様性センター)を使用し、Pacific Spatial Solutions 株式会社が作成・加工したものである。([植生調査(1/2.5万) 都道府県別一覧](http://gis.biodic.go.jp/webgis/sc-025.html?kind=vg67))

## Terms of data usage (en):
This data can be used in accordance with the [Creative Commons Attribution 4.0 International](https://creativecommons.org/licenses/by/4.0/legalcode.ja) (CC BY). When using the data, please indicate the attribution. For more detailed data usage terms, please visit the [Biodiversity Center website](https://www.biodic.go.jp/copyright/index.html).

## データの利用条件 (ja)：
本データは、[クリエイティブ・コモンズ・ライセンスの表示4.0 国際](https://creativecommons.org/licenses/by/4.0/legalcode.ja) (CC BY) に従い利用することができます。データを利用する際は、出典をご記載ください。より詳しいデータの利用規約は[生物多様性センターのサイト](https://www.biodic.go.jp/copyright/index.html)で御覧ください。

# Data descriptions

| field name | description en   | description ja |
| ---------- | ---------------- | -------------- |
| org_no     | legend number in the vegetation map | 植生図内に記載されている凡例番号 |
| mesh2_c    | 2nd mesh code    | 旧図郭の二次メッシュコード |
| surv_year  | Survey year      | 植生調査を実施した年次（西暦4桁） |
| zukaku_no  | Legend number within each data | 植生図の図郭内で使用されている凡例の通し番号 |
| filename   | Original shapefile name | オリジナルのShapefile名 |
| chu_c      | Medium level vegetation code | 植生中区分のコード |
| chu_n      | Medium level vegetation name in ja | 植生中区分の日本語名称 |
| chu_en     | Medium level vegetation name in en | 植生中区分の英語名称 |
| dai_c      | High level vegetation code | 植生大区分のコード |
| dai_n      | High level vegetation name in ja | 植生大区分日本語名称 |
| dai_en     | High level vegetation name in en | 植生大区分の英語名称 |
| hanrei_c   | Integrated legend code | 統一凡例名コード |
| hanrei_n   | Integrated legend name in ja | 統一凡例日本語名 |
| hanrei_en  | Integrated legend name in en | 統一凡例英語名 |
| sai_c      | Fine level vegetation code | 植生細区分のコード |
| sai_n      | Fine level vegetaion name in ja | 植生細区分の日本語名称 |
| sai_en     | Fine level vegeation name in en | 植生細区分の英語名称 |
| shoku_c    | Vegetation group code | 植生区分のコード |
| shoku_n    | Vegetation group name in ja | 植生区分の日本語名称 |
| shoku_en   | Vegetation group name in en | 植生区分の英語名称　|

extent.spatial.bbox: omitted; spatial reference is categorical via [jp_vegetation25000_en.GEOM (geometry), jp_vegetation25000_en.mesh2_c (spatial_index)]. Add bbox once a placename → bbox gazetteer is available.


Example Earth Observation and Model Data

Example data for testing I/O and analytics libraries


example-tiff

A public collection of 510+ TIFF files spanning a wide range of compressions, tiling schemes, data types, and internal layouts. Assembled from the GDAL autotest suite, Development Seed's geotiff-test-data repository, and real-world rasters including Sentinel-2 imagery, sea-surface temperature data, and digital elevation models. Maintained as a test corpus for TIFF reading and parsing libraries, particularly the virtual-tiff project.

cloud-optimized-geotiff remote-sensing satellite-imagery digital-elevation-model sentinel-2 test-data

Dataset files (543 x .tif)

Source Cooperative product page

## README.md
# TIFF test data

A public collection of TIFF files covering a wide range of compressions, tiling schemes, data types, and internal layouts. The files are useful for testing any TIFF reading or parsing library and are maintained as part of the [virtual-tiff](https://github.com/virtual-zarr/virtual-tiff) project.

Last updated: 2026-04-29

## Sources and licenses

### GDAL autotest (`gdal/`)

501 files extracted from the GDAL [autotest](https://github.com/OSGeo/gdal/tree/master/autotest) directory.

- **Source:** <https://github.com/OSGeo/gdal>
- **License:** MIT/X — see [GDAL LICENSE.TXT](https://github.com/OSGeo/gdal/blob/master/LICENSE.TXT)
- **Copyright:** Frank Warmerdam, Even Rouault, and contributors

### External files (`github/`)

Files downloaded from third-party sources for testing a variety of TIFF encodings.

| File | Source URL | License |
|------|-----------|---------|
| `20250331090000-JPL-L4_GHRSST-SSTfnd-MUR-GLOB-v02.0-fv04.1_analysed_sst.tif` | https://data.source.coop/ausantarctic/ghrsst-mur-v2/2025/03/31/20250331090000-JPL-L4_GHRSST-SSTfnd-MUR-GLOB-v02.0-fv04.1_analysed_sst.tif | Public domain (NASA JPL) |
| `40613.tif` | https://cildata.crbs.ucsd.edu/media/images/40613/40613.tif | Public domain (UCSD / NCMIR) |
| `B04.tif` | https://sentinel-cogs.s3.us-west-2.amazonaws.com/sentinel-s2-l2a-cogs/33/U/WP/2025/6/S2C_33UWP_20250615_0_L2A/B04.tif | CC BY-SA 3.0 IGO (Copernicus Sentinel-2) |
| `IBCSO_v2_ice-surface_cog.tif` | https://github.com/mdsumner/ibcso-cog/raw/main/IBCSO_v2_ice-surface_cog.tif | CC BY 4.0 (AWI / IBCSO) |
| `SIG0_20250404T234439__VH_A091_E048N063T3_SA020M_V1M1R2_S1AIWGRDH_TUWIEN.tif` | https://data.eodc.eu/collections/SENTINEL1_SIG0_20M/V1M1R2/EQUI7_SA020M/E048N063T3/SIG0_20250404T234439__VH_A091_E048N063T3_SA020M_V1M1R2_S1AIWGRDH_TUWIEN.tif | CC BY 4.0 (Copernicus Sentinel) |
| `TCI.tif` | https://e84-earth-search-sentinel-data.s3.us-west-2.amazonaws.com/sentinel-2-c1-l2a/55/G/EN/2025/3/S2C_T55GEN_20250324T000834_L2A/TCI.tif | CC BY-SA 3.0 IGO (Copernicus Sentinel-2) |
| `rema_mosaic_1km_v2.0_filled_cop30_dem.tif` | https://github.com/mdsumner/rema-ovr/raw/refs/heads/main/rema_mosaic_1km_v2.0_filled_cop30_dem.tif | Public domain (REMA / Byrd Polar) |
| `test_reference.tif` | https://gitlab.com/Richard.Scott1/raster-analysis-goals/-/raw/main/test_reference.tif?ref_type=heads&inline=false | Unknown |

### geotiff-test-data (`geotiff-test-data/`)

33 files from the [geotiff-test-data](https://github.com/developmentseed/geotiff-test-data) repository.

- **Source:** <https://github.com/developmentseed/geotiff-test-data>
- **License:** MIT (synthetic fixtures); see individual README files in real_data/ subdirectories for real-world data licenses
- **Copyright:** Development Seed and contributors

## Usage

These files are publicly hosted and can be used by any project. To download them with the virtual-tiff helper script:

```bash
uv run scripts/download_test_data.py
```

## Disclaimer

These files are redistributed solely for automated testing. Refer to each source for authoritative license terms.

license: AI returned 'unknown' (README does not state a license). Verify with publisher before flipping to _state: reviewed.


geozarr-examples

Example datasets demonstrating GeoZarr-compliant data, a cloud-native format for storing geospatial raster data using the Zarr specification. The collection covers a projected spatial extent (approximately 110 km × 110 km) with 157 Zarr array files totaling ~72 MB.

Dataset files (1 x .zarr)

Source Cooperative product page

providers: role [producer, processor] for 'GeoZarr Working Group / Radiant Earth' is an AI guess — No README; assumed producer/processor based on API description referencing GeoZarr specification examples. Verify before flipping to _state: reviewed.


Osiris-Comprehensive Bespoke Atmospheric Model (CBAM) reanalysis-east-africa

The Osiris CBAM (Comprehensive Bespoke Atmospheric Model) reanalysis dataset provides high-resolution (4 km spatial, hourly temporal) agrometeorological data for East Africa. It covers the region from approximately 27°E to 44°E, 13°S to 7°N, with data beginning in 2012. The dataset has demonstrated improved or comparable skill relative to existing gridded agrometeorological products.

agriculture reanalysis meteorology agro-meteorology east-africa climate remote-sensing

Dataset files (27308 x .nc)

Source Cooperative product page


Agroforestry Individual Tree Detection (India, GeoTIFF + COCO)

A benchmark dataset of 13,492 GeoTIFF image chips and 353,644 COCO-format tree-crown annotations for individual tree detection in agroforestry and agricultural landscapes across India. Each image chip is paired with per-image metadata and assigned to one of several train/evaluation splits, including a fixed train/in-distribution-test partition and a non-distribution-shift protocol. Split metadata includes state, region, and zone fields to support geographic robustness evaluation.

remote-sensing agriculture machine-learning aerial-imagery agroforestry tree-detection object-detection

Dataset files (13504 x .tiff)

Source Cooperative product page

## README.md
# Individual Tree Detection Dataset

This release contains GeoTIFF image chips and COCO-format tree-crown annotations for individual tree detection in agroforestry landscapes.

## Contents

- `geotiffs/`: 13,492 GeoTIFF image chips.
- `annotations/instances_india_tree_detection_coco_clean.json`: clean COCO annotations.
- `metadata/india_geotiff_release_manifest.csv`: one row per image with metadata.
- `splits/`: train/evaluation split files used by the benchmark and non-distribution-shift baseline.
- `samples/`: small reviewer-inspection sample.
- `croissant.json`: machine-readable dataset metadata.

## Counts

- Images: 13,492
- Annotations: 353,644
- Category: `tree`
- Images with at least one annotation: 13,492

## Split Protocols

The release includes:

- `india_train.*` and `india_id_test.*`: fixed released train and ID-test partition.
- `non_distshift_train_val_test.csv`: non-distribution-shift protocol used by benchmark training jobs.
- `traditional_cv_*.txt`: conventional train/validation/test aliases.

The split metadata includes state, region, and zone fields for geographic evaluation.

## License

This dataset release is licensed under [Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)](https://creativecommons.org/licenses/by-nc/4.0/).

Orthophoto and imagery underlying the GeoTIFF chips remain subject to the original acquisition and provider agreements summarized in `croissant.json` (`prov:wasDerivedFrom`). The CC BY-NC license applies to this release as packaged; confirm compatibility before commingling with other sources or uses outside non-commercial terms where NC applies.

license: The CC BY-NC 4.0 license applies to the packaged release; underlying orthophoto and imagery remains subject to original acquisition and provider agreements documented in croissant.json.


Agroforestry Tree Species Identification (India, Multimodal)

A multimodal tree species identification dataset covering 23,156 individual trees in agroforestry settings across Karnataka and Rajasthan, India. Each example links tree-level metadata and species labels with SkySat RGB crops, Sentinel-1 time series, Sentinel-2 time series, PlanetScope time series, and derived species-classification vectors. Raw Google Street View imagery is not redistributed; panorama IDs are retained to support reproducible workflows for users with appropriate API access.

remote-sensing agriculture agroforestry tree-species multimodal

Ajmer
Alwar
Ballari
Balotra
Barmer
Bengaluru South
Bharatpur
Bhilwara
Bikaner
Bundi
Chikkaballapura
Chitradurga
Chittorgarh
Churu
Dakshina Kannada
Dausa
Davanagere
Deeg
Dharwad
Gadag
Hanumangarh
Hassan
Jaipur
Jaisalmer
Jalore
Jhunjhunu
Jodhpur
Karauli
Kolar
Koppal
Kota
Kotputli-Behror
Mandya
Nagaur
Pali
Phalodi
Pratapgarh
Raichur
Sawai Madhopur
Shimoga
Sikar
Tonk
Tumakuru
Udaipur
Udupi
Uttara Kannada
Vijayanagara

center east north northeast northwest south southeast southwest west

lat

[latlon] Latitude of the sample/location point

lon

[latlon] Longitude of the sample/location point

source

[placename] City or district name for the sample location (e.g. Ajmer, Ballari)

[latlon] Latitude of the Google Street View capture point

[latlon] Longitude of the Google Street View capture point

state

[placename] Indian state name: Karnataka or Rajasthan

[latlon] Original detection latitude before any snapping or adjustment

[latlon] Original detection longitude before any snapping or adjustment

[geometry] Bounding box of the tree crown

3 files sampled for this table

manifest

[latlon] Latitude of the individual tree in the release manifest

[latlon] Longitude of the individual tree in the release manifest

[geometry] Western edge of tree bounding box (combined with bbox_south/east/north)

region

[placename] Named region or district associated with the tree

3 files sampled for this table

[latlon] Original detection latitude

[latlon] Original detection longitude

2 files sampled for this table

[latlon] Original detection latitude

[latlon] Original detection longitude

2 files sampled for this table

Source Cooperative product page

## README.md
# Species Identification Dataset

This release contains a no-GSV multimodal tree species identification dataset organized around individual trees.

Raw Google Street View images are not redistributed. Panorama IDs and related metadata are retained, and code is released separately to repopulate GSV imagery from those panorama IDs where users have appropriate API access and rights.

## Contents

- `tree_metadata.csv`: sanitized tree-level metadata.
- `gsv_pano_ids.csv`: tree-level mapping to GSV panorama IDs and related capture/geometry fields.
- `all_metadata.json`: sanitized nested metadata.
- `instances_default.json`: annotation export.
- `all_locations.csv`, `dataset_summary.json`, `dataset_and_labels_context.txt`: dataset context files.
- `skysat_crops/`: one canonical RGB JPEG per example.
- `sentinel1_pixel_timeseries/pixel_data/`: Sentinel-1 tree time series, one CSV per example.
- `sentinel2_pixel_timeseries/pixel_data/`: Sentinel-2 tree time series, one CSV per example.
- `planetscope_pixel_timeseries/pixel_data/`: PlanetScope tree time series, one CSV per example.
- `species_classification_vectors_5full/`: full-modality species vector outputs.
- `manifest/`: release manifests and audit files.
- `sample_100/`: small reviewer-inspection sample with 100 complete examples across modalities.

## Counts

- Examples: 23,156 individual trees.
- Raw Google Street View images included: no.
- Modalities included: SkySat RGB crops, Sentinel-1 time series, Sentinel-2 time series, PlanetScope time series, and derived species-classification vectors.

## Reproducibility

The release can be used without raw GSV images using the released remote-sensing modalities, labels, metadata, and vectors. Users who have appropriate API access and rights can use the retained panorama IDs with separately released code to repopulate GSV images through the provider-approved access path.

## License

This dataset release is licensed under [Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)](https://creativecommons.org/licenses/by-nc/4.0/).

Upstream and optional sources remain subject to their own terms: for example, Google Street View / Maps Platform rules if you fetch imagery from panorama IDs, Copernicus Sentinel and Planet policies for underlying satellite products, and any provider-specific restrictions noted in `croissant.json` provenance. The CC BY-NC license applies to this curated release as a whole; it does not override third-party licenses for data you obtain separately from those providers.

providers: role [producer] for 'Planet Labs' is an AI guess — Provider of SkySat and PlanetScope satellite imagery used as upstream source modalities; README lists them as an upstream source subject to their own terms, not as an explicit dataset producer.. Verify before flipping to _state: reviewed.

providers: role [producer] for 'ESA / Copernicus' is an AI guess — Provider of Sentinel-1 and Sentinel-2 imagery used as upstream source modalities; README lists Copernicus Sentinel as an upstream source, not an explicit dataset producer.. Verify before flipping to _state: reviewed.

providers: role [producer] for 'Google' is an AI guess — Provider of Street View panoramas (panorama IDs retained but imagery not redistributed); README lists Google Street View / Maps Platform as an upstream source subject to its own terms.. Verify before flipping to _state: reviewed.

extent.spatial.bbox: omitted; spatial reference is categorical via [..lat (latlon), ..lon (latlon), ..tree_lat (latlon), ..tree_lon (latlon), ..gsv_lat (latlon), ..gsv_lon (latlon), ..original_lat (latlon), ..original_lon (latlon), ..source (placename), ..state (placename), ..tree_bbox (geometry), manifest.tree_lat (latlon), manifest.tree_lon (latlon), manifest.bbox_west (geometry), manifest.region (placename), species_classification_vectors_5full/data_splits.tree_lat (latlon), species_classification_vectors_5full/data_splits.tree_lon (latlon), species_classification_vectors_5full/data_splits.original_lat (latlon), species_classification_vectors_5full/data_splits.original_lon (latlon), species_classification_vectors_5full/metadata.tree_lat (latlon), species_classification_vectors_5full/metadata.tree_lon (latlon), species_classification_vectors_5full/metadata.original_lat (latlon), species_classification_vectors_5full/metadata.original_lon (latlon)]. Add bbox once the placename → bbox gazetteer covers it.


ESRI Tutorial Data

Data used for exercises in collaboration with ESRI showing the fundamentals of optical satellite imagery resolution: Spatial, Spectral, Temporal and Radiometric.


Field boundaries created by Planet's Automated Field Boundary detection algorithm

A pan-European vector dataset of agricultural field boundaries automatically delineated from Copernicus Sentinel-2 satellite imagery acquired in May–June 2022, covering approximately 54 country-level GeoParquet files with over 154 million field polygons. Each polygon represents a spatially homogeneous agricultural parcel and includes quality metrics from Planet's automated field boundary detection algorithm.

field-boundaries agriculture remote-sensing arable-land land-use land-parcels deep-learning machine-learning sentinel-2

Field Boundaries

Source Cooperative product page

Proprietary License

## README.md
# EU field boundaries
_A vector dataset of Field Boundaries, automatically delineated from Sentinel-2 satellite imagery from May-June 2022._

Automatic field delineation refers to the process of automatically tracing the boundaries of agricultural parcels from satellite or aerial imagery. We consider an agricultural parcel as a spatially homogeneous land unit used for agricultural purposes, where a single crop is grown. The result of the FD is a set of closed vector polygons marking the extent of each agricultural parcel. Such polygons are the input to a multitude of applications, ranging from the management of agricultural resources, such as the Area Monitoring for the Common Agricultural Policy, to precision farming, to the estimation of damages to crop yield due to natural (e.g. drought, floods), and human-made disasters (e.g. war). Automatic estimation of parcels with high fidelity in a timely manner allows therefore to characterize the changes of agricultural landscapes due to anthropogenic activities, agricultural practices, and climate change consequences.

<img src="https://data.source.coop/planet/eu-field-boundaries/eu-fb.png" alt="AOI of the dataset" width="100%"/>

The dataset was created using Copernicus Sentinel-2 data for May 2022, provided by [@sinergise](https://sinergise.com).

## Dataset License

[CreativeCommons BY-SA](https://creativecommons.org/licenses/by-sa/4.0/)

## Links
  * [Fiboa](https://github.com/fiboa/data-survey/blob/main/data/Planet.md) dataset description
  * Automatic Field Delineation [Blog post](https://medium.com/sentinel-hub/automatic-field-delineation-new-release-1c2938399f0)

## Authors

  [Sinergise](https://www.sinergise.com)
  * Matej Batic
  * Devis Peressutti
  * Nejc Vesel
  * Sara Verbic
  * Matic Lubej
  * Nika Oman Kadunc

  [Planet](https://planet.com)
  * Chris Holmes

## Acknowledgements

This work has received funding from the European Union's Horizon Europe research and innovation programme under grant agreement No. 101059548.

For more info about the project, see [OpenEarthMonitor](https://earthmonitor.org).

providers: role [licensor] for 'European Union / Horizon Europe' is an AI guess — Funder via grant No. 101059548 (OpenEarthMonitor); assumed licensor role is uncertain — they funded the work but may not hold IP. Verify before flipping to _state: reviewed.


99 million agricultural parcel boundaries with harmonized crop type information across seven European countries (Austria, Denmark, France, Germany, Netherlands, Portugal, Spain) covering 2018-2024. Derived from EU IACS programme cadastral and crop data with improved geometries and additional attributes for machine learning and Earth observation applications.

agriculture field-boundaries crop-classification land-parcels remote-sensing

Dataset files (75 x .parquet)

Source Cooperative product page

## README.md
# RapidCrops

## Data coverage

Dense temporal coverage (2018-2022) across seven countries:
- Austria
- Denmark
- Spain (partial coverage in Catalonia only)
- France
- Germany (partial coverage in Brandenberg, Nordrhein Westfalen & Lower Saxony)
- Netherlands
- Portugal

Additional years of coverage are included for:
- Germany (2023 & 2024)
- France (2023)
- Netherlands (2023 & 2024)

Datasets are published in two forms:
1. "National": National datasets are provided individually for each year of coverage.
2. "Combined": All national datasets are combined into a single partitioned (by country) dataset for a given year.

## Data structure

Because all data resides within Europe, boundary geometries are all provided in `EPSG:3035`.

See below an example GeoParquet schema for the France 2020 dataset:

## Usability and efficiency

Redundant vertices were removed from the boundary polygons with a tolerance of 20cm to protect the integrity of the parcel.
This resulted in a >25% reduction in the number of vertices, allowing for more efficient spatial queries.

## Assessing suitability for combining parcels with EO products

Identifying parcels from which clean pixels can be obtained from satellite imagery depends on both the size of a parcel and the regularity of its shape.
RapidCrops provides attributes to help quantify these properties:
- `parcel_width`: The length of the shortest edge on the parcel boundary's minimum rotated rectangle
- `area_ratio_hull`: The ratio between the area of the parcel boundary, and that of its convex hull
- `max_contained_radius`: The radius of the parcel boundary's maximum inscribed circle
Knowing this can help to filter out parcels from which meaningful analysis cannot be performed, or to help explain variation in performance across parcels.

These metrics can be used to identify suitable parcels for analysis by a given EO sensor, as highlighted below:

## Facilitating spatial stratification

Grid cell IDs from two popular spatial gridding systems (Quadkey & H3) are included for each boundary to allow for spatially-stratified sampling. The gridding systems are hierarchical and coarser grid resolutions can be derived form the values provided according to the user’s need.

Below is the quadkey spatial gridding at the resolution provided:

But coarser resolution gridding can be derived by reading a subset of the leftmost characters in the key:

## Accessing the data

```python
import geopandas as gpd

url = "s3://planet/rapidcrops/national/AUT/rapidcrops_2018_aut.geo.parquet"

# Retrieve a full dataset
df = gpd.read_parquet(url)

# OR, filter the dataset on a bbox for faster retrieval
df = gpd.read_parquet(url, bbox=bbox)
```

## Underlying data licenses

The data is made available subject to the licenses associated with the underlying source datasets. No additional limitations or conditions are applied. See below for links to the underlying license information for each source dataset:

| Source dataset        | Dataset license       |
|-----------------------|-----------------------|
| Austria               | [INSPIRE public access license](http://inspire.ec.europa.eu/metadata-codelist/LimitationsOnPublicAccess/noLimitations) & [CC-BY-AT 4.0](https://creativecommons.org/licenses/by/4.0/)                     |
| Denmark               |   [INSPIRE public access license](http://inspire.ec.europa.eu/metadata-codelist/LimitationsOnPublicAccess/noLimitations) & [INSPIRE no conditions](http://inspire.ec.europa.eu/metadata-codelist/ConditionsApplyingToAccessAndUse/noConditionsApply) & [CC0 1.0 Universal](https://creativecommons.org/publicdomain/zero/1.0/deed.en)                   |
| France                |   [Custom open license](https://www.etalab.gouv.fr/wp-content/uploads/2014/05/Open_Licence.pdf)                    |
| Germany               |   Custom open licenses: [NRW](http://dcat-ap.de/def/licenses/dl-by-de/2.0), [Brandenberg](https://www.govdata.de/dl-de/by-2-0), [LS](http://dcat-ap.de/def/licenses/dl-by-de/2.0)                    |
| Netherlands           |   [INSPIRE public access license](http://inspire.ec.europa.eu/metadata-codelist/LimitationsOnPublicAccess/noLimitations) & [INSPIRE no conditions](http://inspire.ec.europa.eu/metadata-codelist/ConditionsApplyingToAccessAndUse/noConditionsApply) & [Dutch creative commons license](http://creativecommons.org/publicdomain/mark/1.0/deed.nl)                    |
| Portugal              |  [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)                     |
| Spain                 |  [Custom open license](https://administraciodigital.gencat.cat/ca/dades/dades-obertes/informacio-practica/llicencies/#limitacio-de-responsabilitat)                     |

## Suggested citation

```
Holden, P., Davis, T., Holmes, C., Senaras, C., & Wania, A. (2025). RapidCrops: A pan-European label dataset for large-scale crop classification (v1.0) [Data set]. Zenodo. https://doi.org/10.5281/zenodo.15166359
```

In BibTeX format:

```
@dataset{rapidcrops,
  title = {RapidCrops: A pan-European label dataset for large-scale crop classification},
  publisher = {Zenodo},
  doi = {https://doi.org/10.5281/zenodo.15166359},
  year = {2025},
  urldate = {<date of access, ISO>},
  author = {
    Holden, Piers and
    Davis, Timothy and
    Holmes, Christopher and
    Senaras, Caglar and
    Wania, Annett
  },
  version = {1.0},
}
```


SkyScraper

Skyscraper pairs multi-temporal Earth-observation imagery with GDELT-derived news text: each record links geolocated PlanetScope or Sentinel-2 image sequences to event-centric captions and article metadata.


OpenStreetMap Open Data Products

Cloud-native vector tile distributions of OpenStreetMap and Natural Earth geodata in PMTiles format, covering Web Mercator zoom levels 0–15. Data is organized into thematic layers (water, buildings, landuse, etc.) and mirrored daily from Protomaps builds. These are lossy transformations of OSM planet data intended for basemap rendering.

openstreetmap administrative-boundaries vector-tiles pmtiles land-use building-footprints natural-earth

Dataset files (4 x .pmtiles)

Source Cooperative product page

## README.md

# OpenStreetMap

Distributions of OpenStreetMap vector geodata in cloud-native formats.

These datasets are "lossy" transformations of open source vector data from [planet.openstreetmap.org](planet.openstreetmap.org) and [Natural Earth](http://naturalearthdata.com).
Includes a subset of OSM features at Web Mercator zoom levels 0-15, organized into themes like `water`, `buildings` and `landuse`. The included features are documented at [Protomaps Basemap Layers](https://docs.protomaps.com/basemaps/layers).

## Tiles

`tiles/v3.pmtiles`: Latest basemap version. Mirrored daily from [maps.protomaps.com/builds](https://maps.protomaps.com/builds).

`tiles/v2/`: Version 2 of basemaps.

* Files can be viewed directly in Source Viewers.
* source.coop URLs can be viewed directly in the [PMTiles Viewer](https://protomaps.github.io/PMTiles/).
* Extract a spatial subset from the source.coop URL using the [pmtiles cli](https://docs.protomaps.com/pmtiles/cli#extract).

## Limitations

Limitations

* We don't recommend cross-origin hotlinking directly to source.coop URLs.
* Data reflects OpenStreetMap as of that day.

## License

Data products are Produced Works of the [Open Database License (ODbL)](https://opendatacommons.org/licenses/odbl/1-0/).

providers: role [processor, host] for 'Protomaps' is an AI guess — Assumed processor/host based on daily mirror from maps.protomaps.com/builds; README does not explicitly state roles.. Verify before flipping to _state: reviewed.


Red_Riego_Madrid

Municipal irrigation network infrastructure dataset for the city of Madrid, Spain, containing spatial records of irrigation sectors and valve-controlled irrigation lots. Each record includes irrigation type, electrovalve type, pipe caliber, and inventory identifiers linked to Madrid's infrastructure management system (MINT). The dataset covers the Madrid urban area with geometries in OGC CRS84.

hydrology irrigation urban-infrastructure geoparquet madrid

lote3

geometry

[geometry] OGC CRS84 polygon/linestring geometry of irrigation lot infrastructure elements

STRUCT(xmin FLOAT, ymin FLOAT, xmax FLOAT, ymax FLOAT)

2 files sampled for this table

sectores_riego_lote2_lote3_.parquet

[geometry] OGC CRS84 geometry of irrigation sectors

3 files sampled for this table

Source Cooperative product page

providers: role [producer, licensor] for 'Ayuntamiento de Madrid' is an AI guess — Inferred as municipal data producer based on dataset name, bounding box covering Madrid, and MINT (Madrid infrastructure inventory) identifiers; no README confirms the publisher.. Verify before flipping to _state: reviewed.

extent.spatial.bbox: omitted; spatial reference is categorical via [lote3.geometry (geometry), sectores_riego_lote2_lote3_.geometry (geometry)]. Add bbox once the placename → bbox gazetteer covers it.


GeoMIP_zarr

Geoengineering model Intercomparison Project (GeoMIP) simulations, from various earth system models, converted to the cloud-native zarr format.


Public Trees in the Netherlands - Test Bucket

Bucket used for testing of public trees in NL dataset

geoparquet/ : Not useful

nl_trees/ : Not useful

nl_trees_2/: Dutch tree dataset

nl_trees_no_hilbert/: Dutch tree dataset without spatial sorting, for testing purposes


Flight Counts