Geo Data: Difference between revisions

From Tygron Support wiki
Jump to navigation Jump to search
m (Reverted edits by Godelief@tygron.nl (talk) to last revision by Hedi@tygron.com)
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{being_updated}}
{{learned|what Geo data is|how Geo data relate to the {{software}}|how to import and export Geo data}}


{{learned|what Geo Data are|how Geo Data relate to the {{software}}|which Geo-Data sources are used}}
==What is Geo data==
Geographical data or geo data is data which have a location component. Almost all data is linked to a location or a place and are, therefore, geo data. Geo data can be, for example, a paper map, a digital web map or just a simple text file with coordinates. Geo datasets is either '''vector data''' (that is, features which are points, lines or polygons) or '''raster data''' (that is, data in grid cells). The features in vector data can have multiple attributes with values. Raster data mostly consist of a value and a color.


==What are Geo data==
==How do Geo datasets relate to the {{software}}==
Geographical data or geo data are data which have a location component. Almost all data are linked to a location or a place and are, therefore, geo data. Geo data can be, for example, a paper map, a digital web map or just a simple text file with coordinates. Geo datasets are either vectors (that is, features which are points, lines or polygons) or raster data (that is, data in grid cells). The features in vector data can have multiple attributes with values. Raster data mostly consist of a value and a color.
[[File:Generate_3D_world_databases.png|Load data from databases|thumb|400px|left|Tygron Platform loading screen showing several of the data connections]]
The {{software}} uses Geo data (vector and raster data) for creating the [[3D World|3D-model world]]. For this, the {{software}} automatically connects to (Open) [[Project_Sources#Sources_connected_to_the_Tygron_Platform|Datasets]], based on the availability of the data for the chosen location of the project. For example the Base Registers in the Netherlands and Open Street Maps worldwide.
A principle that generally applies: if your 3D World lacks certain information, then it is not available in the used datasets. <br> For more information on which data is used for your generating your project, see the [[Project_Sources#Sources_connected_to_the_Tygron_Platform|project sources]] page.  
To add missing Geo data you can add additional Geo data manually (see below for options).
<br clear=all>


==How do Geo data relate to the {{software}}==
==When to use your own data==
[[File:Generate_3D_world_databases.png|Load data from databases|400px|left]]
* The project takes place in a location for which there are no data sources available to create the project
The {{software}} uses geo data (vectors and raster) for creating the [[3D World|3D-model world]]. For this, the {{software}} automatically connects to (Open) Datasets, such as the Base Registers in the Netherlands and Open Street Maps worldwide. A principle that generally applies: if your 3D World lacks certain information, then it is not available in the used dataset. <br>  
* The default data sources are not accurate or up-to-date enough
To add missing Geo data you can either update the information in the database and regenerate the 3D world, or you can add additional Geo data manually. More information on how to import additional data is provided on the [[Geo Data Wizard#How_to_import_Geo_Data|Geo Data Wizard]] page.
* The default datasets are not detailed enough
* To do a more extended analysis in the {{software}}
* To use in combination with an Excel Indicator or Panel
* For creating more overview in your project, for example by highlighting areas
In these situations, it might be useful to overwrite or import data.
 
==Import Geo data==
Almost all data can be imported in the {{software}}, as long as the data is about specific locations and contains geometry (and therefore coordinates). Thus basically when the data is Geo data.
This also means that digital files of [[Spatial plans|spatial plans]] can be imported in the {{software}}.
There are different methods for importing Geo Data. The method to choose is based on how you have your data available, as vector or raster data.
 
====Import vector data====
=====Requirements=====
With the [[Geo_Data_Wizard|Geo data wizard]] you can easily import vector data. The wizard also helps you to transform your data to the proper format for importing.
The following requirements for vector data apply:
# Geo Data in the {{software}} are always polygons. Line and point features are not allowed by the {{software}}. The data wizards helps you by buffering the line and point features to polygons.
# All desired attributes must be numerical, so that they can be loaded as valid [[attribute]] values. Non-numeric attributes are ignored when attempting to load them as attributes.
# The Geo dataset should have a CRS (Coordinate Reference System) defined, for the Platform to properly translate the coordinates to the right location.  
<br>
There are three different import methods:
# with a [[GeoJSON]] file
# through a [[WFS|Web Feature Service (WFS)]]
# through a [[CSW|Catalogue Service for the Web (CSW)]]
Choose a method based on how you have your data available. Read more on the [[Geo_Data_Wizard#Import_method|data wizard page]] about the options.
=====Errors=====
If you run into any errors check this section on the [[Geo_Data_Wizard#Error_messages_in_the_Geo_Data_Wizard|most common errors]].
<br>
<br>
 
====Import raster data====
=====Requirements=====
The following requirements for raster data apply:
#The Geo dataset should have a CRS (Coordinate Reference System) defined, for the Platform to properly translate the coordinates to the right location.
<br>
There are two different import methods:
# through a [[WMS|Web Map Service (WMS)]].
# as a [[Geotiff_(Overlay)|Geotiff overlay]]
Choose a method based on how you have your data available.
 
==Export Geo data==
====Export vector data====
The components that make up the 3D world can be exported as 2D vector data in [[GeoJSON]] format. With this data, further/other calculations or analysis can be done in for example GIS software.
In the Current Situation tab, each of the following menus has an export GeoJSON option:
*[[Buildings]]
*[[Terrains]]
*[[Neighborhoods]]
*[[Zoning]]
*[[Plots]]
*[[Areas]]
*[[Network]]
<br>
{{Editor steps|title=export components of the 3D world|Hover over the desired menu you want to export objects from.|Select Export GeoJSON file|Choose additional options to make a selection of the to be exported data or for export all, click on the Export button.}}
 
<gallery>
File:Export_geojson_file.JPG|Export GeoJSON button in the Buildings menu.
File:Export_options.JPG|Make a selection based on category and/or attribute or export all objects by clicking on the Export button.
</gallery>
 
In the Export Item File panel that will show up, different options for exporting are available:
* Objects from a certain category/type (only for the [[Buildings]] and [[Terrain|Terrains]]) can be exported by selecting the desired category/type.
* Only objects that have a certain attribute can be exported by checking the ''With Attribute'' option and selecting the desired attribute. For example if you only want [[Culvert_(Water_Overlay)|culverts]], you can select the category ''Underground'' (since the function culverts belongs to the category Underground) and check the ''With Attribute'' option and select the attribute name ''CULVERT_DIAMETER'' for example. This will export culverts, since only these objects have this attribute in common.  
<br clear=all>
<br clear=all>


==Used Datasets==
====Export raster data====
[[Grid_Overlay|Grid overlays]] can be exported as a GeoTIFF or ASCII file. With such a file, calculations from for example the [[Water_Overlay|Water overlay]] can be exported to be further processed for analysis in GIS software. For exporting the grid overlays, take also note of the [[Grid_Overlay#Grid_size|grid size]]. The smaller the grid size, the more accurate the exported GeoTIFF is.
<br>
<br>
{{Editor steps|title=export grid overlay calculation results |Select any grid overlay in the editor.|On the [[right panel]], select "Export Grid File".|Choose the overlay, format and click on the Export button.}}
<gallery>
File:Select_grid_overlay.jpg|Select a grid overlay
File:Geotiff_export.jpg|Select "Export Grid File"
File:Export_grid_options.JPG|Choose the desired overlay to export, if applicable the difference overlay and/or timeframe and the desired format.
</gallery>


The table below contains the datasets that are automatically accessed when selecting a location within The Netherlands while creating a new project. When selecting a location outside The Netherlands it is more likely that some Geo Data should be provided manually. Furthermore, the {{software}} provides an overview of the used Geo Datasets in the [[Project_Sources|Project Sources]] overview.
In the Export Grid File panel that will show up, different options for exporting are available:
 
*If in a [[Test_Run|test run]] the option ''Export difference (current and maquette)'' is selected, the difference in results between the maquette state and the current state will be exported. If you checked this option outside of the test run, or did not do any [[Action|Actions]], the exported dataset will consist no difference.
{| class="wikitable"
* For the [[Water_Overlay|water overlays]], it is possible to export a dataset at a certain [[Timeframes_model_attribute_(Water_Overlay)|timeframe]], by selecting the ID of the timeframe. Keep in mind that the ID of the timeframe start at 0. Thus if you have 10 timeframes in the overlay, the timeframes IDs range from 0 to 9.  
|-
<br clear=all>
! (Open) Dataset
<br>
! Description
{{Template:GeoDataOverview}}
! Coverage
! (Connection) Source
! More information
|-
| BGT
| Basisregistratie Grootschalige Topografie: Base Register containining the topography of the Netherlands. The dataset is very detailed and contains for instance roads, parks, trees, water surfaces and street objects.
| Netherlands
| PDOK
| https://www.kadaster.nl/bgt
|-
| BAG
| Basisregistraties Adressen en Gebouwen: Base Register containing data about buildings and addresses such as function, construction year, size and the geometry of the buildings.
| Netherlands.
| PDOK
| https://www.kadaster.nl/basisregistratie-adressen-en-gebouwen
|-
| BRO
| Basisregistratie Ondergrond: Base Register containing detailed subsurface data. This dataset is used in the Tygron Platform 2019.0.0 version instead of the FGR dataset.
| Netherlands
| PDOK
| https://www.basisregistratieondergrond.nl/
|-
| World Imagery
| Satellite map used as base map for the 3D world and used for rooftop colors.
| Worldwide
| ESRI
| https://services.arcgisonline.com/ArcGIS/rest/services/World_Imagery/MapServer/0
|-
| Ocean Basemap
| Basemap with ocean data, including locations of water bodies and their names. Used to determine the location of water bodies worldwide.  
| Worldwide
| ESRI
| https://services.arcgisonline.com/arcgis/rest/services/Ocean_Basemap/MapServer
|-
| Terrain
| Digital Terrain Model: the terrain height of the bare ground without for example buildings, trees and other objects. For the Netherlands the DTM is created of AHN2 data resampled to 3 m.
| Worldwide
| ESRI
| http://www.arcgis.com/home/item.html?id=58a541efc59545e6b7137f961d7de883
|-
| AHN
| Actueel Hoogtebestand Nederland: Digital Surface Model: the terrain height including buildings, trees and other objects. When generating a project, it is possible to choose for AHN3 instead of AHN2 (complete for the Netherlands).
| Netherlands
| -ESRI-
| http://www.ahn.nl/index.html
|-
| CBS Wijk- en Buurtkaart
| The CBS Wijk- en Buurtkaart (2017) contains the geometry of the division in neighborhoods and statistical data related to those neighborhoods.
| Netherlands
| PDOK
| https://www.cbs.nl/nl-nl/dossier/nederland-regionaal/geografische%20data/wijk-en-buurtkaart-2017
|-
| Ruimtelijke plannen
| Ruimtelijke plannen are the offical published spatial plans/zoning plans.
| Netherlands
| Ruimtelijke Plannen
| http://www.ruimtelijkeplannen.nl/web-roo/roo/index
|-
| Top10NL   
| Topographical dataset, used as an addition to the BGT data.  
| Netherlands
| Tygron / PDOK
| https://www.kadaster.nl/-/top10nl
|-
| NWB     
| Nationaal Wegen Bestand: Contains detailed information about the road infrastructure. For instance number of lanes and road type.
| Netherlands
| PDOK
| https://www.rijkswaterstaat.nl/zakelijk/zakendoen-met-rijkswaterstaat/werkwijzen/werkwijze-in-gww/data-eisen-rijkswaterstaatcontracten/nationaal-wegenbestand.aspx
|-
| NSL   
| The NSL (Nationaal Samenwerkingsprogramma Luchtkwaliteit) contains data delivered by municipalities on, among others, traffic intensity. These data come for each municipality from the traffic model they use.
| Netherlands
| Rijksoverheid
| https://www.nsl-monitoring.nl/informatie/data-nsl/
|-
| BRP Gewaspercelen   
| Basisregistratie Gewaspercelen: contains the location of agricultural land and the cultivated crops.
| Netherlands
| Nationaal Georegister
| http://www.nationaalgeoregister.nl/geonetwork/srv/dut/catalog.search#/metadata/%7B25943e6e-bb27-4b7a-b240-150ffeaa582e%7D?tab=general
|-
| FGR   
| Fysisch Geografische Regio's: used to determine the terrain (subsurface) type. In the Tygron Platform 2019.0.0 version this dataset is replaced by the BRO. 
| Netherlands
| Nationaal Georegister
| http://www.nationaalgeoregister.nl/geonetwork/srv/dut/catalog.search#/metadata/c8b5668f-c354-42f3-aafc-d15ae54cf170
|-
| BRK - Kadastrale Kaart
| Basisregistratie Kadaster. In the {{software}} the Kadastrale kaart is used to determine the location of parcels.
| Netherlands
| Nationaal Georegister
| http://www.nationaalgeoregister.nl/geonetwork/srv/dut/catalog.search#/metadata/40840197-0478-432b-8c76-e99c4da9203f?tab=general
|-
| Risicokaart   
| This dataset shows the risks in a neighborhood, for example, by showing hazardous- and / or nuisance buildings (for example LPG station) and cables and pipes. Also contains additional information on vulnerable buildings (hotels, hospital, school, etc.).
| Netherlands
| Risicokaart.nl
| https://www.risicokaart.nl/home
|-
| OSM 
| OpenStreetMap; this dataset contains the topography of the world and attribute information.
| Worldwide
| Overpass API
| https://www.openstreetmap.org/
|-
| Waterschapsdata
| Several datasets from Water Authorities conforming to the Information Model Water (Informatiemodel water), including hydraulic structures and water-level areas.
| Netherlands - dataset does not cover the whole of the Netherlands yet.
| Copy of PDOK dataset
| https://www.pdok.nl/nl/introductie?articleid=1959819
|-
|}

Revision as of 12:43, 11 June 2019

Please note: This page is currently being updated.

Template:Learned

What is Geo data

Geographical data or geo data is data which have a location component. Almost all data is linked to a location or a place and are, therefore, geo data. Geo data can be, for example, a paper map, a digital web map or just a simple text file with coordinates. Geo datasets is either vector data (that is, features which are points, lines or polygons) or raster data (that is, data in grid cells). The features in vector data can have multiple attributes with values. Raster data mostly consist of a value and a color.

How do Geo datasets relate to the Tygron Platform

Tygron Platform loading screen showing several of the data connections

The Tygron Platform uses Geo data (vector and raster data) for creating the 3D-model world. For this, the Tygron Platform automatically connects to (Open) Datasets, based on the availability of the data for the chosen location of the project. For example the Base Registers in the Netherlands and Open Street Maps worldwide. A principle that generally applies: if your 3D World lacks certain information, then it is not available in the used datasets.
For more information on which data is used for your generating your project, see the project sources page. To add missing Geo data you can add additional Geo data manually (see below for options).

When to use your own data

  • The project takes place in a location for which there are no data sources available to create the project
  • The default data sources are not accurate or up-to-date enough
  • The default datasets are not detailed enough
  • To do a more extended analysis in the Tygron Platform
  • To use in combination with an Excel Indicator or Panel
  • For creating more overview in your project, for example by highlighting areas

In these situations, it might be useful to overwrite or import data.

Import Geo data

Almost all data can be imported in the Tygron Platform, as long as the data is about specific locations and contains geometry (and therefore coordinates). Thus basically when the data is Geo data. This also means that digital files of spatial plans can be imported in the Tygron Platform. There are different methods for importing Geo Data. The method to choose is based on how you have your data available, as vector or raster data.

Import vector data

Requirements

With the Geo data wizard you can easily import vector data. The wizard also helps you to transform your data to the proper format for importing. The following requirements for vector data apply:

  1. Geo Data in the Tygron Platform are always polygons. Line and point features are not allowed by the Tygron Platform. The data wizards helps you by buffering the line and point features to polygons.
  2. All desired attributes must be numerical, so that they can be loaded as valid attribute values. Non-numeric attributes are ignored when attempting to load them as attributes.
  3. The Geo dataset should have a CRS (Coordinate Reference System) defined, for the Platform to properly translate the coordinates to the right location.


There are three different import methods:

  1. with a GeoJSON file
  2. through a Web Feature Service (WFS)
  3. through a Catalogue Service for the Web (CSW)

Choose a method based on how you have your data available. Read more on the data wizard page about the options.

Errors

If you run into any errors check this section on the most common errors.

Import raster data

Requirements

The following requirements for raster data apply:

  1. The Geo dataset should have a CRS (Coordinate Reference System) defined, for the Platform to properly translate the coordinates to the right location.


There are two different import methods:

  1. through a Web Map Service (WMS).
  2. as a Geotiff overlay

Choose a method based on how you have your data available.

Export Geo data

Export vector data

The components that make up the 3D world can be exported as 2D vector data in GeoJSON format. With this data, further/other calculations or analysis can be done in for example GIS software. In the Current Situation tab, each of the following menus has an export GeoJSON option:


How to export components of the 3D world:
  1. Hover over the desired menu you want to export objects from.
  2. Select Export GeoJSON file
  3. Choose additional options to make a selection of the to be exported data or for export all, click on the Export button.

In the Export Item File panel that will show up, different options for exporting are available:

  • Objects from a certain category/type (only for the Buildings and Terrains) can be exported by selecting the desired category/type.
  • Only objects that have a certain attribute can be exported by checking the With Attribute option and selecting the desired attribute. For example if you only want culverts, you can select the category Underground (since the function culverts belongs to the category Underground) and check the With Attribute option and select the attribute name CULVERT_DIAMETER for example. This will export culverts, since only these objects have this attribute in common.


Export raster data

Grid overlays can be exported as a GeoTIFF or ASCII file. With such a file, calculations from for example the Water overlay can be exported to be further processed for analysis in GIS software. For exporting the grid overlays, take also note of the grid size. The smaller the grid size, the more accurate the exported GeoTIFF is.

How to export grid overlay calculation results:
  1. Select any grid overlay in the editor.
  2. On the right panel, select "Export Grid File".
  3. Choose the overlay, format and click on the Export button.

In the Export Grid File panel that will show up, different options for exporting are available:

  • If in a test run the option Export difference (current and maquette) is selected, the difference in results between the maquette state and the current state will be exported. If you checked this option outside of the test run, or did not do any Actions, the exported dataset will consist no difference.
  • For the water overlays, it is possible to export a dataset at a certain timeframe, by selecting the ID of the timeframe. Keep in mind that the ID of the timeframe start at 0. Thus if you have 10 timeframes in the overlay, the timeframes IDs range from 0 to 9.