Please note that the forum is in English only. Please log in using the link in the top menu to add new forum topics or comments.

General discussion

Error running batch job on https://openeo.vito.be

Hello,

I'm creating weekly image mosaics for flanders of S1 GRD images, but for a specific week I always get an error. I tried playing around with the job_options to give more resources, even though other weeks worked fine in the past, but this doesn't seem to help either.

The last job options I tried:

job_options = {          "executor-memory": "5G",         "executor-memoryOverhead": "6G",         "driver-memoryOverhead": "5G"     }

I'm using the https://openeo.vito.be backend.

One of the job id's: j-2408089ae2154a3aa76f8bf12f5b4cf5

Read permissions LandCover Product

Hello, I noticed the layers of the Copernicus land cover product have different reading permissions for different years. Is there a reason for that? I include here, as example, the display of the files list for 2017 and 2018 retrieved from the Terminal in my VM. Note that the permissions differ for these years.  Thank you in advance for your help. ls 2017/20170101/ -lht total 38G -rw-rw----. 1 751 hspf_users 5.2G May 14 19:09 PROBAV_LC100_global_v3.0.1_2017-conso_Tree-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 107M May 14 19:01 PROBAV_LC100_global_v3.0.1_2017-conso_Snow-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 5.1G May 14 19:01 PROBAV_LC100_global_v3.0.1_2017-conso_Shrub-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 593M May 14 18:49 PROBAV_LC100_global_v3.0.1_2017-conso_SeasonalWater-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 474M May 14 18:48 PROBAV_LC100_global_v3.0.1_2017-conso_PermanentWater-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 257M May 14 18:47 PROBAV_LC100_global_v3.0.1_2017-conso_MossLichen-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 6.7G May 14 18:46 PROBAV_LC100_global_v3.0.1_2017-conso_Grass-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 974M May 14 18:30 PROBAV_LC100_global_v3.0.1_2017-conso_Forest-Type-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 7.1G May 14 18:29 PROBAV_LC100_global_v3.0.1_2017-conso_Discrete-Classification-proba_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 1.6G May 14 18:17 PROBAV_LC100_global_v3.0.1_2017-conso_Discrete-Classification-map_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 3.6G May 14 18:15 PROBAV_LC100_global_v3.0.1_2017-conso_DataDensityIndicator_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 2.6G May 14 18:10 PROBAV_LC100_global_v3.0.1_2017-conso_Crops-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 175M May 14 18:03 PROBAV_LC100_global_v3.0.1_2017-conso_Change-Confidence-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 541M May 14 18:02 PROBAV_LC100_global_v3.0.1_2017-conso_BuiltUp-CoverFraction-layer_EPSG-4326.tif -rw-rw----. 1 751 hspf_users 2.9G May 14 18:01 PROBAV_LC100_global_v3.0.1_2017-conso_Bare-CoverFraction-layer_EPSG-4326.tif [miguel@miguel lcc_100m_v1_yearly]$ ls 2018/20180101/ -lht total 38G -rw-rw-rw-. 1 754 750 5.1G May 14 21:44 PROBAV_LC100_global_v3.0.1_2018-conso_Shrub-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 5.2G May 14 21:44 PROBAV_LC100_global_v3.0.1_2018-conso_Tree-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 107M May 14 21:39 PROBAV_LC100_global_v3.0.1_2018-conso_Snow-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 578M May 14 21:39 PROBAV_LC100_global_v3.0.1_2018-conso_SeasonalWater-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 472M May 14 21:38 PROBAV_LC100_global_v3.0.1_2018-conso_PermanentWater-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 245M May 14 21:38 PROBAV_LC100_global_v3.0.1_2018-conso_MossLichen-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 6.7G May 14 21:38 PROBAV_LC100_global_v3.0.1_2018-conso_Grass-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 7.2G May 14 21:38 PROBAV_LC100_global_v3.0.1_2018-conso_Discrete-Classification-proba_EPSG-4326.tif -rw-rw-rw-. 1 754 750 986M May 14 21:32 PROBAV_LC100_global_v3.0.1_2018-conso_Forest-Type-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 3.6G May 14 21:30 PROBAV_LC100_global_v3.0.1_2018-conso_DataDensityIndicator_EPSG-4326.tif -rw-rw-rw-. 1 754 750 1.6G May 14 21:30 PROBAV_LC100_global_v3.0.1_2018-conso_Discrete-Classification-map_EPSG-4326.tif -rw-rw-rw-. 1 754 750 2.9G May 14 21:27 PROBAV_LC100_global_v3.0.1_2018-conso_Bare-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 2.6G May 14 21:27 PROBAV_LC100_global_v3.0.1_2018-conso_Crops-CoverFraction-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 169M May 14 21:25 PROBAV_LC100_global_v3.0.1_2018-conso_Change-Confidence-layer_EPSG-4326.tif -rw-rw-rw-. 1 754 750 551M May 14 21:25 PROBAV_LC100_global_v3.0.1_2018-conso_BuiltUp-CoverFraction-layer_EPSG-4326.tif  

Python client authentication

When I use this code from the examples

# connect with the backend

eoconn = openeo.connect( "openeo.vito.be" ).authenticate_oidc()

How do I login with my terrascope account?

ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

Hello,

I use the API Query Global Land product catalog to download hourly LST data; but every few moments I get a connection error  (ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))) that interrupts my download, I don't know what is the problem. Please can someone help me fix this problem. Thank you for your help 

Error during installation with pip - terracatalogueclient

Hi everyone,

I've used terracatalogueclient so far and have never experienced any issues. I've used it in my dockerized app and my Dockerfile looks like this:

RUN pip install --extra-index-url https://artifactory.vgt.vito.be/api/pypi/python-packages/simple terracatalogueclient

as specified in the official Github documentation.

But for some reason this is no more working. Does anyone know why?

Thank you. 

Sentinel 2 image size

Hello everyone,

I'm using Terrascope's jupyterlab in order to analyze the NDVI, NDBI and NDWI of a certain area over a time range. While analyzing the selected files, I noticed that while I selected the same AOI everywhere, I don't get the same image shape every time and the area observed in my image is not the same. To make my problem clearer, I have attached my code here: https://we.tl/t-jtpM5Is9W8

 

In the last cell, the different shapes of the considered files are printed. Do I have to isolate my AOI in another way, because I thought that using mask.msk only the aoi is considered?

TimeseriesDemo notebook error

I'm using the demo notebook 'TimeseriesDemo.ipynb' to try and get Sentinel-1 timeseries. However, upon running requests.get(''https://services.terrascope.be/timeseries/v1.0/ts/''), I get an error code 500 and the following error message: "unknown OpenSearch collection BCGMS_NDVI300". I did not change anything in the notebook, so I'm confused as to why I am receiving this error. Can you help me solve this issue? Thanks!

Could terrascope download the S5P PAL dataset?

Due to an inconsistent of different version of TROPOMI NO2 data set, the TROPOMI official has reprocess the NO2 data  which is the PAL data( https://data-portal.s5p-pal.com/).  In tropomi offical site ,it says(http://www.tropomi.eu/data-products/nitrogen-dioxide/):

The upgrade to version 2.2.0 (5 July 2021) leads to an increase of the tropospheric NO2 columns for cloud-free pixels and the previous upgrade to version 1.4.0 (2 December 2020) led to a substantial increase in the observed tropospheric NO2 column amounts over polluted areas for scenes with small cloud fractions. For time series, trend studies or comparisons between years the results versions should not be mixed without accounting for these changes, as the series would show artificial (positive) jumps.

The PAL data is very important for studying the long-term trend. So, could the terrascope download the TROPOMI PAL data for users? I notice that now only have the old version data in the VM's.  Many thanks.  

Sincerely,

Mitch Zhang

PSInsar

Is it possible to perform  a complete PSInsar worflow in Terrascopre VM?   

401 on downloading WorldCover Products (urn:eop:VITO:ESA_WorldCover_S1VVVHratio_10m_2020_V1 & urn:eop:VITO:ESA_WorldCover_S2RGBNIR_10m_2020_V1)

It is possible to download urn:eop:VITO:ESA_WorldCover_10m_2020_V1 products. Everything works fine.

It is, however, not possible to download urn:eop:VITO:ESA_WorldCover_S1VVVHratio_10m_2020_V1 or urn:eop:VITO:ESA_WorldCover_S2RGBNIR_10m_2020_V1 products, the HTTP response code being 404.

 

This seems to be an authorization issue (HTTP 404) but, on the other hand, the construction of the first URL seems to be a little different (in respect to the other URLs).

Please help me understand if/how it would be possible to download the S1VVVHratio_10m_2020_V1 and S2RGBNIR_10m_2020_V1 products.

https://services.terrascope.be/download/WORLDCOVER/ESA_WORLDCOVER_10M_2020_V100/MAP/ESA_WorldCover_10m_2020_v100_N39E000_Map/ESA_WorldCover_10m_2020_v100_N39E000_Map.tif

https://services.terrascope.be/download/WORLDCOVER/ESA_WORLDCOVER_10M_2020_V100/S1VVVHRATIO/ESA_WorldCover_10m_2020_v100_N41E001_S1VVVHratio.tif

https://services.terrascope.be/download/WORLDCOVER/ESA_WORLDCOVER_10M_2020_V100/S2RGBNIR/ESA_WorldCover_10m_2020_v100_N49E005_S2RGBNIR.tif

stay up to date!
subscribeto our newsletter
new perspectives

Stay up to date!