Tag: Dataportal
-
GSFC OPeNDAP Servers and “subset downloading”
There are three types of OPeNDAP servers running at Goddard (GSFC): The NCCS supports the Global Modeling and Assimilation Office’s (GMAO) OPeNDAP server, as well as assists the Goddard Earth Sciences Data and Information Services Center (GES/DISC) with publishing their data to LLNL ESGF. The major advantage to using OPeNDAP is its ability to select…
-
How to do I get my application to read the NCCS dataserver catalog?
OPeNDAP and THREDDS clients, and applications that analyze, visualize and plot geo-referenced data such as UV-CDAT, Panoply, Ferret, or GrADS, can browse the NCCS Dataserver catalog and use the datasets. At the load from OPeNDAP or Open Remote Catalog (or similar) command, enter:
-
How do I retrieve a list of files with wget?
To download multiple URLs, create a text file with the URLs, one per line, with no trailing spaces or line feeds. The URLs can be copied from the NetCDF Subset Service page and edited. For instructions on how to generate URLs, see the section titled “Where do I find the dataset and variable URLs?” Spreadsheets are handy…
-
How can I rename the output files with wget?
If using wget with no options, the file name will have the default format inmcm4.ncml?var=tasmin, example: Using wget –content-disposition, the file name will have this format: inmcm4.ncml.nc. Example: Finally, using the -O option lets you define the output name, for instance, adding the date and other information:
-
Do I need to use quotes with the URL when running from the command line?
A note on the use of quotes with the URL portion of the wget HTTP request — while not strictly required, it protects the special characters in the URL string from interacting with the shell. One downside to using quotes: if you aren’t renaming the output file, the file name will be long and verbose.…
-
How do I use wget to download data?
Wget is a free network utility you can use to download files referenced by URLs, such as THREDDS and OPeNDAP files. Wget is available in all Linux distributions, UNIX versions, and as a GNU package for many Windows versions. Wget can be used with a single URL or with a text file containing multiple URLs…
-
Where do I find the dataset and variable URLs to use with my application, e.g. wget, GrADS?
The easiest way to get your dataset URLs is to let the NetCDF Subset Service (NCSS) build them for you. 1. Navigate to the catalog from the NCCS Dataserver page, Catalog, and click through the options to the data access page for your variable. 2. Under Access, click on the “NetCDFSubset” link. This is the NCCS dataset variable…
-
What does the TDS NetcdfSubset message “NCSS response too large or Request too big mean?
THREDDS data servers (TDS) simplify the discovery of scientific data and metadata, but don’t have the performance necessary to serve large datasets to the desktop If you’ve submitted a data request through the NetCDF Subset form and received an NCCS response too large or submitted a data request through the OPeNDAP dataset access form and…
-
How do I use the THREDDS data server (TDS) to download a subset of a dataset that is too large to store locally?
From the TDS site, navigate to the dataset of interest and click on the .ncml file. Use the “NetcdfSubset” service that can be found in the THREDDS Data Server “Access” list. Click on the variable of interest.If you want to do horizontal subsetting, click on “Disable horizontal subsetting” to allow it.Set the Lat/lon subset Bounding Box.Click…