DOWNLOADING DATA VIA HTTPS
To learn more about Earthdata Login and register for an account, please see How to Register with Earthdata Login. Once you have logged in, data can be downloaded via a Web browser, command line, or client. For help with downloading data, please see Options Available for Bulk Downloading Data from HTTPS with Earthdata Login.
NOTE: Reverb will be decommissioned in the coming months and replaced with Earthdata Search. All links to Reverb will be removed at that time.
AMSR-E/Aqua L2B Global Swath Surface Precipitation GSFC Profiling Algorithm, Version 3
The AMSR-E/Aqua Level-2B precipitation product includes instantaneous surface precipitation rate and type over ice-free/snow-free land and ocean between 89.24 degrees north and south latitudes at at 10 km spatial resolution along the track and 5 km spatial resolution along the scan. The data are generated by the GPROF 2010 Version 2 algorithm using Version 3 of the AMSR-E Level-2A Brightness Temperatures.
Note: Version 3 was implemented on November 11, 2015. Both Version 2 and Version 3 are available for approximately six months, after which, Version 2 will be discontinued.
Version 3 utilizes the GPROF 2010 Version 2 algorithm and Version 3 of the AMSR-E Level-2A Brightness Temperatures as input. Version 3 now includes both rain and solid precipitation rates and types, as well as ISO lineage metadata.
|Temporal Resolution:||50 minute|
|Data Contributor(s):||Christian Kummerow, Ralph Ferraro, David Randel|
|Metadata XML:||View Metadata Record|
As a condition of using these data, you must cite the use of this data set using the following citation. For more information, see our Use and Copyright Web page.Kummerow, C., R. Ferraro, and D. Randel. 2015. AMSR-E/Aqua L2B Global Swath Surface Precipitation GSFC Profiling Algorithm, Version 3. [Indicate subset used]. Boulder, Colorado USA. NASA National Snow and Ice Data Center Distributed Active Archive Center. doi: http://dx.doi.org/10.5067/AMSR-E/AE_RAIN.003. [Date Accessed].
Detailed Data Description
AMSR-E collects 243 data points per scan for the 6.9 GHz to 36.5 GHz channels and 392 data points for the 89.0 GHz channel. Data are in Hierarchical Data Format - Earth Observing System (HDF-EOS) format. Table 2 uses the notations in Table 1 to describe the data types:
|Float64:||64-bit (8-byte) floating-point integer|
|Float32:||32-bit (4-byte) floating-point integer|
|Int8:||8-bit (1-byte) signed integer|
|Int16:||16-bit (2-byte) signed integer|
|Data Fields||Data Type||Dimensions||Description||Scale||Fill Value/No Value|
|Time||Float64||approximately 2000 scans||Scan start time in International Atomic Time in seconds with 01 January 1993 00:00:00 as the zero base (TAI93).||n/a||n/a|
|Latitude||Float32||392 x approximately 2000 scans||Latitude (-89.24 to 89.24)||n/a||99|
|Longitude||Float32||392 x approximately 2000 scans||Longitude (-180.0 to 180.0)||n/a||999|
|surfaceType||Int8||392 x approximately 2000 scans||
|pixelStatus||Int8||392 x approximately 2000 scans||If there is retrieval at a given pixel, pixelStatus explains the reason.
0: Valid pixel
1: Boundary error in landmask
2: Boundary error in sea-ice check
3: Boundary error in sea surface temperature
4: Invalid time
5: Invalid latitude/longitude
6: Invalid brightness temperature
7: Invalid sea surface temperature
8: No retrieval due to sea-ice over water
9: No retrieval due to sea-ice over coast
10: Land/coast screens not able to be applied
11: Failure in ocean rain - no match with database profile TBs
12: Desert screen
13: Snow climatology screen
|QualityFlag||Int8||392 x approximately 2000 scans||
QualityFlag indicates a generalized quality of the retrieved pixel.
|landAmbiguousFlag||Int8||392 x approximately 2000 scans||Defines codes for uncertain/ambiguous retrievals over land
0: No information
13: Ambiguous T22V / 2 different scattering screens
14: Cannot discriminate precipitation from cold surface
63: Light precipitation
64: Cold surface
65: Grody light precipitation
66: Huffman ambiguous
-22: Desert screen
-42: Snow climatology screen
|landScreenFlag||Int8||392 x approximately 2000 scans||0: No information
-31: Land retrieval found ice likely
-41: Land retrieval found large polarization difference due to ice or sand
-51: Warm 85H and Low 22V, or clear ocean likely in coast retrieval
-61: probable coastline in coast retrieval
|oceanExtendedDbase||Int8||392 x approximately 2000 scans||Percent of the extended database entries (i.e., beyond the TRMM database) used in the retrieval (range 0-100).
0: only the TRMM database entries used
1-99: % of the entries from the extended database used
100: Only the extended datase entries used
|oceanSearchRadius||Int8||392 x approximately 2000 scans||Expansion of the search radius of the a prioridatabase beyond the initial SST and TPW search range.
0: Default search radius used
1: Search radius expanded by +/- 1 mm in TPW and +/- 1 degree in SST
N: Search radius expanded by +/- N mm in TPW and +/- N degrees in SST
|chiSquared||Int8||392 x approximately 2000 scans||Error diagnostic for Optimal Estimation calculation of TPW and wind speed. Values greater than the number of channels (9 for TMI) should be considered suspect, with values greater than 18 of limited use. Rainfall is possible above these values. Values could range from 0 to 10000, but should be less than 100.||n/a||n/a|
|probabilityOfPrecip||Int8||392 x approximately 2000 scans||A diagnostic variable, in percent, defining the fraction of raining vs. non-raining database profiles that make up the final solution. Values range from 0 to 100 percent.||n/a||-99|
|sunGlintAngle||Int8||392 x approximately 2000 scans||sunGlintAngle is the angular separation between the Reflected Satellite View Vector and the Sun Vector. When sunGlintAngle is zero, the instrument views the center of the specular (mirror-like) sun reflection. See Kummerow 2014 for more information. Values range from 0 to 180 degrees.||n/a||n/a|
|freezingHeight||Int16||392 x approximately 2000 scans||The height, in meters, of the 0°C isotherm above the earth ellipsoid.||n/a||-9999|
|surfacePrecipitation||Float32||392 x approximately 2000 scans||The instantaneous total precipitation rate at the surface for each pixel. Check pixelStatus for a valid retrieval. Values are in mm/hr.||n/a||-9999.9|
|convectivePrecipitation||Float32||392 x approximately 2000 scans||The instantaneous convective precipitation rate at the surface for each pixel. Check pixelStatus for a valid retrieval. Values are in mm/hr.||n/a||-9999.9|
|surfaceRain||Float32||392 x approximately 2000 scans||The instantaneous rain rate (liquid portion of precipitation) at the surface for each pixel. Check pixelStatus for a valid retrieval. Values are in mm/hr.||n/a||-9999.9|
|cloudWaterPath||Float32||392 x approximately 2000 scans||Total cloud liquid water in the column. Values range from 0 to 3.0 kg/m2.||n/a||-9999.9|
|rainWaterPath||Float32||392 x approximately 2000 scans||Total rain water in the column. Values range from 0 to 10.0 kg/m2.||n/a||-9999.9|
|iceWaterPath||Float32||392 x approximately 2000 scans||Total cloud ice in the column. Values range from 0 to 10.0 kg/m2.||n/a||-9999.9|
|ReySeaSurfaceTemperature||Float32||392 x approximately 2000 scans||Optimum Interpolation Sea Surface Temperatures constructed by combining observations from different platforms (satellites, ships, buoys) on a regular global grid.||n/a||-9999.9|
Note: Beginning with the algorithm version B04, data dimensions changed from 486 pixels to 392 pixels due to the loss of the 89 GHz A-horn.
This section explains the file naming convention used for this product with an example. The date and time correspond to the first scan of the granule.
Example file name:
Refer to Table 3 for the valid values for the file name variables listed above.
|X||Product Maturity Code (Refer to Table 4 for valid values.)|
|##||file version number|
|hh||hour, listed in UTC time, of first scan in the file|
|mm||minute, listed in UTC time, of first scan in the file|
|f||orbit direction flag (A = ascending, D = descending)|
|P||Preliminary - refers to non-standard, near-real-time data available from NSIDC. These data are only available for a limited time until the corresponding standard product is ingested at NSIDC.|
|B||Beta - indicates a developing algorithm with updates anticipated.|
|T||Transitional - period between beta and validated where the product is past the beta stage, but not quite ready for validation. This is where the algorithm matures and stabilizes.|
|V||Validated - products are upgraded to Validated once the algorithm is verified by the algorithm team and validated by the validation teams. Validated products have an associated validation stage. Refer to Table 5 for a description of the stages.|
Table 5 provides examples of file name extensions for related files that further describe or supplement data files.
|Extensions for Related Files||Description|
|.qa||Quality assurance information|
|.ph||Product history data|
Each half-orbit granule is approximately 18 MB.
This data set offers coverage of all ice-free and snow-free land and ocean between 89°24' N and -89°24' S latitudes.
Data are 10 km resolution along the track and 5 km along scan.
Data were collected from 2002-6-1 to 2011-10-4.
Each half-orbit swath spans approximately 50 minutes. The data sampling interval is 2.6 ms per sample for the 6.9 GHz to 36.5 GHz channels and 1.3 ms for the 89.0 GHz channel. A full scan takes approximately 1.5 seconds.
Total Surface Precipitation Rate (mm/hr)
Convective Surface Precipitation Rate (mm/hr)
Liquid Surface Precipitation Rate (mm/hr)
Precipitation Rate (mm/hr)
Cloud Liquid Water/Ice (kg/m2)
Software and Tools
Each HDF-EOS file contains core metadata with Quality Assessment (QA) metadata flags that are set by the Science Investigator-led Processing System (SIPS) at the Global Hydrology and Climate Center (GHCC) prior to delivery to NSIDC. A separate metadata file in XML format is also delivered to NSIDC with the HDF-EOS file; it contains the same information as the core metadata. Three levels of QA are conducted with the AMSR-E Level- 2 and -3 products: automatic, operational, and science QA. If a product does not fail QA, it is ready to be used for higher-level processing, browse generation, active science QA, archive, and distribution. If a granule fails QA, SIPS does not send the granule to NSIDC until it is reprocessed. Level-3 products that fail QA are never delivered to NSIDC (Conway 2002).
Brightness temperatures are verified to be within the physical bounds (50 K — 305 K) for all channels used by the rainfall algorithm. Automated QA for the rainfall algorithm is difficult because heavy rainfall can mask the surface, thereby hindering geo-location verification. Therefore, the rainfall algorithm relies on the Level 2A product for QA of the geo-location. As a final QA check on the computed rainfall, the brightness temperatures of the computed rainfall are compared to the observed brightness temperatures. If the difference between computed and observed brightness temperatures exceeds a pre-defined threshold, the rainfall is set to missing (pixelStatus=11).
AMSR-E Level-2A data arriving at GHCC are subject to operational QA prior to processing higher-level products. Operational QA varies by product, but it typically checks for the following criteria in a given file (Conway 2002):
- File is correctly named and sized
- File contains all expected elements
- File is in the expected format
- Required EOS fields of Time, Latitude, and Longitude are present and populated
- Structural metadata are correct and complete
- The file is not a duplicate
- The HDF-EOS version number is provided in the global attributes
- The correct number of input files were available and processed
AMSR-E Level-2B data are derived from Level-2A. See AMSR-E/Aqua L2A Global Swath Spatially-Resampled Brightness Temperatures, Version 3 for further information on the QA process for the data. In the SIPS environment, the science QA includes checking the maximum and minimum variable values, and percent of missing data and out-of-bounds data per variable value. At the Science Computing Facility (SCF), also at GHCC, science QA involves reviewing the operational QA files, generating browse images, and performing the following additional automated QA procedures (Conway 2002):
- Historical data comparisons
- Detection of errors in geo-location
- Verification of calibration data
- Trends in calibration data
- Detection of large scatter among data points that should be consistent
Geo-location errors are corrected during Level-2A processing to prevent processing anomalies such as extended execution times and large percentages of out-of-bounds data in the products derived from Level-2A data.
The Team Lead SIPS (TLSIPS) developed tools for use at SIPS and SCF for inspecting the data granules. These tools generate a QA browse image in Portable Network Graphics (PNG) format and a QA summary report in text format for each data granule. Each browse file shows Level-2A and Level-2B data. These are forwarded from the Remote Sensing Systems (RSS) to the GHCC along with associated granule information, where they are converted to HDF raster images prior to delivery to NSIDC. The QA summary reports are available on the GHCC AMSR-E Web page.
Please refer to AMSR-E Validation Data for information about data used to check the accuracy and precision of AMSR-E observations.
Data Acquisition and Processing
The AMSR-E/Aqua L2B precipitation data (AE_Rain) are derived from AMSR-E/Aqua L2A Global Swath Spatially-Resampled Brightness Temperatures, Version 3.
Satellite-based estimates of rain rate and rain type rely primarily on modeling the absorption and emission effects on microwave signals for specified cloud temperatures, water vapor, and hydro meteor profiles. Atmospheric transmittance windows below 20 GHz, from 30 GHz to 40 GHz, and at 90 GHz are used for rainfall monitoring. Below 20 GHz, rainfall absorption and emission are predominant, and ocean surfaces are warmer than the background radiation. Above 60 GHz, evidence of rainfall is primarily from scattering, where areas of heavy rainfall are colder than their backgrounds. Between 20-60 GHz, a combination of absorption and scattering is present.
A radiative transfer equation that includes absorption and scattering coefficients is the basis for deriving rain rate from brightness temperatures in this data set. The absorption and scattering coefficients, which are summarized in more detail in Kummerow and Ferraro 2006 , are expressed as an integral over the range of rain drop sizes. Radiative transfer calculations are used to determine brightness temperatures given atmospheric temperature, water vapor, and hydrometeor profiles. These computations are carried out for the AMSR-E frequencies of 6.9, 10.7, 18.7, 36.6 and 89.0 GHz and 54 degree incidence angle, and for different freezing levels.
At all channels, brightness temperatures increase toward a maximum and then drop off as rainfall rates increase further. The main difference between channels is the range of rainfall rates for which the curve increases in the emission region and decreases in the scattering region (Kummerow and Ferraro 2006 ). The brightness temperature at low frequencies is primarily a function of absorption. The rain rate follows from the absorption coefficient implied by the measurements. Ice and snow are efficient scatterers of microwave radiation compared with rain. Since land background has a high emissivity, rainfall rate over land must be inferred from the ice-scattering signature, instead of relying on the emission signal from rain drops.
This section covers the theoretical basis for the retrieval of liquid and solid precipitation from the AMSR-E radiometers. The algorithm is a Bayesian type algorithm, which searches an a priori database of potential rain profiles and retrieves a weighted average of these entries based upon an uncertainty weighted proximity of the observed Brightness Temperatures (Tb) to the simulated Brightness Temperatures corresponding to each rain profile. The a priori information is supplied by the TRMM radar/radiometer algorithm as detailed in Kummerow et al. (2010). The solution provides a mean rain rate as well as its uncertainty. The major sources of systematic errors in these algorithms are the quality of the a priori database, the estimate of the forward model uncertainty, and the ancillary information used to subset the a priori database.
Instantaneous Ocean Rainfall
The ocean algorithm uses a Bayesian approach in which the TRMM satellite is used to create an a priori database of observed cloud and precipitation profiles as described in Kummerow, et al. (2010). The profiles for the rain ocean procedure are grouped by SST and TPW. The individual pixels TPW and SST are used to retrieve a group of pixels from the database. If there are fewer than 1000 profile clusters found, the search radius is expanded. Once the database of representative profiles and Brightness Temperatures are generated, the algorithm uses a Bayesian inversion methodology in the following manner:
Pr(R) = probability that a profile R will be observed
Pr(Tb | R) = probability of observing the brightness temperature vector, Tb, given a specific rain profile R.
The first term on the right hand side of Equation 1 is derived from the a priori database of rain profiles established by the radar/radiometer observing systems. The second term on the right hand side is obtained from radiative transfer computations through the cloud model profiles. The formal solution to the above problem is presented in detail in Kummerow et al. (1996). In summary, the retrieval procedure composes a new hydrometeor profile by taking the weighted sum of structures in the cloud structure database that are radiometrically consistent with the observations. The weighting of each model profile in the compositing procedure is an exponential factor containing the mean square difference of the sensor observed brightness temperatures and a corresponding set of brightness temperatures obtained from radiative transfer calculations through the cloudy atmosphere represented by the model profile.
The retrieval algorithm thus generates a new cloud profile from the weighted sum of structures in the cloud structure database that are consistent with the observations. The retrieval solution is:
Rj = the vector of model profile values from the a priori database model
Tbo = set of observed brightness temperatures
Tbs(xj) = corresponding set of computed brightness temperatures from model profile Rj
O = observational error covariance matrices
S = model error covariance matrices
Ã‚ = normalization factor
The AMSR-E code searches a subset of profiles with coincident Sea Surface Temperature (SST) and Total Column Water Vapor (TCWV). TCWV is internally within the AMSR-E precipitation algorithm using an Optimal Estimation (OE) framework developed by Elsaesser and Kummerow (2008). The SST is obtained from Optimum Interpolation Sea Surface Temperatures constructed by combining observations from different platforms (satellites, ships, buoys) on a regular global grid. The satellite observations are from the AVHRR and AMSR-E instruments until 03 October 2011, and AVHRR only after that date. For more information, refer to Optimum Interpolation Sea Surface Temperature (OISST) Web page. For more information on the development of the OISST, see Reynolds, et al. 2006. The same OE-based TCWV and SST climatology is also attached to the a priori database to ensure consistency between the brightness temperatures.
Instantaneous Land Rainfall
Accurate rainfall retrievals over land are far more difficult than oceanic retrievals due to the large and variable emissivity of the land surface. Specifically, the high emissivity masks the emission signature that is related directly to the water content in the atmosphere. Instead, only the brightness temperature depression due to scattering in the upper portion of clouds is observable. The scattering increases with increasing frequencies. Consequently, brightness temperature depressions at the 89-GHz channel of AMSR-E contain the least ambiguous signal of scattering by ice and/or large raindrops.
A further complication that arises over land is the lack of consistent backgrounds against which to compare the brightness temperature depression. To alleviate the problem caused by the varying emissivity associated with changes in surface characteristics such as surface wetness, snow cover, vegetation, etc. A rain/no-rain temperature depression threshold is required to screen out false identification of rain. Additionally, snow and desert surfaces cause depressed brightness temperatures at high frequencies due to surface volume scattering and can be confused with the rain signature. If these surface types are not properly screened, they can be misinterpreted as ice scattering in clouds.
GPROF 2010 Version 2 utilizes a two-step process for rain rate retrieval for the AMSR-E algorithm: rain identification and rain rate determination.
Land Rain/No Rain Determination
The rain/no rain determination results from the application of screens applied to the data retrieved at the 89-GHz channel of AMSR-E. McCollum et al. (1999) developed a methodology that adopts the GPROF approach but uses spatial information from neighboring pixels to “fill-in” indeterminate areas. See Figure 2 for a comparison between the three screening methods: NESDIS (Ferraro 1997), GSCAT2 used in the GPROF algorithm, and the new screening method.
Land Rain Rate Determination
The AMSR-E precipitation team decided to use the same GPROF retrieval methodology as used for the ocean retrieval. Unlike the ocean component, however, the initial database of possible profiles was carefully selected to include only those profiles that fit the empirical relation given in Equation 3.
RR = rain rate in mm/hr
SIL = Scattering Index Land
The relationship of Equation 3 was reproduced by selecting 36 profiles fitting Equation 3 from the several thousand profiles in the GPROF database (McCollum et al. 1999).
Version 3 utilizes the GPROF 2010 Version 2 algorithm and Version 3 Level-2A Brightness Temperatures as input. Version 3 now includes both rain and solid precipitation rates and types, as well as ISO lineage metadata. See the AMSR-E Data Versions Web page for a summary of algorithm changes since the start of mission.
Quantifying errors in this data set is complicated, because it involves understanding the nature of precipitation. Uncertainties arise when the rain layer thickness is not well understood, or when inhomogeneous rainfall occurs below the resolution of the satellite. Another potential source of error is the non-precipitating component of clouds, which contribute to brightness temperatures. Scattering-based retrievals over land also present many uncertainties, most notably the lack of a consistent relationship between frozen rain aloft and liquid at lower altitudes. Quantifying the scattering by ice is especially problematic. Ambiguities occur in the data because microwave radiation is scattered not only by rainfall and associated ice, but by snow cover and dry land (Kummerow and Ferraro 2007 ).
A known error exists related to sun glint that results in missing Rain Rate values, and presents as gray ovals in the AE_Rain browse images. Sun glint is not a problem over land; however, the algorithm is using only geometry to determine sun glint causing missing values to exist over land. Sun glint is included in the algorithm because it affects the brightness temperatures out to the missing radius; however, a thorough investigation is yet to be completed. Preliminary investigations indicate that the bias could be up to 15 percent in the affected areas.
References and Related Publications
Contacts and Acknowledgments
Dr. Christian Kummerow
Department of Atmospheric Science
Colorado State University
Fort Collins, CO, USA
2207 Computer and Space Sciences Building
University of Maryland
College Park, MD USA
Dr. David Randel
Department of Atmospheric Sciences
Colorado State University
Fort Collins, CO, USA
Acronyms and Abbreviations
The acronyms used in this document are listed in Table 6.
|AMSR-E||Advanced Microwave Scanning Radiometer - Earth Observing System|
|EOS||Earth Observing System|
|FTP||File Transfer Protocol|
|GHCC||Global Hydrology and Climate Center|
|GSFC||Goddard Space Flight Center|
|HDF-EOS||Hierarchical Data Format - EOS|
|NASA||National Aeronautics and Space Administration|
|NSIDC||National Snow and Ice Data Center|
|OISST||Optimum Interpolation Sea Surface Temperature|
|PNG||Portable Network Graphics|
|RSS||Remote Sensing Systems|
|SCF||Science Computing Facility|
|SIPS||Science Investigator-led Processing System|
|SST||Sea Surface Temperature|
|TAI||International Atomic Time|
|TCWV||Total Column Water Vapor|
|TLSIPS||Team Lead SIPS|
|TMI||Tropical Rainfall Measuring Mission Microwave Imager|
|TPW||Total Precipitable Water|
|TRMM||Tropical Rainfall Measuring Mission|
|UTC||Universal Time, Coordinated|
A typical AMSR-E swath width consists of approximately 2000 scans, with 243 pixels per scan for the 6.9 GHz to 36.5 GHz channels, and 486 pixels per scan for the 89.0 GHz channel.
In 2002, the AMSR-E science team discovered distortion along the outer 23 to 24 pixels of each swath. Some... read more