Removing Spikes While Preserving Data and Noise using Wavelet Filter Banks
Many diagnostic datasets suffer from the adverse
effects of spikes that are embedded in data and noise. For
example, this is true for electrical power system data where
the switches, relays, and inverters are major contributors to
these effects. Spikes are mostly harmful to the analysis of
data in that they throw off real-time detection of abnormal
conditions, and classification of faults. Since noise and
spikes are mixed together and embedded within the data,
removal of the unwanted signals from the data is not always
easy and may result in losing the integrity of the
information carried by the data. Additionally, in some
applications noise and spikes need to be filtered
independently. The proposed algorithm is a multi-resolution
filtering approach based on Haar wavelets that is capable of
removing spikes while incurring insignificant damage to
other data. In particular, noise in the data, which is a useful
indicator that a sensor is healthy and not stuck, can be
preserved using our approach. Presented here is the
theoretical background with some examples from a realistic
testbed.
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| accrualPeriodicity | irregular |
| bureauCode |
[
"026:00"
]
|
| contactPoint |
{
"fn": "J. Blair",
"@type": "vcard:Contact",
"hasEmail": "mailto:James.B.Blair@nasa.gov"
}
|
| description | Many diagnostic datasets suffer from the adverse effects of spikes that are embedded in data and noise. For example, this is true for electrical power system data where the switches, relays, and inverters are major contributors to these effects. Spikes are mostly harmful to the analysis of data in that they throw off real-time detection of abnormal conditions, and classification of faults. Since noise and spikes are mixed together and embedded within the data, removal of the unwanted signals from the data is not always easy and may result in losing the integrity of the information carried by the data. Additionally, in some applications noise and spikes need to be filtered independently. The proposed algorithm is a multi-resolution filtering approach based on Haar wavelets that is capable of removing spikes while incurring insignificant damage to other data. In particular, noise in the data, which is a useful indicator that a sensor is healthy and not stuck, can be preserved using our approach. Presented here is the theoretical background with some examples from a realistic testbed. |
| distribution |
[
{
"@type": "dcat:Distribution",
"title": "Download this dataset",
"format": "HTML",
"mediaType": "text/html",
"description": "Data Access link for ITSD project",
"downloadURL": "https://nsidc.org/data/data-access-tool/AFOLVIS1A/versions/1/"
},
{
"@type": "dcat:Distribution",
"title": "Download this dataset",
"format": "HTML",
"mediaType": "text/html",
"description": "Direct download via HTTPS protocol.",
"downloadURL": "https://n5eil01u.ecs.nsidc.org/ICEBRIDGE/AFOLVIS1A.001"
},
{
"@type": "dcat:Distribution",
"title": "View documentation related to this dataset",
"format": "HTML",
"mediaType": "text/html",
"description": "Includes a user's guide, supplemental documents like ATBDs and academic papers, How Tos, FAQs, etc.",
"downloadURL": "https://doi.org/10.5067/6K0IRWVOUBX7"
},
{
"@type": "dcat:Distribution",
"title": "Download this dataset through Earthdata Search",
"format": "HTML",
"mediaType": "text/html",
"description": "NASA's newest search and order tool for subsetting, reprojecting, and reformatting data.",
"downloadURL": "https://search.earthdata.nasa.gov/search/granules?p=C1932134853-NSIDC_ECS&pg%5B0%5D%5Bgsk%5D=-start_date&q=AFOLVIS1A&m=-7.5501034794526305%21-1.6171916830667783%213%211%210%210%2C2&tl=1588008358%214%21%21"
},
{
"@type": "dcat:Distribution",
"title": "This dataset's landing page",
"format": "HTML",
"mediaType": "text/html",
"description": "Provides access to data, documentation, tools, citation information, support, and other resources.",
"downloadURL": "https://doi.org/10.5067/6K0IRWVOUBX7"
},
{
"@type": "dcat:Distribution",
"title": "Google Scholar search results",
"format": "HTML",
"mediaType": "text/html",
"description": "Search results for publications that cite this dataset by its DOI.",
"downloadURL": "https://scholar.google.com/scholar?q=10.5067%2F6K0IRWVOUBX7"
},
{
"@type": "dcat:Distribution",
"title": "Download this dataset",
"format": "HTML",
"mediaType": "text/html",
"description": "Tool to visualize, search, and download IceBridge data.",
"downloadURL": "https://nsidc.org/icebridge/portal/map"
}
]
|
| identifier | DASHLINK_871 |
| issued | 2013-12-19 |
| keyword |
[
"ames",
"dashlink",
"nasa"
]
|
| landingPage | https://c3.nasa.gov/dashlink/resources/871/ |
| modified | 2025-04-01 |
| programCode |
[
"026:029"
]
|
| publisher |
{
"name": "Dashlink",
"@type": "org:Organization"
}
|
| title | Removing Spikes While Preserving Data and Noise using Wavelet Filter Banks |