- JoNova - http://joannenova.com.au -

BIG NEWS Part II: For the first time – a mysterious notch filter found in the climate

Posted By Joanne Nova On June 15, 2014 @ 7:03 pm In Global Warming | Comments Disabled

The Solar Series: I Background   |  II: The notch filter (you are here)  |  III: The delay  |  IV: A new solar force?  |  V: Modeling the escaping heat.  |  VI: The solar climate model   |  VII — Hindcasting   | VIII — Predictions

This is the first of many posts. It is primarily about the entirely new discovery of a notch filter, which electrical engineers will immediately recognize, but few others will know. Notch filters are used in electronics to filter out a hum or noise. You will have some at home, but everyone seems to have missed the largest notch filter running on the planet.

This post is also about the broad outline of the new solar model. It’s a O-D (zero-dimensional) model. Its strength lies in its simplicity — it’s a top down approach. That solves a lot of problems the larger ambitious GCMs create — they are a bottom up approach, and effectively drown in the noise and uncertainty. This model does not even attempt to predict regional or seasonal effects at this stage. First things first — we need to figure out the main drivers of the global climate.

Here David explains why sinusoids are such powerful tools. Some of the most important graphs here are in frequencies — that’s where we non-EE’s (Electrical Engineers) will have to concentrate. Pay attention to the logarithmic scale on the bottom. 1,000 year cycles are on the left, and 1 year cycles are on the right.

There is a lot to cover. As you read, good skeptics will be thinking of criticisms and questioning assumptions. That’s all excellent, please bear in mind we have asked many of these at length already (like, is it fair to assume linearity?) and this is a short introductory article. There is a lot to discuss. We assume, but only temporarily, that the Sun’s radiation might be associated with all the warming (note I didn’t say “cause”). This assumption is used for the investigation and then dropped and tested. It parallels what CO2 driven models do — they assumed CO2 caused all the warming. They just got stuck on the “testing” step. Also, David used Fourier analysis to investigate the datasets and find the filters,  then used those filters he discovered to build a model. This two stage approach means skeptics may spot red flags that are relevant to one stage, but made irrelevant by the second stage. I’m flagging this at the start in the hope that we generate more constructive criticism.

No time? — skip to Figure 5 and 6 for the most important action! Look at the spike down at 11 years. See how it happens in all the datasets. (Figure 6 was the moment when Bob Carter sat up dead straight in his chair).

– Jo


Discovering the Notch

Dr David Evans, 15 June 2014, David Evans’ Notch-Delay Solar Theory and Model Home

The carbon dioxide theory is clearly inadequate, as readers here know only all too well. So we wondered if the changes in the Sun might be causing some of the recent global warming. That is, the global warming over the last few decades, maybe back to 1800 or so.

Solar radiation and temperature

The best and most obvious solar datasets are those for total solar irradiance (TSI), or the total energy from the sun at all electromagnetic frequencies — mainly visible light, but also UV and some infrared. These datasets estimate the total energy from the Sun falling upon the plane that is at the average distance of the Earth from the Sun (1 AU, or astronomical unit). This TSI data is thus deseasonalized, so it cannot tell us anything about what is happening on time scales of less than a year or at frequencies greater than one cycle per year (this will become important later). TSI is measured in Watts per square meter (W/m2).

The temperature we are most interested in is the one for our immediate environment, the “global average surface air temperature”, namely air temperatures at or near the surface averaged across the entire planet. When we use “temperature” without qualification in these posts, we mean this temperature. “Global warming” is the rise in this temperature.

The initial aim of this project is to answer this question: If the recent global warming was associated almost entirely with solar radiation, and had no dependence on CO2, what solar model would account for it?

Let’s build that solar model

We are envisaging some sort of black box, whose input is TSI and whose output is temperature.

The climate system is approximately linear for small perturbations such as have occurred since the end of the last ice age. It is common in climate modeling to assume that the climate system is linear. The climate system is also “invariant”, which just means that its properties do not change significantly with time. So we assume that the climate system is linear and invariant, at least for the last few hundred years (and presumably as far back as the end of the last ice age).

The way to analyze a linear and invariant system is with sinusoids (aka sine waves). A sinusoid has a frequency, an amplitude, and a phase. Sinusoids are special for linear invariant systems, because:

  • If the input is a sinusoid, then the output is a sinusoid at the same frequency.
  • At each frequency, the ratio of output to input amplitudes and the difference between the output and input phases are always the same.
  • Behavior at one frequency is unaffected by what is occurring at other frequencies.

Lots of systems are linear and invariant, such as free space for electromagnetic fluctuations, which is why sinusoids and Fourier analysis are so ubiquitous in our analysis of the universe. While Fourier analysis can also be used for mere curve fitting, its true significance and power is that sinusoids are eigenfunctions of all linear invariant systems.

So let’s analyze the TSI and temperature datasets in the frequency domain. That is, we will recast them as sums of sinusoids.*

1          The Input Spectrum (TSI)

TSI has only been measured by satellites from late 1978. However the approximate numbers of sunspots have been recorded since 1610, and TSI has been reconstructed from the number of sunspots (Lean 2000). The main TSI datasets are the PMOD satellite observations from late 1978, Lean’s reconstruction from sunspots from 1610 to 2008, and the Steinhilber reconstructions from beryllium isotopes in ice cores going back 9,300 years.

The main TSI datasets are noisy and sometimes contradict one another. We did not attempt to pick a “best” empirical record, but instead tried to find the spectrum of TSI that best fits nearly all of the main TSI datasets. We only care about the amplitudes here, because the phases of the sinusoids cannot be reliably determined from the climate datasets.

Figure 1: The datasets used to estimate the TSI spectrum, from 1600.


The many disagreements of the TSI datasets make for a noisy combined amplitude spectrum.


Figure 2: The amplitude spectra of the various TSI datasets (the series of colored dots), and the smoothed curve of best fit (orange line). Larger dots have more weight in the smoothing. Note the peak around 11 years.


The TSI amplitude spectrum is the smooth curve in orange in Figure 2. It is basically straight over more than three orders of frequency magnitude, except for a pronounced spike around 11 years, the sharpness of which is understated by the smoothed curve.

The length of the sunspot cycle averages 11 years, though individual “cycles” vary between 8 and 14 years. So we’d expect to see stronger sinusoids around 11 years. This spectrum is about what we’d expect.

2          The Output Spectrum (Temperature)

The main temperature datasets are the satellite records since late 1978 (UAH and RSS), the surface thermometer records since 1850 or 1880 (HadCrut4, GISTEMP, and NCDC), the two comprehensive proxy time series of Christiansen and  Ljungqvist in 2012 going back to 1500 with 91 proxies and to 0 AD with 32 proxies, and the Dome C ice cores going back 9,300 years (to match the TSI data).

The main temperature datasets are noisy and sometimes contradict one another. Again we did not pick a “best” empirical record, but simply tried to find the spectrum that best fits all the main datasets.

Figure 3: The datasets used to estimate the temperature spectrum are more contradictory further back in time.


The temperature amplitude spectrum, the smooth orange curve in Figure 4, is essentially straight over more than three orders of frequency magnitude, with no other definite features.


Figure 4: The amplitude spectra of the various temperature datasets (the series of colored dots), and the smoothed curve of best fit (orange line). Larger dots have more weight in the smoothing.


Spot the big clue. There is no peak at 11 years!

This is unexpected, because TSI is the energy input that warms the Earth. The TSI peaks every 11 years or so, yet there is no detected corresponding peak in the temperature, even using our new low noise optimal Fourier transform!

(To put some numbers on it: TSI typically varies from the trough to the peak of a sunspot cycle by about 0.8 W/m2 out of 1361 W/m2. At the surface of the Earth, this is about 0.14 W/m2 of unreflected TSI.  If this was a long term change, the Stefan-Boltzmann equation would imply a change in radiating temperature of about 0.05°C, which would result in a change in surface temperature of about 0.1°C. The peaks only last for a year or two, so the low pass filter in the climate system would reduce the temperature peak to somewhat below 0.1°C. The error margin of the temperature records is generally about 0.1°C, but Fourier analysis will usually find repetitive bumps down to a small fraction of the error margin, maybe a tenth. However these bumps are not quite regularly spaced, so the threshold of detectability would be a bit higher. In any case, we’d expect the temperature peaks to be detectable using the data and methods we have employed, though not by a huge margin. Later in post IV of this series we propose a physical interpretation of the notch that implies a countering of the TSI warming, but of course such a countering would be very unlikely to completely cancel out the temperature effects of the TSI peak. But given that the margin for detection for the TSI peak alone is not great, it is credible that the mainly-countered TSI peaks are indeed not detectable.) This paragraph was corrected. **

This is an important clue. It’s the absence of something expected. (Like the “curious incident of the dog in the night-time”, in Silver Blaze, a Sherlock Holmes story. The clue was that the dog did nothing. The dog did not bark when the crime was being committed in the house, indicating that the dog was familiar with the criminal, which was a vital clue to their identity.)

In electronics, a filter in audio equipment that removes the hum due to mains power is called a notch filter. It removes a narrow range of frequencies, which looks like a notch on a frequency graph. Without a notch filter, the mains hum at 50 or 60 Hz would often be audible. It appears that something is removing the 11 year “solar hum” from the temperature, so we call this phenomenon “the notch”.

3          The Transfer Function

A transfer function tells how a sinusoid in the input is transferred through the system to the output. We are only concerned with amplitudes (that is, not phases), so its value at a given frequency is simply the output amplitude at that frequency divided by the input amplitude at that frequency. Dividing the orange line in Figure 4 by the orange line in Figure 2, we arrive at the empirical transfer function shown in Figure 5.



Figure 5: The amplitude of the empirical transfer function. The gray zone is a graphical device to make it easier to judge and compare locations on and between the graphs—because it is in exactly the same location in all the diagrams in this project.


The transfer function is fairly flat, except for the notch around 11 years, and hints of a fall off at the higher frequencies.

The notch is robust. We computed the empirical transfer function from subsets of the data, such as data before 1945 or data after 1945, and in each case the notch is clearly visible.



Figure 6: The amplitudes of the empirical transfer function when the data is restricted in the ways marked (that is, using a subset of the data used to find Figure 5). The black line and the gray zone are as in Figure 5.


The notch is such a prominent feature that we can verify it just by comparing the TSI to the temperature:


Figure 7: Solar radiation shows a strong heartbeat about every 11 years, but the temperature does not.


In the next post, we’ll build the solar model, starting with a notch filter.

Notch-delay solar project home page, including links to all the articles on this blog, with summaries.


*A technical side note: The traditional tool for estimating the spectrum of a time series (such as a climate dataset) is the discrete Fourier transform (DFT). The Fast Fourier Transform (FFT) is just a faster way of computing the DFT. Although the signals we are after are detectable using the DFT, and were initially detected using the DFT, they are not sufficiently clear and we wanted to gain more certainty in the analysis. So we developed the optimal Fourier transform (OFT) for this paper. The OFT is a new development in Fourier analysis, with greater sensitivity and frequency resolution than the DFT. It is described in the paper “The Optimal Fourier Transform (OFT)”. That paper contains examples in which the OFT does things that the DFT cannot. The OFT is used in all the analysis in this project.

The OFT is better than the DFT at estimating the exact frequencies of sinusoids in a time series, and it introduces less noise into the analysis. Like the DFT, the OFT is applied to a time series and produces an estimate of its spectrum, describing the sinusoids in the spectrum as a series of coefficients of cosines and sines. Unlike the DFT, it can analyze irregular time series (data points not equally spaced through time), it considers all frequencies when estimating the spectrum (rather than just a small pre-determined set of equally-spaced frequencies, like the DFT), it orders the spectral sinusoids by amplitude (so the lesser ones, which are probably just describing noise, can be easily discarded), it typically describes the spectrum in far fewer sinusoids than a DFT (because it stops once the sum of the spectral sinusoids is close enough to the original time series), but it is not invertible (the original time series cannot be exactly recovered from the OFT). The OFT takes much longer to compute than the DFT, because it uses multivariate function minimization to fit sums of sinusoids at variable frequencies to the time series.


** Original paragraph, before correction: (To put some numbers on it: TSI typically varies from the trough to the peak of a sunspot cycle by about 0.8 W/m2. If this was a long term change, the Stefan-Boltzmann equation would imply a change in radiating temperature of about 0.26°C, which would result in a change in surface temperature of about 0.5°C. Even allowing for some attenuation by a low pass filter, there ought to be a detectable temperature peaks.)

Comment: While the correction makes the margin for detection of any corresponding TSI peaks smaller, it increases the likelihood that what remains of  the peaks, after being mainly canceled by a countervailing cooling force, are undetectable.

Cite as Evans, David M.W.  “The Notch-Delay Solar Theory”, sciencespeak.com, 2014, http://sciencespeak.com/climate-nd-solar.html.

VN:F [1.9.22_1171]
Rating: 9.0/10 (141 votes cast)

Article printed from JoNova: http://joannenova.com.au

URL to article: http://joannenova.com.au/2014/06/big-news-part-ii-for-the-first-time-a-mysterious-notch-filter-found-in-the-climate/

Copyright © 2008 JoNova. All rights reserved.