The BOM: Homogenizing the heck out of Australian temperature records

There are adjustments on top of adjustments. Homogenised records are being used to correct raw records. Some man-made adjustments can infect data for miles around…

Rutherglen is a long running station in central Victoria. There are no documented site moves, but the long raw trend of slow cooling was adjusted up to a warming trend. What was cooling of 0.35C per century became a 1.7C warming trend.

Jennifer Marohasy, and others, have spent months trying to get answers from the BOM explaining why these massive adjustments were made. Excuses flowed. In the latest round, the BOM claim the changes are necessary to make the Rutherglen record match the trends in the neighboring stations. What the BOM doesn’t say is that there was no warming in the neighbours either, not until after they were homogenized. The order in which stations are homogenized matters, which rather says something important about the arbitrary nature of the adjustments. Anomalous trends from far distant and poor locations can spread through waves of homogenization until better, longer stations succumb to political correctness and show the “correct” result. Small choices about which stations to to use first in the process can make a huge difference to the […]

Scandal: BoM thermometer records adjusted “by month” — mysterious square wave pattern discovered

There is some major messing with data going on.

What would you say if you knew that the official Perth thermometer was accurate at recording minimums for most of time in October in the eighties, but 0.7°C too warm all of December, and 1.2°C too cool in January? Bizarrely that same thermometer was back to being too warm in February! Try to imagine what situation could affect that thermometer, and require post hoc corrections of this “monthly” nature. Then imagine what could make that same pattern happen year after year. All those weather reports we listened to in Perth in 1984 were wrong (apparently). And this bizarre calendar of corrections is turning up all over Australia.

Bob Fernley-Jones has looked closely at all the adjustments done to achieve the wonderful homogenized ACORN data, as compared to the theoretically “raw” records listed in Climate Data Online (CDO) on the BOM website. He can’t know what the BOM did (since they won’t tell anyone), but he knows the outcome of their homogenization. He was shocked when he noticed a strange square-wave pattern repeating year after year; he was astonished that there were corrections calendar month by calendar month, up and down, switching […]

A mess of adjustments in Australian capital cities — The inexplicable history of temperatures

Two out of three Australians live in our capital cities where the longest and best resourced temperature records would be found. These are the places where the weather reports matter to the most people on a daily basis — and where headlines about records and trends will be widely discussed. But these are also the sites which have been affected by the growth of concrete and skyscrapers, and potentially have the largest urban heat island (UHI) effect, so might need the largest adjustments.

Bob Fernley-Jones has been going through the BOM records for six of Australia’s state capitals, looking at the original raw data (at least, as is recorded in the BOM’s climate data online, called CDO). Bob compares the new “corrected” dataset called ACORN for these locations — that’s the all new marvelous adjusted data. He finds many step changes that can’t be explained by known site moves or the UHI effect. Many step changes occur in either minima or maxima, but not in both at the same time, which is also odd. As we already know, the adjustments usually cool the past — especially the minima (see all the blue lines on graphs below […]

Two-thirds of Australias warming due to “adjustments” — according to 84 historic stations

1954 Yearbook Brisbane

Here’s an update to the digging through our historic records we discussed a month ago, we can now include nearly twice the stations and the difference between temperatures originally recorded 100 years ago and temperatures today are even smaller.

Chris Gillham has been working with CSIR documents and official Commonwealth Year Books. Last month he used the 1953 Year Book which contained 44 weather station averages for 1911-40 to compare with 2000-14 temperatures, but has since discovered that the 1954 Year Book provides an additional 40 stations with 1911-40 data. The average rise in mean temperatures across all 84 weather stations around Australia over the last 70 years of global warming is about 0.3C. This larger dataset suggests as much as two thirds of the current official trend in Australian warming was due to post hoc adjustments, not heat recorded by thermometers.

These historic temperatures were calculated by the best scientists of the day, using the best equipment of the era (the same Stevenson Screen we use now). Yet again, global warming appears to have a “man-made” contribution. Far more important than CO2 is man-made “pollution” called homogenisation.

When doubling the recorded trend makes “No difference”

[…]

BoM forum been, gone. Rejoice! Invisible problems being solved behind closed doors

You’ll be glad to know the BoM problems are all dealt with. Some hand-picked statisticians met with some BoM people yesterday, and they had a robust private chat about secret temperature stuff at the technical advisory forum (that’s the tea-and-cakes one-day-wonder). I’m so relieved to know it was “productive”. (Imagine if the press release had said it was “predictable, boring and unproductive”?) In a few months we will find out a small, filtered version of what they said and possibly something of what the BoM approved statisticians think about the nameless, unlinked, public-submissions.

We do know that the BoM didn’t want public submissions, but in their good grace, they have given them to the select forum members anyway. (Be grateful serfs, you don’t get acknowledgment or answers, but your dedication in listing and referencing known scandalous problems with our national dataset is worthy of one line in the last paragraph of a press release. Congratulations — maybe. Only one two submissions have been formally acknowledged which means the others, with months of work, might fall off the back of a truck, lost in the mail.*It’s possible. Is it too much to expect officials to send an email receipt with acknowledgment?)

[…]

Melbourne heat — BoM makes mystery corrections, but misses new skyscrapers. Incompetence?

More errors in ACORN — The Bureau of Met wonder-database corrects for mysterious “statisticals” but not for 15 story buildings built next to the thermometers. They correct a step change that doesn’t occur in minima, but don’t correct for one that does in maxima. Big site changes are marked in some datasets but not in others. And where is the correction for obvious urban heat island effects? Bear in mind, the size of the artificial steps and corrections is on a par with the warming supposedly due to carbon dioxide. Hmmm.

The BoM database needs to be independently and publicly replicated, all the way from their raw data to the final output down to several decimal places. Then we will all know what is going on. Let’s shine a light in. If it ain’t replicated, it ain’t science.

Melbourne has one of the longest temperature records in the Southern Hemisphere. Looking at the original records it appears Melbourne maximums have not changed much from 1855 – 1995. Then they suddenly jumped or stepped up.

Tom Quirk did some sleuthing, and figured out why that happened. But what he can’t figure out is why the Bureau missed this adjustment, yet makes […]

Historic documents show 30-40%* of Australia’s warming trend is due to “adjustments”

UPDATE: *Chris has been over the entire dataset again, and makes a correction that adjustments account for 30-40% of the rise. A bit less than half. Headline updated. See his site for the newer stats. March 9, 2015

Adjustments that cool historic temperatures have almost doubled Australia’s rate of warming.

CSIR published “Meteorological Data” 1855 – 1931

There was a time back in 1933 when the CSIRO was called CSIR and meteorologists figured that with 74 years of weather data on Australia, they really ought to publish a serious document collating all the monthly averages at hundreds of weather stations around Australia. Little did they know that years later, despite their best efforts, much of the same data would be forgotten and unused or would be adjusted, decades after the fact, and sometimes by as much as one or two degrees. Twenty years later The Commonwealth Bureau of Census and Statistics would publish an Official Year Book of Australia which included the mean temperature readings from 1911 to 1940 at 44 locations.

Chris Gillham has spent months poring over both these historic datasets, as well as the BoM’s Climate Data Online (CDO) which has the recent temperatures […]

Australian BOM under fire – questions about “adjusted” temperatures exploding around the world

A hard hitting article today from Graham Lloyd in The Australian. Finally the scientific debacle of climate records is being hung out like dirty laundry. For people who don’t read skeptic blogs it will be news that there are claims of scandal and corruption about temperature data adjustments around the world, against institutions that are (or were) respected household names.

Lloyd starts with a brilliant analogy from David Stockwell, who asks Would it be OK if we adjusted Don Bradmans batting average down? It won’t affect the global batting average…. (The Don is the legend of international cricket — those stats are sacred.)

Lloyd goes on to tell the tale of how temperature adjustments that make historic records cooler are commonplace, and suddenly under the spotlight around the world. To his credit, Lloyd realizes this has been coming for a long time — he explains the Australian and UK Met offices were caught discussing ways to make it hard for skeptics. He talks about Christopher Booker’s article on adjustments in Paraguay getting 30,000 comments, and the issue “exploding” internationally with questions about the misleading public declarations about 2014 being the hottest year on record, as well as the issue of […]

The mysterious BOM disinterest in hot historic Australian Stevenson screen temperatures

When it comes to our rare high-quality historic records, and the real long term trends of Australian weather, the silence is striking. There are some excellent historical records of long term temperature data from the late 1800s in Australia, which lie underused and largely ignored by the BOM.

For the BOM, history almost appears to start in 1910, yet the modern type of Stevenson screen thermometer was installed across Australia starting as early as 1884 in Adelaide. Most stations in Queensland were converted as long ago as 1889 and in South Australia by 1892. Though states like NSW and Victoria were delayed until 1908.

Here’s a photo of the ones in Brisbane in 1890.

Brisbane was recording temperatures with modern Stevenson screens in 1890, as were some other stations, but the BOM often ignores these long records.

The BOM don’t often mention all their older temperature data. They argue that all the recordings then were not taken with standardized equipment. The BOM prefers to start long term graphs and trends from 1910 (except when they start in 1950 or 1970, or 1993).

The BOM was set up in 1908. Before that there were Stevenson screens going in […]

Heatwaves in Australia: in many ways they are not hotter, longer or more common. Why won’t BOM and ABC say that too?

Heatwaves are a wonderful headline generator. That’s because the term sounds scary, yet the “wave” itself is undefined. A hundred different types of heatwave are theoretically possible, but they all sound the same in a headline. It means an activist team could pick and choose the particular one that scores a “record”. Heatwaves can be 3, 4, 5, 7 or 10 days. They can be measured by town, city, state or national data and they are can be above 35, 37, 40 degrees or… pick a number. A heatwave can be measured as days above some percentile of average. That means a few warm days in a cold town can be defined as a heatwave.

Geoff Sherrington, drawing no dollars from the taxpayer, takes a simple and obvious approach, and looks at 5 capital cities with the BOM raw and adjusted ACORN data. He considered 4, 5, and 6 day heatwaves to see if there was a trend. With 5 cites, 2 data types, 3 lengths of heatwave, Sherrington created 30 graphs. After testing all those different combinations of heatwaves, there were only three graphs out of 30 that showed an increasing trend. Over half of the heatwave graphs showed […]

Another toothless review of the BOM?

In last week’s news we find — by golly — that the BOM are going to “rush” to set up an oversight panel that they were told to set up back in 2011 or 2012. Hey, it was going to take three years to set up the panel, but now they’re doing it in two! That’s what I call “action”.

So the BOM knows it’s in trouble, and they shift to Stage 2. They’ve avoided the skeptical questions, the FOIA’s, and the request for explanations for as long as they possibly could. But now the mainstream media is involved, something has to change — because nothing is worse than playing out the questions and answers in an uncontrolled way in public. To pack away those contentious points, what better method than by appointing a committee, review panel, or some kind of “independent” assessment? The right committee can produce toothless recommendations, vague praise, and a weak slap on the wrist and it can take years to do it.

Thus and verily do Ministers sometimes palm off problems, and responsibility. All decision-making power seemingly goes to the “review” (unless it somehow produces an undesirable result). Should the review churn out the conclusion […]

The hotter nights in Melbourne and some mysterious adjustments

Tom Quirk takes a close look at the long historic station of Melbourne. As we would expect, things have changed around the sensor since 1855 when records started. Amazingly he finds the maximum trend in Melbourne was largely flat from 1855 – 1995. The minimums shows a classic warming from 1945.

To find out how much of the warming in Melbourne may be due to the Urban Heat Island effect (UHI) we can compare the minima at the CBD station to one on the outskirts — and Laverton is 20 kilometers away. The site near the CBD is warming at 0.2C per decade faster than the site on the outskirts. It amounts to a whole degree warmer over 50 years, though the rate may be tailing off now. It’s hard to fit in more concrete or more skyscrapers than there already are.

Tom has a close look at the adjustments and finds plenty of questions but few answers. These adjustments are done as step changes, and Tom (and I) wonder why the gradual increase in concrete would warm Melbourne “step-wise” rather than as a slope change. Tom also wonders why the BOM say that one change is due to a […]

Under pressure, Australian BOM puts up facade of “transparency” — too little, too late

Bottom line: The BOM has added a page listing “Adjustments”. It’s two years late, inadequate and incomplete. Skeptics shouldn’t have had to ask for it in the first place, and we still don’t have the algorithms and codes, or rational answers to most questions. No one can replicate the mystery black box homogenisation methods of the BOM — and without replication, it isn’t science. There is still no explanation of why an excellent station like Rutherglen should change from cooling to warming, except for vague “statistics”, or why any station should be adjusted without documentary evidence, based on thermometers that might be 300 km away.

Lo and behold, the pressure from The Australian and independent analysts means the BOM has made a weak belated attempt to do what it has implied it always has done. When Michael Brown provided cover for the BOM he said the notion that scientists were hiding data was “pseudoscience”. The BOM, meanwhile, added a page called “Adjustments”, two years after launching “ACORN”, quietly admitting that the skeptics were right. They did not correct Brown’s baseless namecalling. Other apologists for their inexplicable anomalies, major adjustments or errors — like David Karoly — demand the […]

BOM homogenisation in Deniliquin creates discontinuities and changes trends

The list goes on, and there is more to come.

In Deniliquin NSW, the homogenisation has lifted both the maxima and minima trends — again converting cooling to warming.

Graham Lloyd continues to increase the pressure on the Australian Bureau of Meteorology. In answers to Lloyd the BOM could only defend their work with the extraordinary statement that while some trends at individual stations look anomalous, overall the results “showed a similar warming trend to that of other inter­national climate ­organisations. ”

So they inadvertently admit that they expect Australian trends to look like trends in other parts of the world. Despite the fact that Australia is drier, flatter and surrounded on every edge by oceans, the Bureau would consider it a fail if our trends were different to others? We’re in the opposite hemisphere to many international climate organizations, which may or may not matter, but we’ll never find out if we are trying to fit our data to theirs. And El Nino’s and La Nina’s mean very different things to countries on opposite sides of the Pacific. We’re blurring the resolution from thousands of data-points. The raw data is blended not just on regional scales but thanks […]

Pitman says BOM don’t “fiddle” with data — it’s magical science by Elite Centres of Excellence

What is striking about Andy Pitman and Lisa Alexander’s response to the articles in The Australian, on The Conversation, is how intellectually weak it is, and how little content they have after we remove the logical fallacies. It’s argument from authority, circular reasoning, and strawmen. Hail the Gods (and don’t look over there)! They don’t question Jennifer Marohasy’s remarkable figures, they don’t even mention them at all, nor use the names “Rutherglen”, “Amberley” or “Bourke” –how revealing.

And these are the points at issue. Long cooling trends at supposedly excellent sites had been homogenized and transformed into warming trends. Rutherglen is the kind of station other stations dream to be: it has stayed in the same place according to the official documents, isn’t affected by the heat from urban growth either and is similar to its neighbors. Other stations might be adjusted to be more like it. Instead the BOM has a method that detected “unrecorded” site moves at Rutherglen by studying unnamed stations somewhere in the region. Awkwardly, someone who used to work there says the thermometer didn’t move. Hmm. Would a thinking person ask for more details and an explanation? Not if you are director of an ARC […]

Hiding something? BOM throws out Bourke’s hot historic data, changes long cooling trend to warming

Hello Soviet style weather service? On January 3, 1909, an extremely hot 51.7C (125F) was recorded at Bourke. It’s possibly the hottest ever temperature recorded in a Stevenson Screen in Australia, but the BOM has removed it as a clerical error. There are legitimate questions about the accuracy of records done so long ago — standards were different. But there are very legitimate questions about the BOMs treatment of this historic data. ‘The BOM has also removed the 40 years of weather recorded before 1910, which includes some very hot times. Now we find out the handwritten original notes from 62 years of the mid 20th Century were supposed to be dumped in 1996 as well. Luckily, these historic documents were saved from the dustbin and quietly kept in private hands instead.

Bourke has one of the longest datasets in Australia — but the BOM, supposedly so concerned about the long term climate trends, appears to have little curiosity in the hot weather of the 1880’s and 1890’s (I talked about the amazing heatwave of 1896 here where hundreds died and people in Bourke escaped on special trains). If it had been a cool spell then, would the BOM feel […]

ABC invites BOM and Marohasy to speak — BOM decline, Marohasy accepts, but is cut off?

Bronwen O’Shea, ABC

UPDATED: Correction. The interview was done by a fan of John Cook, not John Cook. Notes in the post and apologies. – Jo

Hm, curious event on the ABC today. Credit to Bronwen O’Shea, host of the ABC morning radio program for the Goulburn Murray, for asking both Jennifer Marohasy and the BOM to discuss the Rutherglen temperature adjustments. Good-o, I say — public debate and answers! (Note that link is just to their website, I have not found a copy of the interview or transcript).

But everything worked against the ABC. First the BOM chose not to even try to answer. (Hm?) Then not long after the interview started, the line suddenly went dead and Marohasy was abruptly cut off. She waited for the call back, but it never came. What bad luck eh? Even more unlucky — when the ABC tried to call her back they got a fan of John Cook on the phone instead*. Then, things got even worse for poor ABC listeners — because the fan of Cook mistakenly thought Rutherglen was different to the surrounding stations, but the BOM raw records say otherwise (see the graph below). UPDATED: Apologies to […]

BOM

All posts related to the Australian Bureau of Meteorology are at this link.

Some of the best:

Australian temperature records shoddy, inaccurate, unreliable. Surprise! Threat of ANAO Audit means Australia’s BOM throws out temperature set, starts again, gets same results Australia – was hot and is hot. So what? This is not an unusual heatwave Not the hottest ever summer for most Australians in Sydney, Melbourne or Brisbane. Not “extreme” heatwaves either. Mystery black-box method used to make *all new* Australian “hottest” ever records Hottest summer record in Australia? Not so, says UAH satellite data Get Headlines! How to find a heatwave in five easy steps What the CSIRO State of the Climate report forgot to tell you Climate-trivia headlines and the BoM’s unscientific obession with “hottest ever” records Australian BOM “neutral” adjustments increase minima trends up 50% Was the Hottest Day Ever in Australia not in a desert, but in far south Albany?! Wow, look at those BOM adjustments – trends up by two degrees C! The heat is on. Bureau of Meteorology ‘altering climate figures’ — The Australian 10 out of 10 based on 4 ratings […]

Australian BOM responds to Graham Lloyd, at The Australian

I respond to this letter in the post:

BOM finally explains! Cooling changed to warming trends because stations “might” have moved!

For the record, the entire response is below.

Media enquiry: Comparison of temperature charts

From: Graham Lloyd, The Australian

Date: 22 August 2014

Homogeneity adjustments are standard analyses carried out by agencies around the world.

FAQ: http://www.bom.gov.au/climate/change/acorn-sat/documents/ACORN-SAT-Fact-Sheet-WEB.pdf

As outlined in the Bureau’s previous correspondence, each temperature recording is the result of a range of choices — such as choice of instrument, choice of calibration, choice of instrument enclosure and choice of enclosure siting.

All of these elements are subject to change over a period of 100 years, and such non-climate-related changes need to be accounted for in the data. Put another way, one needs to determine whether changes recorded in unhomogenised temperature records are real or artificial — there can be no implicit assumption that such records are unaffected by changes in recording practice over time. This implicit assumption is often uncritically presented on internet blogs.

The international literature strongly concludes that data homogenisation is necessary for the creation of temporally consistent data […]

BOM finally explains! Cooling changed to warming trends because stations “might” have moved!

It’s the news you’ve been waiting years to hear! Finally we find out the exact details of why the BOM changed two of their best long term sites from cooling trends to warming trends. The massive inexplicable adjustments like these have been discussed on blogs for years. But it was only when Graham Lloyd advised the BOM he would be reporting on this that they finally found time to write three paragraphs on specific stations.

Who knew it would be so hard to get answers. We put in a Senate request for an audit of the BOM datasets in 2011. Ken Stewart, Geoff Sherrington, Des Moore, Bill Johnston, and Jennifer Marohasy have also separately been asking the BOM for details about adjustments on specific BOM sites. (I bet Warwick Hughes has too). The BOM has ignored or circumvented all these, refusing to explain why individual stations were adjusted in detail.

The two provocative articles Lloyd put together last week were Heat is on over weather bureau and Bureau of Meteorology ‘altering climate figures, which I covered here. This is the power of the press at its best. The absence of articles like these, is why I have said the media […]