This article is reproduced with the courtesy of Africa Check, a non-partisan organisation that promotes accuracy in public debate and the media. Twitter @AfricaCheck.
Are you a reporter or presenter working for an Africa-based media house? Has a report you published or broadcast exposed a misleading claim from a public figure or institution?
These awards, sponsored jointly by Africa Check and the AFP Foundation, the non-profit media training arm of the AFP news agency, are the first to be set up specifically to honour the works of African journalists who expose misleading claims made by leading public figures and powerful institutions around the continent.
A winner, who will receive a prize of two thousand euros, and two runners up who will each receive one thousand euros, will be announced at a ceremony to be held in Africa in November 2014.
– See more at: The Africa Check website.
In view of these awards we take a look at a vital service offered by the Africa Check website:
Whether you are a reporter, an activist, a business leader, a health worker or a regular citizen how can you know when public figures tell the truth and when they distort it? How can you decide what claims are fair and who to trust? To produce the reports for this site, we have used our own experience as journalists and the help and assistance of specialist experts in a range of fields, to draw up this checklist:
1. Ask where is the evidence?
Whenever anyone in public life makes a claim, big or small, the first question you should ask – once you have got past whether the claim is plausible and worth investigating – is ‘Where’s the evidence?’
Many now agree that, in the build up to the war in Iraq in 2003, (shown left), too little attention was given to the clear lack of hard evidence that Iraq possessed the weapons that was claimed.
There and elsewhere, there is often a good reason for an official to refuse to reveal the evidence behind a claim they make. They may need, as journalists do, to protect their source. But if sources need protection, we still need evidence. And often the reason officials refuse to provide it is that their evidence is weak or partial or contradictory.
So first ask for the evidence, and if none is forthcoming, you know there is, or may be, a problem with the claim.
2. Is the evidence verifiable?
The next step, if evidence is provided, is to see whether it can be verified. One of the key tests made before the results of any new trial are accepted by the scientific community is to see whether the trial can be repeated by other researchers with the same or similar findings. As Thomas Huxley, a prominent 19th century biologist, put it: “The man of science has learned to believe in justification not by faith but by verification”.
It should be the same in public debate. When a public figure, in any field, makes a claim they want believed, they should be asked to provide verifiable evidence. If they can’t, can you take what they say on trust?
3. Is the evidence sound?
As much as we have looked, there is yet no one, single checklist of tests that covers all the different types of evidence you might have to assess before you decide it is sound. Listed below are the main questions we ask.
Could they know what they claim to know?
If the evidence is based on an eye-witness account, could the person know what they claim to know. Where they there? Is it credible to believe they would have access to this sort of information? Is the information first- or second-hand, something they had heard and believed? Is it something that could be known?
If there is data, when was it gathered?
It is a favoured trick of public figures to present information collected many years previously, as if it were from today, and make no mention of the dates. But data ages and, unlike most wines, this is not good. To understand the data, you need to know when it was gathered and what the picture looked like before and after. It is a favoured trick of people presenting data to choose the start and end-dates not for how well they reflect the true performance, over time, but to make the numbers look good, starting at the bottom of a regular cycle and ending at the top.
Was the sample large enough? Was it comprehensive?
An opinion poll that samples the views of a few dozen – or even a few hundred – people is unlikely to be representative of the views of a population of millions. Most polling organisations suggest that a well-chosen sample of around 1,000 people is the minimum required to produce accurate results. But it is surprising how often surveys of a few hundred, or few dozen, people are quoted by public figures and reported in the media as representing wider views.
And remember, even large scale surveys – that do not look in all the right places – can give an inaccurate picture. This is something known by some as the ‘black swan problem’ – a reference to the erroneous assumption made in Europe for centuries that all swans are white because the hundreds of thousands of swans seen there over the years, all were. And indeed, it was only when 17th century Dutch explorer Willem de Vlamingh returned to Europe after discovering black swans in western Australia, that people began to know better. The previous ‘sample’ had been large, but had not been extensive enough.
How was the data collected?
Sample size is not all that matters. When taking an opinion poll, the pollsters have to include people of all the relevant social groups – both genders, all ages, from the different races, social-economic groups and different regions – and in the right proportions, if it is to be thought representative of society as a whole.
How was the study done? Similar surveys done door-to-door can produce different results from those done on the telephone because of how the interviewee responds to someone face-to-face and on the phone.
And studies that rely on the respondents filling in forms tend to show more errors, particularly among respondents with low literacy skills, than person-to-person interviews. If the claim is based on a survey like this, could that be a factor?
Meanwhile, what people taking part in a study or a trial know, or think they know, about it, will also affect the outcome. This is the so-called ‘placebo effect’ and explains why medical trials often are, or should be, ‘blinded’ – so that those being studied do not know the nature of the treatment they have or have not been given.
What about the wider picture?
Once you know how the data was collected, assess the way it was presented. Did the person tell the truth, the whole truth and nothing but the truth? Public figures from all walks of life like to select what they tell you, and what they don’t, cherry-picking the juiciest evidence, favourable to their side in an argument, and leaving the less tasty morsels in the bowl.
Is the data presented in context, and would mean the same, if other, unmentioned factors, are taken into consideration.
When a politician says, for example, that he or she put “record sums” into the public health system, and does not mention inflation, the claim may be true, in itself, but misleading if inflation means “real terms” spending is falling. So make sure to look at other factors that make up the wider picture.
And always remember to keep numbers in proportion. Spending $50million on a health project may sound like a lot, for a small community. But divide it among a population, and note that the programme is set to run over 10 years and it seems a lot less generous than it seemed at first.
4. Data sources, experts and the crowd
The fact that the person making a claim cannot, or does not, offer evidence to back up their statement, makes it harder to check but does not prove it wrong. To check it, you can turn to credible data sources, acknowledged experts and the crowd.
Numerous sources of data useful in fact-checking claims that people make exist. Depending on the sort of claim you are checking, you may seek information from government papers and official statistics, company records, scientific studies and health research databanks, through to school records, development charity accounts, religious orders’ papers and others besides.
We set out tips and examples of data sources we find useful on our Resources for fact-checking page. As with all sources of information, it is important to know all you can about the organisation that gathered and holds the data before you use it.
Depending on the topic – if the claim made is on medical matters, or require detailed knowledge of a major company’s accounts, or a fine point of law – it may be more suitable to check a claim by talking to a number of recognised experts.
When doing this, the most important thing is to know and declare any interest the expert may have in the matter that may cause, or be seen to cause, a bias in their analysis, one way or another.
Sometimes, the people you speak to may seek anonymity. This weakens your report but, if the information they provide is independently verifiable, may be acceptable. Univerifiable information from an anonymous source, who will only talk “off the record” should not be used.
Again depending on the topic, the best source for information to check a particular claim may not be a set of papers or a particular expert, but the knowledge to be found in the wider community; crowdsourcing as it is known.
If an official claims on election morning that all polling stations received their ballot papers on time, or an environmental group claims a factory is polluting a neighbourhood, the best placed people to confirm or undermine what they say may be people in the wider community.
When sourcing information from the crowd, you need to be cautious about a number of things. To start with, it is important you guard the security of your sources. In many cases, information sent by SMS, email and other means can be intercepted and in some countries people who supply ‘sensitive’ information to media sites may suffer for it, so it is important to set up ways to communicate that are as secure as possible.
At the same time, you need to know who your sources are and whether the information they supply is reliable. Seek to verify the identity of anyone who sends you information. Information sent in anonymously should be treated with necessary scepticism. Be wary of mass mailings by groups with agendas to push, and of using anecdotal evidence as if it were representative.
5. Spotting fakes
What you want to verify may not, of course, be a spoken or written claim but material – photos, videos, blogs or other content – sent to you or published online. In the digital age, photographs, video footage, text documents, websites and Twitter and other social media feeds can all be falsified. How to spot what is genuine and what is fake? These are our tests.
Do the words or images ring true?
First things first, before even you start to look for evidence, the most important thing to do when sent material is to engage your brain. Do the images or words ring true? Is the language or sentiment expressed the way the person would talk? Is it the sort of thing they might really have said?
Colleagues understand when people are taken in by clever hoaxes. But if it is obvious, after the event, that the person quoted would never have been likely to say the thing that was quoted, and you did not check, you can look foolish.
So first, think. And then, if in doubt, check with the person or organisation quoted or shown to verify.
Is there a telling detail out of place? Hoaxers are often let down by the details. Be sceptical always. The quote used in this cartoon is not wrong, but something should make you realise it was probably not the 19th century US president who said it.
Look at the phrase used and ask if that could have been said at the time. Look at the photo or video and ask whether it abides by the laws of light and shade. Are there things you can see in the background that should be there that aren’t or shouldn’t be there and are. Does the weather shown reflect the weather you would expect in that place, at that time of year? Are the views, plants, cars, buildings the sort you would expect to see?
If the details are out of place, it may be a hoax.
Has it – or something similar – appeared elsewhere before?
Unlike lightning, hoaxers often do strike twice If you are suspicious about an image or text, check online to see whether it – or something similar – has appeared elsewhere before.
Run a search on Twitter referring to the material with the hashtag ‘fake’ and see if others on Twitter have spotted something too.
If it is text you think might have been used before, drop it into Google search.
If it is a photo, or video free-frame in PNG format, drop it into a website such as www.tineye.com which allows you to check photos or videos to see whether they might have appeared online previously. If the same image, or one very similar, has been published previously in different circumstances, what you have been sent may be a fake.
Has the person filed material elsewhere
Remenber people often use the same username on various platforms, so if you are searching for similar material from one person, put their username into different platforms such as Google Search, Facebook, Flickr, Twitter, YouTube, 123people.com, blogsearchgoogle.com, Technorati.com.
Check the person who sent it is where they say they are
If you have doubts about the source of some information, and have the numerical address – the IP code – of the computer it came from, you can check the country the computer is located in it you enter that into this address: www.domaintools.com/reverse-ip/
6. Be persistent
Fact-checking takes time and persistence. When someone tries to fob you off, refusing you access to data you are entitled to, or failing to provide evidence that backs up their claim, keep pushing.
Verifying public debate is not easy. The devil is, often, in the detail. To find it you need stamina and persistence.
7. Be open & accept you’ll have critics
Finally, be open in the way you write up any fact-checking reports, providing links to the evidence you use. And be honest, if you make a mistake, admit it. Even so, you need to accept that you won’t convince everyone.
Most people show some reluctance to accept evidence that goes against what they believe. And there are some that no amount of careful argument and linking to evidence will convince. It is a phenomenon known by scientists as the “persistence of discredited beliefs”, and describes a state where, according to the psychologists Craig Anderson and Lee Ross said: “Beliefs can survive potent logical or empirical challenges. They can survive and even be bolstered by evidence that most uncommitted observers would agree logically demands some weakening of such beliefs. They can even survive the total destruction of their original evidential bases.”
Some people, you just can’t convince.
– See more at Africa Check.
I am constantly invstigating online for tips that can help me. Thanks!
Can I just say what a relief to find someone who actually knows what theyre talking about on the internet. You definitely know how to bring an issue to light and make it important. More people need to read this and understand this side of the story. I cant believe youre not more popular because you definitely have the gift.
Hiya, I’m really glad I’ve found this info. Nowadays bloggers publish just about gossips and internet and this is really annoying. A good web site with exciting content, that’s what I need. Thank you for keeping this website, I will be visiting it. Do you do newsletters? Can not find it.
I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post…
Thanks for the good writeup. It in fact used to be a entertainment account it. Glance advanced to far added agreeable from you! However, how could we keep in touch?
There may be noticeably a bundle to find out about this. I assume you made sure nice factors in features also.
you are really a good webmaster. The web site loading speed is amazing. It seems that you’re doing any unique trick. Furthermore, The contents are masterwork. you have done a excellent job on this topic!
I haven’t checked in here for a while because I thought it was getting boring, but the last several posts are great quality so I guess I will add you back to my daily bloglist. You deserve it my friend 🙂
I conceive this site has got very fantastic composed content articles.
Hi, i think that i saw you visited my site so i came to “return the favor”.I am trying to find things to improve my website!I suppose its ok to use a few of your ideas!!
It’s a pity you don’t have a donate button! I’d most certainly donate to this fantastic blog! I guess for now i’ll settle for bookmarking and adding your RSS feed to my Google account. I look forward to brand new updates and will talk about this site with my Facebook group. Chat soon!
magnificent post, very informative. I wonder why the other specialists of this sector don’t notice this. You must continue your writing. I’m confident, you have a great readers’ base already!
Appreciating the dedication you put into your site and in depth information you present. It’s great to come across a blog every once in a while that isn’t the same old rehashed material. Fantastic read! I’ve saved your site and I’m adding your RSS feeds to my Google account.
F*ckin¦ tremendous issues here. I¦m very satisfied to look your article. Thank you so much and i am looking ahead to touch you. Will you please drop me a e-mail?
I’ve been absent for some time, but now I remember why I used to love this site. Thank you, I¦ll try and check back more often. How frequently you update your website?
Great post. I was checking continuously this weblog and I’m impressed! Extremely useful info specifically the ultimate section 🙂 I handle such information much. I was seeking this certain info for a long time. Thanks and good luck.
Hey there this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding experience so I wanted to get advice from someone with experience. Any help would be greatly appreciated!
Some genuinely nice and utilitarian information on this web site, besides I think the design has got good features.
excellent post, very informative. I wonder why the other specialists of this sector don’t notice this. You must continue your writing. I’m confident, you’ve a huge readers’ base already!
I really like your writing style, fantastic info , appreciate it for putting up : D.
Hi, I think your blog might be having browser compatibility issues. When I look at your website in Chrome, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, very good blog!
I believe this is one of the most significant info for me. And i’m happy studying your article. But wanna observation on few general things, The site taste is great, the articles is in reality nice : D. Good activity, cheers
Whats Happening i’m new to this, I stumbled upon this I have found It positively helpful and it has aided me out loads. I hope to give a contribution & aid other customers like its aided me. Good job.
Have you ever considered about adding a little bit more than just your articles? I mean, what you say is valuable and everything. But think about if you added some great graphics or videos to give your posts more, “pop”! Your content is excellent but with pics and video clips, this blog could certainly be one of the most beneficial in its niche. Great blog!
Hi there! I could have sworn I’ve been to this blog before but after checking through some of the post I realized it’s new to me. Nonetheless, I’m definitely glad I found it and I’ll be bookmarking and checking back frequently!
Good site! I truly love how it is easy on my eyes and the data are well written. I’m wondering how I could be notified whenever a new post has been made. I’ve subscribed to your feed which must do the trick! Have a nice day!
I am often to blogging and i really appreciate your content. The article has really peaks my interest. I am going to bookmark your site and keep checking for new information.
Hiya very cool website!! Guy .. Beautiful .. Superb .. I will bookmark your blog and take the feeds additionally…I’m happy to seek out numerous helpful info here in the publish, we want develop more techniques in this regard, thanks for sharing. . . . . .
Some truly interesting info , well written and broadly user friendly.
Hey very nice web site!! Guy .. Excellent .. Superb .. I’ll bookmark your site and take the feeds also…I am happy to seek out numerous helpful information here within the post, we’d like work out more techniques in this regard, thank you for sharing.
Your style is so unique compared to many other people. Thank you for publishing when you have the opportunity,Guess I will just make this bookmarked.2
Hello, you used to write magnificent, but the last few posts have been kinda boringK I miss your great writings. Past several posts are just a bit out of track! come on!
I really appreciate this post. I’ve been looking all over for this! Thank goodness I found it on Bing. You’ve made my day! Thank you again
Some genuinely nice and useful information on this web site, as well I conceive the design holds wonderful features.
I would like to express my appreciation to this writer for rescuing me from this type of predicament. After researching through the online world and meeting tips which are not beneficial, I was thinking my entire life was over. Living without the presence of approaches to the difficulties you have fixed all through your entire write-up is a crucial case, as well as ones which might have in a wrong way affected my career if I had not come across your web site. Your primary skills and kindness in playing with all the details was tremendous. I am not sure what I would’ve done if I had not discovered such a subject like this. I can also now look ahead to my future. Thank you so much for your skilled and amazing guide. I will not hesitate to suggest your web site to any person who should receive guidelines on this topic.
What’s Happening i’m new to this, I stumbled upon this I have found It absolutely useful and it has helped me out loads. I hope to contribute & aid other users like its aided me. Great job.
Great post. I am facing a couple of these problems.
Video Marketing Explained And Why Every Business Should Use It
I just couldn’t leave your web site prior to suggesting that I extremely enjoyed the standard info a person provide on your guests? Is going to be again steadily in order to inspect new posts
Hiya, I’m really glad I’ve found this info. Today bloggers publish only about gossips and web and this is actually frustrating. A good site with exciting content, this is what I need. Thank you for keeping this website, I’ll be visiting it. Do you do newsletters? Can not find it.
I feel this is among the most vital info for me. And i’m glad studying your article. However wanna commentary on few general issues, The web site taste is ideal, the articles is actually great : D. Excellent task, cheers
Hey this is great article. I will certainly personally recommend to my friends. I’m confident they will be benefited from this website.
Very interesting subject , appreciate it for putting up.
Woah! I’m really enjoying the template/theme of this blog. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appearance. I must say you’ve done a amazing job with this. Also, the blog loads very fast for me on Internet explorer. Excellent Blog!
As I website possessor I believe the content material here is really fantastic, appreciate it for your efforts.
Do you mind if I quote a couple of your posts as long as I provide credit and sources back to your website? My blog is in the very same area of interest as yours and my users would really benefit from a lot of the information you present here. Please let me know if this ok with you. Cheers!
I do love the way you have framed this matter and it does supply me personally a lot of fodder for consideration. On the other hand, through what precisely I have observed, I just hope when the reviews pack on that individuals remain on issue and don’t get started upon a tirade associated with some other news of the day. Anyway, thank you for this exceptional point and while I can not necessarily agree with it in totality, I regard the point of view.
I am curious to find out what blog system you are working with? I’m having some minor security problems with my latest blog and I’d like to find something more safe. Do you have any suggestions?
Hi, Neat post. There’s a problem with your website in internet explorer, would test this… IE still is the market leader and a good portion of people will miss your magnificent writing because of this problem.
We are a group of volunteers and opening a new scheme in our community. Your site provided us with valuable info to paintings on. You’ve done a formidable job and our whole community can be thankful to you.
Wow! Thank you! I continuously needed to write on my site something like that. Can I implement a part of your post to my blog?
I love your blog.. very nice colors & theme. Did you create this website yourself? Plz reply back as I’m looking to create my own blog and would like to know wheere u got this from. thanks
Excellent blog post here and useful information. Thank you very much for sharing your experience and good luck in future blogging
Hiya, I am really glad I have found this information. Nowadays bloggers publish just about gossips and web and this is really annoying. A good blog with exciting content, that is what I need. Thanks for keeping this web site, I will be visiting it. Do you do newsletters? Can’t find it.
Rattling nice design and superb subject material, hardly anything else we want : D.
Thankyou for helping out, great info .
I’ve read a few good stuff here. Definitely worth bookmarking for revisiting. I surprise how much effort you set to create the sort of wonderful informative web site.
My brother suggested I would possibly like this blog. He used to be entirely right. This submit actually made my day. You can not believe simply how so much time I had spent for this information! Thanks!
I really appreciate this post. I have been looking everywhere for this! Thank goodness I found it on Bing. You’ve made my day! Thx again
Thanks a lot for providing individuals with an exceptionally marvellous opportunity to read from this blog. It can be so enjoyable and packed with amusement for me personally and my office colleagues to visit your blog the equivalent of thrice in one week to find out the new tips you have got. Not to mention, we’re at all times pleased with your amazing ideas you give. Some 1 facts in this article are indeed the finest I’ve ever had.
I gotta favorite this web site it seems very useful very useful
Just wanna say that this is very useful, Thanks for taking your time to write this.
Outstanding post, you mentioned some great points in this article. Nice writing skills. Thank you!
I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post…
Probably one of the best articles i have read in long long time. Enjoyed it. Thank you for such nice post.
Definitely a magnificent site and revealing posts, I surely will bookmark your website.Best Regards!
Some very interesting points made in this post. Glad i found it. Thanks for sharing such valuable information.