Al Jazeera Journalism Review

Outside image

What is an open-source investigation?

In the second part of our special series on using open-source intelligence in journalism, we look at what makes a good investigation

 

An open source investigation (OSINT) uses intelligence gathering techniques and technologies including satellite imagery, social media posts and user-generated content to uncover the invisible. In recent years, open source investigations have become one of journalism’s most valuable tools, largely due to its ability to tap into vast amounts of publicly available online information to reveal otherwise untold stories. 

Collecting and analysing publicly available data and information from across the internet can include anything from analysing an IP address all the way through to interrogating public governmental records. 
 

Read more:

Open-Source Investigations, Part 1: Using open-source intelligence in journalism

Al Jazeera Media Institute Open-Source Investigation Handbook

 

What is OSINT? Open source intelligence is the application of intelligence gathering techniques and technology to investigations that make use of open source data. 

Security adjunct professor at Columbia University Mark M Lowenthal defines OSINT as “any and all information that can be obtained from the overt collection: all media types, government reports, and other files, scientific research and reports, business information providers, the Internet, etc”. 

The learning process of how to use open source tools is constantly evolving. The Al Jazeera Media Institute Open-Source Investigation Handbook provides core elements and tools for journalists who are interested in conducting open-source investigations. It introduces a framework and outlines ethical approaches, while examining case studies, to analyse the fundamentals of online search and research techniques for investigations. 

Whether it involves using search engines to gather documentation, examines videos and satellite imagery to collect critical evidence, or evaluates data gathered from an online database, this handbook offers journalists the necessary skills to acquire and verify documentation.

From early conflict and environmental monitoring to high-profile investigations such as Anatomy of a Killing, using advanced open source techniques has quickly developed to become a crucial practice for journalists in both long-form investigations and breaking news. Open source techniques involve researching, selecting, archiving and analysing information from publicly available sources. 

OSINT15

An effective open source investigation begins by addressing these three questions: What do we need to know? Why do we need to know it? Who might have the information we need?

While various open source guidebooks available to investigative journalists differ on the exact process that should be followed in an open source investigation, they all agree on certain fundamentals. 

First, you must have a clear strategy and framework in place for acquiring and using open source information. This involves identifying which investigation to pursue and how to transform your findings into an engaging story. 

Second, you must identify a set of tools and techniques for collecting and processing open source information without compromising the safety of your subject matter or those involved in investigating the story. 

Third, you should develop the right strategies to validate your findings. Collaboration is an important consideration here. 

Finally, as in many parts of the world information is heavily controlled, knowing how to preserve and archive data remains an important element that can affect accountability mechanisms.

 

Benefits 

● Wide array of information to collect 

● No or low barriers to access 

● Easy-to-locate publicly available data 

 

Risks 

● Identity exposure 

● Counterattacks from online adversaries 

● Collection of misinformation

 

Debunking Myths about OSINT 

● Open Source investigation is just Googling 

● Open Source investigation is only for cybersecurity professionals 

● Open Source investigation is only for tech-savvy individuals or experts 

● Open Source investigation is surveillance and violates privacy 

 

Tips for an open source investigator 

1. YOUR SECURITY IS PARAMOUNT – Don’t forget to keep your identity hidden while searching. 

2. BE CAREFUL – You really need a good eye for small details. A successful open source investigator has sharp observational skills to detect even the slightest bit of information that might contribute to the bigger picture. 

3. PERSEVERANCE – To be a successful open source investigator, you need to stick out the seemingly never-ending process of compiling data and research.

osint

Case Study

Forced out - Measuring the scale of the conflict in South Sudan 

In 2019, Al Jazeera’s AJLabs data journalism team, in partnership with the Pulitzer Center, published an open source investigation to better understand the complexities and scale of displacement and land rights in South Sudan. 

For this story, Carolyn Thompson and Kristen van Schie worked with land rights experts and statisticians to survey more than 35,000 random phone numbers across South Sudan in order to paint an accurate picture of displacement across the world’s youngest nation which had descended into civil war. 

As of 2019, nearly 2.5 million refugees had fled to neighbouring countries. 

osint

As many journalists are denied access to or even barred from reporting within the country, Al Jazeera used a mobile phone survey to gather information from those in places traditional journalism cannot reach. That data, which included questions on demographics, displacement, destruction, and plans to return home was then verified against other reporting tools, including satellite imagery, on-the-ground interviews, UN reports, public records, photos of the destruction and testimonies from internally displaced people and refugees. 

The result was an interactive longform which included maps, videos, infographics and before-and-after sliders. 

In 2020, the Investigative Reporters and Editors (IRE) awarded the story third place in the Philip Meyer Award for “an outstanding example of a determined group of reporters using social science methods to get to the root causes of a refugee crisis, even with severely limited press freedom, possible government interference, and a scared population.”

This article has been adapted from the Al Jazeera Media Institute’s Open-Source Investigation Handbook

 

More Articles

Analysis: The media’s coverage of the Pakistan cable car incident

It was a roller coaster ride with news organisations all over the world giving minute-by-minute reports on the daring rescue. How does the media create suspense and is this sort of coverage useful?

Anam Hussain
Anam Hussain Published on: 21 Sep, 2023
How to use data to report on earthquakes

Sifting through data sounds clinical, but journalists can use it to seek out the human element when reporting on natural disasters such as earthquakes

Arwa
Arwa Kooli Published on: 19 Sep, 2023
‘I had no idea how to report on this’ - local journalists tackling climate change stories

Local journalists are key to informing the public about the devastating dangers of climate change but, in India, a lack of knowledge, training and access to expert sources is holding them back

Saurabh Sharma
Saurabh Sharma Published on: 13 Sep, 2023
Ethical reporting - how to cover suicide responsibly

Sensationalist reporting of suicide cases has been shown to cause a rise in the numbers of people taking their own lives in affected communities. Journalists must take great care

Abeer Ayyoub
Abeer Ayyoub Published on: 7 Sep, 2023
‘Don’t let someone else narrate your stories for you’ - travel journalists in the global south

THE LONG READ: Life as a travel journalist isn’t just for privileged Westerners ‘discovering’ quaint parts of south-east Asia and Africa

Anam Hussain
Anam Hussain Published on: 1 Sep, 2023
‘People need to stop blindly obeying the law’ - journalists fighting on the fringes in Vietnam

THE LONG READ: Imprisoned, exiled and forced to base themselves overseas, independent journalists in Vietnam are punished harshly if they publish the ‘wrong’ sort of content. Some, such as Luật Khoa tạp chí, are fighting back

headshot
Al Jazeera Journalism Review Correspondent Published on: 25 Aug, 2023
Ethics and safety in OSINT - can you believe what you see?

OSINT is increasingly important for journalists in a digital world. We take a look at ethics, safety on the internet and how to spot a ‘deepfake’

Sara
Sara Creta Published on: 15 Aug, 2023
‘Other journalists jeer at us’ – life for mobile journalists in Cameroon

Journalists in Cameroon are using their phones in innovative ways to report the news for many different types of media, but major news organisations have still not caught up

Akem
Akem Nkwain Published on: 1 Aug, 2023
‘Life of journalists is cheap’ - how the Philippines became deadly for reporters

Forging ahead with a career in journalism is fraught with difficulty in the Philippines - and many are walking away. What went so wrong?

Ana
Ana P Santos Published on: 19 Jul, 2023
Analysis: Could AI replace humans in journalism?

Recent advances in AI are mind-blowing. But good journalism requires certain skills which, for now at least, only humans can master

Mei Shigenobu
Mei Shigenobu Published on: 17 Jul, 2023
Analysis: Comparing coverage of the Titanic submersible and migrant boat disasters

Two disasters costing human lives have occurred at sea in the past two weeks, but the media coverage of each was markedly different. How and why?

Anam Hussain
Anam Hussain Published on: 28 Jun, 2023
The silencing of Sudan's journalists - again

THE LONG READ: Detained, beaten and their cameras smashed - Sudan’s journalists are enduring a renewed crackdown on the media

Philip Obaji Jr
Philip Obaji Jr Published on: 7 Jun, 2023
'Rebuilt memory by memory' - recreating a Palestinian village 75 years after the Nakba

REPORTER'S NOTEBOOK: How it took the collective memories of several generations, painstaking interviews and a determined search through tall grass and prickly plants to recreate a destroyed community

Amandas
Amandas Ong Published on: 4 Jun, 2023
Suffering in silence - the Kashmiri journalists facing a mental health crisis

THE LONG READ: Al Jazeera Journalism Review has interviewed more than 20 journalists in India-controlled Kashmir who are facing exhausting, insurmountable obstacles to doing their jobs safely every single day

Adil Akhoon
Adil Amin Akhoon, Khalid Bashir Gura Published on: 29 May, 2023
How to analyse satellite imagery

When you have a story, but still need to tie up loose ends to answer where or when a particular event occurred, satellite imagery can point you in the right direction

Sara
Sara Creta Published on: 25 May, 2023
OSINT: Tracking ships, planes and weapons

Tracking ships and planes is an increasingly valuable technique in open-source investigations carried out by journalists. In part 4 of our special series, we examine how it works

Sara
Sara Creta Published on: 18 May, 2023
How social media bans have crippled journalism in India’s Punjab

The Indian government has ordered social media platforms to block hundreds of accounts of journalists and activists

Meer Faisal
Meer Faisal Published on: 16 May, 2023
Tear gas and internet blackouts - reporting on protests in Pakistan

REPORTER'S NOTEBOOK: Following the arrest of former Prime Minister Imran Khan, violence has erupted across Pakistan. For journalists, it is like reporting from the centre of a storm

Anam Hussain
Anam Hussain Published on: 14 May, 2023
Remembering Shireen; my colleague and a 'role model for professionalism'

On the eve of the first anniversary of the killing of Shireen Abu Akleh, Al Jazeera's Senior Correspondent in Palestine, her colleague commemorates the compassion, integrity and professionalism which made her the extraordinary journalist and human being that she was

Walid
Walid Omary Published on: 10 May, 2023
Planning and carrying out an open-source investigation

Part three of our special series of articles on using OSINT in journalism. This time, follow our four steps to completing an open-source investigation

Sara
Sara Creta Published on: 9 May, 2023
How misinformation in the media wreaked havoc on an Indian village

When journalists - and social media ‘influencers’ claiming to be journalists - aimed for sensationalism and did not check their facts about the outbreak of the HIV virus in an Indian village, the results were devastating

Saurabh Sharma
Saurabh Sharma Published on: 1 May, 2023
Using open-source intelligence in journalism

Where once journalists relied on sources for information - also known as ‘human intelligence’ (HUMINT) - they now increasingly rely on ‘open-source’ intelligence (OSINT) gathered from the internet, satellite imagery, corporate databases and much, much more

Phil
Phil Rees Published on: 12 Apr, 2023
Why is life so dangerous for Pakistani journalists?

Pakistani journalists face huge danger in the course of carrying out their work. Why is so little being done to address this?

Anam Hussain
Anam Hussain Published on: 6 Apr, 2023
Investigating the assassination of my own father

As a journalist, reporting on the murder of my father meant answering questions about my own position as an objective observer

Diana Lopez
Diana Lopez Zuleta Published on: 3 Apr, 2023