Al Jazeera Journalism Review

Outside image

What is an open-source investigation?

In the second part of our special series on using open-source intelligence in journalism, we look at what makes a good investigation

 

An open source investigation (OSINT) uses intelligence gathering techniques and technologies including satellite imagery, social media posts and user-generated content to uncover the invisible. In recent years, open source investigations have become one of journalism’s most valuable tools, largely due to its ability to tap into vast amounts of publicly available online information to reveal otherwise untold stories. 

Collecting and analysing publicly available data and information from across the internet can include anything from analysing an IP address all the way through to interrogating public governmental records. 
 

Read more:

Open-Source Investigations, Part 1: Using open-source intelligence in journalism

Al Jazeera Media Institute Open-Source Investigation Handbook

 

What is OSINT? Open source intelligence is the application of intelligence gathering techniques and technology to investigations that make use of open source data. 

Security adjunct professor at Columbia University Mark M Lowenthal defines OSINT as “any and all information that can be obtained from the overt collection: all media types, government reports, and other files, scientific research and reports, business information providers, the Internet, etc”. 

The learning process of how to use open source tools is constantly evolving. The Al Jazeera Media Institute Open-Source Investigation Handbook provides core elements and tools for journalists who are interested in conducting open-source investigations. It introduces a framework and outlines ethical approaches, while examining case studies, to analyse the fundamentals of online search and research techniques for investigations. 

Whether it involves using search engines to gather documentation, examines videos and satellite imagery to collect critical evidence, or evaluates data gathered from an online database, this handbook offers journalists the necessary skills to acquire and verify documentation.

From early conflict and environmental monitoring to high-profile investigations such as Anatomy of a Killing, using advanced open source techniques has quickly developed to become a crucial practice for journalists in both long-form investigations and breaking news. Open source techniques involve researching, selecting, archiving and analysing information from publicly available sources. 

OSINT15

An effective open source investigation begins by addressing these three questions: What do we need to know? Why do we need to know it? Who might have the information we need?

While various open source guidebooks available to investigative journalists differ on the exact process that should be followed in an open source investigation, they all agree on certain fundamentals. 

First, you must have a clear strategy and framework in place for acquiring and using open source information. This involves identifying which investigation to pursue and how to transform your findings into an engaging story. 

Second, you must identify a set of tools and techniques for collecting and processing open source information without compromising the safety of your subject matter or those involved in investigating the story. 

Third, you should develop the right strategies to validate your findings. Collaboration is an important consideration here. 

Finally, as in many parts of the world information is heavily controlled, knowing how to preserve and archive data remains an important element that can affect accountability mechanisms.

 

Benefits 

● Wide array of information to collect 

● No or low barriers to access 

● Easy-to-locate publicly available data 

 

Risks 

● Identity exposure 

● Counterattacks from online adversaries 

● Collection of misinformation

 

Debunking Myths about OSINT 

● Open Source investigation is just Googling 

● Open Source investigation is only for cybersecurity professionals 

● Open Source investigation is only for tech-savvy individuals or experts 

● Open Source investigation is surveillance and violates privacy 

 

Tips for an open source investigator 

1. YOUR SECURITY IS PARAMOUNT – Don’t forget to keep your identity hidden while searching. 

2. BE CAREFUL – You really need a good eye for small details. A successful open source investigator has sharp observational skills to detect even the slightest bit of information that might contribute to the bigger picture. 

3. PERSEVERANCE – To be a successful open source investigator, you need to stick out the seemingly never-ending process of compiling data and research.

osint

Case Study

Forced out - Measuring the scale of the conflict in South Sudan 

In 2019, Al Jazeera’s AJLabs data journalism team, in partnership with the Pulitzer Center, published an open source investigation to better understand the complexities and scale of displacement and land rights in South Sudan. 

For this story, Carolyn Thompson and Kristen van Schie worked with land rights experts and statisticians to survey more than 35,000 random phone numbers across South Sudan in order to paint an accurate picture of displacement across the world’s youngest nation which had descended into civil war. 

As of 2019, nearly 2.5 million refugees had fled to neighbouring countries. 

osint

As many journalists are denied access to or even barred from reporting within the country, Al Jazeera used a mobile phone survey to gather information from those in places traditional journalism cannot reach. That data, which included questions on demographics, displacement, destruction, and plans to return home was then verified against other reporting tools, including satellite imagery, on-the-ground interviews, UN reports, public records, photos of the destruction and testimonies from internally displaced people and refugees. 

The result was an interactive longform which included maps, videos, infographics and before-and-after sliders. 

In 2020, the Investigative Reporters and Editors (IRE) awarded the story third place in the Philip Meyer Award for “an outstanding example of a determined group of reporters using social science methods to get to the root causes of a refugee crisis, even with severely limited press freedom, possible government interference, and a scared population.”

This article has been adapted from the Al Jazeera Media Institute’s Open-Source Investigation Handbook

 

More Articles

Covering the War on Gaza: As a Journalist, Mother, and Displaced Person

What takes precedence: feeding a hungry child or providing professional coverage of a genocidal war? Journalist Marah Al Wadiya shares her story of balancing motherhood, displacement, psychological turmoil, and the relentless struggle to find safety in an unsafe region.

Marah Al Wadiya
Marah Al Wadiya Published on: 29 May, 2024
Fighting Misinformation and Disinformation to Foster Social Governance in Africa

Experts in Africa are using various digital media tools to raise awareness and combat the increasing usage of misinformation and disinformation to manipulate social governance.

Derick M
Derick Matsengarwodzi Published on: 22 May, 2024
"I Am Still Alive!": The Resilient Voices of Gaza's Journalists

The Israeli occupation has escalated from targeting journalists to intimidating and killing their families. Hisham Zaqqout, Al Jazeera's correspondent in Gaza talks about his experience covering the war and the delicate balance between family obligations and professional duty.

Hisham Zakkout Published on: 15 May, 2024
Under Fire: The Perilous Reality for Journalists in Gaza's War Zone

Journalists lack safety equipment and legal protection, highlighting the challenges faced by journalists in Gaza. While Israel denies responsibility for targeting journalists, the lack of international intervention leaves journalists in Gaza exposed to daily danger.

Linda Shalash
Linda Shalash Published on: 9 May, 2024
Elections and Misinformation – India Case Study

Realities are hidden behind memes and political satire in the battle for truth in the digital age. Explore how misinformation is influencing political decisions and impacting first-time voters, especially in India's 2024 elections, and how journalists fact-check and address fake news, revealing the true impact of misinformation and AI-generated content.

Safina
Safina Nabi Published on: 30 Apr, 2024
Amid Increasing Pressure, Journalists in India Practice More Self-Censorship

In a country where nearly 970 million people are participating in a crucial general election, the state of journalism in India is under scrutiny. Journalists face harassment, self-censorship, and attacks, especially under the current Modi-led government. Mainstream media also practices self-censorship to avoid repercussions. The future of journalism in India appears uncertain, but hope lies in the resilience of independent media outlets.

Hanan Zaffa
Hanan Zaffar, Jyoti Thakur Published on: 25 Apr, 2024
The Privilege and Burden of Conflict Reporting in Nigeria: Navigating the Emotional Toll

The internal struggle and moral dilemmas faced by a conflict reporter, as they grapple with the overwhelming nature of the tragedies they witness and the sense of helplessness in the face of such immense suffering. It ultimately underscores the vital role of conflict journalism in preserving historical memory and giving a voice to the voiceless.

Hauwa Shaffii Nuhu
Hauwa Shaffii Nuhu Published on: 17 Apr, 2024
Journalism in chains in Cameroon

Investigative journalists in Cameroon sometimes use treacherous means to navigate the numerous challenges that hamper the practice of their profession: the absence of the Freedom of Information Act, the criminalisation of press offenses, and the scare of the overly-broad anti-terrorism law.

Nalova Akua
Nalova Akua Published on: 12 Apr, 2024
The Perils of Journalism and the Rise of Citizen Media in Southeast Asia

Southeast Asia's media landscape is grim, with low rankings for internet and press freedom across the region. While citizen journalism has risen to fill the gaps, journalists - both professional and citizen - face significant risks due to government crackdowns and the collusion between tech companies and authorities to enable censorship and surveillance.

AJR Contributor Published on: 6 Apr, 2024
Silenced Voices: The Battle for Free Expression Amid India’s Farmer’s Protest

The Indian government's use of legal mechanisms to suppress dissenting voices and news reports raises questions about transparency and freedom of expression. The challenges faced by independent media in India indicate a broader narrative of controlling the narrative and stifling dissenting voices.

Suvrat Arora
Suvrat Arora Published on: 17 Mar, 2024
Targeting Truth: Assault on Female Journalists in Gaza

For female journalists in Palestine, celebrating international women's rights this year must take a backseat, as they continue facing the harsh realities of conflict. March 8th will carry little celebration for them, as they grapple with the severe risks of violence, mass displacement, and the vulnerability of abandonment amidst an ongoing humanitarian crisis. Their focus remains on bearing witness to human suffering and sharing stories of resilience from the frontlines, despite the personal dangers involved in their work.

Fatima Bashir
Fatima Bashir Published on: 14 Mar, 2024
A Woman's Journey Reporting on Pakistan's Thrilling Cholistan Desert Jeep Rally

A Woman's Voice in the Desert: Navigating the Spotlight

Anam Hussain
Anam Hussain Published on: 8 Mar, 2024
Breaking Barriers: The Rise of Citizen Journalists in India's Fight for Media Inclusion

Grassroots journalists from marginalized communities in India, including Dalits and Muslims, are challenging mainstream media narratives and bringing attention to underreported issues through digital outlets like The Mooknayak.

Hanan Zaffa
Hanan Zaffar, Jyoti Thakur Published on: 3 Mar, 2024
Why Journalists are Speaking out Against Western Media Bias in Reporting on Israel-Palestine

Over 1500 journalists from various US news organizations have signed an open letter criticizing the Western media's coverage of Israel's actions against Palestinians. They accuse newsrooms of dehumanizing rhetoric, bias, and the use of inflammatory language that reinforces stereotypes, lack of context, misinformation, biased language, and the focus on certain perspectives while diminishing others. They call for more accurate and critical coverage, the use of well-defined terms like "apartheid" and "ethnic cleansing," and the inclusion of Palestinian voices in reporting.

Belle de Jong journalist
Belle de Jong Published on: 26 Feb, 2024
Silenced Voices and Digital Resilience: The Case of Quds Network

Unrecognized journalists in conflict zones face serious risks to their safety and lack of support. The Quds Network, a Palestinian media outlet, has been targeted and censored, but they continue to report on the ground in Gaza. Recognition and support for independent journalists are crucial.

Yousef Abu Watfe يوسف أبو وطفة
Yousef Abu Watfeh Published on: 21 Feb, 2024
Artificial Intelligence's Potentials and Challenges in the African Media Landscape

How has the proliferation of Artificial Intelligence impacted newsroom operations, job security and regulation in the African media landscape? And how are journalists in Africa adapting to these changes?

Derick M
Derick Matsengarwodzi Published on: 18 Feb, 2024
Media Blackout on Imran Khan and PTI: Analysing Pakistan's Election Press Restrictions

Implications and response to media censorship and the deliberate absence of coverage for the popular former Prime Minister, Imran Khan, and his party, Pakistan Tehreek-e-Insaf (PTI), in the media during the 2024 elections in Pakistan.

Anam Hussain
Anam Hussain Published on: 14 Feb, 2024
Digital Battlegrounds: The New Broadcasting Bill and Independent Journalism in India

New legislation in India threatens the freedom of independent journalism. The draft Broadcasting Services (Regulation) Bill, 2023 grants the government extensive power to regulate and censor content, potentially suppressing news critical of government policies.

Safina
Safina Nabi Published on: 11 Feb, 2024
Pegasus Spyware: A Grave Threat to Journalists in Southeast Asia

The widespread deployment of spyware such as Pegasus in Southeast Asia, used by governments to target opposition leaders, activists, and journalists, presents significant challenges in countering digital surveillance. This is due to its clandestine operations and the political intricacies involved. The situation underscores the urgent need for international cooperation and heightened public awareness to address these human rights infringements.

AJR Contributor Published on: 5 Feb, 2024
Media Monopoly in Brazil: How Dominant Media Houses Control the Narrative and Stifle Criticism of Israel

An in-depth analysis exploring the concentration of media ownership in Brazil by large companies, and how this shapes public and political narratives, particularly by suppressing criticism of Israel.

Al Jazeera Logo
Rita Freire & Ahmad Al Zobi Published on: 1 Feb, 2024
Cameroonian Media Martyrs: The Intersection of Journalism and Activism

Experts and journalists in Cameroon disagree on the relationship between journalism and activism: some say journalism is activism; others think they are worlds apart, while another category says a “very thin” line separate both

Nalova Akua
Nalova Akua Published on: 28 Jan, 2024
Silent Suffering: The Impact of Sexual Harassment on African Newsrooms

Sexual harassment within newsrooms and the broader journalistic ecosystem is affecting the quality and integrity of journalistic work, ultimately impacting the organisation’s integrity and revenue.

Derick M
Derick Matsengarwodzi Published on: 23 Jan, 2024
Echos of Israeli Discourse in Latin American Media on Gaza

Heavily influenced by US and Israeli diplomatic efforts, Latin American media predominantly aligns with and amplifies the Israeli perspective. This divergence between political actions and media representation highlights the complex dynamics shaping Latin American coverage of the Gaza conflict.

Rita Freire Published on: 23 Nov, 2023
Why have opposition parties in India issued a boycott of 14 TV presenters?

Media workers in India argue that boycotts of individual journalists are not the answer to pro-Government reporting bias

Saurabh Sharma
Saurabh Sharma Published on: 23 Oct, 2023