Annotations
MMGA brings journalists and the community together through annotations
Journalists have to deal with a vast amount of information on a wide range of topics. Small mistakes are normal, human. There is no such thing as fully objective, flawless journalism.
We are on a mission to help journalists on their quest of informing the public. MMGA is on the lookout for a diversity of people in all communities who want to help improve the quality of media to avoid misinformation.
Annotations are a great way to be helpful to journalists.
What is an annotation?
Formal definition
A short explanation or opinion on a text or figure
Traditionally, scientific work and academic papers are the major target and consumer of this layer of feedback. In this setting it works because its purpose is to be “actionable” and constructive, instead of loose opinions and comments which are predominant on social platforms
MMGA definition
Clear suggestion directly attributed to a sentence or paragraph. Must be actionable, i.e., must avoid debate and, if correct, directly trigger a correction
We aim for a meaningful community contribution to the editorial process.We believe we can stimulate professionalism and a constructive environment among members of our system
How to annotate?
1 An annotation starts by highlighting a statement or paragraph.
2 The annotator then selects a label that describes the nature of the suggestion. This makes it more objective and clear for the author to take action
The annotation is then visible to the community and the editorial team. Other members can quickly react.
3 Annotators can interact with the suggestion by adding sources or arguments.
They can support it or refute it by presenting supporting or counter sources and/or arguments
4 The article’s author and/or editor can then respond to the annotation He/she too uses editorial labels to be more clear and signal his response
The author can choose to accept or reject an annotation. In case the annotation is accepted, the author changes the corresponding part of the article
The use of labels
Annotation labels make the interaction between the community and journalists more efficient and clear. It also guides the annotators so they can be more objective and make meaningful contributions.
How to define labels that summarize the feedback and give input for meaningful improvements? This is our ongoing quest.
You’ll find the labels currently used in the editorial process here.
For the community
Good Unverifiable Unreliable Link False balance Insufficient Sloppy
Good
Unverifiable
Unreliable
Link
False balance
Insufficient
Sloppy
Considerably correct information and sources
Source is missing and / or origin is unclear:
Source is unreliable
Link to source missing
More balance with sources needed
Information is lacking or unclear
Sloppy wording and / or typing and / or language errors
For the journalist
annotation followed up improvement within 2 hours improvement now impossible
annotation rejected
How to become an annotator
We are actively looking for diverse domain experts and general critical, experienced readers / writers who find it fascinating to critically assess journalism news articles with comments (‘annotations’) on resource use and information provision
Are you naturally experienced with critical reading and observing, critical, precise and open to discussion?
Do you have special domain knowledge / expertise?
Then join the movement!
Training and guidance
All joining annotators go through training for logical reasoning and for the usage of labels. Our Chief Annotator provides everything necessary to get started.
Applicant annotators also go through the Annotator’s test, which is a series of annotating exercises together with a sample of the community to assess the quality and appropriateness of their suggestions.
Contact Us
Stichting Bèma
Phone: 0204277703
Email: contact@mmga.io