Defence Innovation Monitoring Guide
Defence Innovation Monitoring Guide
1 Table of Contents
1 Table of Contents ............................................................................................................................ 2
2 What is Defence Innovation Monitoring (DIM) .............................................................................. 4
3 DIM's Database ............................................................................................................................... 6
3.1 Scientific publications ............................................................................................................. 7
3.2 Patents .................................................................................................................................... 8
3.3 Granted EU projects ................................................................................................................ 8
4 Description of DIM Main page and menus ..................................................................................... 9
4.1 Main Panel .............................................................................................................................. 9
4.1.1 Network graphs............................................................................................................... 9
4.1.2 Colour of the nodes....................................................................................................... 10
4.1.3 Labels ............................................................................................................................ 10
4.1.4 Moving and exploring the network visualisation.......................................................... 11
4.2 Tools panel ............................................................................................................................ 11
4.2.1 Search............................................................................................................................ 11
4.2.2 Info on/off ..................................................................................................................... 11
4.2.3 Vis .................................................................................................................................. 12
4.2.4 Order: Normal / Order by size / Order by year ............................................................. 12
4.2.5 Colours: Modularity ...................................................................................................... 12
4.2.6 Hover On/Off................................................................................................................. 12
4.2.7 Hide On/Off ................................................................................................................... 13
4.2.8 Edges On/Off ................................................................................................................. 13
4.2.9 Labels None/ Main / All ................................................................................................ 13
4.3 Filter panel ............................................................................................................................ 13
4.3.1 Year filter....................................................................................................................... 14
4.4 Year selector ......................................................................................................................... 14
4.5 Navigation Panel ................................................................................................................... 14
4.6 Page Selector......................................................................................................................... 14
4.7 Options .................................................................................................................................. 16
4.7.1 Refresh .......................................................................................................................... 16
4.7.2 Page info ....................................................................................................................... 17
5 DIM Pages ..................................................................................................................................... 18
5.1 Landing Page – Analysis on all datasets ................................................................................ 18
2|Page
DIM – User Manual
3|Page
DIM – User Manual
4|Page
DIM – User Manual
To explore the scientific and technical landscapes, choose one field within EDA Reseach and
Technology Taxonomy or on of CapTech Research areas
For example in Captech Navigation page, choose GNC TBB01 Navigation in GNSS denied
Environment.
The user will be taken to the DIM page populated with technologies relevant for this specific
TBB. In this case, technologies related to Navigation in GNSS denied Environment.
The landscapes for each technology in each technology field are built using information from
documents contained in DIM's database. Additionally, news from major media sites are
gathered for each subfield. See section "News" in the present guide.
5|Page
DIM – User Manual
3 DIM's Database
DIM's database contains documents that are the underlying data for the visualisations in DIM.
DIM's database contains mainly three types of documents: scientific publications (articles,
conference proceedings, reviews and book chapters), patents and EU granted projects.
More than 60 million documents are currently indexed in DIM Technology's database.
The coverage per year is not homogeneous for each type of data. The coverage in DIM
depends on what is available at the time of indexing the data from the providers.
For example, this is the distribution of documents resulting from the last indexing of the data
in August 2018.
6|Page
DIM – User Manual
Articles include Original research or opinion and Article-in-Press. Original research or opinion
consist of articles in peer-reviewed journals and are usually several pages in length, most
often subdivided into sections: abstract, introduction, methodology & methods, results,
conclusions, discussion and references. However, case reports, technical and research notes
and short communications are also considered to be articles and may be as short as one page
in length. Articles in trade journals are typically shorter than in peer-reviewed journals and
may also be as brief as one page in length. Article-in-Press (AiP) are accepted articles that are
made available online before official publication.
b) Conference proceedings
Article reporting data presented at a conference or symposium. Conference papers may range
in length and content from full papers and published conference summaries to short items
like conference abstract which can be as short as few lines.
c) Reviews
This category includes both reviews and short surveys. Reviews are usually state-of-play of a
given branch or field of science & technology and typically have an extensive bibliography.
7|Page
DIM – User Manual
Educational items that review specific issues within the literature are also considered to be
reviews. As non-original articles, reviews lack the most typical sections of original articles such
as materials & methods and results.
Short surveys, also called Short or mini-review are similar to reviews, but usually are shorter
(not more than a few pages) and with a less extensive bibliography.
d) Book chapters
Complete chapter in a book or book series volume where the item is identified as a chapter
by a heading or section indicator.
The list of sources (journals) from where these types of publications are coming from can be
consulted here.
For more information you can also consult the Scopus Coverage Guide.
3.2 Patents
The patent documents are extracted from the database PATSTAT from the European Patent
Office (EPO). It contains patents from more than 90 patent authorities including all the major
countries. We consider all patent documents in Patstat with priority date from 1996 onwards.
The patent documents are then grouped per patent family when at least one of the members
of the family is in English. The underlying assumption is that one patent family equals one
invention. The EPO database is released two times a year.
This dataset contains projects funded by the European Union under the fifth framework
programme for research and technological development (FP5) from 1998 to 2002, FP6 from
2002 to 2006, FP7 from 2007 to 2013 and the Horizon 2020 framework programme for
research and innovation (H2020) from 2014 to date. Grant information is provided for each
project, including reference, title, starting date, programmes, participant countries, subjects
and objectives. This data is extracted from the Cordis dataset, accessible on the European
Union Open Data Portal.
8|Page
DIM – User Manual
4 Description of DIM
Main page and menus
1. Main Panel
2. Tools panel
3. Filter panel
4. Year selector
5. Navigation Panel
6. Page Selector
7. Options
DIM massively uses network visualisations to display data. These network visualisations
contain nodes and edges. This principle applies to most of the graphs in DIM.
The attribute of nodes will change according to the visualisation that is selected. For example,
when visualising the data item "cities", each node will be a city.
9|Page
DIM – User Manual
The size of the nodes corresponds to the respective weight (the number of documents) of the
data items in the dataset.
The edges correspond to documents in common between two nodes. The thickness of the
edge varies with the number of documents actually in common.
In the main panel, when no specific dataset is selected, the graph represents all the datasets
listed in the navigation panel. The visualisation principle of DIM applies here: the size of the
node represents the number of documents retrieved for that dataset while the edges
represent documents in common between two datasets.
Nodes are assigned to communities and the colour of the nodes and edges represents the
community to which the nodes belong: nodes of the same colour belong to the same
community. The quality and relevance of the communities (which is actually a type of
clustering), is measured by their modularity. You can consult the scientific article on the
algorithm used in DIM or also look at the Wikipedia page relating to this so called Louvain
Modularity algorithm. This algorithm is a commonly accepted clustering method of nodes in
network graphs and only relies on characteristics of the network, without taking into account
any semantic measures of similarity. It can be applied to any network and it does not have to
be applied necessarily to documents. This feature comes from the library used to display the
network graphs, which is based on Gephi, a well-respected visualisation software.
4.1.3 Labels
The labels indicate what the item refers to. By default, not all the labels are visible to optimise
the visualisation of the data. Some options are available to modify the display of labels.
10 | P a g e
DIM – User Manual
To facilitate the exploration of the network graphs, the mouse can be used to:
- zoom in by using the mouse wheel. When positioned anywhere on the main panel, turn the
wheel up to zoom in and down to zoom out.
- move the graph by moving the mouse while keeping the left mouse button pressed.
- see the label of a node by hovering the nodes with the mouse.
- move a node by left-clicking on the node and move the mouse while keeping the button
pressed. This functionality is particularly useful to allow for clear reading or for differentiation
of nodes.
- filter by double-clicking on a node to add it to the active filter. Double click again to remove
from the filter.
- filter for all the nodes of same community (represented with one same colour) by activating
first the hover button (in tool panel) and then double-clicking on any of the nodes of the
community. All the nodes of the community will be added to the filter.
Note that several filters can be applied at the same time by double-clicking on all the items
you wish to include in the filter, even from different network graphs. For more information
on filters see also the section on filter panel.
- see the node/edge size by right-clicking on a node/edge. Also, some filtering options appear
when right-clicking.
Some other types of visualisation are displayed on the main panel depending on what is
chosen in the page selector. Among others there are analytical visualisations, text display and
geographical maps visualisations. Each of these will be discussed with its correspondent item
in the graph selector.
4.2.1 Search
Search allows searching for a node in the graph. After three or more characters are typed, it
suggests the labels of the nodes that coincide with the search. Click on the relevant label and
the visualisation will automatically zoom in to the relevant node. If no items are listed after
typing at least three characters, the search wasn't able to retrieve any results.
11 | P a g e
DIM – User Manual
When the info is ON a panel appears on the left side of the main panel with the list in
alphabetical order of all the nodes of the currently displayed graph. The list is clickable and
the view will zoom to the selected node.
4.2.3 Vis
This button adjusts the visual complexity of the graph by hiding nodes or edges according to
their specific size. Both edge and node size selectors will show in brackets the minimum and
maximum sizes of edges or nodes that are currently displayed. These values can be modified
by dragging the selector bars. It is possible to adjust both the minimum and the maximum
size of edges and nodes. The same can be done to adjust the size of the edges displayed.
Example of Node size selection: Visualisation of the same graph with all the nodes (left) or with the nodes that represent
more than 13 data items (right).
This drop-down menu allows to choose between a default (normal) visualisation of the graph
or to order the nodes by size or by year.
When ordered by size the top left node is the biggest node and the down right one is the
smallest.
When ordered by year, the node that appeared most recently is at the left top part and the
one that appeared first on the down right.
The meaning of colours and edges remains unchanged.
This drop-down menu allows choosing the meaning of the colouring of the nodes.
Modularity is the option by default and displays the communities of nodes.
12 | P a g e
DIM – User Manual
When hover is on, mouseover on a node makes visible only that node and the other nodes
and edges of the same community (all nodes of the same colour).
Position by default is off. When a filter is active and hide is off, the non-selected items
(outfiltered) appear shaded in a very light colour.
When Hide is on, the non-selected items are hidden and therefore do not appear in the
visualisation.
The position by default is on and the edges are visible. When turned off, the edges disappear
from the graph.
The position by default is main. Only some of the labels of the biggest nodes are visible.
By clicking on the switch, all the labels appear or none of the labels is visible.
To activate a filter, simply double click on the node you want to filter for.
A filter allows you to work with only a subset of the dataset. Once applied, the filter will hide
all the data items that do not meet the criteria of the filter. The filters can be defined with
one or multiple criteria. The lower part of the panel indicates the items that are part of the
filter.
The example above shows an active filter for documents from [United States + University of
Minnesota + Electrical and Electronic engineering].
The filter panel allows the user to manage the (multiple) filter(s) that are applied to the
visualisation of the dataset. Every criteria of a filter can be de-activated by pressing the red x
button. To clear all filters, press "Clear filter" on the top right of the panel.
The filters work cross-graphs, meaning that a filter that is activated in one of the graphs stays
active when changing graph. For example, if we filter for a subject, such as Software and then
we move to a graph that shows geographic information, we will see only the location(s) of the
documents related to the subject Software.
The panel can be moved (drag by left-click and keep left button pressed).
13 | P a g e
DIM – User Manual
The year filter is used in conjunction with the year selector. Its use is discussed in the
paragraph about the year selector.
14 | P a g e
DIM – User Manual
- Location: Network graph visualisations relating to the location of the entities detected in the
documents. Different levels of granularity are available, from countries to regions and cities.
There is also a geographic projection on a map.
- Topic: Visualisations that relate to the topic of the documents in the dataset.
- News: Direct access to the latest news on the specific technology subfield and news trends.
- Quantitative analysis: Trends and indicators calculated on the dataset. Filters apply to the
data.
15 | P a g e
DIM – User Manual
euproject: EU project
Data source Graph Original database from where the
documents come from (Scopus or
Patstat).
Documents list Text List of documents in (filtered) dataset
More information on each type of page will be provided in the following sections.
4.7 Options
The options available can vary depending of the type of user.
4.7.1 Refresh
16 | P a g e
DIM – User Manual
17 | P a g e
DIM – User Manual
5 DIM Pages
5.1 Landing Page – Analysis on all datasets
When no dataset is selected, the landing page is displayed. The default page presents data
that is relative to all the datasets.
To go back to the default page once a dataset has been selected, simply click on the DIM logo
to deselect any active dataset.
5.1.1 Datasetgram
The datasetgram is a network graph with all the datasets that have been created.
In this visualisation, each node is a technology (or dataset). The size of the nodes corresponds
to the number of documents retrieved for each dataset. The edges between the nodes are
documents in common in between the two datasets. The thicker the edge, more documents
are in common. The colours show the communities of nodes, i.e. datasets that tend to have
more data in common among each other that we the nodes of a different colour .
18 | P a g e
DIM – User Manual
News trends shows the numerical trends in number of news articles. The plot represents the
dates in the X axis and the number of news articles in the Y. Not all the datasets/spaces in
DIM have associated news. This will be progressively populated.
For all the other pages to be displayed, choose first a dataset from the Navigation Panel on
the left.
19 | P a g e
DIM – User Manual
Organisations are the institutions or companies that are affiliations of the authors of scientific
publications, applicants of patents or beneficiaries of EU Framework programme grants.
The graphs in this category are also called sociograms, i.e. graphs that represent the "social
network" of the organisations. In a sociogram each node represents an organisation. The links
between organisations represent a collaboration between two organisations. They
correspond to documents where the two organisations appear. Therefore the links represent
co-publishing, co-patenting or co-granting of EU projects.
20 | P a g e
DIM – User Manual
The thicker the node, the more intense the collaboration (in terms of common number of
documents) is.
For groups of organisations of the same colour, the graph suggests that those tend to
collaborate more among themselves than with the others. (Read more about communities of
nodes in the specific section).
This type of graphs allows studying the collaboration patterns between organisations that are
active in publishing, patenting or beneficiaries of EU projects.
Because the names of the organisations come from different sources, a process of cleaning
and harmonization is necessary. The tool used for processing and cleaning of organisation
names is in continuous development and is not a 100% accurate: not all organisations are
recognised and some errors may be done when attributing a unique identifier to variants of
an organisation.
In DIM, the process of harmonising names of organisations is called Entity Matching. The
Entity Matcher groups all the organisations and their different spellings with a predefined list
of organisations. One of the main limitations of this approach is that if an organisation is not
recognised then the node is not shown in the graph.
21 | P a g e
DIM – User Manual
The correct attribution of the location of an organisation depends in the first place in a correct
identification of the organisation and therefore depends on the process of cleaning and
harmonization of the organisations.
In this type of graphs, each node represents a location (city, region, country...). The links
between locations represent collaboration between two organisations in the different
locations. They correspond to documents where the two locations appear. Therefore, the
links represent co-publishing, co-patenting or co-granting of EU projects between different
geographical locations. The thicker the node, the more intense the collaboration (in terms of
common number of documents) is. For groups of locations of the same colour, the graph
suggests that those tend to collaborate more among themselves than with the others (read
more about communities of nodes here)
5.4.1 Countries
5.4.2
EU/World
The worldgrams are countrygrams where all the EU countries are gathered in one node.
This visualisation is based on the country of the organisations that have been processed by
the Entity Matcher.
5.4.3 EU countries
The Europegram is a normal countrygram that shows only EU countries. The rest of the
countries are not shown. This visualisation is based on the country of the organisations that
have been processed by the Entity Matcher.
5.4.4 Regions
The NUTSgrams represent the regions of Europe of the organisations that are publishing,
patenting or receiving EU projects. The NUTS classification (Nomenclature of territorial units
for statistics) is a hierarchical system for dividing up the economic territory of the EU.
5.4.4.1 Nuts2
In a NUTS2grams nodes are NUTS2 level regions. This visualisation is based on the NUTS2
region of the organisations that have been processed by the Entity Matcher.
23 | P a g e
DIM – User Manual
5.4.4.2 Nuts3
In a NUTS3grams nodes are NUTS3 level regions. This visualisation is based on the NUTS3
region of the organisations that have been processed by the Entity Matcher.
5.4.5 Cities
Citygrams show the cities where organisations are located. This visualisation is based on the
city of the organisations that have been processed by the Entity Matcher.
5.4.6 Map
This visualisation is the projection on a geographical map of the city of the organisations that
have been processed by the Entity Matcher. When zoomed out, the colours of the bubbles
indicate the intensity of the number of documents per regions. When hovering on the bubble,
the region taken into account for the calculation is shown. The map can be zoomed in and
out. No filtering or further analysis is however possible.
The "topics" refer to attributes in relation to the content of the documents. Each graph gives
the user a different perspective on the topics of the documents that are analysed.
This network graph is built with the Journal Category attributed to each articles contained in
the subdataset. The journal category is a classification of field of science that is attributed by
Elsevier to each scientific journal that is part of the database. See the subjects here.
The graph will only take into account the documents that have a subject category in Scopus
(articles, reviews, conference proceedings and some book chapters).
In a journal category gram each node represents a subject category (for example: Computer
Science or Engineering).
The link between two subject categories represents the fact that at least one document is
being attributed to those two subjects.
The thicker the node, the higher the number of documents that have those two subjects is.
For groups of categories of the same colour, the graph suggests that those tend to appear
more often together in the same publications than with others.
The journal category gram will only represent the documents that have been classified in a
certain Subject Category by Scopus. All other types of documents are not taken into account
for this visualisation.
25 | P a g e
DIM – User Manual
The patent classification graph is a visualisation of the CPC class attributed to the documents.
Patent publications are each assigned at least one classification term indicating the subject to
which the invention relates. For the nomenclature of patent classes see the European Patent
Office page.
In a classificationgram each node represents a CPC class (for example: C12N 15/10 or F16K
47/18).
The link between two CPC classes represents that at least one patent has been classified in
those two classes.
The thicker the node, the higher the number of patents that belong to that couple of classes.
This visualisation is based on the CPC class of the patents. All other types of documents are
excluded from the visualisation.
5.5.3 Keywords
The keywordgrams are a visualisation of the keywords attributed to the documents. The
keywords can come directly from the documents or be calculated by DIM using some text
processing algorithms.
26 | P a g e
DIM – User Manual
In a keyword graph each node represents a keyword (for example: Cyber Security or
Transplantation).
The link between two keywords represents that at least one document has a least those two
keywords.
The thicker the node, the higher the number of documents that have those two keywords is.
In this visualisation, the keywords are computed by DIM for each type of document.
Autokeywords or Automatic keywords are computed by text mining techniques. This
visualisation includes all types of documents in the system, including those that do not have
author keywords.
27 | P a g e
DIM – User Manual
The News pages displays information related to general news about the field. The news have been
aggregated using Europe Media Monitor, news aggregation and analysis system developed by The
European Commission’s Joint Research Centre (JRC)
5.6.1 News
This page gives direct access to the latest news related to the subfield of interest. Links are
provided to the original news article on the website of the publisher.
28 | P a g e
DIM – User Manual
The plot shows the evolution in time of the news articles aggregated by the EMM System for
the specific category.
The Miscellaneous page contains graphs with a few additional fields that are present in the
data. Most of the visualisations are not very useful from an analysis point of view but are to
be used for filtering.
5.7.1 Year
This network graph represents the years of the documents. The date taken into account is the
year of publication for scientific publications, the year of the priority date for patents and the
year of beginning of the project for EU projects.
The size of the nodes represents the number of documents for each year. There are no edges
between the nodes because one document cannot have two distinct publication years.
29 | P a g e
DIM – User Manual
This network graph represents the types of documents. As already presented previously those
represent article: Research article, conf: Conference proceedings, boch: Book chapters,
review: Review, patent: Patent, euproject: EU project.
The size of the nodes represents the number of documents for each type. There are no edges
between the nodes because one document cannot be of two different types.
This network graph represents the sources of documents. As already discussed previously,
there are only three types of sources for document, Scopus for scientific publications, Patstat
for patents and Cordis for EU projects.
The size of the nodes represents the number of documents for each source. There are no
edges between the nodes because one document cannot be originated from two different
sources.
30 | P a g e
DIM – User Manual
The documents list retrieves some basic information about the documents in the dataset.
Access to the abstract or description is also provided. For scientific publications, a link to the
original location of the article is provided. If your institution has the proper subscription,
access to the full article might be possible. For patents, a link to the patent in Espacenet is
provided.
31 | P a g e