6.1 System Release V1

This report summarizes the work performed so far during Task 6.1 “Integrate RED-Alert components into the RED-Alert solution” of WP6 “Solution Integration”, presenting the results of the first iteration, namely D6.1 “System release v1”. The focus of the task is to integrate the components and modules developed in WP2, WP3, WP4 and WP5 into a unified RED-Alert system, which will comprise three separate architectural layers, namely:

  • the “speed” layer, which includes data collection components for processing data streams in real time by means of data collection (social media capture, web crawling, LEA “raw” content), data filtering (pulling text data from a message queue, normalizing and extracting the required meta-data), data enrichment (multimedia content analysis), and data privacy (anonymization of text and image data);
  • the “batch” layer, which integrates the predictive models (based on complex event processing) that will be used by the pattern detection features within the analysis module. Due to the changing nature of the facts and behaviours, the set of stored models should be periodically re-trained with the new data arriving to the system. This is usually a resource-intensive task that cannot be performed in real-time and it should be scheduled as a frequent batch job;
  • and the “service” layer, which integrates the visual analytics gateway that will be in charge of presenting the aggregated data, metrics and events configured by users, who can set up the rules or conditions for triggering alerts. This will be used directly by the rules engine to determine whether the conditions exist for a particular event type. The layer will also offer a Web Service API allowing third parties or LEAs in-house developers to build external components on top of the RED-Alert integrated solution.

The vision of RED-Alert project is to provide a complete toolkit with real-time collaborative capabilities that will allow LEAs to collect, process, visualize and store online data related to terrorist groups, whether related to propaganda, fundraising, recruitment and mobilization, networking, information sharing, planning and coordination, data manipulation and misinformation. RED-Alert will also enable information exchange between various tools used by LEAs and between LEAs within a data privacy environment: the project will deliver a solution able to act as an information hub between heterogeneous tools used by various LEAs.

This report describes the work performed for producing and delivering D6.1 – “System release v1” of RED-Alert project, as well as the integration and testing plan and the overall product roadmap that will be implemented in the remaining iterations of the project towards the pilots deployments that will validate the RED-Alert system in a simulated environment, close to reality conditions, resulting in the final release of the project.