News

AI-ARC Project’s Baltic Demo taking place September 2023 in Karlskrona, Sweden: We speak to the organisers

Posted on by Simon Patterson
Photo Swedish Coast Guard

We caught up with Pontus Svenson, Senior Researcher, RISE, Daniel Larsson, Administrator, Swedish Coast Guard, Else Timms, Funding Strategist, Strategic Planning and Analysis Unit, Swedish Coast Guard who are hosting and key organisers or the AI-ARC projects’ Baltic Demonstration which takes place from the 20th -21st of September 2023 in Karlskrona, Sweden. The main focus of the demonstration will be on anomaly detection such as illegal fishing, smuggling or threats to critical underwater infrastructure.

Can you give some background to The Swedish Coastguard? What are some of your main activities?

The Swedish Coast Guard works for a sustainable environment and safety at sea. The national authority has approximately 850 employees and the fleet consists of approximately 30 large vessels, 40 smaller vessels and 3 aircrafts. Apart from emergency preparedness, as the largest civilian responder at sea the everyday work consists of a variation of tasks and also requires cooperation with many other national and international organizations and authorities.


The Coast Guard is responsible for general maritime surveillance, the combatting of pollution such as oilspill, but also the combatting of other criminal offences committed in the maritime environment connected to border control, fishing, transporting of goods. Within the area of maritime surveillance, the Coast Guard is responsible for the maritime situational picture. This is done in a surveillance system called Sjöbasis, in which an anomaly detection service is currently being improved and developed within the AI ARC project. When done the function will facilitate the planning of actions and prevent accidents, which will lead to improving the general safety at sea.

Can you give some background to RISE? What are some of your main activities?

RISE is Sweden’s research institute and innovation partner. Through our international collaboration programmes with industry, academia and the public sector, we ensure the competitiveness of the Swedish business community on an international level and contribute to a sustainable society. Our almost 3300 employees engage in and support all types of innovation processes. RISE is an independent, State-owned research institute, which offers unique expertise and over 130 testbeds and demonstration environments for future-proof technologies, products and services.

Map showing RISE’s 25 locations around Sweden



Can you describe in more detail The Swedish Coastguard ‘s role in the AI-ARC project and your involvement in the AI-ARC Baltic demonstration?

The Swedish Coast guard is an end-user of the system developed in the AI-ARC project. At a general level we are contributing with a user’s perspective but also contributing with our knowledge as a Coast Guard. We contribute to the knowledge of certain use cases and scenarios. Our main focus is on the Baltic and illegal activities like illegal fishing, smuggling, environmental violation and threats to critical infra structure under water. We have our own maritime surveillance system which we are continuously upgrading with new functionalities. Therefore we are also hoping to be able to use some of the outcomes from the AI-ARC directly in our system. There is a period of testing of the system coming up and it feels like it is the last major contribution to be done by us as a Coast Guard competence in the project.

The Baltic Demo will be hosted in Karlskrona and we are planning it together with the involved partners, especially RISE. There isn’t really much to add as an end user at this stage in the project I suppose. We are listening in and contributing when needed. As of right now we are mostly focusing on practical things on site in Karlskrona to be done.

Getting the right people with interest in this kind of development is one important part for us in the demo. This is challenging and intriguing since our view of things doesn’t necessarily mean that our close partners have the same view. But hopefully we have gathered the right ideas and info from some of our authorities we cooperate with closely!.

The goal is to increase the situational awareness of maritime surveillance operators and criminal investigators.

Pontus Svenson, RISE

Can you describe in more detail RISE’s role in the AI-ARC project and your involvement in the AI-ARC Baltic demonstration?

RISE is involved in the technical work of AI-ARC, with a focus on developing anomaly and intent detection methods. The goal is to increase the situational awareness of maritime surveillance operators and criminal investigators. In AI-ARC, we are extending previous work on AI and anomaly detection for maritime surveillance and integrating our framework for detecting criminal activities by combining multiple weak signals with the anomaly detection methods developed by other partners.

Pontus Svenson, Senior Researcher, RISE

You could easily picture yourself in a virtual world adding all kinds of functionalities like moving around on the ship sweeping the deck to remotely navigating the ship.

Daniel Larsson, Swedish Coast Guard

What do you find 1) most interesting and 2) most challenging about The Swedish Coastguards’s role in the AI-ARC project?

There is an intriguing variety of competences included in this project. Contributing to a vast palette of possibilities. Since we are standing on a high TRL we are kind of trying to find our specific angle to an almost ready system. This is both interesting and challenging.

These kind of big EU-projects need good coordination. It is a challenge trying to keep up and it is interesting to be part of such a diverse group trying to unit in a common cause. Adding complexity by different professions, EU member states and languages. That’s not an easy thing to do.

Suggesting needs and understanding what could be done with different systems, I have to admit, it is a bit tricky. From the end user perspective it is both interesting and challenging to understand all the technologies spoken of and interpreting to a usable understanding on our end.

In the end isn’t it all about minimizing one’s “mind gap”. I mean take the visualization module called the virtual control room. You could easily picture yourself in a virtual world adding all kinds of functionalities like moving around on the ship sweeping the deck to remotely navigating the ship. We are getting there, I believe, but first we are gathering around a virtual table to be able to communicate, actually talk to each other’s avatar, see and touch the same map table. State of the art I guess but still amazing!

What do you find 1) most interesting and 2) most challenging about RISE’s role in the AI-ARC project?

RISE: As always in international cooperation projects, the collaboration with other researchers is both the most interesting and the most challenging part. Interesting, because we learn from each other and discover new ways of thinking that improve both our individual research and the combined result. And challenging, because we all have different ways of working and expressing ourselves. While we are all fluent in English, it always adds a layer of complexity to explain our ideas in a non-native language.

The combination of the different AI methods developed by different AI-ARC partners will enable us to show how a system-of-systems based maritime surveillance solution can enable security and law-enforcement agencies in different countries to collaborate for mutual benefit.

Another real challenge in the project has been the difficulties in getting real data to work on, and to be able to share that data with all project partners. There is as ever a strong need to go from the “need to know” to the “need to share” mindset in the security domain.

What is your Individual research/ technical interests?

Daniel: To get a “better” situational awareness. Upgrading the decision making systems continuously. We are doing this within the Swedish Coast Guard but we also need to be aware of other possibilities being developed.

Daniel Larsson, Administrator, Swedish Coast Guard


Pontus: Personally, I am interested in exploring further how Bayesian-based methods can be used for detecting different kinds of anomalies, and how we can combine different weak signals to estimate the intentions behind the observed behaviours of vessels.

It has also been very fun to program in C++ again in AI-ARC, which I haven’t done for many years.

How do you find working together as a research team on the Baltic Demonstration?

SCG: It works well, feeding each other with our individual perspective on the objectives in the project. It is nearly the same but of course there are some differences in the understanding of how things work but it helps a lot that the people from RISE developed an AI-module in our current sea surveillance system a while back. Maybe it explains in some sense that collaborating difficulties with RISE, doesn’t really exists. Working together is just great! Hopefully we will do more work together in the future.

Else Timms, Funding Strategist, Strategic Planning and Analysis Unit, Swedish Coast Guard


RISE: The RISE and SCG teams are very tightly integrated and share the goal of developing AI-based tools that increase the situational awareness of operators and analysts. We are continuously learning from each other, both in terms of technology and how SCG personnel think and act in their jobs.

I really look forward to seeing all the AI services analysing the same large data stream and then to see the results visualized in the Virtual Control Room.

Pontus Svenson, RISE


Can you explain what aspects of the upcoming AI-ARC Baltic demonstration you are most excited about?

SCG: I’m not thinking about it really, to be honest. Guess I’m in the zone, of all the doings and maybe it is because the stage belongs to the developers as from now on. It’s about a delivery of a functionality now and that’s not our role. But it is pretty exiting to kind of host such an event. It is easy to forget. Easy to be shortsighted. Just another joint gathering but it is pretty…amazing actually!

In the end it is interesting to see the result! Is it going to deliver? I think it will be nice to hear the point of view from the invited guests, who haven’t been with us, on the ride. Nevertheless I guess I am a bit curious about upcoming reactions and of course to see everybody in real life again! Thank you for asking this question!

RISE: I really look forward to seeing all the AI services analysing the same large data stream and then to see the results visualized in the Virtual Control Room. Since we are showing five different use cases in the Baltic demo, it will be exciting to see the details of some of the use cases where I have not been involved.

Thanks to Pontus Svenson, Daniel Larsson, Administrator, and Else Timms for taking part in this interview. The AI-ARC Baltic Demonstration takes place from the 20th to the 21st of September 2023 in Karlskrona, Sweden. For information and updates on this event and more, please stay tuned here on the AI-ARC website and on social media.

Dr Kevin Willis shares University of Portsmouth’s exciting role in the AI-ARC project

Posted on by Simon Patterson
T: University of Portsmouth, B: City of Portsmouth, Credit: University of Portsmouth

In this, the second of our series of AI-ARC web posts, we catch up with Dr Kevin Willis to find out about University of Portsmouth’s exciting role in the AI-ARC project and how the service UoP are developing will be used in the AI-ARC Virtual Control Room.

Can you give some background to University of Portsmouth?

The University of Portsmouth (UoP) is a top modern higher education and research institution based on the south coast of England. UoP receives good feedback from student satisfaction surveys and ranks highly in the UK research excellence framework. While maintaining close ties to the past in this historic naval city, the university is progressive and forward thinking, with one of the universities key research themes being sustainability and the environment. The university has recently been awarded a grant worth over £3 million which will bring it a step closer to its ambition of becoming climate positive by 2030.

We are measuring potential end-user opinions on the acceptance of the new technology being developed and how these views change through the project.

Can you describe in more detail University of Portsmouth’s role in the AI-ARC project?

The UoP AI-ARC team is involved with the project through leading tasks across three work packages. We are measuring potential end-user opinions on the acceptance of the new technology being developed and how these views change through the project, evaluating the individual component services of the AI-ARC Virtual Control Room in terms of what they can add to existing systems, creating a future deployment roadmap for these services at the end project, and also responsible for designing one of the specific services in the system – the risk index computation service.

What are your Individual research/ technical interests as a team?

Members of the UoP team are split across two of the university’s faculties, the School of Mathematics, in the Faculty of Technology and the School of Operations, Systems and People, within the Faculty of Business and Law. All the team are members of the Centre for Operational Research & Logistics (CORL) offering expertise in data, algorithms, system design, modelling, programming, and decision-making. Recent research produced from the UoP team has been in diverse application areas like off-shore windfarm maintenance and drone inspection technology, Arctic and North Atlantic security and safety, allocating novel robotic devices to treatment centres, and modelling support in humanitarian crisis.

The part of the project that has been both the most interesting, is also the greatest challenge, and that is the complex nature of all the interconnected elements.

What do you find most interesting or challenging about University of Portsmouth’s role in the AI-ARC project?

The part of the project that has been both the most interesting, is also the greatest challenge, and that is the complex nature of all the interconnected elements. The designing of a service to aid decision-making in a perilous maritime context based on a set of use case scenarios to demonstrate effectiveness, the communication within the main AI-ARC system, the data requirements, the multiple services all based on advanced Artificial Intelligence ideas – and all this done with the further challenge of cross-border cooperation and collaborating with the wide range of project partners. This complexity can seem daunting but offers a real opportunity to be involved in important and interesting research.

Dr Kevin Willis, Research Fellow at the University of Portsmouth

What is your involvement in the preoperational testing?

The upcoming pre-operational testing is another big step in the project and for the services being developed. After previous demonstrations to test service integration and communication the aim is now to achieve meaningful service output and gather feedback from users participating in the tests about the system performance and the individual services. UoP are involved in a key project task of reporting on the maturity of the services and their value added to current system capabilities. We will use the feedback and system output from this testing stage as part of a future technology roadmap of what is required to have these services ready for full operational use. Of course, as one of the service developers we are also looking forward to using these tests to gather more information about the performance of our risk index.

The index will offer a multi-level output measure, which will not only indicate when risk is high, but should clearly indicate as the risk levels change with time.

Can you tell us more about the service you are developing on risk computational indexes? what are the aims of the service to contribute to the overall project?

The service we are responsible for is the risk index computation service, with risk and security being a second of UoP’s key research themes. This service is not intended to identify the specific risks, those have been outlined earlier in the project, but to assess the risk level for certain identified challenges like vessel grounding, collisions, route planning, and oil spill prevention. The service will use the available data sources, together with human-factor expert information, to act as a dynamic tool as an aid to measuring situational awareness. The index will offer a multi-level output measure, which will not only indicate when risk is high, but should clearly indicate as the risk levels change with time. These risk levels will then be visualized within the AI-ARC Virtual Control Room.

We view the risk service as a useful tool as an aid to decision making alongside all other information available to the system user.

How do you think this service can complement other services?

We view the risk service as a useful tool as an aid to decision making alongside all other information available to the system user. For example, if the risk index level changes for a specific risk type this could be registered by the user who can then look at an accompanying service to see if action needs to be taken. It is hoped that in these situations the risk index can be considered as a potential early warning system, with incident likelihood together with potential severity being key aspects of the risk evaluations. This service should help decision makers to assess risk of the various scenarios, so that actions related to prevention or mitigation can be activated.

What’s next in terms of follow on projects?

With UoP being involved in the ARCSAR project identifying safety and security needs and monitoring potential innovation solutions in the Arctic and North Atlantic region, as well as the AI-ARC project where innovation is happening it is hoped we can continue in the area of safety and security research in future projects, including the Arctic, Baltic and North Atlantic maritime regions. Like many AI-ARC partners, we are very concerned, and hence interested in researching the topic of critical underwater infrastructure. As a university, we have entered into a twinning agreement with a Ukrainian University, and our team is hence in the initial stages of joint safety and security research in a couple of fields, but for now we remain concentrated on preparing for a successful pre-operational testing in the AI-ARC project.

AI-ARC Live Demonstrations dates 2023

Posted on by Simon Patterson

We are excited to share the dates and locations for the upcoming AI-ARC live demonstrations in the Autumn.

Baltic Demonstration 20-21.9.2023, Karlskrona, Sweden
The focus will be on anomaly detection such as illegal fishing, smuggling or threats to critical underwater infrastructure.

Arctic Demonstration 16-20.10.2023, Reykjavik, Iceland
In the Arctic Demonstration the focus will be on major Search and Rescue incidents as well as safe navigation including ice and weather information.

AI-ARC Event hosted by Fraunhofer IOSB in December

Posted on by Simon Patterson

Ahead of the upcoming AI-ARC consortium Meeting and Lab tests in Karlsruhe from the 13th to 15th of December, we caught up with Mathias Anneken and Adrian Hoppe from Fraunhofer IOSB.

Fraunhofer IOSB, © indigo

Can you give some background to Fraunhofer IOSB?

The Fraunhofer-Gesellschaft based in Germany is the world’s leading applied research organization. Prioritizing key future-relevant technologies and commercializing its findings in business and industry, plays a major role in the innovation process. A trailblazer and trendsetter in innovative developments and research excellence, it is helping shape our society and our future. Founded in 1949, the Fraunhofer-Gesellschaft currently operates 76 institutes and research units throughout Germany. Over 30,000 employees, predominantly scientists, and engineers work with an annual research budget of €2.9 billion. Fraunhofer generates €2.5 billion of this from contract research.

Fraunhofer IOSB as one of the 76 institutes, has 7 research sites in Germany and a liaison office in Beijing. With an operating budget of €70 million and about 810 employees (including about 250 students), we focus on the three core competencies that are reflected in our name. Optronics, system technologies, and image exploitation.

Optronics is concerned with the generation of light, its beam shaping, propagation, and transformation into electronic signals – i.e. in particular with technical processes to generate images (in the broadest sense) of the world around us. System technologies ensure a holistic approach: We not only develop components and algorithms but also complex hardware and software architectures. The resulting information technology systems support people on the basis of sensor data, automate certain tasks, and/or open up new paths in human-machine interaction. We set the highest standards in terms of interoperability, IT security, and data protection/privacy. Image exploitation investigates methods and algorithms to obtain information and ultimately relevant insights from the images.

As WP3 leaders can you describe in more detail Fraunhofer’s role in the AI-ARC project?

As the leader of WP3 “Technical Development”, Fraunhofer is responsible for monitoring the general implementation of the AI-ARC solution, which includes the Virtual Control Room (VCR) as well as the different services provided by the partners. Additionally, we facilitate the contact between WP2 and WP4 stakeholders to support the development of the use cases and the demonstrations. Furthermore, different components of the AI-ARC solution will be developed and integrated by the involved Fraunhofer Institutes: Fraunhofer IOSB will provide the Digital Map Table (DigLT) software as the foundation of the VCR and a probabilistic expert-knowledge-based anomaly detection system, while Fraunhofer EMI will provide a service to estimate the reliability of AI-based services.

What are your Individual research/ technical interests?

Mathias:

Coming from a background in control engineering at the Karlsruhe Institute of Technology (KIT), I always had a passion for automation. During my time working at Fraunhofer IOSB and as a PhD student at the KIT, I focused my research on situation recognition and anomaly detection mainly in the maritime domain. I was able to gain experience in multinational projects by successfully supporting projects like MARISA and OCEAN2020. Since July 2022, I’m leading the research group “Applied Explainable Artificial Intelligence” at Fraunhofer IOSB. In my group, we develop transparent AI systems which will put an end-user into the position to not only get some results out of a black-box system but rather have an explanation for the system’s results, thus enabling the usage of AI system’s critical domains. In AI-ARC, I’m more than happy to work with a motivated international team on solving our challenges ahead!

Adrian:

Already in my studies at the Karlsruhe Institute of Technology (KIT), I developed a strong interest in the topics of human-computer interaction and computer graphics. I combined the two topics in my master thesis at the Fraunhofer IOSB, by evaluating how common PC interactions could be implemented in virtual reality (VR). After that, I stayed with Fraunhofer IOSB to dive deeper into the topics of visualization, interaction, and collaboration in VR and started a dissertation on that topic. Besides research and other topics in our department of Interactive Analysis and Diagnosis, we develop the DigLT, a web- and VR-based situational display, where questions or requirements from end-users would drive forward my research interests. Thereby gained insights and new and interesting functionality that would then flow back into the DigLT software and complete the circle before starting a new iteration. Even after completing my dissertation, the possibilities of VR still amaze me and I am looking forward to uncovering more hidden potential to increase the usability and performance of current and future software systems.

What do you find most interesting or challenging about Fraunhofer’s role in the AI-ARC project?

For Fraunhofer, the biggest challenge is leading the developments which are performed by a multitude of partners to work on the same goal of making the VCR a reality. Thus getting all partners on the same page about the challenges in the maritime domain as well as the underlying used technologies is crucial for AI-ARC success. For our developments, for sure the implementation of our technologies into the VCR and the tailoring of these technologies to the end user’s needs is the most interesting part.

© Fraunhofer IOSB

Can you tell me about the upcoming lab tests? What will they consist of, and what are the aims?

The lab-based demonstration, as the first testing phase of the AI-ARC project, will take place in M16 (13-15th December 2022) at the Fraunhofer IOSB lab in Germany. An AI-ARC consortium meeting will also occur during this time. One month before the lab test, there will be an online pre-test to assure a smooth demonstration. The lab demonstration will serve to test the technical readiness of the VCR platform and will coincide with the completion of MS 11 (Data and system integration 1 – System is functional without AI).  In addition, to prepare for the integration of AI services in the near future, all partners will demonstrate that they are capable of exchanging data with each other. This requires defining the message topics and formats to be used, establishing a connection to our data exchange node, and most importantly sending and receiving data. As some systems are not finalized yet, the integration test does not target testing the systems themselves but rather checking the validity and robustness of the communication interfaces.

Fraunhofer will be hosting the next consortium meeting – What are you looking forward to about this? 

We are looking forward to welcoming the whole consortium in Karlsruhe at the Fraunhofer IOSB and thus being able to see each other in person again. During this meeting, there will be a consortium meeting as well as integration sessions and possibilities to exchange information about the developments of the individual partners.  Hopefully, the weather and the general situation will allow us to continue our discussions in the cosy atmosphere of a visit to the Christmas market in the city centre.

Christmas Market – Photo by cmophoto.net on Unsplash

AI-ARC Joins The EU Polar Cluster

Posted on by Simon Patterson

AI-ARC Joins The EU Polar Cluster

We are delighted to share that the AI-ARC project is now a member of the EU Polar Cluster.

The EU Polar Cluster is a network of Horizon 2020 and Framework Programme 7-funded polar projects. Its vision is to create a strong, well-connected ecosystem of European Polar projects and organisations operating together to substantially increase their combined impact and legacy.

To find out more please see: www.polarcluster.eu