Recon AI

White Paper - AM-X.

WHITE PAPER - AM-X

Recon AI Logo

DESCRIPTION

This document consist description of AM-X platform implementation and benefits.

PURPOSE

Purpose of the contract is to give clear understanding of the AM-X platform implementation and benefits.

General

Foreword

AM-X is an EDGE-AI solution that has been developed for efficient data annotation, AI training and system deployment. AM-X is a hardware independent, modular part of client’s data ecosystem and enables building 4D Digital Twin of real world operational environment.

In this paper, we provide example use cases and describe benefits of AM-X. In addition, information on implementation process and cost of implementation of AM-X is described in this document.


Definitions

“Recon AI” - Recon AI Oy, Business ID 2827294-8 ;

“AM-X” - Recon AI platform that provides position information of components (object of interest) from sensor data. AM-X platform is adapted for needs of different industries.

“Relevant information” - Information that the client specifies to be relevant for their application

“Object of interest” - Object that sensors are receiving information from and client specifies as object of interest.

“Measurement accuracy” - Accuracy with which the device is measuring dimensions, position or distances of objects of interest

“Measurement interval”  - Interval between which objects are measured.

“Position database”  - Database where objects position information is saved to.

“Output information” - Information that AM-X provides for the client. Usually object of interest related to a structural drawing, point-cloud information of position and orientation of the component and information on environmental conditions.

AM-X Summary

AM-X is an EDGE-AI/IOT solution and is processing data in real-time and on-site. Real-time processing makes it possible to analyse huge amount of data from sensors and provide only relevant information for client’s operations to system via mobile networks. AM-X is hardware independent and can be cost-efficiently adjusted to any new hardware, which makes the platform agile and adaptable for current rapid development of sensor technology.

AM-X recognizes objects of interest from sensor data and output information of objects of interest related to a structural drawing, object’s location and orientation, environmental condition, etc can provide several different benefits. Examples of these kind of benefits are anonymity, obstacle detection, 4D modelling- and designing operations, asset management, predictive maintenance and improvement of logistics operations. All this information can be used for automation via robotics.

FEATURES

Real time operations

REAL-TIME

An optimised neural network makes it possible for AM-X to analyse large data sets in real-time. Real-time analysis makes it possible to run AM-X without large data storages.

On-site operations

ON-SITE

After training the neural network on cloud, the optimised neural network makes it possible for analyse data on-site with low calculation power requirements. These features makes EDGE processing possible and solves problems caused by mobile network bandwidth restrictions.

Hardware independent

HARDWARE INDEPENDENT

AM-X is hardware independent solution that can be trained for any existing and new hardware in client’s ecosystems. Using data from existing and new sensors, benefits of sensor fusion can be maximised.

Edge Anonymity

EDGE ANONYMITY

True to the AM-X ability of processing data on EDGE. AM-X can anonymize data already on-site. On-site anonymization decreases cyber security requirements for the rest of the information ecosystem.

Low power consumption

ECOLOGY

Due to optimised calculation requirement of neural network, AM-X decreases energy consumption of processing and utilises unused processors in EDGE/IOT devices. Decreased power consumption and utilisation of processors in IOT-devices smaller ecological footprint can be achieved.

Cost effective

COST-EFFECTIVE ADJUSTMENT

Recon AI is continuously working on optimising the training pipe-line of new components to new sensor data. Optimised training pipe-line makes it possible for our clients to apply AM-X on scale that benefits their ecosystem in full.

ADDED VALUE

Obstacle detection

OBSTACLE DETECTION

Transportation and automotive industry is making huge efforts for making their machinery safer and autonomous - AM-X can track the motion of vehicles and estimate routes in real-time, which makes it possible for using the data for obstacle detection purposes.

4D Modelling

4D DIGITAL TWIN

Building 4D (real-time) digital twin of city is one of the key elements for making cities true smart cities. AM-X can provide real-time location information of different components of interests. By applying sensor fusion the platform provides 4D information for building information modelling.

Asset management

AUTOMATED ASSET MANAGEMENT

By relating real-time location information of components of interest to structural drawings such as CAD, AM-X can provide up-to date information of your assets in buildings and infrastructure. This information can be used as baseline for designing operations and making 5D BIM modelling reality.

predictive maintenance

PREDICTIVE MAINTENANCE

Predictive maintenance makes it possible for our clients to allocate their resources during maintenance operations. By training AM-X to recognise faulty component and applying measurement abilities of the platform, operators can move from pre-emptive maintenance models to predictive maintenance models.

Operational logistics

OPERATIONAL LOGISTICS

During all operations inefficient logistics is one of the major cost-drivers. By applying route tracking abilities of AM-X platform, all on-site logistic operations can be surveilled and optimised.

Operational logistics

AUTOMATION & ROBOTICS

Automated solutions often requires applying huge datasets. Analysing these datasets with traditional methods requires huge calculation power. AM-X real-time, on-site processing makes it possible for training AM-X for guiding robotic systems and machines autonomously on-site with low requirements for processors in use.

AM-X Implementation description

Phase 1 - 3D Digital Twin. The client provides a high fidelity measurement of the environment. Based on this, Recon AI will build a framework for the synthetic data and implement a measurement simulation algorithm.

Phase 2 - Detection of immovable objects. Recon AI trains and implements an object detection and localization system for the immovable objects.

Phase 3 - Tracking algorithm. Based on the reference of the aforementioned immovable objects and 3D environment, Recon AI develops and implements a tracking algorithm for the measurement vehicle.

Phase 4 - Detection of movable objects. Recon AI trains and implements an object detection and localization system for the movable objects, and implements it to the clients edge device.

Phase 5 - 4D Digital Twin. Recon AI finalizes the implementation of the 4D digital twin, that is continuously updated with respect to the movable objects.

We estimate the first implementation circle to take 8-14 months. Training new object of interest to AM-X platform is estimated to take three weeks on average.

Implementation schematics

.

Railway example: AM-RAIL

Obstacle detection / location awareness

For railway and metro rolling-stock operators and locomotive manufacturers AM-X provides possibility of improving safety on their operations. AM-X can specify open-space on the tracks and recognize obstacles from the route, and the information can be used as assisting system for machinery operator or collision avoidance.

4D modelling / designing operations

For designers information provided by AM-X platform can be used to gain right basic information on any designing operations. Same information can be used for 4D modelling of the environment and provides possibility for usage of AR-systems on field operations.

Asset management / ownership control

For network owners AM-X platform provides machine vision based monitoring, real-time asset management. In addition AM-X improves quality control by providing relevant information of objects of interests in railway and metro structures. Automated measurements during maintenance and installation operations provides network owners transparent quality measurement information and networks owners can further automate their surveillance operations and improve quality control operations.

Predictive maintenance / automated measurements

For construction and maintenance operators system provides possibility of recognizing and flagging the need for maintenance before additional cost occurs and so AM-X enables moving to Predictive maintenance model from preventive maintenance model. Predictive maintenance increases route capacity and decreases costs of maintenance operations by decreasing down-time of the track. In addition, construction material and machinery movement can be tracked during installation and the information can be used for optimizing work-site logistics.

Operations logistics

For rolling-stock operators and locomotive manufacturers can recognize and track objects such as wagon routes during shunting and use gained route information for improving logistics operations. In addition, rolling stock operators is able to offer services for network owners and contractors by providing information from sensors on their rolling stock.

Automation and robotics

For achieving higher level of automation, AR-platform can be used to increase efficiency and quality in the installation operations by providing remote guidance during installation operations. This guidance information and information from AM-X system combined with machine learning can be used to further automate maintenance and installation operations through robotics.

Construction example: AM-CONSTRUCTION

Obstacle detection / location awareness

For construction machinery operators and manufacturers AM-X provides possibility of improving safety during machinery operations. AM-X can specify route of the machine and recognize obstacles and hazards from the route, and the information can be used as assisting system for machinery operator and collision avoidance.

4D modelling / designing operations

For designers information provided by AM-X platform can be used to gain right basic information on any designing operations. Same information can be used for 4D modelling of the environment and provides possibility for usage of AR-systems on field operations.

Asset management / ownership control

For building owners AM-X platform provides machine vision based monitoring and real-time asset management. AM-X improves quality control by providing relevant information of objects of interests in structures. Automated measurements during maintenance and installation operations provides owners transparent quality measurement information can further automate their surveillance operations and improve quality control operations from construction phase to maintenance.

Predictive maintenance / automated measurements

For construction and maintenance operators system provides possibility of recognizing and flagging the need for maintenance before additional cost occurs and so AM-X enables moving to Predictive maintenance model from preventive maintenance model, which decreases life-cycle cost via more effective maintenance operations.

Operations logistics

AM-X provides possibility to trace routes of construction material and machinery during construction and maintenance operations. This information can be used for optimizing work-site logistics.

Automation and robotics

For achieving higher level of automation, AR-platform can be used to increase efficiency and quality in the installation operations by providing remote guidance during installation operations. This guidance information and information from AM-X system combined with machine learning can be used to further automate maintenance and installation operations through robotics.

SmartCity example: AM-CITY

4D modelling / assets management

AM-X can recognize location of components from city structures. This information can be used for asset management purposes and tracing changes in city structures and information can be used for 4D modelling of the environment. 4D modelling provides possibility for usage of AR-systems for real-time virtual tour of whole city and same information can be used as part of building information modelling.

Asset management / ownership control

For infrastructure and building owners AM-X platform provides machine vision based monitoring and real-time asset management. AM-X improves quality control by providing relevant information of objects of interests in structures. Automated measurements during maintenance and installation operations provides owners transparent quality measurement information can further automate their surveillance operations and improve quality control operations from construction phase to maintenance.

In addition, solution provides opportunity for goods manufacturers to implement training of their goods to system and manufacturers can get information on condition and location of their goods in city. Manufacturer can use this information for improving their service level by handling renewing and maintenance surveillance on behalf of their clients.

Predictive maintenance / automated measurements

For construction and maintenance operators system provides possibility of recognizing and flagging the need for maintenance before additional cost occurs and so AM-X enables moving to Predictive maintenance model from preventive maintenance model, which decreases life-cycle cost via more effective maintenance operations.

Operations logistics

AM-X provides possibility to trace routes of urban transportation, materials and machinery during operations. This information can be used for optimizing city logistics.

Obstacle detection / location awareness

For urban transportation operators and manufacturers AM-X provides possibility of improving safety during machinery operations. AM-X can specify route of the machine and recognize obstacles and hazards from the route, and the information can be used as assisting system for machinery operator and collision avoidance.

Automation and robotics

For achieving higher level of automation, AR-platform can be used to increase efficiency and quality in the installation operations by providing remote guidance during installation operations. This guidance information and information from AM-X system combined with machine learning can be used to further automate maintenance and installation operations through robotics.

Best Regards

Recon AI

Henri Memonen

Chief executive officer

Implementation of AM-RAIL™


 

CONTENT

Foreword

Implementation

Ecosystem - Added value

Pilot?

Foreword

In this article, we describe how the AM-RAIL™ can be implemented to our clients' ecosystems. The article includes a description of the implementation process and explains the added value to a railway operations. The goal of this article is to give an idea of how AM-RAIL™ can be implemented to our clients' ecosystem, as we aim to gain pilot projects for AM-RAIL™. 

Implementation

Implementing AM-RAIL™ does not require expertise of AI-solutions from the client. Only data from the client's ecosystem is required. This data can be gathered from existing or newly installed sensors (Cameras, LiDars, Sonars). The data gathered from the field needs to be related to a CAD drawing of the components. These CAD drawings can also be used for recognition operations by rendering the drawings and relating them to the sensor data.

Implementation process

Phase 1 - Data acquisition. The client provides the CAD drawings, video and LiDar cloud data from the railway network. This can be done by using existing data or by gathering data with a new hardware set-up. 

Phase 2 - Data annotation. Recon AI labels the video and LiDar data and renders the CAD drawings to annotate the data for the training phase. 

Phase 3 - Training. Recon AI plans, builds and tests neural network models for training the AI to gain sufficient recognition performance.

Phase 4 - Deployment. Recon AI deploys the trained AI algorithms to the on-site sensors via API.

Phase 5 - Development. Recon AI further develops the solution in order to recognise additional components of interest and to improve recognition performance and measurement accuracy.

 We estimate the first implementation circle to take 6-12 months.

 

Ecosystem - Added Value

Immediate added value of the AM-RAIL™ is the automation of measurements performed currently in installation operations. In addition to this, point-cloud information of components can be utilized for object detection, 3D modelling of infrastructure (asset management) and combining information of infrastructural changes for predictive maintenance operations.

Screenshot 2018-11-01 at 8.23.17.png

Pilot?

We are looking for clients to start a pilot with. Interested? Feel free to contact:

info@recon-ai.fi

+358 (0) 50 587 1254

More information:

Article: AM-RAIL™ AS A PART OF SMART CITY

Video:

Showing is better than telling - take a look at the AM-City™ video.

Recon AI
Henri Memonen

 

 

AM-RAIL™ as a part of Smart City


 

CONTENT

Foreword

What is a Smart City?

Ecosystem

Implementation

Summary of benefits to different stakeholders

Emphasize on data-acquisition on an early stage

Foreword

In this article, we describe the use case of AM-X™ platform in Smart City transportation, the requirements for the ecosystem of the client, and implementation of the solution emphasizing the benefits in both short- and long-term. The goal of this article is to give an idea of how AI-solutions can be implemented to our clients' ecosystem and to emphasize the importance of gathering vast amounts of clear data at an early stage in the development. 

What is a Smart City?

”A smart city is an urban area that uses different types of electronic data collection sensors to supply information which is used to manage assets and resources efficiently. This includes data collected from citizens, devices, and assets that is processed and analyzed to monitor and manage traffic and transportation systems, power plants, water supply networks, waste management, law enforcement, information systems, schools, libraries, hospitals, and other community services.”

*https://en.wikipedia.org/wiki/Smart_city 

Ecosystem

The ecosystem is commonly built on the following three essential elements:

On a common level, the process of these kinds of ecosystems are quite straightforward.

  1. Sensors measure the environment and collect data for analytic platforms, with time and location labels.

  2. Analytics platforms provide analyzed guidance information to the client’s ERP-system.

  3. On ERP-system, operators are inspecting and labeling the data, and the labels are provided back to the analytics platform.

  4. Self-learning algorithms on the analytics platform read measurement data to provide more accurate predictions per each new data-point.

Screen Shot 2018-04-10 at 14.10.44.png

When implementing the AM-RAIL™ as a part of Smart City, a variety of options for the sensors, analytic platform models and ERP-systems are available for the ecosystem. Some of the options and their related considerations are listed below as suggestions that we recognize as valuable to the Smart City ecosystem.

Sensors:

All sensor data should be labeled with time and location labels when using the sensor.

 Analytic platform models:

ERP-systems:

We have categorized the labels into the following categories:

  • Fault labels (a label that indicates a fault in the ecosystem)

  • Effect labels (a label that indicates causal effect in the ecosystem)

  • Component labels (data that is labeled relation to a component)

  • Simulated data labels (simulated data label from engineering models)

Implementation
 

We often hear from our networks that they do not wish to be first ones to implement AI-solutions to their own operations, but want to wait for markets to mature and consider applying AI-solutions at a later stage. We believe that the major fault in this reasoning is that after AI-solutions have developed enough, the AI would be easily applicable to various operation models. Unfortunately, this mix-up of the intelligence explosion and use-case based machine learning application is a common mistake. As intelligence explosion would make a machine that only requires calculation power to develop, machine learning requires adaptation to the specific user cases. If the assumption of the intelligence explosion is faulty, it does not matter, because the machine would still be solving most of our problems, one way or another.

The second line of reasoning we often hear from our clients is that the system would only bring benefits after several years of training of the AI, which would mean that ROI for the project investment does not make sense. Our belief is that when the implementation process is built smartly, we can add value to the clients´ ecosystem early on in different phases that support each other. This way the investment will start paying back quickly, and the benefits of the system will increase when more data is gathered.

On implementing AM-RAIL™ to railway and city maintenance operations, we estimated the following timetable and benefits from the system.

Screen Shot 2018-04-11 at 9.30.24.png

Phase 1, Sensors and improvement of the current planned predictive maintenance by providing an increasing amount of data from the field. This data can be used as an alarm-rate maintenance operation right after the sensor data is gathered. The data is stored in the database. The estimated time for implementation is 1,5 – 2 years. Components can be recognized and the information can be used for ownership management.

Phase 2, An analytics platform is chosen and implemented. The analytical platform can recognize decay rates from the data gathered from the sensor. The decay information can be used for maintenance operations and the operations can be moved towards a preventive maintenance model.

Phase 3, The analytics platform starts to receive labels from the ERP-systems for self-learning algorithms. The self-learning algorithms will receive fault, effect, component and simulated data labels from ERP-systems which leads to the platform performing better with each new data point. Maintenance can be moved towards a predictive maintenance model.

Phase 4, AR-solutions can be implemented to operations to provide guidance for the field operators. While providing guidance the guiding person can label components from the pictures and train machine vision solutions for recognition of these components. After a sufficient amount of component labels, machine vision can be used for guiding robotics and maintenance the operations can be further automated in steps. The ultimate goal is set to automate maintenance operations fully.

As we see, AI-solutions will bring benefits to operations also in short-term.

 

A summary of the benefits to different stakeholders

Construction and maintenance operators

Recognizing the need for maintenance before additional cost occurs - moving to a Predictive maintenance model. This increases route capacity and decreases costs of maintenance operations by decreasing down-time of the track. In addition, component recognition can be used to maintain uptodate information for ownership management.

By adding measurement solutions to provide data for a BIM engineering software and providing real-time uptodate information, the right baseline information can be provided for designing operations. These measurement solutions will also remove the need for manual measurement of structures and gathering the measurement data into database can be automated.

In addition, an AR-platform can be used to increase efficiency and quality in the installation operations by providing guidance remote guidance during installation operations. At the same time, operators can label videodata and labels can be used for the training of machine vision solutions.

For traffic and transportation operators

Moving into a Predictive maintenance model decreases requirement for maintenance operations on the route and improves route capacity.  Facial recognition system provides smooth passenger transportation and provides baseline for TaaS-solutions.

Smart city, citizens of the city, Institutes and companies operating in the city

Camera systems attached to transportation machinery can measure and recognize components from surrounding structures in its route meaning anything from the surveillance of street-lights to the condition of buildings. Changes in these structures can be surveilled and data can be used for the allocation of maintenance resources. The same data can then be used for building a uptodate digital model of the city. All this data can be used as a platform for new inventions resulting in a better quality of life for the citizens.

 

Emphasis on data-acquisition on an early stage

Implementing AI-solutions to most of the ecosystem requires a lot of data to work with. The data needs to be raw, clear and labeled to provide sufficient information for self-learning algorithms that aim to provide information for operations and finally make automation possible for the application.

When a system requires huge amount of clean raw-data from several sensors, the makes cost of a single measurement to work as major cost-driver. This means heavy and expensive sensors wont do the trick, instead by using multiple cheap sensors in the ecosystem most of the benefits can be achieved.

In addition, the know-how of the field operators needs to be digitalised and stored as data. Machine learning means that the machine needs to learn what to do, and so far humans are acting as teachers. This means personnel working in the ecosystem needs to use digital tools on their operations in order to provide sufficient information for machines to eventually operate automatically.

We recommend all operators to start collecting data by implementing cheap sensors to their ecosystems and storing the raw-data to databases for the future’s needs. Ungathered information can never be recovered.

 

Recon AI
Henri Memonen

 

Don’t wait FOR your data to arrive -

let’s get it for you.