As part of the series of product updates on AgilePoint NX v9.0 release, the next one I would like to share is Elasticsearch.
Elasticsearch is a near real-time, distributed, RESTful search and analytics engine. It is based on top of Apache Lucene open source project and is very popular with developers and enterprises. It provides a highly scalable and flexible solution for indexing, searching and analyzing structured and unstructured data in real time. Elasticsearch is designed to handle large volumes of data and offers robust full-text search capabilities, as well as advanced features such as distributed searching, real-time analytics and near real-time indexing.
Powered by Elasticsearch, The ELK stack, is a combination of three open-source tools: Elasticsearch, Kibana and Logstash. It is widely used for many type use cases including centralized log management and analysis, reporting, metrics & alerting, Machine learning, Security and SEIM tools and many more. In AgilePoint NX V9, the integration has two key components:
- An AgileConnector: A data pipeline that transforms and streams process/app data to Elasticsearch for indexing.
- A set of Process Activities: This will allow drag-and-drop of activities onto your process and automation of querying and writing data to the Elasticsearch indexes.
In the first demo, we’ll be focusing on the AgileConnector part. As mentioned, the AgileConnector component acts as a data pipeline to transform and to stream process/app data to Elasticsearch, needed for indexing. Here are few key features
- It will Stream process and app data to Elasticsearch as a single JSON Doc – so all instance process and app info is structured into a single JSON doc
- Fully transparent to app and process model, so no additional action is needed on process or app side for the data to be streamed.
- Data will be streamed to a dedicated index which is Timeseries index
- It allow configurable number of threads to make for an efficient and scalable processing on both AgilePoint and Elasticsearch
Note: Elasticsearch AgileConnector is available for on-premise and dedicated cloud customers only!
Check on the demo video to learn about:
- The Agile Connector’s configuration and options
- Data generation
- Data in Elasticsearch
- Analytics and Data visualization
Hope you enjoyed the video and please do check out the second part.
Note: Please note that this video is recorded while this feature is in beta version. Some of the labels and icons might change by the time it goes GA but the general concept of configuring these activities would remain the same.