Collector Reader

Live provides collector reader plugin to collect and ingest data between a cloud and edge instance

Edge architectures overview

Live plugin to read data being ingested by a LiveRig Collector at the same machine, or at least in the same filesystem. LiveRig Collector data.log files will be monitored, parsed and will create local events to represent the same information. This plugin enables the installation of an additional Live instance at the Edge environments to use the events locally without any impact on the ordinary LiveRig Collector data flow tasks for the central site.

Installation

Download the plugin collector reader available at Intelie marketplace:

Verify that the plugin-collector-reader is valid at the plugins page:

Configuration

Search for "collector reader" on Live integrations administration page.

A typical configuration for a LiveRig collector installed by RPM package will use the folder /opt/intelie/liverig as explained in Collector configuration.

The Collector Reader plugin needs to be configured to consume the same data folder than LiveRig Collector will use to store temporary the data being ingested.

In this case, the folder is /opt/intelie/liverig/data, please confirm the data_path at the liverig.properties file of the LiveRig Collector installation.

This plugin delivers an Extension Type in Live, which enables an arbitrary number of instances for it, so potentially you can monitor the data flow for any number of collectors since they run locally in the same filesystem.

Receiving events

In the example below are two environments configured, side by side, one represented by cloud (left) and the other represented by edge (right) with the plugin-live-collector-reader installed.

The cloud environment is receiving data from a configured collector:

On the image below it is possible to see the online collector source active:

An example of WITSML source configuration:

Typical WITSML source configuration

Without configuring the plugin-live-collector-reader it is not expected to receive any data on edge side by executing the query:

__src:(liverig|collector)*

Demonstrating the data arrival in cloud-only environments

After configuring the integration instance as long as the collector you are pointing to start receiving events those events will be replicated inside live with the field __src set to collector-reader/<qualifier of the instance>.

For example, if your instance's qualifier was set to Rig 01 then you could test the instance is working by running the following pipes query:

__src:"collector-reader/Rig 01"

Ensures the Collector Reader instance is working fine and receiving data

Last updated

Was this helpful?