Collector Reader
Live provides collector reader plugin to collect and ingest data between a cloud and edge instance
Last updated
Was this helpful?
Live provides collector reader plugin to collect and ingest data between a cloud and edge instance
Last updated
Was this helpful?
Live plugin to read data being ingested by a LiveRig Collector at the same machine, or at least in the same filesystem. LiveRig Collector data.log files will be monitored, parsed and will create local events to represent the same information. This plugin enables the installation of an additional Live instance at the Edge environments to use the events locally without any impact on the ordinary LiveRig Collector data flow tasks for the central site.
This plugin must not be installed in a Live which already receives data from the same LiveRig Collector (by TCP), otherwise name clashes will occur and the remote control capabilities from the ordinary LiveRig Collector instance will not work due to ambiguous internal events.
Download the plugin collector reader available at Intelie marketplace:
Verify that the plugin-collector-reader is valid at the plugins page:
Search for "collector reader" on Live integrations administration page.
The Collector Reader plugin needs to be configured to consume the same data folder than LiveRig Collector will use to store temporary the data being ingested.
In this case, the folder is /opt/intelie/liverig/data, please confirm the data_path at the liverig.properties file of the LiveRig Collector installation.
This plugin delivers an Extension Type in Live, which enables an arbitrary number of instances for it, so potentially you can monitor the data flow for any number of collectors since they run locally in the same filesystem.
In the example below are two environments configured, side by side, one represented by cloud (left) and the other represented by edge (right) with the plugin-live-collector-reader installed.
The cloud environment is receiving data from a configured collector:
Without configuring the plugin-live-collector-reader it is not expected to receive any data on edge side by executing the query:
__src:(liverig|collector)*
After configuring the integration instance as long as the collector you are pointing to start receiving events those events will be replicated inside live with the field __src set to collector-reader/<qualifier of the instance>.
For example, if your instance's qualifier was set to Rig 01 then you could test the instance is working by running the following pipes query:
__src:"collector-reader/Rig 01"
A typical configuration for a LiveRig collector installed by RPM package will use the folder /opt/intelie/liverig as explained in .
On the image below it is possible to see the online active:
An example of source configuration:
