Data Monitoring Application
- Nina Cardillo
This example uses IAP/MQ setup monitoring for a specified set of data points based on a device type. It captures data update events, and dynamically adjusts point monitor rates based on transitions in device health. Here are the specific features of this application:
- Monitor the
..fb/dev/lon/+/stschannel to detect provisioned communicating devices. - If the device is found in a list of targeted devices, set up the monitoring parameters for the set of targeted data points.
- When data events arrive, send a time-stamped log record to the console.
Let's get started creating and testing this example in VS code:
- Create an empty directory for this project, called point-monitor.
- In a command window, make the directory created in step 1 your current working directory.
- Type:
npm initand provide inputs when prompted as appropriate.
This screen clip highlights the provided inputs, with mostly the defaults being used. The key input is the name of the entry point file: pointmonitor.js - This application uses the following npm packages: mqtt.js. Add the mqtt module to your project using this command:
npm install mqtt --save - Type
code -a .to launch VS Code with this directory as the project directory. - In VS Code select File > New File, followed by File > Save As to save this application as pointmonitor.js.
The following code block is the application pointmonitor.js. Expand to view and copy the contents to the file you just created in step 6.
- Now we need to setup the launch configuration for the VS Code debugger. Click the
icon in the VS Code left side tool ribbon, and click the gear icon 
to the left of the 'No Configurations' drop down. - Edit launch.json to match this screen clip. You will need to add the highlighted key/value pairs, and adjust the DEV_TARGET address to match your SmartServer IP address.
- With a default launch configuration set, you can now run this application in the VS Code debugger by clicking the play icon
.
Code Walk-Through
The first two lines of pointmonitor.js create objects needed to using the mqtt.js. We have seen the mqtt.js module used previously. The devStates Map object is used to keep track of the device health, as reported on the ...fb/dev/lon/+/sts IAP/MQ topic.
Line 13 defines the MontorSpecs object array. Each element of MonitorSpecs includes a PID and an nvList that provides a point Path and ms object to describe how to monitor the datapoint. You can review the Monitoring Preference Object to better understand the ms object.
/*
* pointmonitor.js
*/
"use strict";
const mqtt = require('mqtt');
const devStates = new Map();
let glpPrefix="glp/0"; // this will include the sid once determined
var subscribtionsActive = false;
// Edit monitorSpecs object array according to your requirements to monitor the targets data points of interest
var monitorSpecs = [
{
pid: '9FFFFF0501840460',
nvList: [
{ptPath: 'LightSensor/0/nvoLuxLevel', ms:{rate: 20, report: 'any', threshold:0, inFeedback:false, event:false}},
{ptPath: 'TempSensor/0/nvoHVACTemp', ms:{rate: 20, report: 'any', threshold:0, inFeedback:false, event:false}},
{ptPath: 'Switch/0/nvoValue', ms:{rate: 20, report: 'any', threshold:0, inFeedback:false, event:false}},
]
},
{
pid: '9FFFFF0501840450',
nvList: [
{ptPath: 'LightSensor/0/nvoLuxLevel', ms:{rate: 20, report: 'change', threshold:1, inFeedback:false, event:false}},
{ptPath: 'TempSensor/0/nvoHVACTemp', ms:{rate: 20, report: 'any', threshold:0, inFeedback:false, event:false}},
{ptPath: 'Switch/0/nvoValue', ms:{rate: 20, report: 'any', threshold:0, inFeedback:false, event:false}},
]
}
];
Lines 33-39 instantiate the client mqtt object, and establishes whether the connection to the broker is through a local loop-back IP address or to a remote broker as occurs when executing from the VS Code debugger.
// environ returns the value of a named environment variable, if it exists, or returns the default value otherwise.
function environ(variable, defaultValue) {
return process.env.hasOwnProperty(variable) ? process.env[variable] : defaultValue;
}
// Set up a MQTT client for the duration of the app lifetime.
const client = mqtt.connect(`mqtt://${environ('DEV_TARGET', '127.0.0.1')}:1883`);
Lines 40-60 are establishing the value of an optional command line argument that has the following behaviors based on the argument value (default = -1) assigned to a global variable rateOverride.
- rateOverride == -1: causes the application to apply the monitor rate as defined in the monitorSpecs object array.
- rateOverride == -2: causes the application not to modify datapoint monitor rates. Data events will flow only if a DLA file is specifically imported and applied.
- rateOverride == 0: causes all monitor rates to be set to zero for the defined targets in the monitorSpecs object array. The program will self terminate after 20s.
- rateOverride > 0: will use the value to override the value defined in the monitorSpecs object array.
var rateOverride = -1; // -2 means DLA managed polling. -1 means use monitor spec value. >= 0 set as the monitor rate
var args = process.argv.slice(2);
// rateOverride of -1 uses the rate defined in MonitorSpecs Object array, -2 assumes the DLA file was used to define
// the monitor rate. 0 will stop monitoring and the the application will exit
if (args.length === 1)
rateOverride = parseInt(args[0]);
console.log ('PointMonitor applicaiton rateOverride: %d',rateOverride);
console.log (`PointMonitor applicaiton rateOverride: ${rateOverride}`);
if (rateOverride === -2)
console.log ('An active DLA file must be use to start monitoring');
// Openloop exit after 20s operation, assuming all the targeted monitor points get set to 0
if (rateOverride === 0)
setTimeout(() => {
console.log ('Exitting point monitor application. Monitor rates set to 0.');
process.exit();
},
40000
);
const sidTopic = 'glp/0/././sid'
// Subscribe to the segment ID topic.
client.subscribe(
sidTopic,
(error) => {
if (error) {
console.log(error);
}
}
);
Line 65 uses the client mqtt object to subscribe to a topic to establish the sid (segment ID) for the target SmartServer. The iap object is used to build the topic 'glp/0/././sid'
Lines 74-161 are handlers that are called to process the IAP/MQ messages. The function handleSid(sidMsg) established the target SmartServer's sid, add stores in a IAP/MQ topic prefix for reuse. It then sets up a subscription to monitor device status in the ../fb/dev/lon/+/sts channel, and to capture data in the ../ev/data channel (lines 85-86)
The function qualifiedDevice(stsMsg) is used to sort out which sts messages are from devices of interest. This function returns an index to the monitorSpecs object array, or -1 if the device is not targeted.
The function handleDeviceSts (...) enables monitoring for the target points for all state:"provisioned" and heath:"normal" devices. The current health of the device is cached in the devStates Map object.
function handleSid (sidMsg) {
// Assuming the SID topic is a string sidMsg
let nowTs = new Date(); // Seconds TS good enough
if (typeof(sidMsg) === typeof("xyz")) {
if (sidMsg.length > 0) {
glpPrefix += `/${sidMsg}`;
console.log(`${nowTs.toISOString()}- SmartServer SID: ${sidMsg}`);
// Note how the "+" wild card is used to monitor device status for
// any lon device. Note, once we know the SID, we need to avoid
// adding multiple listeners. Subscbribe once and only once
if (!subscribtionsActive) {
client.subscribe (`${glpPrefix}/fb/dev/lon/+/sts`);
client.subscribe (`${glpPrefix}/ev/data`);
client.unsubscribe (sidTopic);
subscribtionsActive = true;
} else {
console.log(`${nowTs.toISOString()} - Redundant SID topic message`);
}
} else {
// We are not provisioned.
cosole.log(`${nowTs.toISOString()} - [${sidMsg}] Problem with SID payload.`);
}
} else {
console.error('The sid topic returned an unexpected payload type.')
}
}
function qualifiedDevice (stsMsg) {
// qualify the device as a targeted for monitoring by returning the monitorSpecs Index
let i;
for (i = 0; i < monitorSpecs.length; i++)
if (stsMsg.type === monitorSpecs[i].pid)
return i;
if (i === monitorSpecs.length)
return -1;
}
// Function enables point monitoring for provisioned targeet devices that are healthy
// returning true if monitoring is setup
function handleDeviceSts (devHandle, stsMsg, monSpecIndex) {
let dpTopic;
let nowTs = new Date(); // Seconds TS good enough
if (stsMsg.state === "provisioned") {
// define the monitorObj assuming provisioned and healthy devices
let monitorObj = {};
// To track the health of monitored devices the devState map is used to determine if the monitoring has be set
let setMonitorParams = false;
if (stsMsg.health === "normal") {
if (!devStates.has(devHandle)) { // First time through, set up monitoring
devStates.set(devHandle,"normal");
setMonitorParams = true;
} else { // Transistion from down or unknown to normal, set monitoring
if(devStates.get(devHandle) !== "normal") {
devStates.set(devHandle, "normal");
setMonitorParams = true;
}
}
console.log(`${nowTs.toISOString()} - Device: ${devHandle} (S/N: ${stsMsg.addr.domain[0].subnet}/${stsMsg.addr.domain[0].nodeId}) is Up.`);
} else {
devStates.set(devHandle, stsMsg.health);
console.log(`${nowTs.toISOString()} - Device: ${devHandle} (S/N: ${stsMsg.addr.domain[0].subnet}/${stsMsg.addr.domain[0].nodeId}) is ${stsMsg.health}.`);
return;
}
// Setup monitoring of the nvoVAVstatus variable
monitorSpecs[monSpecIndex].nvList.forEach(function(dp) {
// setMonitorRate is true at the health transitions and at startup.
if (setMonitorParams) {
monitorObj = dp.ms;
dpTopic = `${glpPrefix}/rq/dev/lon/${devHandle}/if/${dp.ptPath}/monitor`;
console.log (`${nowTs.toISOString()} - Set Monitor: ${dpTopic}, Interval: ${monitorObj.rate} Event: ${monitorObj.event}`);
client.publish (
dpTopic,
JSON.stringify(monitorObj),
{qos:2,retain: false},
(err) => {
if (err != null)
console.error(`${nowTs.toISOString()} - Failed to update Nv`);
}
);
}
});
return;
} else {
devStates.delete(devHandle); // If not provisioned, drop all consideration
console.log(`${nowTs.toISOString()} - Device: ${devHandle} (S/N: ${payload.addr.domain[0].subnet}/${payload.addr.domain[0].node}) is ${d1.state}`);
}
return;
}
Lines 163-205 process the message events from the mqtt client object. String functions establish the IAP/MQ topics, and direct processing to the handlers described above. The data events for the datapoints of interest are simply logged to the console in lines 182-200.
Next Step
Now that you understand the application specifics, we will next install and configure the application to run on the SmartServer in the Installing the Data Monitoring Application on Your SmartServer.