Introduction
With the introduction of Delta Watch version 2.15 there are various new features introduced. One of them is the Import & Export module which will handle many of the actions required to perform these import and export tasks. With this new module it is possible to use a predefined export format or to define your own. The last is particular useful when there is a need to provide third parties with continues processed data flow.
The module can be found in the main access bar on the left under the item ‘Interfaces’, see image
In this module you can add an unlimited number of import and export configurations, called jobs.
Each job can be configured to execute at specific time intervals and will run independent of other processing tasks. The custom format configuration if very flexible and allows you to configure things like:
- Sensor type
- Filename
- Date/time format
- Headers
- Column separator
- Data values
- Units
- Decimal places
The import capabilities of this module is also used for items like:
- THP sensor import (*.THP)
- Delta Link Control unit information (*.CUI)
- Total station information file statistics (*.STNI)
Additionally you can configure alarms to be triggered if no data has been send or received for a certain amount of time. As well as having a status overview showing, for example, age of last action. See below image of the status overview in the module.
Create Custom formats
The import/export module has already a few pre-defined export formats. These are formats as could be found in pre-2.15 versions of Delta Watch. See below table for details on the Geodetic export formats.
Export Type | Replaces export option pre DW v2.15 |
---|---|
GeodeticPointExport | |
Kronos_3Ddeformation | Automated networks -> Export to information system with export format set to ‘Kronos’ * |
Kronos_Levelling | Automated network(levelling) -> Export to information system with export format set to ‘Kronos’ * |
Iris(Group; Name) | Automated networks -> Export to information system with export format set to ‘Iris(Group; Name)’ * |
Iris(Name; Group) | Automated networks -> Export to information system with export format set to ‘Iris(Name; Group)’* |
ProcessedPointExport | Automated networks -> Processed Point Export |
* The export type in pre DW v2.15 was normally set at DW>SYSTEM>AUTOMATIC_PROCESSING>GENERAL> Export_type
If you were exporting data from other modules than the automated networks then you will find each format back in the export module once you select the Sensor type.
A ‘format’ is a sort of template that tells what data should go in which columns and once defined can be used by multiple jobs. Besides the predefined formats you can also define your own format. How to do this, follow below simple steps.
- Navigate to the DW>INTERFACES>IMPORT_& _EXPORT module
- Select [ Custom Format ] button in the top toolbar, a new dialog, like below, opens showing you any existing formats.
- Select now either Add or duplicate. If you are not sure how the format looked, select it and the Overview will update with the specific details.
- A new dialog opens were you can now configure your Custom format. The dialog will look like this image and you now have to configure all fields. Make sure you give it a sensible name.
- Select file name extension
- Specify the sensor type, there are multiple sensor types, selecting the correct one will ensure it show up correctly later when creating the export job. You can choose from one of the following:
- Geodetic sensor
- Meteorological
- Structural monitoring
- Convergence section
- Set what this format should be used for, Import or Export
- Both the file name and timestamp format can be customized. To do so, simply click on [Add format] and a dialog will open showing you all the current formats. Now you can manage them here; when you Edit/Add a new format it shows a dialog with all options that can be used, as per below image.
- Specify the required column separator
- Header configuration: Check if you want a header when exporting
- Now configure your columns:
- You can Add/Remove columns, it will always perform this action at the end, you cannot insert
- For each column were applicable specify:
- Column type
- Unit
- Decimal places
- Text (only when fixed text is selected)
- When done click [ OK ] to save your custom format configuration, it is now ready to be used.
Configure an automatic export
The Export jobs are replacing all automated exports that in Delta Watch versions before ver-sion 2.15 where configured in specific modules, like automated-networks or the structural-monitoring module. To create an Export job, follow the below steps:
1) Add a new job definition by clicking on the [ + ] Add button. See below.
- A new dialog will open were we can now define our job. See image
- Specify an export name. The definition can export only from one project but can export multiple Point groups at the same time!
- Set Import/Export to Export
- Select the sensor type, you can choose from:
- Geodetic sensor
- Meteorological
- Structural monitoring
- Convergence section
- Rail track
- Specify the destination folder
- Specify the Export interval, for more control over the exact timing of when the job should execute or if you want to change the timestamp timezone from the default, which is UTC, then enable ‘extended settings’. The Start time has two function:
- You can set it to a date in the future so the job would not start until reached
- By specifying the time you can control base time of the export. For example setting the time to 00:10:00 and 60 minutes interval the job will export at 00:10:00; 01:10:00, 02:10:00, 03:10:00…….23:10:00
- Select the export type, this is the export format and if you had defined your own format(s) for the specific sensor-type then it would show up here.
- Select your project to export from, depending on which sensor type is selected you might have to select a sensor group or a sensor field. If using groups you can select multiple groups at once but all the data will be written to the same file. Either ensure there is a column in the export format that indicate the group-name or create for each group its own export job using either a unique destination folder or a custom format with a unique file name, using the {Text} option.
- It is also possible to setup messaging here, in order to configure them you must have setup your email server and added contacts to you project. You can select any of the following triggers:
- Data transfer
- Incorrect Export
- Confirmation, that data was exported
- Click [ OK ] To save your edits and don't forget to click the [Apply] button when finished Add all your exports.
Configuring an automatic import
Import configurations are used to import some of the special data files that Delta Link generates. These are the files that contain:
- basic weather station data (*.THP)
- Control unit information (*.CUI)
- Station information (*.STNI)
Here we will limit the explanation on the general setup of an Import job, for more details on each of the above items there are specific documents which will explain the complete setup for each item.
- Add a new job definition by clicking on the [ + ] Add button in the import & Export module
- Enter a name for this import job
- Set the Import/Export option to Import
-
There are various sensors types to choose from, for Topcon Delta Watch only the below are applicable:
- AMTS Import, imports *.CUI and *.STNI
- Meteorological, imports *.THP
- Specify the import folder
- Specify the import interval. If wanting to set alarms if something happens with a Delta Link unit, such as AC power loss, then ensure your import interval is set reasonably high to 10 minutes or less. Even though under normal conditions the CUI file is only generated hourly.
- Complete the rest of the configuration, available fields will change depending on the chosen sensor type. See image for an example
How to use the Manual Export function
With the introduction of the Import & Export module there is now also the option to manually ex-port data for a user defined period of time using one of the pre-defined or your own custom for-mat.
- In the Import & Export module click on the [ Manual Export ] button in the main toolbar, see image
- A new dialog will open up. Here you can select the following options:
- Project
- Sensor type
- Export type
- Export folder
- Timezone to use
- Depending on the selected Sensor type and the current definitions in your DB, for items like convergence, the dialog shows different options. These could be point groups or sen-sor fields, make your selection. If using groups you can select multiple groups at once but all the data will be written to the same file. Either ensure there is a column in the custom-export-format that indicate the group-name or create for each group its own custom ex-port format with a fixed text in the filename definition.
- Select your Start and End epoch, the end epoch could be the same as the start and it will then just export that epoch.
- Click [ OK ], Delta Watch will now start exporting and shows a message when it is finished indicating how many files have been written.