Map Fields

Map Fields

In Step 2 of the Data Import Routine in the lower panel under Map Fields, you will map your input fields to your DataSight fields.

The method of field mapping depends upon whether your data is a pivoted data set or a normalised data set.

Mapping involves matching the left-hand column Input Field Name, the middle column Field Type and the right-hand column DataSight Field Name. You will need to have modified or added your Variables into the database prior to field mapping.

 

Add or modify a Variable

  1. Select the Variables button at the bottom of the Step 2 Window. A Variables window will appear showing the database variables.
  2. To add a variable, click New in the Quick Access Toolbar and a new row at the bottom of the Variable table will be added.
  3. Enter the Variable Name, Units, Description, Type and Display Format as required.
  4. To modify a variable, click in the variable row and edit as required. Any changes will appear in italics.
  5. Click Save in the Quick Access Toolbar at any point to save changes and continue, otherwise when you Close the Variables table you will be prompted to save your changes.

 

Map Levels

If you wish to use or match the exact names as they appear in your raw data to DataSight Levels, you can map your site names to a Level 2 Name or Level 3 Name DataSight Field. DataSight does not let you map across different Level 1 sites on import. Where a data file contains multiple Level 1s, you will need to undertake multiple imports of that data file. A Level 3 ID column may also be mapped using the Level 3 ID DataSight Field, where the ID value is the Level 3's ID within DataSight.

To map to Levels:

  1. Click on row which corresponds to the Level 2 names, Level 3 names or Level 3 IDs. The row and corresponding column in your data file is highlighted in green.
  2. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Level.
  3. Click in the adjacent line in the DataSight Fields column to access the drop-down list of  DataSight Fields and select either Level 2, Level 3 or Level 3 ID.

 

Map Date and Time

You are able to map date and time fields in Step 2. Where Date or Time are not selected, you will be required to select Date and Time in Step 4 of the Import Routine. In DataSight, each entry or record MUST have a datetime.

To map to Date and/or Time:

  1. Click on the row which corresponds to the datetime column of your data file. The row and corresponding column in your data file is highlighted in green.
  2. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Date Time.
  3. Click in the adjacent line in the DataSight Fields column to access the drop-down list of DataSight Fields and select any of the following as required:
    1. Date
    2. Time
    3. Date&Time
    4. Year
    5. Month
    6. Day of the Month or Year

Note

Unmapped fields will not be imported.

If you have made changes to the Variable table during import, after import you will need to refresh the Variable list in the Variable panel.

 

Map Variables and Metadata Variables in a Pivoted Dataset

After mapping your levels and datetime fields, in a pivoted data file you will need to map your measured values and metadata values to a DataSight data or metadata variable. To do this:

  1. Ensure that Normalised box is unchecked in Step 1 of your import to allow pivoted data field mapping.
  2. Click on the row which corresponds to the Variable or Metadata Variable column of your data file. The row and corresponding column in your data file is highlighted in green.
  3. Click in theField Type cell to the right to display the drop-down list of available Field Types and select either Variable Data or Metadata.
  4. Click in each adjacent line in the right hand column to access the drop-down list of DataSight Fields and select an existing DataSight Variable Name or DataSight Metadata Variable Name to map each Input field to. At least one DataSight Variable must be mapped.
  5. If you already know the name of the Variable or Metadata Variable, simply type in the name to limit the choices in the drop-down list, and speed up the mapping.
  6. When you have mapped all the fields, click Next. The Step 3 Window appears.

 

Map Variables and Metadata Variables in a Normalised Dataset

In a normalised data set you need to create a variable mapping template to correctly import your measured values and metadata values to a DataSight data or metadata variable.

A Variable Map consists of selection criteria which need to match in order for a DataSight Variable to be populated with data. DataSight requires you to identify the column containing the names of the measured parameters, and optionally the column containing the Units or CAS Number of the measured parameters. When the entry in each of these columns matches exactly that specified, data can be imported to the DataSight variable selected.

 

Create a Variable Mapping template

  1. Ensure that the Normalised box is checked in Step 1 of your import to allow Variable Mapping.
  2. Click Variable Mapper in Step 2 of the Import Routine. The Map Variables window appears.
  3. To add a template, click New in the Quick Access Toolbar. The Column Selection window appears.
  4. Click on the column header or within the column that contains the variable names. The Selected Column will display the column header name and relative position within the data set. Click OK.
  5. You will be asked if you wish to map the Variable Units. This is optional. If you click Yes another column selection window appears. Disregard Step 6 if you select No.
  6. Click on the column header or within the column that contains the variable units. The Selected Column will display the column header name and relative position within the data set. Click OK.
  7. You will be asked if you wish to map the CAS Number. This is optional. If you click Yes another column selection window appears. Disregard Step 8 if you select No.
  8. Click on the column header that contains the CAS Number. The Selected Column will display the column header name and relative position within the data set. Click OK.
  9. The next window shows the repeating field entries in the selected column for your normalised datasheet. DataSight will identify all repeating entries in the raw data file for possible selection. You are also able to set your own field names.
  10. Enter a Name for your Variable Mapping template.
  11. Highlight a row and select an existing DataSight Variable from the drop-down list of DataSight Variables to map the entry to. Repeat as necessary.
    1. You may also begin typing the name of the DataSight Variable if known, this will allow you to quickly select the Variable from the drop-down list.
  12. If you wish to set your own field names, click New in the Quick Access Toolbar.
  13. A new mapping row will appear. Type your specific criteria for the selected column name (and unit if applicable).
  14. Select the DataSight Variable from the drop-down list of DataSight Variables to map the entry to.
  15. Click Save. The Variable Mapping window will close.
  16.  

 

Modify a Variable Mapping

  1. Click Variable Mapper in Step 2 of the Import Routine. The Map Variables window appears.
  2. Click in the template name to change the name as required. The changes will appear in italics.
  3. Click the Edit Variables button to access the specific variable mappings. Amend as required.
  4. Click Save or the Save button in the Quick Access Toolbar at any point to save changes and continue, otherwise when you Close any of the Variable Mapping windows you will be prompted to save your changes.

 

Import a Variable Mapper

When there are a large number of import variables that need to be mapped to DataSight variables, creating (or modifying the mapping of) a Variable Mapper can be very time consuming. To assist with this process, a Variable Mapper template may also be imported from an Excel file. The file must contain two columns of data, the first column being the Import Variables as they would be entered in your data files and second column being the mapped DataSight Variable name as it appears in DataSight. Users must have the Import execute and Import Template modify permissions.

  1. Ensure that the Normalised box is checked in Step 1 of your import to allow Variable Mapping.
  2. Click Variable Mapper in Step 2 of the Import Routine. The Map Variables window appears.
  3. You can click the Edit Variables button to access the specific variable mappings of an existing Variable Mapping template and proceed to step 9 below or continue with step 4 to create a new Variable Mapping template.
  4. Click New in the Quick Access Toolbar. The Column Selection window appears.
  5. Click on the column header that contains the variable names. The Selected Column will display the column header name and relative position within the data set. Click OK.
  6. You will be asked if you wish to map the Variable Units. This is optional. If you click Yes another column selection window appears. Disregard Step 6 if you select No.
  7. Click on the column header that contains the variable units. The Selected Column will display the column header name and relative position within the data set. Click OK.
  8. The next window shows the repeating field entries in the selected column for your normalised datasheet. DataSight will identify all repeating entries in the raw data file for possible selection. You are also able to set your own field names.
  9. Click Import Variable Mapping to display the File Open dialog.
  10. Navigate to and select the file containing your Variable Mapper template and then click Open.
  11. DataSight will display a confirmation dialog for validating the contents of your file. Click Yes to confirm that your Variable Mapper template file format matches the below, otherwise click No to cancel the import:
    1. Column A - must contain the Variable names as they will appear in your data files; and
    2. Column B - must contain the DataSight Variable Name to be mapped to the respective Variable in Column A.
  12. DataSight will import the Variable Mapper template, adding or updating rows as per the Variable Mapper template file, and will display an information dialog detailing the changes made. Review the information provided and then click OK.
  13. Review your updated Variable Mapper template, giving it a name and then click Save.
  14. You can now use your imported Variable Mapper for other import tasks.

 

Delete a Variable Mapping template

  1. Click to check the Delete checkbox(es) against any template(s) that you wish to delete.
  2. Click Save in the Quick Access Toolbar at any point to save changes and continue, otherwise when you Close the Variable Mapping table you will be prompted to save your changes.

 

Duplicate a Variable Mapping template

  1. Click Variable Mapper in Step 2 of the Import Routine. The Map Variables window appears.
  2. Click the template name to select it.
  3. Click the Edit Variables button mceclip0.png to access the specific variable mappings.
  4. Click the Save As button in the Quick Access Toolbar to duplicate the template.
  5. Enter a Name for your Variable Mapping template.
  6. Click Save button at any point to save changes and continue, otherwise when you Close any of the Variable Mapping windows you will be prompted to save your changes.

 

Applying a Variable Mapping

  1. Click on the row which corresponds to the Variable Name column of your data file. The row and corresponding column in your data file is highlighted in green.
  2. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Variable Map.
  3. Click in the adjacent line in the right hand column to select the VariableMapping template name.
  4. Click on the row which corresponds to the Variable Value column of your data file.
  5. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Variable Map.
  6. Click in the adjacent line in the right hand column to select VariableMapping - Value.
  7. Click on the row which corresponds to the Variable Units column of your data file.
  8. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Variable Map.
  9. Click in the adjacent line in the right hand column to select VariableMapping - Unit.
  10. Click on the row which corresponds to the Variable CAS Number column of your data file.
  11. Click in theField Type cell to the right to display the drop-down list of available Field Types and select Variable Map.
  12. Click in the adjacent line in the right hand column to select VariableMapping - CAS Number.
  13. Click on a row which corresponds to a Metadata Variable column of your data file.
  14. Click in the Field Type cell to the right to display the drop-down list of available Metadata Variables and select the Metadata Variable.
  15. Click in the adjacent line in the right hand column to access the drop-down list and select a Metadata Variable.
  16. When you have mapped all the fields, click Next. Window for Step 3 of the Import Routine appears.
    • Related Articles

    • Map

      The MAP tab uses the spatial information stored in the Level 3 Properties within DataSight to display pinned locations for your Levels, while also displaying the most recent Variable data in a pop-up box when a Level is selected. Use of the MAP tab ...
    • Importing calculated fields from Microsoft Excel files

      Reported: June 16, 2017. Version(s) affected: DataSight 3.0 and 3.1. Issue: During an import routine, if values in nominated fields of a file have been calculated using Microsoft Excel formulae, they appear empty when previewed and do not import. ...
    • Google Map View

      Valid geographical information should be entered into your level 3 properties (via DataSight). If this information is not present in the database, the level 3's location will default to 0,0 (on the equator, south of Ghana). You can view monitoring ...
    • Mandatory Fields in Tabular Forms

      Reported: October 18, 2017 Version(s) affected: DataSight 3.0 and above Issue: When a new record is mistakenly added to any grid view in DataSight (e.g. new Variable, new Standard etc), a Can't be Empty marker will appear in any cell that a mandatory ...
    • Video: Report Designer Flagging Calculated Fields