CSV Connector

CSV Connector
Customizable CSV file (CSV Connector type)

CSV Connector

Introduction

Description

The CSV Connector provides a way to load authoritative data from fixed record size files.

Managed System

This connector has been performed to charge authoritative data from files with CSV format or other format in other extension files.

For more information to check if your system may be synchronized with this connector you do not hesitate to contact us through our Contact form

Prerequisites

The file must be placed in the same Synchronization Server host.

The file must has the correct permissions to be readed for the Synchronization Server.

Download and Install

This addon is located in the Connectors section and its name is Flat file plugin.

For more information about the installation process you can visit the Addons Getting started page.

Agent Configuration

This connector could only be used as an identity source, no output file could be generated yet.

Usually, this connector is used the first time to charge manually the user information of the identities from the HR applications o database.

As example, this is the flow to shows how the "Customizable fixed-columns file v2.0" works.

Basic

Generic parameters

After the installation of the addon, you may create and configure agent instances.

This addon has 5 available types:

Customizable fixed-columns file v2.0: it is used to charge a table where each column has a fixed number of characters.
Customizable CSV file: it is used to charge a standard CSV file (comma-separated values), where all the columns are separated by a comma.
CSV file test agent.
Dummy password agent.
Test.

To configure this CSV plugin, you could select one of the previous agent in the attribute "Type" of the generic parameters section in the agents page configuration.

For more information about how you may configure the generic parameters of the agent, see the following link: Agents configuration

Custom parameters

The main parameters for this connectors are:

Customizable fixed-columns file v2.0

Parameter	Description
Enable debug	Two options: [ Yes / No ]. When it is enabled more log traces are printed in the Synchronization Server log
Character set (utf-8)	Charset used to load files. Despite it in uncommon, multi-byte character sets, as UTF-8, are allowed. Nevertheless, single byte character sets as ISO-8859-1 are recommended

Customizable CSV file

Parameter	Description
Enable debug	Two options: [ Yes / No ]. When it is enabled more log traces are printed in the Synchronization Server log

CSV file test agent

Parameter	Description
User's file	Directory where the CSV file is placed

Dummy password agent

Parameter	Description
Dummy Password	Dummy Password

Test

Parameter	Description
CSV file	Path of the CSV file

Attribute mapping

Only the "Customizable fixed-columns file v2.0" and the "Customizable CSV file" agents have this functionality implemented.

Properties

Customizable fixed-columns file v2.0

This agent requires two properties:

Property	Description
file	Path where the file is placed in the directory system
recordSize	Total number of characters of the rows. This property must have a number value. The file will be split into records of this size in bytes. Mind the record size must include any line terminator character as "carriage return" or "line feed".

Property

Description

file

Path where the file is placed in the directory system

recordSize

Total number of characters of the rows.

This property must have a number value.

The file will be split into records of this size in bytes. Mind the record size must include any line terminator character as "carriage return" or "line feed".

And after that you must specify the number of rows of every row as follow:

Property	Description
N-M	Where N is the position of the first character and M the position of the last character, both included. Column numbers start with 1 (not 0). And for instance, if the property is defined as "1-10" with the value "NAME", Soffid will extract characters from columns 1 to 10 (both inclusive) into a field named NAME in Soffid.

Property

Description

N-M

Where N is the position of the first character and M the position of the last character, both included.

Column numbers start with 1 (not 0).

And for instance, if the property is defined as "1-10" with the value "NAME", Soffid will extract characters from columns 1 to 10 (both inclusive) into a field named NAME in Soffid.

For instance for this file:

abernal   Antonio        Bernal         world      YES
jwayne2   John           Wayne          world      YES

These are its properties:

Customizable CSV file

This agent only needs the next properties:

Property	Description
file	Mandatory: Path where the file is placed in the directory system
key	Mandatory: The field to be used as key

Attributes

Customizable fixed-columns file v2.0

The mapping in only available for USER object.

Now we could map the system attribute defined as property values agains Soffid attributes, for instance:

System attribute	Soffid attribute
USER	userName
FIRSTNAME	firstName
LASTNAME	lastName
GROUPNAME	primaryGroup
ACTIVE.equals("YES")	active

For instance:

For more information about how you may configure attribute mapping, see the following link: Soffid Attribute Mapping Reference

Customizable CSV file

The mapping in only available for USER object.

The first row of the file must include the name of the attribute.

USER,FIRSTNAME,LASTNAME,GROUPNAME,ACTIVE
abernal,Antonio,Bernal,world,YES
jwayne2,John,Wayne, world,YES

Now we could map the system attribute (file) with the Soffid attributes, for instance:

System attribute	Soffid attribute
USER	userName
FIRSTNAME	firstName
LASTNAME	lastName
GROUPNAME	primaryGroup
ACTIVE.equals("YES")	active

Load Triggers

You can define BeanShell scripts that will be triggered when data is loaded into Soffid (incoming triggers). The trigger result will be a boolean value, true to continue or false to stop.

Triggers can be used to validate or perform a specific action just before performing an operation or just after performing an operation into Soffid objects.

To view some examples, visit the Incoming triggers examples page.

Account metadata

Accounts are default objects in Soffid. Agents allow you to create additional custom data, on the "Account metadata" tab, to customize the accounts created only for that agent.

The attributes which you define here, will be shown when you click on the proper account, on the Accounts Tabs at user page.

At this tab you could add or delete custom attributes. You can visit the Metadata page for more information about the standard attributes.

Operational

Monitoring

After the agent configuration you could check in the monitoring page if the service is running in the Synchronization Server, please go to:

Tasks

Authoritative

If you are checked "Authorized identity source", an automatic task to load identities from the managed system to Soffid is available, please go to

And you will something like "Import authoritative data from <AGENT_NAME>".

Reconcile

If your are configured the "Attribute Mapping" tab with some of our objects: "user", an automatic task to synchronize these objects from the managed system to Soffid is available, please go to:

And you will do something like "Reconcile all accounts from <AGENT_NAME>".

Synchronization

Regarding the synchronization of the objects, there are two possible options:

If you are checked the generic attribute "Read Only" in the "Basics" tab, only the changes in the managed systems will be updated in Soffid. We recommend these options until the global configuration of Soffid will be tested.
If you are not checked the generic attribute "Read Only" in the "Basics" tab, all the changes in Soffid or the managed system will be updated in the other. Note that this synchronization must be configured in the "Attribute mapping" tab correctly.

For more information about how you may configure the generic parameters of the agent, see the following link: Agents configuration

Customizable CSV file (CSV Connector type)

Introduction

Description

The CSV connector type allows users to load a collection of data stored into a plain CSV file.

In the following page, the process to complete the CSV connector setup will be explained.

To begin with, address to the quick start section.

Quick start

The core of Customizable CSV file connector is located under the 'Attribute Mapping' tab.

There are two important sections:

Property

File information related configuration.

Property	Description
file	Mandatory: Path where the file is placed in the directory system
key	Mandatory: The field to be used as key

System attribute

Mapping between CSV fields and Soffid objects.

Taking a look to the configuration used, we can see that:

System objects is the entity to load (user, account, group, role).
System attributes fields match the columns defined into the 'file.csv'.

To demonstrate Soffid flexibility in terms of agent customization, notice that:

USERNAME, NAME, LASTNAME fields, correspond to default fields from User object.

NDI is a custom field defined into the User object.

"I" is a 'char' literal that indicates the UserType.

Soffid attributes match Soffid specification model object.

Example

Type	File
data (file used in this configuration guide)	file.csv
attribute-mapping (file used in this configuration guide)	csv-agent-config.xml

Useful information

System objects
User
Account
Group
Role