What is SmartLoader

SmartLoader is an ETL Component designed to simplify the loading of plain CSV files into a database. It has advanced capabilities that includes analyzing the input file(s) structure and generating corresponding configuration scripts to be used for loading the data into a database. It also supports the Groovy scripting language that lets you implement a wide range of data transformations. It is a must-have in environments that require FAST and SCALABLE loading of CSV files.

Features

  • Parsing and loading of plain CSV files into a database

  • Automatic creation of destination table if it does not exist

  • Auditing of loaded files via generating detailed data loading logs

  • Automatic archiving loaded files

  • Identification and placement of rejected files into a separate folder

  • Advanced file parsing capability for files with same content but different filenames

  • Setting of data loading speed

  • Support for Groovy scripting language for advanced data transformations

  • Support for data loading into Vertica and MySQL databases (support for additional databases being added)

  • Run component as needed or schedule it for regular execution intervals