What is SmartLoader
SmartLoader is an ETL Component designed to simplify the loading of plain CSV files into a database. It has advanced capabilities that includes analyzing the input file(s) structure and generating corresponding configuration scripts to be used for loading the data into a database. It also supports the Groovy scripting language that lets you implement a wide range of data transformations. It is a must-have in environments that require FAST and SCALABLE loading of CSV files.
Features
Parsing and loading of plain CSV files into a database
Automatic creation of destination table if it does not exist
Auditing of loaded files via generating detailed data loading logs
Automatic archiving loaded files
Identification and placement of rejected files into a separate folder
Advanced file parsing capability for files with same content but different filenames
Setting of data loading speed
Support for Groovy scripting language for advanced data transformations
Support for data loading into Vertica and MySQL databases (support for additional databases being added)
Run component as needed or schedule it for regular execution intervals