Turn Small Data Into Smart Data. Part 2: ETL with NodeJS and ES6 Promises


This is the second of a three part series focused on an open source tool chain for small data business intelligence. Part 1 explored dimensional modeling from a logical and use case perspective.

Part 2 focuses on Extract, Transform and Load with NodeJS. While it may be out of the ordinary to use Node for batch style processing, the use of Node's newly builtin ES6 Promise support works well for the scale of this project. Plus it highlights a fitting use of Promises in general.

Part 3 will use gnuplot for visualizations. All three together represent a complete small data business intelligence solution from design to implementation to visualization.


Conquer the Data Layer

Spend your time developing apps, not managing databases.