Turn Small Data Into Smart Data. Part 2: ETL with NodeJS and ES6 Promises
PublishedThis is the second of a three part series focused on an open source tool chain for small data business intelligence. Part 1 explored dimensional modeling from a logical and use case perspective.
Part 2 focuses on Extract, Transform and Load with NodeJS. While it may be out of the ordinary to use Node for batch style processing, the use of Node's newly builtin ES6 Promise support works well for the scale of this project. Plus it highlights a fitting use of Promises in general.
Part 3 will use gnuplot for visualizations. All three together represent a complete small data business intelligence solution from design to implementation to visualization.
Some Relevant Links
- See the Code on github
- Turn Small Data Into Smart Data. Part 1: The Star Schema
- NodeJS ES6 Support listing.
- Wistia for hosting videos plus the stats.
- Google's Timezone API for turning lat, lon into an offset from UTC.
- MassiveJS a PostgreSQL data access tool