Articles in transporter

Mongo to Mongo Data Moves with NiFi

There are many reasons to move or synchronize a database such as MongoDB: migrating providers, upgrading versions, duplicating for testing or staging, consolidating, and cleaning. There are even more ways to perform the function of moving said data:…

Continue reading »

Compose Notes - PostgreSQL Updating, FDW and Transporter

Compose Notes details the small enhancements and changes which make life better for Compose users. In this edition, there's a lot happening in the PostgreSQL department. Smoother version updating PostgreSQL 9.4.8 and 9.5.3 are now available on Compos…

Continue reading »

Compose's new MongoDB and what you need to know

The release of our new MongoDB deployments has brought a lot of new questions about what you need to know and why and what has changed - everything from SSL, WiredTiger, Oplogs and Importing. So we're going to answer as many of those here. How can I…

Continue reading »

Transporter Maps: MongoDB to Elasticsearch

The open source Transporter from Compose is a powerful tool and there's a lot to take in when you want to get started. With people wanting to use some particular configurations of Transporter, it is an opportune time to offer some simple recipes for…

Continue reading »

Transporter Driving 3: Restoring and Extracting

We've previously shown some examples of how to use the Compose Transporter for moving data around between databases, and how to upload files to other databases. Transporter can also be used to transform existing data into more useful formats too. For…

Continue reading »

Transporter's new namespace-aware data transfer

With the release of the latest Transporter, version 0.1.0, the authors have made quite a change to Transporter with its new namespace handling. The TL;DR version is you are now able to define the latter part of the namespace as a regular expression a…

Continue reading »

Transporter 0.1.0 Released

The latest release of Transporter, Compose's open source data transfer and replication application, brings a couple of new features, including one "big ticket" breaking change, and a number of smaller fixes as we move the development on, towards the…

Continue reading »

Transporter 0.0.4 - More control

When we released Transporter as open source, we knew it was a work in progress which we'd be evolving. Well, the first evolutionary step has just happened with version 0.0.4 of the Transporter. This update is more of a preview than a release - if yo…

Continue reading »

Transporter Driving: 2 - From DB to DB

In part one of this series, we showed how you could use the open source Transporter from Compose to move and transform data between files and databases in both directions. The next stage is to start connecting databases to each other and in the proce…

Continue reading »

Separating Collections to Improve MongoDB Measurability

There's a common implementation pattern that exists with MongoDB users – keep everything, all our collections, in the one database. It's a very odd thing to be doing though. If we had the ability to join between Mongo collections, this would make sen…

Continue reading »