Elasticsearch updates and a new Hadoop - NewsBits


Welcome to NewsBits where you'll find the database, cloud, and developer news from around the net for the week ending December 15th 2017

And now, those NewsBits in full:

Database Bits

Elasticsearch - Version 6.1 of Elasticsearch is now available from Elastic. New features include an index splitting API and a new pageable composite aggregation function so you can return all the results from a query and work your way through them page by page.

The biggest updates though seem to be for Kibana - the 6.1 release has new input controls for dashboards, a homepage, cross-cluster search monitoring support, new visualizations, labels for piecharts and more.

Apache Hadoop - Less a singular project and more a huge ecosystem, Hadoop is found in many big data projects, and now it's GA time for Hadoop 3.0.0. The changes include a bump for required Java version (now Java 8), HDFS erasure coding to save space, a rewrite for all Hadoops shell scripting and a preview of a new more scalable and reliable YARN Timeline.

Indexes as models - In The Case for Learned Index Structures, the MIT and Google authors put forward the concept of using models instead of indexes to locate stored data. It argues that real-world access patterns could make the learned model more efficient than the general purpose B-tree index and then delves into some experimentation around that idea.

The early results are promising - expect plenty of research into this in the future as machine learning hardware becomes more integrated into general purpose computing.

pgBackRest - pgBackRest, the backup utility for PostgreSQL, has a new release out. The new version 1.26 adds the ability to encrypt your backup repositories and comes at the end of a year of solid improvements such as S3 bucket support, multi-threaded asynchronous archiving and backup standby support.

Security Bits

TLS ROBOT - It's an old flaw with a new twist and a website and logo - say hello to the ROBOT (Return of Bleichenbacher's Oracle Threat). It turns out that an old vulnerability from 1998 still has legs partly because the countermeasures in subsequent versions of TLS were "incredibly complex".

It's no Heartbleed because to exploit it you need to do hundreds of thousands of connections to reveal data but it is an important issue. The final question on the web page shows how hard it was to classify:

That Question

Developer Bits

W3C HTML 5.2 - Here's the latest version of the W3C's HTML 5.2, now a W3C recommendation. The changes include additions like a new <dialog> element and support for ECMA-262's JavaScript modules and the removal of keygen, menu and menuitem elements. This is, though, a W3C snapshot of the "living standard" HTML at WHATWG who are still rather scathing about the W3C's work.

JSON - "I think this is the last specification of JSON that anyone will ever publish" says Tim Bray in a blog post about RFC 8259. Bray edited the RFC which basically takes current JSON specifications and says JSON must be encoded in UTF-8 (with an exception if you are in a closed ecosystem). Developers should note, if you're building a REST API or similar, Bray recommends RFC7493 instead - same syntax but more rules to avoid "legal-but-dumbass things".

VS Code - The latest update to Microsoft's VS Code has arrived. Amongst the improved performance, diagnostics, Intellisense and tab layout enhancements, our favourite addition is that you can now pipe output from the command line straight into the editor.

And finally, how about a story that combines the latest in WebAssembly and Rust with the old school charm of the CHIP-8 interpreter and ends up running ROMs in your browser.

NewsBits. News in bits, every Friday at Compose.

Read more articles about Compose databases - use our Curated Collections Guide for articles on each database type. If you have any feedback about this or any other Compose article, drop the Compose Articles team a line at articles@compose.com. We're happy to hear from you.

attribution Raphael Schaller

Dj Walker-Morgan
Dj Walker-Morgan is Compose's resident Content Curator, and has been both a developer and writer since Apples came in II flavors and Commodores had Pets. Love this article? Head over to Dj Walker-Morgan’s author page to keep reading.

Conquer the Data Layer

Spend your time developing apps, not managing databases.