Jump to
Product Updates
v24.45 v24.40 v24.36 v24.27 v24.23 v24.17 v24.13 v24.09 v24.05 v24.01 v23.48 v23.44 v23.39 v23.31 v23.27 v23.27.1 v23.24 v23.19 v23.19.1 v23.14 v23.14.1 v23.12 v23.10 v23.08 v23.06 v23.04 v23.02 v22.52 v22.50 v22.48 v22.46 v22.44 v22.42 v22.40 v22.38 v22.36 v22.34 v22.32 v22.30 v22.28 v22.26 v22.24 v22.22 v22.20 v22.18.1 v22.16 v22.14 v22.12 v22.10 v22.08 v22.06 v22.04 v22.02 v21.51 v21.49 v21.47 v21.45 v21.43 v21.41 v21.39 v21.37 v21.35 v21.33 v21.31 v21.27 v21.23 v21.19 v21.14 v21.10 v21.06 v21.02 v20.51 v20.47 v20.43 v20.39 v20.35 v20.31 v20.27 v20.19 v20.15 v20.11 v20.07 v20.03
Updated on

Product Update - v20.23

Details of the product update v20.23 from 4th of June 2020.

Features

We are happy to announce that our Executions and Logs pages graduated from the beta stage to a full production. Thank you for all early adopters who provided the valuable feedback. With your help we improved these pages immensely.

Topics UI

Introducing UI for publish-subscribe (pub-sub) messaging pattern to compliment the pub-sub API endpoints already introduced last month. Using the new Topics UI you can create and modify the topics. The UI is accessible from the main navigation > Integrate sub-section.

Topics section

We have a dedicated page you can dive in to read more and start using the Topics feature in your integration patterns.

To help implement pub-sub pattern we have a dedicated pub-sub component which we recommend to use to along with the Topics feature.

Flow Message Queue UI

You have heard from us talking about how many messages were processed and how many still in the messaging queue. This information was always hidden from you under the wraps. Not anymore!

We introduce the new feature called Flow Message Queue. You can now see number of messages in the queue for each of your flow steps. To access navigate to Executions, select any active execution and look for the Flow Queues menu link along with the Download Logs and View Flow links like in the picture below.

Flow Queues Menu

Click on link to navigate to a special page showing the current queue of this flow to see how many messages are in each flow-step of your integration flow.

Flow Queues Menu

You can access the Flow Queues page from the Flow Designer and Flow-card menu of general Flows page. However, the Flow Queues are only available for actively running flows.

You can also access the queue information using the /v2/stats/queues/FLOW_ID API endpoint. More information is available from the API reference documentation.

Java Sailor Update

We are releasing a new version of JAVA Sailor 3.1.0 which support a dynamic flow control. More information is available from the io.elastic:sailor-jvm documentation pages.

Secrets Management Service for OAuth

Introducing a new centralised service to handle the secrets and OAuth credentials. We aim to replace the credential handling mechanism in the whole platform.

Please Note: The service is still in early implementation and experimentation stage and it is not implemented on any currently released components.

This new service aims to solve the problem of outdated and invalid secrets/tokens. Here is the general approach for future component developments:

  1. Refreshing secrets/tokens are handled by the platform.
  2. Component can not and MUST not try to refresh token by itself, it should ask platform to do so.
  3. Component MUST ask platform for a valid value of secret every time it needs it. Caching is not recommended.
  4. When using this new service you MUST NOT use this.emit('updateKeys') mechanism.
  5. The this.emit('updateKeys') mechanism would still continue to co-exist until the deprecation of Credentials mechanism. It is still OK to use it for refreshing the Credentials.
  6. You MUST NOT use both Secrets and Credentials mechanisms at the same time in the same component.

Improvements

Mapper fixed version

The mapper component now adheres the general approach of fixed components. The version of the component is fixed when you save the flow draft. To use a newer version of the mapper component in your integration flow you must create a new draft of your flow and publish it again.

Node.js Sailor 2.6.10 release

The new Node.js Sailor 2.6.10 is available. It adds support for the dynamic flow control in the return promise interface in the Node.js Sailor. An update of components using this interface and hoping to dynamically control the flow messaging queues is highly recommended.

Fixed Bugs

  • Fixes the problem when the dynamic metadata reloaded often during the flow-step configuration.
  • Fixes the problem when after series of random navigation through the flow-step design an error Something technically Wrong would appear making the flow in-recoverable.
  • Addresses the problem when by navigating forward and backwards without saving, in the flow-step design an error Something technically Wrong would appear making the flow in-recoverable.
  • Fixes the problem when the error retry in the executions page kept showing after a successful retry.

Components

MongoDB Component

Introducing a new integration component for MongoDB interaction. Only action functions are available. This means component can not be used in the first step of integration flows. The component uses the new Node.js Sailor 2.6.7.

  • NEW - introducing action Aggregate which calculates the aggregate values for the data in a collection or a view.
  • NEW - introducing action Bulk Write which takes an array of write operations and executes each of them.
  • NEW - introducing action Delete By ID which deletes document by ID.
  • NEW - introducing action Delete By Unique Criteria which deletes document by a Unique Criteria.
  • NEW - introducing action Lookup By ID which performs a lookup of document by ID.
  • NEW - introducing action Lookup By Unique Criteria which performs lookup (at most 1) Document By Unique Criteria.
  • NEW - introducing action Lookup Plural which performs lookup of many documents by a criteria.
  • NEW - introducing action Upsert By ID which upserts document by ID.
  • NEW - introducing action Update Many which updates documents in a collection.
  • NEW - introducing action Upsert By Unique Criteria which upserts document by a Unique Criteria.
  • IMPROVED - added the help-links to all the descriptions of the component.

Marketo component

  • NEW - introducing action Lookup Object (at most 1) which performs lookup of one object.
  • NEW - introducing action Delete Object By Unique Criteria which deletes an object by Unique Criteria.
  • UPDATED - updated Sailor version to 2.6.7 to support dynamic flow control.

Filter component

  • UPDATED - updated Sailor version to 2.6.7 to support dynamic flow control.
  • IMPROVED - added JSONata expression when error is thrown by assertion for better debugging.
  • IMPROVED - added the incoming message when filter condition is true.
  • FIXED - the bug causing the message Cannot read property info of undefined.

Google Spreadsheet component

  • IMPROVED - dynamic created fields based on sheets schema are now used in Create/Add spreadsheet row action.

SFTP component

  • NEW - introducing action Move File on SFTP.
  • UPDATED - updated Sailor version to 2.6.7 to support dynamic flow control.
  • FIXED - the bug when the Lookup Files action tries to download many files.

AWS S3 component

  • NEW - introducing action Upsert S3 Object (aka File) by Key (aka ID/Filename).
  • UPDATED - updated Sailor version to 2.6.7 to support dynamic flow control.

Pub-Sub component

  • IMPROVED - added the help-links to all the descriptions of the component.
  • UPDATED - updated Sailor version to 2.6.7 to support dynamic flow control.
  • FIXED - the issue when by changing the topic had no real effect.
  • FIXED - the problem with the dynamic select model and dynamic metadata.
  • FIXED - the issue when the Property ID was shown instead of the name in the metadata dropdown for trigger and action.

Updated Sailor version to 2.6.7

For the following list of components only the Sailor version was updated to 2.6.7 to support dynamic flow control: