This content not available without scripts

YellowDog Jul-2021 Release Notes

Home >YellowDog Jul-2021 Release Notes

Component Versions

Platform:
Cell 3.3

Portal:
Platform Portal 3.3

YellowDog Platform and Portal Jul-2021

New Features and Improvements for the YellowDog Platform

Advanced Worker Pools

YellowDog now offers the ability to precisely configure your multicloud Worker Pools using a single API, specifying properties such as the number of workers to create on each node (instance) and the circumstances under which a pool will shutdown automatically. This enables you to customise your Worker Pools as required, including using custom tags (Node Types) to perform different configuration on specific nodes.

You can create and configure your Worker Pools using the object ProvisionedWorkerPool (for instances provisioned using YellowDog) or ConfiguredWorkerPool (for on-premise instances).

In addition, when creating a provisioned Worker Pool, the YellowDog Scheduler will automatically create the Compute Requirement to satisfy the pool (based on a Compute Requirement Template), so there is no longer any need to explicitly specify a Compute Requirement.

An intuitive user interface has been created in the Portal to enable easy monitoring of your Worker Pools.

Meta Scheduling

Meta Scheduling enables you to use the YellowDog scheduler to create clusters of nodes, and to configure them so that you can use your favourite third party scheduler alongside the YellowDog Scheduler to manage the running of tasks on that cluster.

The key concepts that enable this are Node Types, Node Actions and Node Events, along with Mustache templating.

Node Actions enable you to perform essential actions on one or more specified nodes. The actions currently available are:

  • Write a file to the node(s).
  • Run a command on the node(s).
  • Create workers on the node(s), either per node, per vCPU, or as a total number distributed across the specified nodes.

These can be submitted using the SDK, or defined to trigger automatically in response to changes in the Worker Pool (Node Events)such as adding new nodes. Using simple and straightforward principles such as the ability to run different Node Actions on different Node Types, and to use Mustache Template properties as arguments to your Node Actions, you can set up complex and sophisticated options for clustering and Meta Scheduling.

Source Traits in Dynamic Templates

You can now configure your Dynamic Templates to select Sources based on desired combinations of Source Traits. Source Traits are capabilities that affect the actions that can be performed on a compute requirement.

Sources may be selected or excluded based on the following traits:

  • canStopStart Whether this Source’s instances can be stopped and restarted.
  • isSelfMaintained Whether this Source is managed outside YellowDog, and therefore whether YellowDog can reprovision the supplied instances.
  • canScaleOut Whether YellowDog can request additional instances from this Source after the Compute Requirement has been provisioned.

Fixes for the YellowDog Platform

  • If the connection between the worker and the Scheduler is interrupted, the YellowDog Agent now continues retrying until it successfully reconnects.

For more information, contact YellowDog.


YellowDog Portal Jul-2021

New Features and Improvements for the YellowDog Portal

Worker Pools Visualisation

A new set of screens have been added to the Portal to enable you to monitor the Advanced Worker Pools feature. The Workers menu follows the same design principles used in the Compute and Work menus, providing a familiar environment in which to view your Worker Pools and investigate the details of individual Nodes and Workers.

Summary details of a Worker Pool

The Worker Pool Summary includes a list of the Workers, showing details such as their current status, the number of Task Groups that have claimed them, and any Node Actions currently in the queue.

The Node List

You can click on an individual Node to show further details.

Node Details

It is not currently possible to create or edit Worker Pools via the Portal. This functionality is expected to be added in a future release.

Various UX Improvements

  • A new Search facility enables you to go directly to a specific item or object. Enter a YellowDog ID in the Search box at the top of the page to view the object’s details.
  • You can open a menu in a new browser tab by CTRL-clicking on the relevant menu or icon.
  • When creating items that use credentials or images, you can now select the correct option from a dropdown.

Fixes for the YellowDog Portal

  • Sorting columns on screens such as Compute Requirements and Work Requirements now correctly sorts items across all pages.
  • When viewing an Application’s Access Delegates, Work Requirement delegates now correctly link to the Work Requirement.
  • Clicking the browser Back button when working with multiple open items now takes you back to the previous item.

For more information, contact YellowDog.

YellowDog Please upgrade your browser

You are seeing this because you are using a browser that is not supported. The YellowDog website is built using modern technology and standards. We recommend upgrading your browser with one of the following to properly view our website:

Windows Mac

Please note that this is not an exhaustive list of browsers. We also do not intend to recommend a particular manufacturer's browser over another's; only to suggest upgrading to a browser version that is compliant with current standards to give you the best and most secure browsing experience.