Dps10ReleaseNotes

From CEDPS

Jump to: navigation, search

Data Placement Service

The Data Placement Service (DPS) presents a layered architecture of reusable components. Within the DPS architecture, the Bulk Transfer Service (BuTrS) is a low-level, fundamental component for managing bulk data transfers. BuTrS is the first component of DPS to be released.

Contents

Overview

The Bulk Transfer Service (BuTrS) is a lightweight, simple, efficient utility for bulk data transfer with priorities.

  • Lightweight
    • Distributed in a single Java archive
    • Minimal third-party dependencies
    • 1-step installation (Add jar to classpath) with no configuration required
  • Simple
    • Zero administrative overhead (no containers, daemons, or databases)
    • Conventional, easy-to-use Java API (no RPC overhead)
    • Familiar callback style notification of transfer results
  • Efficient
    • Concurrent transfers on all pairwise combinations of transfer endpoints
    • Low constant overhead, linear-time algorithms for inserting, deleting, and reprioritizing bulk transfers
    • In-memory data structures to avoid database or file IO overhead

Features

Features in this BuTrS release:

  • Create bulk transfers
  • Destroy bulk transfers
  • Change priority of individual data transfer
  • Find data transfer object by (source, sink) URL pair
  • Find data transfer objects by transfer status
  • Callback notification of transfer status change
  • Supports GridFTP third-party transfers
  • Supports most GridFTP transfer options
  • Retries failed transfers up to defined maximum

Dependencies

BuTrS depends on the following components

Downloads

BuTrS is available in the following formats:

Installation

If you downloaded the Java archive, add it to your classpath and make sure the depenencies are properly installed. If you downloaded the GPT source package, you will need a recent version of Grid Packaging Tools (GPT) such as the version distributed with the Globus Toolkit 4.0.x. To install, issue the command "$GPT_LOCATION/sbin/gpt-build globus_butrs_service-0.0.tar.gz".

Interface Guide

BuTrS provides a Java API.

Architecture

For an overview of the DPS layered architecture and the BuTrS design refer to the following illustrations.

See: DPS Architecture Overview (png) (pdf)

See: BuTrS Design Overview (png) (pdf)

Personal tools