Welcome to GWDG CDSTAR

CDSTAR is a headless repository service and data management framework for research data applications. It provides scalable storage, publishing, archiving and search via a simple RESTful HTTP API and enables the rapid development of highly customized tools and workflows for data-heavy applications.

Support Download Documentation Source code

Overview

CDSTAR provides scalable storage, fine grained access control, full-text and meta-data search, LTA integration and much more. A solid and flexible foundation for developing custom repositories, publishing platforms, virtual research environments, long-term archives and other data management applications.

Headless data repository

CDSTAR is designed as a backing web-service, providing functionality to other command-line, desktop- or web-applications via stable and flexible APIs. This headless approach gives application developers maximum control and enables the rapid development of highly customized and specialized solutions, powered by CDSTAR.

Features

  • Scalable storage: There is no artificial limit on file size or number of packages. CDSTAR scales effortlessly to millions of packages and huge amounts of data.
  • Fine grained access control: Permissions can be defined per package, or globally for all packages of a vault via LDAP or other pluggable identity providers.
  • Strong Consistency: Execute complex workflows with high confidence thanks to fully isolated ACID transactions, revision history and audit logs. All operations are atomic and synchronized with the backing storage by default.
  • Search: CDSTAR integrates with elasticsearch to allow near real-time search, both full-text and for specific meta-data attributes. Other targets (e.g. databases or caches) or custom background tasks can be integrated via message-passing protocols.
  • Long term archiving: CDSTAR integrates with Koala and other long term storage systems to archive or recover individual packages based on automated policy rules or user request.

Open Source

GWDG CDSTAR is Apache 2.0 licensed and can be used free of charge. In addition, GWDG offers professional support and hosting for its customers.

Resources

Documentation, source packages and binary distributions are available for all supported releases as well as the nightly SNAPSHOT release.

Snapshot (nightly, unstable) Client libraries and tools (third party)

Demo Instance

We provide a demo instance at https://cdstar.gwdg.de/demo/ (login: test password: test) for quick tests or as a playground for new developers. The instance is reset and all data is removed ever night. If you need a more stable or private test instance, please contact us.