Spring Cloud Data Flow (SCDF)

Tags:

What Is Spring Cloud Data Flow (SCDF)?

Spring Cloud Data Flow is a microservice-based toolkit for building streaming and batch data-processing pipelines on Cloud Foundry and Kubernetes.

SCDF Features

  • Provides various interfaces, including a web dashboard, REST API, Java DSL, and console shell
  • Can be installed and operated locally, on Cloud Foundry, and on Kubernetes
  • Scheduling is available only on Cloud Foundry and Kubernetes, not on general-purpose servers
  • Manages SCDF state and data in a relational database
  • Uses H2 by default, but because data is reset when the application runs, production environments should connect a relational database such as MySQL or MariaDB
  • Supports H2, HSQLDB, MySQL, Oracle, PostgreSQL, DB2, and SQL Server

Official Documentation