Product Demo: Spring XD
Demo of Spring XD Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export. The project's goal is to simplify the development of big data applications. Big data applications share many characteristics with Enterprise Integration and Batch applications. Spring has provided proven solutions for building integration and batch applications for more than 6 years now via the Spring Integration and Spring Batch projects. Spring XD builds upon this foundation and provides a lightweight runtime environment that is easily configured and assembled via a simple DSL. The Spring ecosystem of projects provides an excellent foundation for building big data applications. The Spring XD project aims to build upon this foundation and provide a one stop shop solution for these use-cases. This is in contrast to many other offerings that are more siloed and fragmented. One of our first features is to create an out-of-the-box server that provide a consistent configuration model and runtime that spans the four use-case categories listed above. You don't need to code anything up to get going, no build scripts, no IDE, no maven coordinates. You can use a high level configuration DSL (not XML!) that will allow you to hit your head against the keyboard and get started quickly. However, if you choose to extend the platform (and we hope you will), Spring provides the foundation for extensibility. For the curious, XD is an abbreviation for eXtreme Data. Features High throughput distributed data ingestion from a variety of input sources into big data store such as HDFS or Splunk Real-time analytics at ingestion time, e.g. gathering metrics and counting values. Workflow management via batch jobs. The jobs combine interactions with standard enterprise systems (e.g. RDBMS) as well as Hadoop operations (e.g. MapReduce, HDFS, Pig, Hive or Cascading). High throughput data export, e.g. from HDFS to a RDBMS or NoSQL database. Quick Start Requirements To get started, make sure your system has as a minimum Java JDK 6 or newer installed. Java JDK 7 is recommended. Manual Installation Download spring-xd-1.0.0.M5.zip Unzip the distribution. This will yield the installation directory spring-xd-1.0.0.M5. All the commands below are executed from this directory, so change into it before proceeding
