Intellicus 16.3 SP1 lets you connect to Apache Spark SQL database and fetch data that has a schema similar to JSON, Hive Tables, Parquet, etc. You can create a database connection to Spark SQL and use the connection to create Query Objects. You can thereafter build reports and perform analytics.
As a continuous process of adding connectivity to diverse and modern data sources, Intellicus now provides support to connect to Apache Kafka database as a data source and fetch real-time data, build reports and perform analytics.
You can create a database connection to Kafka and use the connection to create Query Objects.
Load step under Query Object workflow loads the incoming data (after extraction and transformation) into a target system (File, Relational database, HDFS, No SQL / Columnar system etc.) to be used for further reporting needs.
With this enhancement, you can configure the output of Load step act as input to another data source or another Load step.
Intellicus 16.3 SP1 provides support for loading data from query object workflow into Hive database using the Load step.