In our previous story we looked at how to build a modern Cloud Data Platform and which capabilities it should offer. This story puts some more flesh on the bones by describing how to actually implement a reporting use case on the Cloud Data Platform. We will look at how…

In our first story we pointed out which architectural aspects and paradigms are crucial for a sucessful data platform. The data platform described there is located on-prem and makes heavy use of the Hadoop ecosystem. However, with the advent of the public cloud, focus shifts towards designing and building data…

In our previous story we looked at the challenge of how to migrate from a Hadoop based analytics ecosystem with Impala and HDFS to GCP’s BigQuery. We tried to solve this problem with a commercial data integrator called Striim. Whilst this worked pretty well, reading data from files on HDFS…

Today everyone wants to have his needs served immediately. What is true in e-commerce and B2C, is also valid for business-people who want to receive their reports on time. In established enterprises the reality is rather different. As businesses grow, they get more data due to both additional products they…

“No app is an island Do not ask for which the Incident bell tolls May be it tolls for yours” In our previous story we’ve looked at how to implement a monitoring for an even-driven CRM architecture. We saw that using a KSQL/KStreams based approach led to a problem of…

In our last article we told the story about how to implement a scalable, event-driven based CRM archtcture. We also pointed out why monitoring it is so crucial and how to implement the monitoring. In today’s story, we want to look at the solution and its technical details. The high-level…

Imagine an important viewing event or a new product launch coming up for an entertainment or e-commerce company. After heavy advertising, legions of potential new customers are registering with the company to get the product or watch the event. And all of a sudden nothing works. These new customers can’t…

In the first of this series on how to build a data platform, Change Data Capture (CDC) was mentioned as a core part of the platform’s architecture. CDC is intended to have a non-intrusive way of retrieving data in real-time from operational system’s databases in order not to overload them…

Real-time customer journeys using Kudu Offering personalized customer journeys in order to provide an optimized customer experience is the focus of all B2C companies. Normally the contents of customer journeys get stored in a campaigns system database. If a journey is displayed to the customer a webservice retrieves the data…