After setting up the environment, it is now time to simulate the beer ratings flowing in. As explained, I will start off several generators simultaneously. To generate some (intended) data skew away from the average, several generators will have the same structural event definition, however they will be different in the combination of users, beers and ratings upper and lower bounds. Of course this is also based on my personal preference – who said my demonstration scenario should be fair?
In this blog, I am going to zoom into KSQL and the opportunities it offers for manipulating streaming data in Kafka, by merely using SQL-like statements. One of the neat things about the Confluent Kafka platform, is that it provides additional utilities on top of the core Kafka tools. One of these utilities is the ksql-datagen, which allows users to generate random data based on a simple schema definition in Apache Avro.
For a long time I have been interested in Apache Kafka and its applications. Unfortunately, forced by circumstances, work and other personal endevours, I had not been able to really dive deeper into the matters until Spring 2019. In April I have finally finished the Udemy course “Apache Kafka for Beginners“.
At work, my exposure to Kafka had only been limited, as we were (ultimately) publishing messages onto a Kafka topic using Oracle Service Bus. However, this was actually a Java-built integration, as we wer just pushing the messages onto a JMS queue, which had a MDB listening that propagated the messages to the Kafka cluster.
After completing the first training I got interested, especially in the role of Kafka in real-time event systems and I decided to take another course on Kafka Streams. I was a bit disappointed that this specific course focussed on the Java development quite heavily, and as an exception I decided to abandon the course uncompleted. During one of the Kafka Meetups, I found out that Confluent was actually offering a very interesting alternative to programming the Kafka Streams API in Java, viz. KSQL.
Charles Darwin zei het al: “It is not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is most adaptable to change”. Zo is het ook voor bedrijven noodzakelijk om (ICT) processen continu te verbeteren om de dienstverlening optimaal te kunnen blijven aansluiten op de steeds sneller veranderende wereld.
Willem de JongDe uitdagingen van de Agile transformatie
Dennis is 22 jaar oud en werkt nu sinds een paar maanden bij SynTouch. Dennis koos na zijn opleiding International Business Administration voor IT. Hij begon met een IT traineeship, daarna is hij het SynTouch-team komen versterken. Vandaag bezoek ik hem om te kijken hoe zijn werk als consultant bevalt!
“Data and Analytics Programs Will Become Mission-Critical for all Businesses”, gaf Gartner al aan, terwijl Forrester stelt dat “Your Business Is Only As Fast As Your Data”. Data wordt door succesvolle bedrijven meer dan ooit beschouwd als een strategische asset, een noodzaak om het tijdperk van digitale transformatie te overleven.
Harald van der WeelVergroot de waarde van uw data (Data Value Chain)
Data is Increasingly acknowledged as a strategic asset. It is required by organization to survive in a world that cries for agility, transparency and the power to act. Data Virtualization (DV) and API Management (AM) are two technologies that respond to this need. Therefore, they are in the spotlights today. Both DV and AM aim to provide you an effective, efficient, and controlled access to your data.
Harald van der WeelData Virtualization + API management: A powerful couple in the data era!
Wij kunnen de afronding van het eerste Mule 4 project voor één van onze eindklanten bijschrijven op de lijst van succesvolle implementaties. Mule 4 is de nieuwste en meest geavanceerde versie van de runtime engine van MuleSoft’s Anypoint Platform.
One of my hobbies is photography and when I bought my first camera it was a compact camera. I soon realized and experienced that I needed a reflex camera (SLR), because the resolution, speed and quality was far more better. I did not realize it until I really used the product. The again after a few years I noticed that I did not use my camera a lot. Why was that? Because the camera was pretty big and unpractical to take with me all the time. Then I read about a system camera, which has the advantage of being small, but still has the possibility to switch lenses. I never regretted my choices, because at the time it seemed to be the best choice. Today there are a lot of camera’s with lots of possibilities and specifications. Which one to pick? This depends on a lot of factors. What do you want to photograph with the camera. What type of photographs do you want to take, for example portret-, landscape-, sport- or street photography.
Roger van de Kimmenade9 items to consider when selecting an API Manager
Als je werkzaam bent in de ICT, dan heb je vast gehoord van het CAP-theorema: voor een gedistribueerd systeem is het onmogelijk om tegelijk te voldoen aan alle drie de aspecten Consistency, Availability en Partition Tolerance.