• Category Archives: karafka framework

Karafka (Ruby + Kafka framework) 0.5.0 release details

I’m proud to announce that we’ve released a new shiny version of Karafka: Framework used to simplify Apache Kafka based Ruby applications development. In this article I will cover all the important changes and new features that you will be able to use. Karafka? But what is it? Karafka provides a higher-level abstraction than raw […]

Read more at the source

Dry-Configurable lazy evaluated default settings

Dry-configurable is  a simple mixin to make Ruby classes configurable. It is quite nice, uses Struct and allows you to have default values. Unfortunately, it does not support (yet hopefully) default values that are evaluated upon each setting key request. When would that be useful? Let’s take a simple example: Kafka + Zookeeper. Zookeeper stores […]

Read more at the source

Ruby: Karafka framework 0.4 – Routing engine

We’ve finally released a new version of Karafka framework. Apart from many tweaks and bug fixes it contains three huge improvements: ApplicationWorker and ApplicationController Routing engine Offset commit after data processing (not only after fetching) In this article I will focus on the routing engine. Pre-routing times First version of Karafka framework routed incoming messages […]

Read more at the source

Benchmarking Karafka – how does it handle multiple TCP connections

Recently I’ve released a Ruby Apache Kafka microframework, however I don’t expect anyone to use it without at least a bit information on what it can do. Here are some measurements that I took. How Karafka handles multiple TCP connections Since listening to multiple topics require multiple TCP connections it is pretty obvious that in […]

Read more at the source

Karafka – Ruby micro-framework for building Apache Kafka message-based applications

What is Karafka? Karafka is a microframework used to simplify Apache Kafka based Ruby applications development. Up until now there was only a sending library called Poseidon and its extension called Poseidon Cluster that could be used to work with Kafka clusters. Unfortunately there was no Sinatra “like” framework to rapidly develop message based applications. […]

Read more at the source