WePay talks with Confluent about Apache Kafka
WePay’s infrastructure relies on a great deal of robust engineering to support the huge number of transactions we process every hour. Part of that infrastructure is based on open source frameworks. When WePay uses a framework like this it also contributes heavily to that open source community. An example is Apache Kafka®, an open-source event streaming processing platform capable of handling trillions of real-time data events a day and developed by LinkedIn.
Recently, Chris Riccomini, a Distinguished Engineer at WePay, spoke with Tim Berglund, Senior Director of Developer Experience at Confluent on an episode of the Streaming Audio podcast about Apache Kafka, hosted by Confluent titled, “Chris Riccomini on the History of Apache Kafka and Stream Processing.” In it, Chris shares how Apache Kafka® was born while he was at LinkedIn and how Kafka and the stream processing framework Samza came about. He also shares what he’s doing these days at WePay—building systems that use Kafka as a primary data store.
You can listen to the podcast episode here: https://www.buzzsprout.com/186154/1145507-chris-riccomini-on-the-history-of-apache-kafka-and-stream-processing