Streaming data ingestion using Amazon MSK
Apache Kafka is a very popular open source distributed event streaming platform. For years now, organizations of all kinds have been using Kafka to power their event-driven systems. Kafka provides low sub-second latency and is a highly scalable framework.
One downside of using this open source framework is that you have to set up, manage, and operationalize production-grade infrastructure. This means making sure the system is highly resilient and scalable, is always patched with software updates, has all the bells and whistles, such as logging, monitoring, and notification setup, and, of course, is performant and cost-effective. Doing all this is sometimes error-prone and complex to manage.
In the era of cloud computing, organizations want all the advantages of Kafka but don’t want to deal with managing all the infrastructure behind the scenes. This is where Amazon Managed Streaming (MSK) for Apache Kafka comes to the rescue. MSK...