Monitoring Amazon Kinesis Information Streams | by Ross Rhodes | Sep, 2024

Exploring observability choices and suggesting enhancements

Launched in November 2013, Kinesis is a managed Amazon Net Providers (AWS) answer for real-time processing and analytics of streaming knowledge. Kinesis gives a pair totally different streaming providers:

  • Information Streams to course of knowledge information with out managing servers.
  • Video Streams to seize and retailer media streams, e.g. for playback.

There may be already an abundance of documentation on-line which dives into the workings of Kinesis. Amazon’s personal documentation could be reference to start with. On this weblog publish, we are going to concentrate on Kinesis Information Streams monitoring, following the same format to my earlier publish about EventBridge Guidelines.

Photograph by Rob Laughter through Unsplash.

We’ll begin with an outline concerning how Kinesis metrics work earlier than masking present Information Stream metric choices of notable curiosity. The place relevant, we are going to pay attention to their limitations. We’ll then end with steered steps that may add buyer worth to Information Stream observability.

Like different AWS providers, Kinesis gives CloudWatch metrics to watch Information Stream efficiency. Two ranges of metrics can be found: stream stage and shard stage. For…