Why should I use Amazon Kinesis and not SNS-SQS? When to Choose Amazon Kinesis over SNS SQS Understanding Streaming Data Needs In the world of cloud computing handling large volumes of real time data effective 2 min read 07-10-2024 5
Kinesis data stream - TRIM_HORIZON not showing recently added data Kinesis Data Streams Troubleshooting TRIM HORIZON and Missing Data Imagine you re using Amazon Kinesis Data Streams to ingest real time data You ve configured y 3 min read 13-09-2024 15
Calling Trigger once in Databricks to process Kinesis Stream Processing Kinesis Streams in Databricks The Once Trigger Conundrum Scenario You ve got a Kinesis stream flowing with valuable data and you need to process it u 3 min read 04-09-2024 16
Lease table is not updated when new shards are added causing stale workers in KCL Kinesis Client Library KCL and Stale Workers Understanding the Lease Table and Resharding When using the Amazon Kinesis Client Library KCL to process data in a 3 min read 03-09-2024 16
Kinesis Lambda Event Source Mapping Concurrent Invocation Understanding Kinesis Lambda Event Source Mapping Concurrent Invocation A Deep Dive This article explores the behavior of Kinesis Lambda Event Source Mapping co 3 min read 01-09-2024 22
Why is this Lambda function not running more concurrent executions? Why Your Lambda Function Isnt Scaling A Deep Dive into Concurrent Executions Have you ever set up a Kinesis stream and Lambda function expecting a smooth scalin 2 min read 01-09-2024 21
AWS Architecture for Splitting and streaming data to multiple 3rd party Accounts Streamlining Data Distribution Across AWS Accounts A Practical Guide This article explores effective AWS architectures for distributing data streams to multiple 3 min read 01-09-2024 11
Trigger Lambda function every 15 minutes to process Kinesis data by device ID, calculate average, and store in DB Processing Kinesis Data in 15 Minute Intervals A Serverless Approach In this article we ll dive into a common serverless architecture scenario where we need to 3 min read 31-08-2024 23
Firehose data backup add newline after every record? Firehose Data Backup Adding Newlines for Readability When using Amazon Kinesis Firehose to back up raw data in S3 you might find that the records are concatenat 2 min read 31-08-2024 14
How can I use "SchemaName.TableName" partition key in AWS DMS to migrate data to an Amazon Kinesis data stream? Mastering Partition Keys in AWS DMS for Kinesis Data Stream Migration Achieving Table Specific Sharding When migrating data to an Amazon Kinesis data stream usi 2 min read 29-08-2024 16
Improve the ingestion strategy for my IoT Sensor data Optimizing Io T Sensor Data Ingestion in AWS A Guide to Reducing Costs and Improving Efficiency Handling vast volumes of data from a growing fleet of Io T senso 3 min read 28-08-2024 20
Streaming audio to Amazon Connect through Kinesis Video Streams Streaming Audio to Amazon Connect Through Kinesis Video Streams A Practical Guide This article explores the process of streaming audio to Amazon Connect through 3 min read 28-08-2024 18