6/11/2023 0 Comments Insurmountable supportSynchronously: where the output of your function is returned to you in the HTTP response.With AWS Lambda, you upload your function code, and then invoke your functions one of two ways: To illustrate queue-based systems in this article, I touch on how two AWS services work under the hood: AWS Lambda, a service that executes your code in response to events without you having worry about the infrastructure that it runs on and AWS IoT Core, a managed service that lets connected devices easily and securely interact with cloud applications and other devices. In the first half, I describe scenarios that lead to backlogs, and in the second half, I describe many approaches used at Amazon to avoid backlogs or deal with them gracefully. Most importantly, I describe how to prevent queue backlogs from building up in the first place. In this article, I discuss strategies we use at Amazon to deal with queue backlog scenarios – design approaches we take to drain queues quickly and to prioritize workloads. It’s only when the queue is backlogged, when the line to an event goes out the door and around the corner,that people start thinking about throughput and prioritization. After all, when a queue is short, everyone is happy. In queueing theory, the behavior of queues when they are short is relatively uninteresting. Working in parallel with so many other people, I found it beautiful to be a part of what is essentially an amazingly orchestrated physical merge sort. I was guided by an algorithm, picking items off of shelves, moving items from one box into another, moving bins around. Over a decade ago, I spent a day working in an Amazon fulfillment center. I’ve found that being bored while standing in lines provides great opportunities to ponder queueing theory. I especially do this when I’m stuck in a line, like in the grocery store, in traffic, or at the airport. When we think about some of the things that happen in the real world, we can come up with algorithms that mimic those things. Ever since my first computer science course in college, I’ve been interested in how algorithms play out in the real world.
0 Comments
Leave a Reply. |