Throttling
Canvas includes a built in dynamic throttling mechanism to prevent a single
user from abusing the system and causing adverse effects for others. It
works by having a rate limit, and a cost for every request. Each request
subtracts from your quota, and the quota is automatically replenished over
time. In the event that your API request is throttled, you will receive
a 403 Forbidden (Rate Limit Exceeded)
response. Your application should
be prepared for this error, and retry the request at a later time.
To assist applications with planning, every request will return a
X-Request-Cost
header that is a floating point number of the amount
that request deducted from your remaining quota. If throttling is applicable
to this request, there will also be a X-Rate-Limit-Remaining
header of
your remaining quota.
Since the cost of a request is roughly based on the amount of time it takes to process, and the quota (by default) replenishes at a rate faster than real-time, any API client that makes no more than one simultaneous request is unlikely to be throttled. Parallel requests are subject to an additional pre-flight penalty to prevent a large number of incoming requests being able to bring the system down before their cost is counted against their quota. As soon as each request finishes, the pre-flight penalty is credited back to the quota, and only the actual cost of the request is counted.
For applications that go through the OAuth flow and obtain an access token for each user, each access token has its own quota, and the developer need not be concerned with requests from one user causing another user to be throttled.