What are good options for cloud storage of audit data? (written continuously, rarely queried)
-2
votes
1
answer
56
views
*Cross-post from StackOverflow as I expect it may get closed there because S.O is so nitpicky...*
https://stackoverflow.com/questions/63432484/what-are-good-options-for-cloud-storage-of-audit-data-written-continuously-ra
I'm working on something which wants to store a lot of "audit record" style data. Such as "user created a thing", "user deleted a thing", "user had 27 things".
We want to store it in the cloud (AWS or possibly Azure). Ideally I'd like to use a cloud-native service such that I don't have to worry about things like scaling up server instances, sharding, etc.
This kind of data is mostly a continuous stream of writes, and every so often a big "report" style query where we summarize or count a large block of data over a given date range. We need to query individual records approximately never.
The go-to for "cloud database in AWS" seems to be DynamoDB, however the pricing model, and the articles I've been reading seem to imply it is designed for more of a transactional model. Writes are an order of magnitude more expensive than reads, which is the opposite to my use case.
Those of you with deep cloud knowledge - please: What service(s) would you use for storing this kind of data and running reports on it? Is DynamoDB a bad choice here?
Asked by Orion Edwards
(107 rep)
Aug 16, 2020, 02:14 AM
Last activity: Aug 18, 2020, 05:17 AM
Last activity: Aug 18, 2020, 05:17 AM