Sample Header Ad - 728x90

Import CSV or JSON file into DynamoDB

7 votes
4 answers
34144 views
I have 1000 CSV files. Each CSV file is between 1 and 500 MB and is formatted the same way (i.e. same column order). I have a header file for column headers, which match my DynamoDB table's column names. I need to import those files into a DynamoDB table. What's the best way / tool to do so? I can concatenate those CSV files into a single giant file (I'd rather avoid to though), or convert them into JSON if needed. I am aware of the existence of [BatchWriteItem](http://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_BatchWriteItem.html) so I guess a good solution would involve batch writing. ---------- Example: - The DynamoDB table has two columns: first_name, last_name - The header file only contains: first_name,last_name - One CSV file looks like : John,Doe Bob,Smith Alice,Lee Foo,Bar
Asked by Franck Dernoncourt (2093 rep)
Feb 14, 2015, 10:46 PM
Last activity: Feb 6, 2019, 10:52 PM