SSIS upsert from CSV File Source
2
votes
2
answers
941
views
I'm trying to determine the most effect way to do an upsert in SSIS with CSV source 100+ columns
1 x CSV Source (loop through multiple CSVs same structure 100 + columns)
1 x Staging Table Destination
I have come up with 3 approaches:
1. Using the SSIS lookup component, if record doesn't exist insert otherwise call some SQL script to do the update (row by row) so could be slow.
2. Calling a stored procedure with a merge statement, so CSV to stored procedure (will be row by row) so slow. Also there will 100+ params
3. Using another staging table that gets cleaned out before insert..Then calling a stored procedure to merge the 2 staging tables
I'm leaning towards approach #3 as it's the simplest and cleanest.
Thoughts?
Asked by davey
(679 rep)
Mar 17, 2017, 09:40 AM
Last activity: Mar 19, 2025, 10:01 PM
Last activity: Mar 19, 2025, 10:01 PM