How to load data from the record it failed to load

I am working with a DS job responsible for loading data into the dimension table. I have noticed that of the 15000 records that have to be loaded only 5000 have been loaded as the job aborted prematurely.

Is there a way to start loading data from 5001 record (without the need to drop the initial 5000 records and reload all the 15000 records)?

********

the one way you can do this is to do a lookup to the target table based on neccessay keys and load only the ones that do not find a match.

if you are inserting into the table using the "Upsert" option then you can set the environment related to the commit frequency to zero (assuming the target is Oracle) - in which case your records are only committed once the entire transaction has gone through successfully. Havent tried this yet though.

*****

we can also use "Tail stage" to get all the remaining records from 5001 to 15000 and the target is the same SeqF stage with append mode.