I've come across a very odd bug. SSIS for each loop is loading 30 + files from various directories. File volumes vary from 1 record to over 2 million records. The load table had been configured correctly to map to the file format given but I changed this - VARCHAR (100) for all fields which is way in excess of needs. Error output has been set to ignore on error and truncation. Duplicate records bar date stamp see one record load and the other fail. The underlying table has no constraints etc.
Any ideas - have in been at work too long????? Its driving me slightly mad.