0

I have an package where i load csv source files into table. I have two typs of source files, employee and employeedetails.

  1. For example Employee csv file has 4 columns eid, ename, designation, age.

  2. Employeedetails csv file has 6 columns eid, ename, designation, age, depatname, deptid.

  3. My destination table has eid, ename, designation, age, depatname, deptid.

Now, i want to load this 2 files based on file type variable in my Variables collection. I have completed that part also.

So instead of using 2 Dataflow tasks, i used only one. My DFT has following transformations inside it.

RawFileSource
|
Derived column Transformation
|
Oledb Destination table

In Control Flow i have used Execute Package Task whcih calls Child package when i give filetype as Employee, it runs Employee Package where it takes employee CSV file and loads it into rawfile destination.

If i select File type as Employeedetails, it runs EmployeeDetails Package where it takes employeeDetails CSV file and loads it into rawfile destination.

now i take this raw file and need to load it into destination table. Foe one file am able to load, when i load the second file be it either Employee file or EmployeeDetails file, metadata problem occurs.

Because of this i need to go to Package and change each and every transformation.

I tried keeping validate External Meta data value to false for all the transformations and at package level also.

How to over come this problem and load my two files.

user1348424
  • 699
  • 4
  • 14
  • 26
  • Take a peek at my answer on http://stackoverflow.com/questions/10686785/ssis-pkg-with-flat-file-connection-with-fewer-columns-will-fail/10696025#10696025 I think you're running into the same problem – billinkc Jun 04 '12 at 14:27

1 Answers1

0

Since the two files have different columns, you need two data flows. You could have a step in the control flow that choses the correct one based on the filename you send in as a varaiable.

But since the details file has all the columns of the employees file, why don't you just process that one and ignore the other?

HLGEM
  • 91,883
  • 14
  • 110
  • 181
  • hi, Both the input files data varies. So i cant ignore any of the file. Any way i'll try using that 2 dfts approach. But if i use 2 DFT's i load data into RAw File deatination and where up on i load it into destination table. i think there also metadata prob occurs. – user1348424 Jun 04 '12 at 14:22