Dynamic File Names for Raw files created by conditional expressions

Hot Topic

Unable to open MSDB node
Using managedDTS in a CLR
Prevent Other Users from Changing Data of a Table
Installing SMS with SSMSE
BIDS:Precedance Constraints not visible
DTS / Export Data in Sql2005 Mgm Studio
Failed to enable constraints. One or more rows contain values violating non-null, unique, or foreign-key constraints.
ErrorColumn field from Datasource Error Output
Rsreportserver.config Smtp password settings
How to define a Left Outer Join in report using ReportModel as DataSource

SQL Server

One data source view and multiple data source
Activation proc failed
SQL Server 2005 x64: Intermittent "Error: 18456, Severity: 14, State: 10."
Changing Date
Where to build client application for SQL 2005 standard edition
SQLExpress Install fails
Report Builder percent calculation.
SSIS refresh fails
flow layout in rs2005
SQL Query Help....

Dynamic File Names for Raw files created by conditional expressions

Hello,

I have a huge table of around 6.2 billion rows in Oracle and I need to load this table to SQL Server. I am creating multiple raw files based on contact_dates in the table. I have used conditional expressions to branch out and create raw files. I need to specify static file names for each branch or I have to create multiple variables for each branch and use expressions to create file names.

My intention is to create only 1 variable and evaluate the expression based on the conditional expression description. Is this possible

Regards

RH

Answer this question

Dynamic File Names for Raw files created by conditional expressions

  • SanderS

    Here's one way to do it, perhaps:

    Create an execute sql task in the control flow to select distinct contact_dates from your table accordingly. Store the results in an object-typed variable and then use a foreach-loop to spin through each date in that variable. Then, you'd put a data flow inside the foreach loop, using the current contact_date variable (populated from the foreach loop) as the destination file name. Of course, you'd have to select from the Oracle table using the contact_date in your where clause, but if your table is partitioned and/or indexed, this might not be a problem.


  • AndyQ

    You are correct. I have been running this SQL for some time now, and I can't afford to wait this long and I cannot let the package run. This package is not for archival purposes as we are migrating from oracle to SQL Server.

    I may have to hardcode the filenames to each of the raw file.

    Regards

    RH

  • PraveenL

    At 6.2 billion rows, my solution will likely be slow, but if you are archiving this table or something and can afford to just let the package run, it should work. Stop back in if you need help in getting things hooked up and working correctly.


  • sapaplanus

    Thanks for the info. I will try implementing your solution.

    Regards

    RH
  • Dynamic File Names for Raw files created by conditional expressions
Answer this question