Showing posts with label flat. Show all posts
Showing posts with label flat. Show all posts

Tuesday, March 20, 2012

Creating stored procs that need to continusiouly append to a new table (this is to scrub d

I have 1 table with a huge amount of data that I recive from someone else in a flat file format. I want to be able to filter through that data and scrub it and find out the good data and bad data from it.

I'm scrubbing the data using different stored procs that i've created and through a web interface that the user can pick which records they wish to create.

If I were to create a new table for clean records, what is the syntax to keep Appending to that table through the data that i'm obtainig via the stored procs that i've created.

Any thoughts or suggestions are greatly appriciated in advance

Thanks again in advance
RBCheck outINSERT (INTO)

Or you might consider adding a STATUS column and flagging all records initially as BAD and then flagging with GOOD as appropriate as you progress through your scrubbing routines.

Terri

Wednesday, March 7, 2012

Creating one flat file per record in the data flow

I have a table that holds in each record an image (varbinary(max) actually), a text reference for the image and a MIME type for the image. I need to read this table and for each record that has been created since the last run, I need to create a file with the image as the content, the mime type as the file extension and the text reference as the file name. There will be one file created per record found by the data flow source.

I was assuming that I could use the flat file destination and manipulate the file naming using the contents of each record in the flow but am completely stumped on how to achieve this.

Does anyone have any ideas?

thanks

Have a look at the export column transform.|||cheers, it worked great.....

Sunday, February 19, 2012

creating flat file and SQL Server 2005 hangs...

i m using the hands-on labs for SQL server 2005.

Step 6 age 14 i went thro and it make my SQL server 2005 hangs when i try to use the flat file destination.

You'll have to provide more info. The flat file destination doesn't use SQL Server in any way shape or form.

What does your dataflow do?

What colour are all the components in there (assuming you are running this in BIDS).

Do you get an error message?

-Jamie