I have huge text files coming from the other end.But they are sending as .zip files and when unziped i find .dat.
Is there a way to set up such that my package can unzip those files and change .dat files to .txt and then start working with with those files.
Please let me know thanks
Hi all,
RE: Dynamically import textfiles:
I have a C# assembly that scans textfiles in a certain directory residing on the same server as the SQL2005 database server.
The names and directory are retrieved from a configurationtable on the SQLServer.
These textfiles have a header with column information.
The problem is that these headers can change and as a result the table in which to import this data no longer reflects the columnlayout of the header in the textfiles.
I would rather not use xp_cmdshell or bcp utility and would like to create a package that dynamically sets the input and output columns while the rest of the package remains unchanged.
At the moment whenever the header of the textfile has changed the assembly I created drops and recreates an importtable for the textfile. All this runs without a problem.
But if I then import the textfile with the dataflow-object in the existing package I have to reset the columns in the metadata object to reflect the changed columns.
This is easily done by pressing the reset columns button on the design surface in BIDS, but I would like to do this automatically (programmatically).
So what I would like is to load a package (=no problem) and then reset the columns of the textfile source and table-destination in code. The samples I found on the web seem rather obscure to me and I am not sure which way is the preferred way.
Can anyone give me an example of loading a package and then resetting the columns (VS_NEEDSNEWMETADATA ReinitializeMetaData ?) of a flatfile-datasource and a SQLServer destination
in code (C#)?
Any help appreciated
Greetings,
Francis
I am transferring data from text file to sql server.I have created .dtsx packages. After the package executes i need to remove the data from the text file or even remove the text files. But i want my package to run it receives new textfile.What do i need to do??Please help????
View 6 Replies View RelatedDear all,
Do anyone knw that how am I gonna write data from a DB table to TextFiles(.txt)? If use Flat File Destination, how do I do the setting?
Is there a way to check if duplicates exists in the incoming textfiles????
HI All,
I need your help, i want to Unzip files that i downloaded from FTP. i want to unzip using T-sql or SSIS, especially using T-SQL, i am working on sql server 2005, my FTP dump is C:FTP, under this FTP folder i have different zip files, example:
C:FTPFile1.zip
C:FTPFile2.zip
C:FTPFile3.zip
etc, under this zip files there are about 13 text files, thus i need to unzip only C:FTPFile3.zip using T-SQL, how do i do it, please quick response, your response will make my weekend free of headache. Thank you in advance for your help and time.
Thanks,
Good Day
How do I unzip a file osing SQL command
I am trying to unzip some files that I have ftp'ed into a local directory.
I use a foreach file container. Into this container I have placed an Execute Process Task. The EPT runs pkzipc with the following arguments set: -dir=current -extract.
The standard input variable is set to the output variable of the foreach loop.
When I run the package, a console window will open for what I assume is the PKZIP process, but there is nothing printed out in the console and the console won't close unless I force a timeout.
When I enable a timeout I get the following error:
SSIS package "Package.dtsx" starting.
Error: 0xC002914C at Execute Process Task, Execute Process Task: The process timed out.
Task failed: Execute Process Task
Warning: 0x80019002 at Foreach Loop Container 1: The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
Warning: 0x80019002 at Package: The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "Package.dtsx" finished: Failure.
So I have two questions:
1) Is this the best way to unzip files?
2) If it is, what am doing wrong?
Thanks
How is it possible to unzip a file using ssis please?
View 1 Replies View Related
Hi,
how would i unzip a password protected file after downloading it from sftp server.
thanks
I have two question
1.In SSIS is there a way to unzip the text files
I have set an automated process in sql server agent
I receive ziped text files.I want to unzip the files before loading the data
2.Is there a way to notify when an error occurs in the package in sql server agent.
Please let me know
hello
my problem is how to unzip the file using the c# and asp.net
code
Hi
We are planning to setup log shipping model being setup between two sqlserver 2005 enterprise edition.
Our transaction log backup sizes are not consistent through out the day.The following is the scenario.
T1 at 8.00 -- 315MB
T2 at 8.30 -- 152MB
T3 at 9.00 -- 2.5GB
T4 at 10.00 -- 500MB
The bandwidth available is 25MB/minute. We are taking the backups of Tlogs at 30mins interval.Now at 'T3' log transfer we want to zip the file on the primary server,copy the file over the WAN and unzip it standby server.
Now i wanted to know whether to perform this kind of action(Zip,copy,unzip), can i create a separate job on primary ?? which will put the unzipped file on standby and allow the log shipping job to restore the log file (T3)
Also i wish to carry my T3,T4 etc backup -- copy-- restores through my Log shipping activity.
I cannot take 15mins backup on primary server to reduce the transaction log backup size.Thts another constraint i have.
Also tell me how to zip and unzip thru command line if u hve any link.
Please advice me
thnks for the help in advance
Regards
Arvind L
Do U know how to unzip a file with T/SQL?
thanks in advance,
I want to unzip a file through "Execute Process Task".
For compressing(zip) a file i write the following.
In Process Tab:
In Executable: C:Program FilesWinZipWINZIP32.EXE
In Arguments: -min -a "C:file.zip" "C:file.mdb"
What arguments should i write to unzip a file?
And in case i want to copy a file from one location to another through Execute Process Task what should i do?
Please Help
Is there a way to unzip files in a SQL Server 2005 SSIS package. I now I can do it using winzip and executing the procedure, master..xp_cmdshell, but that is not what I am preferring at the moment. Anything direction in this regards will be much appreciated.
Thanks,
Monisha
Hi,
I have created a job that will execute a SSIS package which will unzip some zip files. For unzipping we are using WinZip. In the package I have used a .Net script task for unzipping. This script is using WZUNZIP. When I am executing the package directly it is unzipping all the zip files. But when I am executing the job that will execute the SSIS package for unzipping it is going on with the execution and not unzipping the zip files. So finally I stopped the job.
Can you please help me to resolve this issue?
HI All,
I have Uzip Files to be loaded From ftp.companyname.com, the zip files get updated everyday thus i have to load the newly added files, the Zip file has got 13 text Files within it, the issue is:
1. how do i load it for the new zip file only, the zip files are shown below, i am trying using FTP Task, but need more info.
2. How do i UnZip it and and take the text files and then load them to sql server 2005, each text file has to be loaded to sql server tables.
3. How do i automate it, i mean every time i run the package (on Job based) it has to look the new file only, see the zip file below to understand what i am saying about.
02/25/2008 09:02PM 2,780,729 CompanyName_2008-02-22.zip
02/27/2008 09:04PM 1,274,557 CompanyName_2008-02-23.zip
02/25/2008 08:57PM 1,383,112 CompanyName_2008-02-24.zip
02/26/2008 04:21PM 3,327,882 CompanyName_2008-02-25.zip
02/27/2008 08:44PM 3,623,334 CompanyName_2008-02-26.zip
02/28/2008 05:27PM 3,570,243 CompanyName_2008-02-27.zip
02/29/2008 04:20PM 3,444,375 CompanyName_2008-02-28.zip
03/01/2008 04:17PM 2,655,782 CompanyName_2008-02-29.zip
03/03/2008 04:09AM 1,179,338 CompanyName_2008-03-01.zip
03/03/2008 05:21PM 1,267,777 CompanyName_2008-03-02.zip
03/04/2008 04:49PM 3,238,121 CompanyName_2008-03-03.zip
As you can see the Zip file names are the blues color, they are added at different time, thus what i need is only the current Zip file (i mean i have to Load only the newly added Zip file (recent one)). Thus the SSIS Task has to go to this FTP server and look the newly added zip file. After that i have Unzip it b/se i have 13 text files there, and then Load them to Sql Server 2005.
Please get help on this, the deadline is near by time, if possible try as soon as possible, I would like to say Thank you for every help you do and try.
Thanks,
Hi,
I get a "sample.txt.z" file from an ftp site. My work is to unzip the file and load it into SQL Server Database.
Please give me VB Script to write in the SSIS Script task. to unzip the file.
Please help
i have posted the question in many blogs and i could not get the right answer.
Thanks in Advance
Hi,
I am trying to use SSIS.Execute Process Task within Foreach loop . The task should unzip a a variable gzip file provided to it from the previous task
to execute the command from cmd C:Program FilesGnuWin32ingzip.exe -d -k c:folderfilename
My input in the Execute Process Task as follow:
The command line: C:Program FilesGnuWin32ingzip.exe
Argument: -d -k c:folder
Variable: User::var_filename
keep getting error
The process exit code was "1" while the expected was "0".
Thanks
while i am trying to unzip files using execute process task ,getting below error
[Execute Process Task] Error: In Executing "C:Program Files7-Zip7z.exe" "a -tzip D:excel.zip D:unzipfileexcel.xls" at "", The process exit code was "1" while the expected was "0".
Warning: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
i want to know more about unzip and zip files and folders using execute process task.
zip folder: C:Program Files7-Zip7z.exe
SQL version: SQL server 2008 R2
do not having win rar so please instruct using 7z.its quite interest to work but i don't know to get desired result.
Exec Prcoess task with source : ftp
destination :ftpunzip
work directory ftpunzip
executable : c:Program FilesWinZip
i am using expressing.
It is doing the unzip but getting this error
package process on server server1 has failed within the Task 'Unzip Files' with the following errors:
>
> File/Process "WZUNZIP.EXE" does not exist in directory "c:Program FilesWinZip".
This is the error message i am getting it
Hi,
I am pulling text files in gzip format from UNIX system. I want to unzip these files and then import data from these files into database using SSIS.