Dear All,
I'm experiencing a stuck SSIS package that I'm developing. The package reads about 9915 rows and then it juts stops processing, all the boxes in the data flow task remains yellow and it would not proceed.
I have another similar package but it does not get stuck.
Has anyone experience this problem before ?
Regards
Ash
Using SQL Server 2000 SP4.There is a relatively complex stored procedure that usually completes inless than 20 seconds. Occasionally it times out after 180 seconds. The SPis called via ADO 2.8, using adCmdStoredProc command type. If I useProfiler to capture the EXEC that ADO sends to run the procedure, and runthat from QA, the procedure completes in less than 20 seconds as it should.The procedure is created WITH RECOMPILE. One additional twist is thatsp_setapprole is called from the client before running the procedure inquestion. This may be irrelevant, because even if I include the samesp_setapprole call when running the procedure from QA, it still executesquickly, and even if I comment out the call to sp_setapprole in the clientcode, the proc still times out when run from the client.The only thing that fixes it, at least for a day or two, is DBCCFREEPROCCACHE. So it appears that a bad plan is somehow stuck in memory andis only used when the procedure is called from the client app, and is notflushed even though the procedure was created WITH RECOMPILE.Other than scheduling the DBCC call to run every night, is there anythingelse I could try to get this resolved? Thanks.--(remove a 9 to reply by email)
View 5 Replies View RelatedI have a package which reads from a source, does some transformation and then loads into a target table(custom transformation build to handle multiple scenarios for insert/update/delete etc). For couple of packages, I am facing an unusual problem. The package gets stuck after executing for some records. There is no data flow in the buffer. But again, if I stop executing the package and run it again, it runs through fine.
Any idea what could be issue or what particularly I should be looking for in order to debug this issue.
Thanks,
Manish
I would like to see if someone can help me out.
Scenarion:
1.- SSIS Package execute tasks on 2000 SQL Server Database
2.- Execution takes places using Business Intelligence Studio
Question:
1.- How can I tracked that SQl 2000 tasks took place using a SSIS Package?
Thanks
I have a SSIS package developed by a different user which does a lot of DML. This package sits on the server.
The package needs to be executed on a regular basis.
I have given RO access for a regular user on production DB, he is executing the package from his client desktop.
I was expecting this execution fail, since the package is doing lot of INSERTS , where the user has ONLY RO access.
I understand from the above experience that there is an “execution context� for SSIS execution. Can someone tell me how can I define the execution context for SSIS?
------------------------
I think, therefore I am - Rene Descartes
Hi,
I have been using SSIS now for quite sometime and over teh past month when i open for edit or execute a package SSIS just seems to go away and wait for about 10 minutes before opening or starting the execution.
I have defragmented my drive, i have monitored cpu usage and it just looks like it is not doing anything at all.
I am running windows xp connecting to windows 2003 servers with sql server 2005.
Has anyone else experienced this and can anyone help?
Thanks
Hi,
when using lookup i am geting the following warning.our OLEDB connection is Oracle.how to resolve this will this have any performance impact.
[Lookup [14342]] Warning: Cannot retrieve the column code page info from the OLE DB provider. If the component supports the "DefaultCodePage" property, the code page from that property will be used. Change the value of the property if the current string code page values are incorrect. If the component does not support the property, the code page from the component's locale ID will be used.
Thanks
Jegan
I have multiple data source text files with different names , file extensions and format , i need to bring the data into SQL tables for temporary holding of data. Once i bring the data into table i need to identify some fields using substring and then after cleansing at table level command. Once thats done i need to convert those tables back into text file with comma delimited join those tables and bring a different output.
Problem i am facing is if i have one data flow task then the first source file bring the data into table which is destination , but how to convert the data back using those tables back in to text file.
basically when i create one source file which is text file becomes source of data flow task and when convert those files into tables becomes destination. but when i need to bring the data back into a different format , the tables which were destination needs to become source.
Do i need to create a multiple data flow task or is their any other way i could work out.
Plese advise
Thank you
Hi all,
Which is the best way to execute SSIS packages? I have no problem to use dtexec command but I want it to run every night. Is this going to be done through the SQL Server (SQL Server Agent under Jobs)? Is the type going to be Operating System (CmdExec) or Transact Sql? How exactly is the command written there?
Thanks in advance.
Hi all,
I am Hazara. I am trying to call a SSIS package from a web service. But package.execute() method is returning 'failure'. Though I am able to execute the same package from a normal .Net project and it is working fine (using the same code that i have used in web service).
I have also tried to execute it through stored procedure for which firstly I created a .dll in c#(which is perfectly working) and then I registered this .dll in sqlserver-2005 using following command.
CREATE ASSEMBLY asmPackageExecuter FROM 'C:WINDOWSMicrosoft.NETFrameworkv2.0.50727PackageExecuter.dll'
WITH PERMISSION_SET = UNSAFE
GO
Now on calling the method of .dll (which is responsible to execute the package) I am getting the DTSExecResult as 'success' but data is not getting transfered from one able to other as was expected from the package.
Please help me. I have searched it everywhere on net but didn't get any solution.
I want to execute package only through web-service or stored-procedure
Thanks
Hazara.
Hi
I am getting this error when I try to execute a package source is oracle and destination is sql
[Source [1016]] Error: The AcquireConnection method call to the connection manager "Oracle_test" failed with error code 0xC0202009.
It was working fine until I changed the Connection to New Connection from Data Source.
Hi.
I have an SSIS package which is used to import various different files.
When I run the package directly through the Visual Studio, it works fine, with no problems.
However, when I call the package through within a Visual Basic application, it returns "success" but when I check the database, nothing has been imported!!
The VB code I use to execute the package is:
pkgLocation = ConfigurationManager.AppSettings.Item("ImportSenseSSIS").ToString.ToUpper.Trim
pkg = app.LoadPackage(pkgLocation, Nothing)
pkg.Variables("bError").Value = False
pkg.Variables("SenseFileName").Value = strFile ' e.g. ksf_booking_20070608.1.csv
pkg.Variables("SenseImportPath").Value = path ' e,g, \SandPiperDataSense Downloads
pkgResults = pkg.Execute()
The App Setting "ImportSenseSSIS" is set to:
<add key="ImportSenseSSIS" value="C:devtTravelodge Pegasus ImportSenseImportImportSense.dtsx"/>
(which does exist)
I have another package which runs perfectly in both the Visual Studio IDE, and the VB application.
I hope someone can help!!
We have a monitoring tool that find a query that is using most of execution time of all sessions on the server.
I located it, and found it is a data flow task in an SSIS package.
It export data from a table which has big mount of data to another database.
I know it only executes one time, but I see in the monitoring tool it executes 4 times.
I am wondering is it because SSIS is doing it in parallel execution automatically?
We use all default settings, and the server physical cpu is 4.
Also it says the query is slow is because it has a wait called PREEMPTIVE_OS_WAITFORSINGLEOBJECT
not sure what does that mean
Is there a way to find the content of a variable in SSIS while the package is executing?
------------------------
I think, therefore I am - Rene Descartes
Hi Friends,
I need help from you.
I am working on SSIS packages for ETL purpose.
The version of SQL Server i am using is SQL Server 2005.
In Brief , the working of current ETL is as follows.
In ODS database i have 2 tables i.e Table_A & Table_B which gets loaded from another 2 staging tables A & B.
And using this 2 tables data will be loaded into a target table i.e Trg_A.
The ETL packages are executed by stored procedures by creating a job within the stored procedure.
The loading of the trg table is little tricky.
Before that loading of Table_A is implemented in a single SSIS package.
and loading of Table_B is been implemented in another SSIS package.
In the trg table there are two columns which will be getting updated as and when each table is loaded.
so for the first time if i run the package which is resposible for loading Table_A, it loads values into Table_A and once done it will updates (col1) in the target table.
Once after the complete of the execution of Package1.
Now i will kick off the second ssis package which loads the data into Table_B and updates the trg table's columns (col2).
Now the actual problem what i am facing is:
For loading Table_A and updating the col1 in Trg table i will be receving more than 5 excel file every month on weekly basis.
I cannot even gather all the files and run using a For-Loop counter.
So presently i am loading data excel file per week .
Similarly loading of table_B.
For a week if i am executing both the packages which loads the Table_A and updates the Trg(col1) and Table_B and updates Trg(col2), then i am getting a Deadlock Error and the entire ETL is getting messed up.
Now my requirement is , Eventhough the 2 packages are run in parallel , there could certain milli seconds time difference while start of the execution in Job Monitor.
I need to implement a Queing Mechanism which takes care of running the packages in a sequential manner rather than in parallel. i .e i need to ensure only one SSIS package is running in Job Monitor. Only after successful execution of either one the package, then only the second package should start its execution.
If we can implement such a queing mechanism , then my problem is solvedl.
I need some suggestions on this regard in implementing the Queing mechanism in a programatic approach using SQL Server Job Related MetaData Tables.
or else is there in server parameter or initialization parameters which can be set at Database level which suffice my requirement.
Any suggestions would be greatly appreciated.
Looking for sincere comments on this regards.
Thanks in advance.
Hi All,
This not a problem but here i wan to give u my some trial on package execution from C# code.
i just want to make sure whether this is right way or not?
I need to upload some processed text file into table using SSIS packages. I m calling these packages in runtime for different source text files passed to it.
I first created package on my machine and deployed packages on Sql server using default protection level. So when i m tryng to execute it from integration services it wont work giving some exception in AquireConnectionCall() , its coz all the sensitive information is stroed inside package is not available to that machine.
In C#
Now i m loading this package using LoadFromSqlServer().
I am creating connection manager object for each of source and destination type and then setting all sensitve information from my solution's config file.
Set the protection level of package and available connection managers to DontSaveSensitve.
by using this method m able to execute any package created on any machine with default protection level.
Can any one of tell me -ve aspects of this approach?
Thanks
I am wondering something, once we've created a job that executes a package at a given time interval, does that package get recompiled each time the job spins up and executes the package? Or is the package compiled once and then that compiled code is executed each run after the first run?
What I'm seein is this; I have a package that reads data from flat text files and then dumps that data into the database. The package will take 3 minutes to execute when executing on a single file, but when it's looping through ~50 files, it will take ~30 minutes to execute, that is less than a minute per file. Why is this?
Hopefully I'm just forgetting something and not setting a checkbox or radio button somewhere. The job is set up as an SSIS job, not as a command line job.
Thanks in advance for any help you can give me.
Wayne E. Pfeffer
Sr. Systems Analyst
Hutchinson Technolgy Inc.
I am currently experiencing a 30 second delay when starting an SSIS package from a query window or stored procedure in SQL 2005 Management Studio, using xp_cmdshell and dtexec.
When I run the package in BI Dev the execution results state an elapsed time of 4.82 sec, at a command prompt using dtexec the elapsed time is 3.48 sec, from MStudio the elapsed time is 33.86 sec, this test was run using the same configuration and databases. For the MStudio run, if I look at the DTS log file I€™m creating or the PC Application log, it states the package doesn't actually start until 31 sec after the execute button is pressed. I€™ve tried executing the package as both a SQL package and a file package without any difference in elapsed times. I have also set DelayValidation = True for every Task, ConnectionManager and the package itself.
When I look at the package log one difference I see is that the Management Studio executes using €˜NT AUTHORITYSYSTEM€™, BI Dev and the cmd prompt use the local user €˜[Server]Administrator€™, which in this case is the administrator. From this I have to believe it is some kind of user rights problem. I think SQL or the OS is waiting for something and after it times out at 30 sec, it allows the package to run. If this is the case I€™m not sure what it might be or how to find it.
I also tried making an xp_cmdshell_proxy_account with admin rights but this didn€™t seem to work either. I€™ve included the query code below. Any ideas, help or solutions are greatly appreciated.
DECLARE @cmd varchar(250)
DECLARE @Result INT
SET @Result = 0
--SET @cmd = 'dtexec /F "C: empDP2000 DataTransfer.dtsx" /DE ttalg /REP EW'
SET @cmd = 'dtexec /SQL "DP2000 DataTransfer" /DE ttalg /REP EW'
EXEC @Result = xp_cmdshell @cmd
SELECT @result
While executing the SSIS package from visial studio it is running. If we execute from Integration services - - -> stored packages - - - -> msdb - - - -package name, the package gets executed.
But when scheduled through jobs it gives the following error in history
"Execution as user. <user name > The command line parameters are invalid. the step failed"
command line looks like this "
/DTS "MSDBMaintenance PlansPackage1-HYUNDAI" /SERVER tvmwindev02 /CONNECTION "10.10.1.52.upsframis";"Data Source=10.10.1.52;Initial Catalog=upsframis;Provider=SQLOLEDB.1;Integrated Security=SSPI;Auto Translate=False;" /CONNECTION DestinationConnectionOLEDB;"Data Source=mscoe.db.ustri.com;Initial Catalog=HISNA_POC;Provider=SQLOLEDB;Integrated Security=SSPI;Auto Translate=false;" /CONNECTION "sample.db2test";"Data Source=sample;User ID=db2test;Provider=IBMDADB2.1;Location=10.10.1.55;" /CONNECTION SourceConnectionOLEDB;"Data Source=SAMPLE;User ID=db2test;Provider=IBMDADB2.1;Persist Security Info=True;Location=10.10.1.55;Extended Properties="""";" /MAXCONCURRENT " -1 " /CHECKPOINTING OFF
"
What could be the reason ?
Deleep.P
Hi,
I have a SSIS package runnig trough my sql server 2005 schedule job every one hr. it is a simple package to pull some data from a table and transfer this data into a text file. it was runnign smoothly since long time, but today its not executing through my job and giving me the following error.
Executed as user: GYRODATAGyroDBA. ...n 9.00.3042.00 for 32-bit Copyright (C) Microsoft Corp 1984-2005. All rights reserved. Started: 1:13:27 PM Error: 2008-04-10 13:13:28.18 Code: 0xC001401E Source: Package1 Connection manager "DestinationConnectionFlatFile" Description: The file name "\Gyrow2kefw001PURCHASESPOOLsupplier.txt" specified in the connection was not valid. End Error Error: 2008-04-10 13:13:28.18 Code: 0xC001401D Source: Package1 Description: Connection "DestinationConnectionFlatFile" failed validation. End Error Progress: 2008-04-10 13:13:28.20 Source: Data Flow Task Validating: 0% complete End Progress Progress: 2008-04-10 13:13:28.34 Source: Data Flow Task Validating: 50% complete End Progress Progress: 2008-04-10 13:13:28.34 Source: Data Flow Task Validating: 100% complete End Progress DTExec: The package execution returned DTSER_FAILURE (1). Started: 1:13:27 PM Finis... The package execution fa... The step failed.
If i try to execute the same package trough business development studio its working f9.
anyone have any idea whats the problem is?
masroor
Hello everybody!
I have a question - is it possible to visualize an execution of the SSIS package when it is being run from SQL Agent? "Visualize" means to show a data-flow "live" - similair to the visualization provided by BI Dev.Studio when you run a package there, with coloured boxes, blinking etc.
I searched the Web but found nothing - neither MS-related nor utilities from third parties. Is it possible in any way?
Thanks in advance,
Andrey.
P.S. Parsing log-files is an option, but we would like to try first something less "painfull" and more universal...
Hello,
I have two packages which is having parent child relationship.
Package1 is calling Package2, Package2 will download the input files from remote server using COZYROC SFTP Task. then Package1 will execute.
It is working fine in BIDS and SQL Agent job in "DEV" Server. But it is not wroking when i deployed the packages and it's config files and then created a SQL Agent JOB to "QA" Server.
The Error is:
Description:
The connection type "SSH" specified for connection manager "LG-AUS" is not recognized as a valid connectionmanager type.
This error is returned when an attempt is made to create a connection manager for an unknown connect
ion type. Check the spelling in the connection type name.
End Error
Error: 2008-04-23 05:33:57.26
Code: 0xC0010018
Source:
Description:
Error loading value "<DTS:ConnectionManager xmlnsTS="www.micro
soft.com/SqlServer/Dts"><DTSroperty DTS:Name="DelayValidation">0</DTSroperty
><DTSroperty DTS:Name="ObjectName">SFTP-CMS</DTSroperty><DTSroperty DTS:Na
me="DTSID">{49D115FA-B208-4BFC-928D-7CC0964E743A}</DT" from node "DTS:Connection
Manager".
End Error
Error: 2008-04-23 05:33:57.29
Code: 0xC00220DE
Source: EPT Calling LG_Inbound
Description:
Error 0xC0010014 while loading package file "C:QATestLG-SFTPInbound.dtsx". One or more error
occurred. There should be more specific errors preceding this one that explains
the details of the errors. This message is used as a return value from functions
that encounter errors.
.
End Error
DTExec: The package execution returned DTSER_FAILURE (1).
Started: 5:33:55 AM
Finished: 5:33:57 AM
Elapsed: 1.359 seconds
Please give the solution ASAP.
Thanks
Thiru
Hi everyone,
I'd like to alter OnInformation event in order to add more parameters (as TaskHost). Is it possible? I've tried but appears an error:
OnInformation' cannot to implement OnInformation' because of it doesn't exists on the Microsoft.SqlServer.Dts.Runtime.IDTSEvents'
Sub OnInformation(ByVal taskHost As TaskHost, ByVal [source] As DtsObject, ByVal informationCode As Integer, ByVal subComponent As String, ByVal description As String, ByVal helpFile As String, ByVal helpContext As Integer, ByVal idofInterfaceWithError As String, ByRef fireAgain As Boolean) Implements IDTSEvents.OnInformation
I suppose that I must add an overload method but how?
Thanks for you help/advices,
Enric
Hello,
I have a resultset, which I pass to a loop container, to use as parameters in an ExecuteSQL task for each row.
However, I would like to do some parallell processing, rather then iterate through them sequentially. How can I achieve this? Is there a way I can make the loop iterate before sql task is finished, or should I be using soemthing else entirely?
I hope this makes sense.
Can anyone point me in the right direction please?
Hi guys,
I am basically from COGNOS domian, but now i am trying to learn SQL server 2005.
Can any one say how automate or schedule the package that it been created in SSIS.
That package contains the data flow task..
i have got stuck in this
Thanks in advances
Lalitha
Keysoft Solutions
I'm not exactly sure how to ask this question ... but here goes!!
I want to get an idea of how SSIS actually executes transformation tasks.
Do transformation tasks (eg a lookup) complie down to managed code or are the executed as SQL commands in a SQL server database?
Thanks.
Hello,
I want to know detail execution flow of SSIS package (like Validation -> Expression evaluation -> Execution etc.)
Where can I get detail information, any reference (links)?
Thanks in advance.
-Omkar.
I would like to know how long will my package take to run if i have 2 million records to be inserted to my database.
Its taking hours( arround 5 hours or more)...is that the way it is????? i used oledb destinations..
i am transfering from text file to sql server database.
And one more thing which i want to know is...
Is is better to have several data flows where in one i check to see if the incoming records are valid.and have my insert or update logic in the other.
Will this increase the speed..
Hi everybody,
I currently need help on an issue I can't find the solution.
I developed a package and I when I run it from the Integration Service directly it runs and ends correctly, deletes/creates tables on the db on the server the package is running and copy the data from the other db.
I want to specify that I use two db in different domain as source and destination.
When I schedule it using the Sql scheduler it fail reporting the following error:
SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "DBname" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed.
Can anyone of you give me a clue about the issue I have?
Thanks!
Hi
I'd like to know if there's a way to control the execution of ETL packages, such that:
Different packages, or at least packages that don't access the same table or database run asynchronously with respect to each other; e.g., two different packages run at the same time
and
If a package is called for execution more than once by different requests, force them to run synchronously, or one after the other.If this is possible, what resources would it require? Is this possible under, say, a dual or quad processor machine?
Thanks.
How do I grant a regular user or group the same rights to view the SSIS execution reports as say the sysadmin role?
I need to figure out how to give users the visibility of those reports without actually granting sysadmin.
Hello friends!
I have one query regarding execution of SSIS package through Stored Procedure.
I have created SSIS package which extract data from database and put that into various text files.Here I am using two global variables one is for Department ID and another is path where I wanna to place my text files as per departments.When I ran it through command prompt it works fine but now I want that dtsx package to run from stored procedure with same input parameters
when i searched on line i got this solution
Declare @FilePath varchar(2000)
Declare @Filename varchar(1000)
Declare @cmd varchar(2000)
set @FilePath = 'C:setupSSIS PackagesSSIS Package File Extract DataSSIS Package File Extract Datain'
set @Filename = 'DataExtract.dtsx'
select @cmd = 'DTExec /F "' + @FilePath + @Filename + '"'
print @cmd
exec master..xp_cmdshell @cmd
but when i execute it i got error like
Source: {8A27E8DF-051B-4F6B-9538-85BED1F161D8}
Description: Unable to load the package as XML because of package does not have a valid XML format. A specific XML parser error will be posted.
End Error
Error: 2007-02-22 11:31:37.32
Code: 0xC0011002
Source: {8A27E8DF-051B-4F6B-9538-85BED1F161D8}
Description: Failed to open package file "C:setupSSIS PackagesSSIS Package File Extract DataSSIS Package File Extract DatainDataExtract.dtsx" due to error 0x80070003 "The system cannot find the path specified.". This happens when loadin
g a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.
End Error
Could not load package "C:setupSSIS PackagesSSIS Package File Extract DataSSIS Package File Extract DatainDataExtract.dtsx" because of error 0xC0011002.
Description: Failed to open package file "C:setupSSIS PackagesSSIS Package File Extract DataSSIS Package File Extract DatainDataExtract.dtsx" due to error 0x80070003 "The system cannot find the path specified.". This happens when loading a
package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.
And also I am not understand where i should pass my two input parameters which I used in SSIS package variables???????
Please help me out
Thanks
I have various ssis packages which need to schadule through SQL server agent, I manage to schadule those packages but every time SQL server agent execute those packages automaticlly they failed ... I went to package log and it gives error that Step one failed, on the other hand if i execute those packages through "Execute Package Utility", they run without any error ...
Please Help...