Executing A Whole Container In One Transaction
Oct 15, 2006
Hello all,
I am trying to build a package running a container that includes several tasks: 2 Execute SQL tasks and a data flow task. I would like to execute this container in a single transaction, which means that if any of the tasks fail, no changes are been made by the container execution.
To achieve this, I have followed the instructions of how to configure the DTC on the server and locally, and set the container's TransactionOption Property to "Required".
The problem I encounters is that when using a dataflow task in the container, the running process runs OK until it reaches the dataflow task, then it just gets stuck (marking the task in yellow). When removing the dataflow task, left with only Execute SQL tasks everything works fine.
Any idea?
Thanks,
Liran
View 8 Replies
ADVERTISEMENT
Aug 15, 2006
Hi -
I've seen variations on this question in this forum, but none of the suggestions work for me, so any ideas would be greatly appreciated!
I have a SSIS package whose function is to monitor a directory for flat files and distribute the information in these files into a SQL 2005 DB for further processing later. I've configured Transactions for the package as serializable and supported, and I have a ForEach container set to serializable and required. All SQL and Data Flow tasks take place within this container. I have a single Connection Manager to pull in the flat input file, and another for the connection to the SQL DB. This setup will function, and roll back if necessary, but I take a huge hit on the continual establishment of connections to the DB. If I set the retainsameconnection property on the SQL DB Connection manager, I get an error when executing my first Data Flow task to move data from the flat input file to working tables within the DB: 0xC001A004 - Incompatible transaction context was specified for a retained connection. If I turn off Transaction support, the retainsameconnection property works as expected.
I've been running Profiler Traces, and can verify that no connection has been established to the SQL Server prior to execution of this task, so it seems like the context should be OK. I would welcome any feedback, suggestions or alternatives.
Thanks,
Jim SweeneySLC
View 2 Replies
View Related
Jun 1, 2006
I've created an SSIS package that contains a Sequence Container with TransactionOption = Required. Within the container, there are a number of Execute Package Task components running in a serial fashion which are responsible for performing "Upserts" to dimension and fact tables on our production server. The destination db configuration is loaded into each of these packages using an XML configuration file. The structure of these "Upsert" packages are nearly identical, while some execute correctly and others fail. Those that fail all provide the same error messages.
These messages appear during Pre-Execute
[Insert new dimension record [1627]] Error: The AcquireConnection method call to the connection manager "DW" failed with error code 0xC0202009.
[DTS.Pipeline] Error: component "Insert new dimension record" (1627) failed the pre-execute phase and returned error code 0xC020801C.
... which are followed by
[Connection manager "DW"] Error: The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00A "Unable to enlist in the transaction.".
[Connection manager "DW"] Error: An OLE DB error has occurred. Error code: 0x8004D00A.
While still in debug mode, I can check the properties of the "DW" connection and successfully test the connection within the packages that fail.
The same packages run successfully when tested outside the container (i.e. no transaction) or when the configuration file is modified to point the "DW" connection to a development version of the db which is running on the same server as the source database.
I have successfully used DTCtester to verify that transactions from source to destination server are working correctly. Also tried setting DelayValidation = True with no change. I have opened a case with Microsoft and am awaiting a reply so I thought I'd throw a post out here to see if anyone else has encountered this and might have a resolution. Here's some more on the environment:
Source Server:
Windows Server 2003 Enterprise Edition SP1
SQL Server 2005 Enterprise Edition SP0
Destination Server:
Windows Server 2003 Enterprise Edition SP1
SQL Server 2000 Enterprise Edition SP3 (clustered)
Thank you in advance for any feedback you might be able to provide.
KS
View 4 Replies
View Related
May 30, 2008
Hi
What is SQL Server 2005 default behavior with statement like this:
SELECT * FROM dbo.Products
Will it take any shared locks on Products table? Is it different than:
BEGIN TRAN
SELECT * FROM dbo.Products WITH NOLOCK
COMMIT
TIA
View 2 Replies
View Related
Sep 24, 2007
Hi,
I have a stored proc and using transactions as foolows
(not coplete Sp)
Begin Transaction TransName
Select @vsSql = Create a temp table (dynamically)
Exec( @vsSql )
Select @vsSql = dynamic insert statement
Exec( @vsSql )
and executing couple of dynamic statements using Exec
And @ the end of SP
if @@error <>0
rollback transaction TransName
else
commit transaction TransName
and when i execute the stored proc i am getting the following error
Transaction count after EXECUTE indicates that a COMMIT or ROLLBACK TRANSACTION statement is missing. Previous count = 0, current count = 1.
And also my sql server management studio hogs up
Can any one please help me on this
~Mohan
View 9 Replies
View Related
Jul 25, 2007
Has anyone ever seen this issue?
If i place a loop container inside a sequence container the connectors within the loop container disappear.... is this a bug - will the loop tasks still run in the correct order?? or will they fire off willy nilly??
View 4 Replies
View Related
Jan 24, 2008
Hi,
I have a web application using Stored Procedure (SP). I see that there's a SP taking long time to execute. I try to capture it by Profiler Tool, and find out that with the same SP on the same db with the same parameter. The duration of executing by my web app is far bigger than the duration of executing on SQl server management studio - query window
Please see the image through this url http://kyxao.net/127/ExecutionProblem.png
Any ideas for this issue?
Thanks a lot
View 1 Replies
View Related
Jan 23, 2008
Hi,I have a web application using Stored Procedure (SP). I see that there's a SP taking long time to execute. I try to capture it by Profiler Tool, and find out that with the same SP on the same db with the same parameter. The duration of executing by my web app is far bigger than the duration of executing on SQl server management studio - query windowPlease see the image attached http://kyxao.net/127/ExecutionProblem.png Any ideas for this issue?Thanks a lot Jalijack
View 2 Replies
View Related
Oct 10, 2006
Hi all,I am facing an unusual issue here. I have a stored procedure, that return different set of result when I execute it from .NET component compare to when I execute it from SQL Management Studio. But as soon as I recompile the stored procedure, both will return the same results.This started to really annoying me, any thoughts or solution? Thanks very much guys
View 2 Replies
View Related
May 31, 2008
Hi All
I'm getting this when executing the code below. Going from W2K/SQL2k SP4 to XP/SQL2k SP4 over a dial-up link.
If I take away the begin tran and commit it works, but of course, if one statement fails I want a rollback. I'm executing this from a Delphi app, but I get the same from Qry Analyser.
I've tried both with and without the Set XACT . . ., and also tried with Set Implicit_Transactions off.
set XACT_ABORT ON
Begin distributed Tran
update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.TRANSACTIONMAIN
set REPFLAG = 0 where REPFLAG = 1
update TSADMIN.TRANSACTIONMAIN
set REPFLAG = 0 where REPFLAG = 1 and DONE = 1
update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.WBENTRY
set REPFLAG = 0 where REPFLAG = 1
update TSADMIN.WBENTRY
set REPFLAG = 0 where REPFLAG = 1
update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.FIXED
set REPFLAG = 0 where REPFLAG = 1
update TSADMIN.FIXED
set REPFLAG = 0 where REPFLAG = 1
update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.ALTCHARGE
set REPFLAG = 0 where REPFLAG = 1
update TSADMIN.ALTCHARGE
set REPFLAG = 0 where REPFLAG = 1
update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.TSAUDIT
set REPFLAG = 0 where REPFLAG = 1
update TSADMIN.TSAUDIT
set REPFLAG = 0 where REPFLAG = 1
COMMIT TRAN
It's got me stumped, so any ideas gratefully received.Thx
View 1 Replies
View Related
Feb 22, 2007
I have a design a SSIS Package for ETL Process. In my package i have to read the data from the tables and then insert into the another table of same structure.
for reading the data i have write the Dynamic TSQL based on some condition and based on that it is using 25 different function to populate the data into different 25 column. Tsql returning correct data and is working fine in Enterprise manager. But in my SSIS package it show me time out ERROR.
I have increase and decrease the time to catch the error but it is still there i have tried to set 0 for commandout Properties.
if i'm using the 0 for commandtime out then i'm getting the Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.
and
Failed to open a fastload rowset for "[dbo].[P@@#$%$%%%]". Check that the object exists in the database.
Please help me it's very urgent.
View 3 Replies
View Related
Feb 6, 2007
I am getting this error :Distributed transaction completed. Either enlist this session in a new
transaction or the NULL transaction. Description:
An unhandled exception occurred during the execution of the current web
request. Please review the stack trace for more information about the error and
where it originated in the code. Exception Details:
System.Data.OleDb.OleDbException: Distributed transaction completed. Either
enlist this session in a new transaction or the NULL transaction.have anybody idea?!
View 1 Replies
View Related
Dec 22, 2006
i have a sequence container in my my sequence container i have a script task for drop the existing tables. This seq. container connected to another seq. container. all these are in for each loop container when i run the package it's work fine for 1st looop but it gives me error for second execution.
Message is like this:
Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.
View 8 Replies
View Related
Jan 8, 2008
Hi,
i am getting this error "Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.".
my transations have been done using LINKED SERVER. when i manually call the store procedure from Server 1 it works but when i call it through Service broker it dosen't work and gives me this error.
Thanks in advance.
View 2 Replies
View Related
Apr 18, 2008
I have an execute sql task that uses the following query: (modified for this thread but normally its going to return all records in the table)
Code Snippet
SELECT
'PrimaryID' AS 'Parameter/name',
PrimaryID AS 'Parameter/value',
'LastName' AS 'Parameter/name',
LastName AS 'Parameter/value'
FROM ParkingUpload
WHERE primaryid = '1234' or primaryid = '4321'
FOR XML PATH('T2Method')
The output of this query looks like this: (I know normally this would be a bad xml file, but its needed for my purpose)
Code Snippet
<T2Method>
<Parameter>
<name>PrimaryID</name>
<value>1234</value>
<name>LastName</name>
<value>Abiola</value>
</Parameter>
</T2Method>
<T2Method>
<Parameter>
<name>PrimaryID</name>
<value>4321</value>
<name>LastName</name>
<value>Aboud</value>
</Parameter>
</T2Method>
That xml is stored in a user variable in the Execute SQL Task. I need to take that user variable and send out that xml to a webservice. The web service is expecting one record at a time(a new record is defined by the <T2Method> node.
So question is, does my approach seem fine so far? I was wondering if my next step should be to put this variable in a For Each Container and send out one record at a time to the webservice. If so, how would I go about doing that?
If anyone else has a different suggestion as how to approach this, or be able to help with the For Each portion (I am brand new to SSIS), I would really appreciate it.
View 5 Replies
View Related
Apr 26, 2006
i am trying to insert data into a table and roll back if this fails. What i have done is created an Execute SQL task with a SQL statement of BEGIN TRANS .. if the constraint = success then it goes to a Sequence Conatiner that amoungst other thing includes an Execute SQl task that does INSERT statement . outsied of the container i have 2 execute sql tasks that to a COMMIT TRANS ond a ROLLBACK Trans . when executing it i get an error the Rollback Transaction request has no corrasponding Begin tranaction. I have seen this in a SSIS created by one of the Wizards and it works fine, im oviously missing something fundemental .. any pointers ?
View 1 Replies
View Related
Jan 22, 2008
Hello Experts,
Sorry that I open a new thread again but I didn€™t found any good tutorials about foreach loop container. I would like to read every row from one table and do something.
I red something about sql task€¦ Can someone give a little instruction, please?
Kind regards,
Alex
View 3 Replies
View Related
Jul 31, 2007
Hi,
I'm using data flow as flat file source -> derived column ->Data Conversion-> oledb destination
I have a fifty thousand record in a delimited file. while processing i got error in 45000th row. In database only 40000 records are there(why is there no all 45000 records). Is there any way to roll back all the 40000 records.
View 9 Replies
View Related
Feb 15, 2007
Hi
I using data flow task to import from flat file to database but i need to use Foreach Loop Container to import multiple files in specific folder and all will be insert in the same table
tahnks & Regards
View 1 Replies
View Related
Mar 6, 2008
hi people, i have crashed on a this problem. I have a sequence container and on this container I have set "FailPackageOnFailure=true". Now in this container there are 2 tasks. The first one is preceeding the second one. Now both this task have set "FailParentOnFailure=true". Both task are the same and their purpose is to drop table A.
1) I run the package and it fails, because there is no table to drop.
2) I create the table manualy and run package again.
3) I see, that the first task is beeing just SIMPLE OMMITED and the second task runs
In general, everytime any task in a sequence container invokes failure, next time is beeing ommited regardelss of its status. How can this be fixed ? Thanks
View 4 Replies
View Related
Feb 27, 2006
What I'm trying to do is take multiple "snapshots" of a membership for many months. I was trying to do this in a For Loop Container in which I added one to the month variable and subtracted one from an iteration variable each loop, unless the month variable = 13...then I would add one to the year variable, set the month variable to 1 and subtract one from the iteration variable. This, I was hoping, would allow me to initialize 24 to the iteration variable, 1 to the month variable and 2004 to the year variable, kick off the package, and get 2 years worth of "snapshots" in seperate files (one for each month). Here is the AssignExpression I thought would work:
@Member_Month == 13 ? @Member_Month = 1 && @Member_Year= @Member_Year + 1 && @Member_Iteration = @Member_Iteration - 1 : @Member_Month = @Member_Month + 1 && @Member_Iteration = @Member_Iteration - 1
The package states that the single "=" should be double, but I don't think that that is what I want to do (I tried doing this just to check, and it didn't like this either). I think that it is having problems with doing multiple things on both sides of the ":". What am I doing wrong?
Thanks,
Brian Layden
View 1 Replies
View Related
Oct 19, 2007
Afternoon Folk ...
Here is the question.
I have a RAID 10 container consisting of 4 146GB, SAS, 3.5-inch 15K RPM Hard Drives.
We have the OS on its own RAID so we are strictly dealing with setting up SQL Server 2005 on the RAID 10.
SO ... is it better to create seperate volumes for the Data, TLog and TempDB file placements (i,e, C:, F: and G or is it alright to create just plain-jane folders for the file placements?
Does it make a difference?
Is there a better way to carve this RAID 10 up?
Thanks ALL!
View 7 Replies
View Related
Jul 24, 2006
Has anyone investigated extending any of the SSIS Container classes?
I have been looking into it because we'd like to add a set of standard logging calls on events, standard startup procedures, etc. on any package that we execute.
I've been looking into the Sequence Container, For-Each, etc. They are all sealed classes. I'm not sure why MS has sealed them.
We're currently thinking of implementing our own version of the Sequence Container -- we'd really like to be able to extend the functionality of a standard container class, but we don't want to have to implement the actual container class itself.
Any insight appreciated.
View 5 Replies
View Related
Aug 22, 2006
Is there a way to set a variable as a substring of the enumerator in a Foreach File Enumerator type? The Variable Mappings tab in the Foreach Loop Editor does not allow you to enter an expression.
Fred
View 13 Replies
View Related
Oct 24, 2006
hi guys,
I was wondering about a silly thing but, anyway, which is the maximum number of grouping for a container? I mean, when you group from, i.e, a sql task and then over that group do again another one and so on...
Thanks in advance for your time,
View 3 Replies
View Related
May 18, 2007
We have a config table which has columns like pollingfolder, cop to folder etc.
Data looks like this
Config id polling folder
1 d:dataloadacn
2 d:dataloadship
under ACN and Ship folders we can have more than 1 source files which had to be loaded into target
the load process has to be repeated for each file in all the folders like ACN and ship
I have used for each loop container to poll the folder.
Can we set the directory to be polled at runtime taking from config table.
For doing this I have used the property Directory in expression editor of for each loop. But it is not working.
If I hard code the variable value in variables section , then its working.
How to change the directory to be polled value at runtime?
View 1 Replies
View Related
Apr 25, 2007
I'm trying to set up a For Loop Container that steps through the loop based on date logic.
Here's an example of what I'd like to do:
InitExpression | @SomeDate = 1/1/2007
EvalExpression | @SomeDate < GETDATE()
AssignExpression | @SomeDate = DATEADD(DAY, 1, @SomeDate)
The above syntax does not work, and I can't find an example that uses date logic with the For Loop Container.
Can anyone help me with this, or point me to an example that uses the For Loop Container with dats?
Thanks in advance for the help!
View 9 Replies
View Related
Mar 12, 2008
Hi,
I am using For each loop container in my SSIS package which will loop through more than one input file in the input folder.
All the input files in the input folder are picked by one by one. All the input files in the input folder are executed with the same ExecutionInstanceGUID.
Now, my requirement is to get a new ExecutionInstanceGUID during the execution of each input file in the For each loop container. My package only contains the For each loop container with some logic inside that.
Please let me know if any one can help me for the same.
Regards,
Sriram.
View 6 Replies
View Related
Apr 20, 2007
Hi Guys
I am trying to do the following and am quite new to SSIS.
I have to select a dataset from a database on server A, check if it exists on server B and perform an Update or Insert dependant on the existence.
I have created a SQL task to do the Select from server A with the results set passed to a variable of Vendors. I have added a ForEach Loop container with an enumerator of Foreach ADO Enumerator and the source variable is set to Vendors.
I have created 2 variables in the Foreach Loop called Code and Supplier - both as strings - as there are 2 fields from the initial Select that need to be passed to the final Update/ Insert.
I have then created another SQL task insert the Foreach which will perform the Update/Insert.
obviously when I run it at the moment it performs the Update/ Insert but just adds the rows with both Code and Supplier as NULL.
having looked at a couple of examples in books I have i know i need to add something in the Expressions of the Update/Insert SQL task but it is here i get a bit lost.
Which of the properties from the drop down do i need to use to map the variables against?
Any help would be massively appreciated asI am tearing my hair out!
Thanks
Scott
View 5 Replies
View Related
Aug 27, 2006
Hi,
A very strange thing happened to me. I have a package that includes two For each loop containers. Each container has script tasks, sequence containers, etc. Both are Foreach ADO Enumerator basis. It works without any problems until I changed the position of one of them in the Control flow and added some code in the script task. After these changes I executed the package and both of For each loop containers did not execute the tasks inside of them, any task. However the execution color on the containers was green (success). How can it be?
Your help is much welcome. Thanks in Advance.
JoĂŁo Cruz
View 2 Replies
View Related
Mar 30, 2007
Hi
Can anyone point me to an example of using a ForEach Loop Container to step through the rows in a recordset. I cannot seem to see how this is done from the help files.
Thanks
View 6 Replies
View Related
Aug 13, 2007
WHAT IS THE USE OF THE FOR LOOP CONTINER
PLEASE GIVE ME THE EXAMPLE
REGARDS
KOTI
View 5 Replies
View Related
Feb 26, 2007
Hi,
I am having problem when setting for-each container's EvalExpression as a variable comparison.
I have set this in expression editor
@[User::Syn] == 1
Editor says that it couldnt convert from System.Bool to System.String.
If I put it in quote, then for-each container says that it needs Bool, not String.
Please help me with this,
Thanks
View 7 Replies
View Related
