Two Phase Commit With Sql And Msmq
Jul 3, 2006Doe's anyone have a good article on it ?
Thanks
Avi
ADVERTISEMENT
Two Phase Commit
Jun 15, 2006How to implement two pase commit in SQL Server 2000, Is there Database Link link Oracle available here ?
View 5 Replies View RelatedTransactional Replication 2 Phase Commit
Apr 20, 2001Hi All,
Server A has been configured as distributor, publisher and push subscription to Server B. Replication works fine from A to B. But B to A gives an error "OLE DB Provider SQLOLEDB does not support distributed transaction".
The other way I tried is :
Server B has been configured as distributor, publisher and push subscription to Server A. Replication works fine from B to A. But A to B gives an error "OLE DB Provider SQLOLEDB does not support distributed transaction".
Regards,
Suresh.
Does Ms Sql Support Two Phase Commit Protocol
Dec 29, 2006Hello ,My question is:does ms sql support two phase commit protocol?and Why if no.How if yes.Thank you
View 2 Replies View RelatedData Flow Stuck In Phase The Final Commit Data Insertion Has Started
Jun 19, 2007Hello,
I have noticed that for one of my data-flows, the process is really long during the phase "the final commit data insertion has started".
To be accurate, the process is fast until it reaches this phase. It happens often when I load millions of lines.
The extraction is done from a database SQL Server 2005 to a database SQL Server 2005, on the same server (with the SQL Server native provider).
I used a SQL Server destination but I have tried with an OLE DB destination and it is the same situation.
Why the process could be so long during this phase?
There is a way to optimised my package to avoid that?
Any idea is welcome.
Thanks.
Guillaume
MSMQ
Nov 28, 2006Does anyone know or have any idea what's the use of msmq or how can this apply in ssis.
Thanks
MSMQ SSB WCF?
Jun 27, 2007I've an asp.net application that generates tons of messages (a few hundreds/Second, depending on load of requests). Basically, I need to consume those messages (doesn't have to call "message" even) into sql server table. Each message being a new row in a table.
I tried a few things but failed to satisfy the performance. I tried to put the messages in MSMQ and then have either the MSMQ trigger to process the message or Windows C# service to process message. The performance is horrible.
I'm thinking to send messages directly to SSBQueue and have sql server process it. Is there any async way of doing this so the performance would not be a problem? Anyway I can use WCF + SSB to solve this problem?
Can anybody suggest better approach? Buying a decent hardware or SQL Server 2005 is not a problem.
Rushi, if you are reading this post, sorry for the repeatation, I know I emailed you a few hours ago...
Thanks.
COMMIT TRAN Does Not Commit
Mar 28, 2008Microsoft SQL Server Management Studio Express
select @@trancount
begin tran
select @@trancount
use ProdNetPerfMon
select @@trancount
update Nodes set Caption = 'xxxx' where Vendor = 'yyyy'
select @@trancount
commit tran
select @@trancount
Executes as expected including trancount without errors.
Nodes.Caption is updated but reverts after a few minutes.
sa privileges
What am I missing?
Does MSMQ 1.0 Work With SQL 7?
Feb 15, 1999Does MSMQ 1.0 work with SQL 7?
MSMQ requires SQL Server. It works with SQL 6.5.
SQL Service Broker Vs MSMQ
Aug 23, 2006I'm in the process of doing the initial research for the architecture of a large scale, transactional messages routing platform.
My initial
design called for a series of MSMQ queues and Windows Services, written
in C#, to process the messages in these queues. There will be incoming
and outgoing queues, queues to store unroutable messages, etc.
My
application will be routing many hundreds of thousands (and eventually
millions) of messages per day. These message are very small (< 200
bytes each) and must be routed very quickly. (<1 second processing overhead per message for high priority messages.)
Using the term
"routing" may be a bit misleading. The messages arrive via TCP socket
connections. I will just need to take in a message, examine its
intended destination, and send it to one of several outgoing socket
connections, likely on different machines. Some messages require higher priority routing than others,
but I don't need multi-hop routing or anything like that.
Of
great concern to me is that there are absolutely no single points of
failure in the system. Because of this I was considering using a combination of MSMQ and Windows Services in a Clustered environment.
Can the Service Broker provide me with this kind of functionality? If so, how well does it perform and scale? Is it a better choice for messaging applications that require high transactional throughput than MSMQ?
I'm just trying to get an idea of what products/services I should look into further.
MSMQ && Integration Services
Feb 6, 2006I have a SSIS package in SQL Server 2005 that attempts to publish some data into a MSMQ Private queue located on another machine.
While I was creating the package the connection string was pointing to the local server something like: localhostprivate$csin
Now I'm trying to get to the remote machine but I'm not sure what type of connection string I need to enter:
I tried: mw59private$csin where mw59 is the name of the remote machine I need to publish to but that result into a "Invalid Queue Path Name."
I tried: formatname:DIRECT=OS:mw59private$csin but that results in "The specified format name does not support the requested operation...."
Any idea?
Thanks,
Thierry
Pre-Execute Phase
May 23, 2006What happens during the pre-execute phase?
Is there anything I can do to optimize it's execution?
I have a package that takes data from 2 SQL Server sources, unions them, and writes to a sql table.
The pre-execute takes 20 minutes, and the execution takes 45 seconds.
Thanks
BobP
Receive Adodb.Recordset From MSMQ?
Feb 6, 2008 I've been trying different things to "READ" the recordset from the "Message Queue". I can read it but with some weird characters. I've tried
ActiveXMessageFormatter
BinaryMessageFormatter
XMLMessageFormatter
So, far I have no luck.
MessageQueue msgQ3 = new MessageQueue("SERVERNM\" + msg.Label, false);
Message msg3 = new Message();
msg3.Formatter = new ActiveXMessageFormatter();
msg3 = msgQ3.Receive(new TimeSpan(0, 0, 30));
byte[] b = new byte[msg3.BodyStream.Length];
msg3.BodyStream.Read(b, 0, (int)msg3.BodyStream.Length); System.Text.ASCIIEncoding enc = new System.Text.ASCIIEncoding();
returnVal = enc.GetString(b);
RESULTS:
I try to convert it to String and then deserialize later but I'm getting some junk.
<?xml version="1.0" encoding="utf-8" ?>
<string xmlns="http://tempuri.org/">5??m.????????#?_?XTG!???????#?_?Xg??c??????? ?<???m????_?X |?"???????Dw=?????"I?<???m????_?X21? Reply_Code?$??5? MultiEntries?$??7?dName?.$??3? Page_Number?$??1? Number? $??3? Status_Code?$??/?_Name?.$??5? _Address?+$??/? B_City?$$??1? _State?$??-? _Zip? $??A? Bank_Telephone_Num?"$?? ??11 033000333YHONDA2nd street xavier VA 326200000(555) 555-5500</string>
Call Stored Procedure From MSMQ Message
Nov 28, 2007Does anyone have any ideas or sample code for firing a stored procedure using an MSMQ message?
I have to assume XML is in there somewhere.
(ie. create XML formatted message with proc call as element?)
Just getting started on project, any help appreciated.
www.beyonder422.com
MSMQ Export List Of The Public Queue
Jan 2, 2008
Hi,
I want to Export a List of the Public Queues using the command prompt. Can this be done. I don't want to always click the Export List button. I eventually want to automate the Export List so I can create an Environment HealthCheck.
Thanks
Long Duration Pre-Execute Phase
Mar 2, 2006Does anyone know why SSIS sometimes just sits in the Pre-Execute phase of a data flow and does nothing? It doesn't matter how elaborate the data flow is or the volume of data. It can sometimes take 80% of the task's run time.
View 44 Replies View RelatedDTS.Pipeline: Validation Phase Is Beginning.
Nov 19, 2007Hi, My package hangs and the log says DTS.Pipeline: Validation phase is beginning. Any ideas why this is happennig? This same package runs fine when I run it without turning on the transaction.
View 4 Replies View RelatedExecute Phase Memory Error
Aug 3, 2005Hi,
View 9 Replies View RelatedMsmq Missing Messages After Applying SP3a To SQL Server
Jan 12, 2004Used to work fine:
(windows 200 server, sql server 2000, JDBC driver SP2.)
Two java processes, one sending messages (using jdbc and sql as temp storage), second is receiving and placing on msmq.
After installing SP3a for SQL server, under high load (200 a sec) there are missing messages in msmq.
Installed everything from scratch on separate machine, works fine until SP3a is applied.
Any help is highly appreciated
MSMQ Connection Manager And Input Into A Data Flow
Apr 13, 2006Firstly the disclaimer: im a total SSIS bunny.
Ok, with that out of the way...
What i want to do is have data read from an MSMQ message (which will be a simple XML message) and have it transformed and inserted into a simple table. Sound simple, but i cant work out how to do it.
I started a new Integration Services Project and dropped a Data Flow task on the Control flow tab, then double-click it to go to the data flow tab. I have added a MSMQ connection manager which points at my private queue and i can hit the test button and it sees it tests ok. How do i wire that into my data flow?
On my dataflow tab i have a SQL Server Destination (set to the local SQl server instance) and ive been trying a DataReader source and try setting the Advanced Editor "Connection Manager" column on IDBConnection row to point to my MSMQ connection manager. I get some error "cannot aquire a managed connection from the run-time connection manager". How do i get a Data Flow source which reads the XML message off my MSMQ connection manager??
On the Control Flow tab you can add a Message Queue Task and i can bind it to my MSMQ connection manager and set it up as a recieve task etc, but how do i use that?
Help!
MSMQ Or Service Broker For Mission Critical Applications
Nov 30, 2007Hello,
I'm working on the design of a system that will have two queues. The first queue will take requests to do something. The second queue will hold the results of having done something. Both queues won't necessarily be on the same physical server. Clients reading/writing to the queue will not be using SQL server. Web service/WCF interfaces will be developed to interrogate/manipulate queues.
My question is: which is better - MSMQ or Service Broker; if I want reliable queues. I can affort to loose items off the first queue, but cannot afford to loose any result data on the second queue.
Can anyone make any recommendations please?
Regards,
Jonathan.
SSIS Writing To MSMQ Fails Only When Scheduled By Agent Job
Feb 12, 2008
Hi All,
I'm a bit lost on this...
I have an SSIS package which writes to a configured public MSMQ. When run directly through Visual Studio, file system or msdb it works fine (I guess these use me as the user).
However, when I schedule it through an SQL Agent Job it fails with the following:
Failed to write message ... to the queue.
This seems like a permissions thing to me, but I've tried giving full control to everyone in the MSMQ permissions, also explicitly giving full control to the user that the agent job executes as. Neither made a difference.
Any help would be greatly appreciated.
Cheers,
Tony Vaughan.
T-SQL (SS2K8) :: Rebuild Index Online Last Phase?
Jan 10, 2015I'm running SQL Server 2008 R2 with latest patch. I'm performing all index maintenance online. How long the final phase of the index operation takes? Does the size of the index matter and if any blocking occurs, does the duration increase because the size of indexes is larger? I've been told by management, we can not have any downtime, its my understanding even with online index there's a chance blocking can occur in the final phase of the index operation. My database and index size is over 1.5 tb and the number of transaction per second are in the 100's.
View 2 Replies View Related[DTS.Pipeline] Information: Pre-Execute Phase Is Beginning
Nov 28, 2007Hi,
I have a SSIS package which pumps data from one server to other without any additional steps. There are 11 tables for which data is transferred. And this packages runs fine on two different environments but fails in one environment i.e. on SIT.
It doesn't throw any error and every time stops at the below step
[DTS.Pipeline] Information: Pre-Execute phase is beginning.
Progress: Pre-Execute - 0 percent complete
Progress: Pre-Execute - 1 percent complete
Progress: Pre-Execute - 2 percent complete
Progress: Pre-Execute - 3 percent complete
Progress: Pre-Execute - 4 percent complete
Progress: Pre-Execute - 5 percent complete
Progress: Pre-Execute - 6 percent complete
Progress: Pre-Execute - 7 percent complete
It doesn't complete neither throws an error. Any pointers on what the problem could be
Thanks
Package Stuck On Pre-Execute Phase Is Beginning.
Jun 8, 2007Hi all,
I have a monster SQL query (SQL Server connection) that I'm trying to export to flat file. My package appears to just stick on the "Pre-Execute phase is beginning" stage. (I left it running overnight, and it's still going... no error message, I think it's just hung. If I include a "Top 10" in the my source query it completes without a problem. I'm wondering if it's an out-of-memory issue, but when I've run into this in the past there have been error messages generated. I've tried using both a Data Reader and an OLEDB Datasource. Does anyone have any ideas of what's going on and how I might fix it?
Thanks!!!Jess
Problem With Excel Import In Execute Phase
Jul 23, 2007Hi All
I have a SSIS package running and tested fine on my desktop. However when I deploy the package to my server I get the error given below.
SSIS package "CR Sec Watch List 2.dtsx" starting.
Information: 0x4001100A at Transform Master Files: Starting distributed transaction for this container.
Information: 0x4004300A at Transform Master Files, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Transform Master Files, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Transform Master Files, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Transform Master Files, DTS.Pipeline: Execute phase is beginning.
Error: 0xC0202009 at Transform Master Files, Excel Source [1]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E21.
Error: 0xC0208265 at Transform Master Files, Excel Source [1]: Failed to retrieve long data for column "NKoreaPoi".
Error: 0xC020901C at Transform Master Files, Excel Source [1]: There was an error with output "Excel Source Output" (9) on component "Excel Source" (1). The column status returned was: "DBSTATUS_UNAVAILABLE".
Error: 0xC0209029 at Transform Master Files, Excel Source [1]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "output "Excel Source Output" (9)" failed because error code 0xC0209071 occurred, and the error row disposition on "component "Excel Source" (1)" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
Error: 0xC0047038 at Transform Master Files, DTS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on component "Excel Source" (1) returned error code 0xC0209029. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
Error: 0xC0047021 at Transform Master Files, DTS.Pipeline: SSIS Error Code DTS_E_THREADFAILED. Thread "SourceThread0" has exited with error code 0xC0047038. There may be error messages posted before this with more information on why the thread has exited.
Error: 0xC0047039 at Transform Master Files, DTS.Pipeline: SSIS Error Code DTS_E_THREADCANCELLED. Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown. There may be error messages posted before this with more information on why the thread was cancelled.
Error: 0xC0047021 at Transform Master Files, DTS.Pipeline: SSIS Error Code DTS_E_THREADFAILED. Thread "WorkThread0" has exited with error code 0xC0047039. There may be error messages posted before this with more information on why the thread has exited.
Information: 0x40043008 at Transform Master Files, DTS.Pipeline: Post Execute phase is beginning.
Information: 0x40043009 at Transform Master Files, DTS.Pipeline: Cleanup phase is beginning.
Information: 0x4004300B at Transform Master Files, DTS.Pipeline: "component "SQL Server Destination" (20)" wrote 0 rows.
Task failed: Transform Master Files
Information: 0x4001100C at Transform Master Files: Aborting the current distributed transaction.
Warning: 0x80019002 at Process Master Files: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (8) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "CR Sec Watch List 2.dtsx" finished: Success
For some reason it tells me that it not able to retrive the long data for a column. The column mentioned in the error contains special characters.
Once again, there seems to be no problem with the package as the package runs fine on my desktop.
Any help or clues as to why this is happening on my server is greatly appreciated.
Regards
Ryan
Verify Phase Fails On SQL Cluster On Win 2003 Server
Jul 23, 2005I posted this to the ms sql clustering news group, but I thought I'dpost it here just in case someone here knew the answser. This problemhas had me baffled for 5 months, and I'm not seeing any supportarticles from Microsoft on it, yet. Anyone here got a clue?About 5 months ago, I posted a query to this group after experiencingfailures with my database maintenance plans (during the verify phase)that run on SQL Clusters on Windows 2003(http://groups-beta.google.com/group...9b?dmode=source)I was re-posting this in hopes that someone knows of a fix besidescoding a home-brew verify step in to the backup job to check the file'sintegrity?Thanks,TW
View 1 Replies View RelatedCan Anyone Explain What The Pre-execute Phase Is Doing For OLE DB Data Sources Using Sql Commands?
Nov 3, 2006I have a project which spans multiple servers and aggregates literally billions of rows of data into a much smaller and manageable result set which I store on another server. There are two stored procedures which take up 99.9% of the processing time. Each one of these SPs are estimated to run over 3 hours a piece (gives you an indication of how much data there really is). With in this SSIS package, I have two control flows, one for each SP. When I run the SSIS package from VS2005, I can see that there is a pre-execute phase which takes about an hour abnd a half to complete, and then move on to executing. My question is, what the heck is this, and what is it doing? I know it validates the sql in the procedure, but does it actually run the SP during that pre-execute phase? If it does, is there any way to get around that?
Any help would be appreciated.
Data Flow With Fuzzy Lookup Freezes On Pre-execute Phase
Dec 5, 2006I have a fuzzy lookup in a data flow but this data flow never gets pass pre-execute phase. What is the problem?
Thanks
MS SQL Commit?
Sep 14, 2004Do delete/update statements in MS SQL Server need a "commit" (or equivalent) run after them as they do in Oracle?
View 1 Replies View RelatedMSMQ And SQL Server 2000 On Same Server?
Oct 14, 2004I had a question thrown at me today that I am unable to find an answer to.
Can MSMQ 2.0 and SQL Server 2000 co-habitate on the same server? That is, can they both be installed on the same server and run along side each other with a big smile on their face?
My instinct is that, "yes", they can because they are both Microsoft products, but I have not been able to find anything that confirms this. Lots of information on the web about the two being used together, but nothing about them being on the same box.
Would someone be able to confirm whether they can/cannot run side by side on the same server? If you know of a website I can look at please let me know that also.
Thanks for the help! I greatly appreciate it!
-- Shava
Explicit Commit
Jun 8, 1999Hi ,
I've tried to switch MS-Sql/Server 6.5 on explicit_transactions
without success.
(set implicit_transaction on/off)
What is the exact syntax for doing that ?
Herve
(PS: Thanks Gregory for your quick answer )
Explicit Commit
Jun 3, 1999Hi All,
I don't know MS-SQLserver internal system at all. I 've just used Oracle
a couple years ago and so in some cases (e.g using TP-monitor MTS or Tuxedo)
you can switch off the implicit transaction by using
the option AUTOCOMMIT ON/OFF.
How can switch off the implicit transaction system on MS-SQLServer ?
In advance thanks,
Herve