SQL 7 Identity Alternative And Transaction Concurrency
Apr 3, 2001
One of the kernel components of our application(s) is the concept of using surrogate keys (aka system assigned keys [SAKs]) for significant tables. We chose early on not to use IDENTITY due to limitations of cross-DBMS compatibility and @@identity retrieval issues relating to trigger value resets.
We are now in the process of reengineering our own "System Counter" scheme. Our current scheme runs in the user's transaction space (not using an identity column, but a separate "counters" table) -- we're running into performance problems in high concurrency situations as the counters table is holding locks for the duration of a user's transaction (e.g. if the insert trigger on one row's insert inserts rows into a log table which must fetch counters first, the counter rows are locked until the original insert is committed).
Our best performing solution currently is using an extended SP which opens its own connection, gets the counter then closes the connection (running quick this way, running in its own transaction space, it doesn't cause concurrency blocks from the longer running outer user transaction). It appears to work very well (with "pooled connections" its taking appx. 2ms to run) and is easy to use (e.g. a "black box solution"). However we're still considering using IDENTITY to avoid the extra DB connections that are taken up from the middle-tier solution.
Does anyone have experiences working with this topic, that you could share?
Hi everyone, I'm trying to come up with a replacement for @@IDENTITY, because I have SQL code I want to make more portable.
Original:ID = MyDataLayer.Execute("INSERT INTO X(a,b,c) VALUES(A,B,C); SELECT @@IDENTITY") Proposed solution: lock(MyDataLayer) ID = MyDataLayer.Execute("SELECT MAX(id)+1 FROM X") if(ID==null) ID=1 MyDataLayer.Execute("INSERT INTO X(id,a,b,c) VALUES(ID,A,B,C)") unlock(MyDataLayer) (This is of course pseudocode, for SQL Server I'd need SET IDENTITY_INSERT.)
Do you think the preceding solution is equivalent to the original? Do you know something better?
Equivalent should mean here, not necessarily generating the same ID's, but maintaining functionality and consistence all over the database.
I have a SSIS package that imports an Excel file using Visual Basic 2005 into my SQL 2005 database. All the fields are the same in the DB and xls. The package runs with no problem but I need one of the fields to be autoincrement. I tried to set up the properties of one of my fields "ID" to be an Identity. This didn't seem to work at all. There are about 1300 records in the DB so far with the last "ID" number being 10001415. Before now, the numbers were inputed manually. I want the "ID" to be assigned when the SSIS package imports the xls file.
hi gurusthe scenarioFrontend - MS Access (not yet decided whether MDB or ADP)Backend - MS SQL Serverit is a conversion from MS Access backend to MS SQL Server Backend.Planning to create stored procedures for all the Inserts, Updates,Deletes and Business Rules / Validations wherever it is possible.the problemi am running in concurrency problem. the same classic scenario of twousers retrieving the same row (record) from the same table. it allowsboth the user to update the record, that is, the user who updates lasthas his changes saved though he retrieved that particular recordsecond.what i need is that the user who retrieved the record second shouldn'tbe able to update or delete the record when it is already retrieved byany other user.would appreciate if someone pointed me in the right direction to solvethe above problem, i know it is related to isolation property but amnot surethanx in advanceregardsbala
Is it possible to do the following? Begin Transaction Insert into some table select @@identity as someid insert into relatedtables(forgeignkey) values(someid) Commit
Or does SQL not know the value of @@IDentity until the actual transaction commits, thus not allowing the select @@identity as someid? How does one circumvent this issue
I am having some problems wit a form where i need to insert a record into a table and then get the id of the record i just inserted and use it to insert a record in another table for a many to many relationship. The code is below (I cut out as much as i could to make it more readable). The erro message i get is this: Error saving file ATLPIXOFC.txt Reason: System.Data.SqlClient.SqlException: Prepared statement '(@FileName varchar(13),@ i' expects parameter @FileID, which was not supplied. at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj) at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj) at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString) at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async) at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe) at System.Data.SqlClient.SqlCommand.ExecuteNonQuery() at Microvit_Document_Product_Document_Add_v2.insertDocumentToDB() in e:inetpubwwwrootMicrovitDocumentProduct_Document_Add_v2.aspx.vb:line 127 at Microvit_Document_Product_Document_Add_v2.btnInsert_Click(Object sender, EventArgs e) in e:inetpubwwwrootMicrovitDocumentProduct_Document_Add_v2.aspx.vb:line 37
Protected Sub insertDocumentToDB() Dim myConnString As String = ConfigurationManager.ConnectionStrings("Master_DataConnectionString").ConnectionString Dim myConnection As System.Data.IDbConnection = New System.Data.SqlClient.SqlConnection(myConnString) Dim myCommand As System.Data.IDbCommand = New System.Data.SqlClient.SqlCommand Dim myTransaction As System.Data.IDbTransaction = Nothing myCommand.Connection = myConnection myCommand.Parameters.Add(New SqlParameter("@FileName", SqlDbType.VarChar)) myCommand.Parameters.Add(New SqlParameter("@ProductID", SqlDbType.Int)) myCommand.Parameters.Add(New SqlParameter("@FileID", SqlDbType.Int, ParameterDirection.Output))
I'm using transactions with my SqlConnection ( sqlConnection.BeginTransaction() ).
I do an Insert into my User table, and then subsequently use the generated identity ( via @@identity ) to make an insert into another table. The foreign key relationship is dependant on the generated identity. For some reason with transactions, I can't retrieve the insert identity (it always returns as 1). However, I need the inserts to be under a transaction so that one cannot succeed while the other fails. Does anyone know a way around this problem?
So heres a simplefied explanation of what I'm trying to do:
Begin Transaction Insert into User Table Retrieve Inserted Identity (userID) via @@Identity Insert into UserContact table, using userID as the foreign key. Commit Transaction.
Because of the transaction, userID is 1, therefore an insert cannot be made into the UserContact table because of the foreign key constraint. I need this to be a transaction in case one or the other fails. Any ideas??
I'm getting this when executing the code below. Going from W2K/SQL2k SP4 to XP/SQL2k SP4 over a dial-up link.
If I take away the begin tran and commit it works, but of course, if one statement fails I want a rollback. I'm executing this from a Delphi app, but I get the same from Qry Analyser.
I've tried both with and without the Set XACT . . ., and also tried with Set Implicit_Transactions off.
set XACT_ABORT ON Begin distributed Tran update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.TRANSACTIONMAIN set REPFLAG = 0 where REPFLAG = 1 update TSADMIN.TRANSACTIONMAIN set REPFLAG = 0 where REPFLAG = 1 and DONE = 1 update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.WBENTRY set REPFLAG = 0 where REPFLAG = 1 update TSADMIN.WBENTRY set REPFLAG = 0 where REPFLAG = 1 update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.FIXED set REPFLAG = 0 where REPFLAG = 1 update TSADMIN.FIXED set REPFLAG = 0 where REPFLAG = 1 update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.ALTCHARGE set REPFLAG = 0 where REPFLAG = 1 update TSADMIN.ALTCHARGE set REPFLAG = 0 where REPFLAG = 1 update OPENDATASOURCE('SQLOLEDB','Data Source=10.10.10.171;User ID=*****;Password=****').TRANSFERSTN.TSADMIN.TSAUDIT set REPFLAG = 0 where REPFLAG = 1 update TSADMIN.TSAUDIT set REPFLAG = 0 where REPFLAG = 1 COMMIT TRAN
It's got me stumped, so any ideas gratefully received.Thx
I have a design a SSIS Package for ETL Process. In my package i have to read the data from the tables and then insert into the another table of same structure.
for reading the data i have write the Dynamic TSQL based on some condition and based on that it is using 25 different function to populate the data into different 25 column. Tsql returning correct data and is working fine in Enterprise manager. But in my SSIS package it show me time out ERROR.
I have increase and decrease the time to catch the error but it is still there i have tried to set 0 for commandout Properties.
if i'm using the 0 for commandtime out then i'm getting the Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.
and
Failed to open a fastload rowset for "[dbo].[P@@#$%$%%%]". Check that the object exists in the database.
I am getting this error :Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction. Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code. Exception Details: System.Data.OleDb.OleDbException: Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.have anybody idea?!
i have a sequence container in my my sequence container i have a script task for drop the existing tables. This seq. container connected to another seq. container. all these are in for each loop container when i run the package it's work fine for 1st looop but it gives me error for second execution.
Message is like this:
Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.
i am getting this error "Distributed transaction completed. Either enlist this session in a new transaction or the NULL transaction.".
my transations have been done using LINKED SERVER. when i manually call the store procedure from Server 1 it works but when i call it through Service broker it dosen't work and gives me this error.
Hi everybody,I need to understand how concurrency excatly work in asp.net. For example, I'm confused what happens if two users at the same time try to access the same record in a table or even the same variable. Do ASP.NET handle this , I mean by locking one user and letting the other to have access OR it's up to the programmer to write some code to lock shared resources such as database , objects and variables?If it's up to the programmer to do this task, I appreciate if you can show me an example that clarifies that.Thank you
Following on from a thread I started about "concurrency" (real-time-ishsystem), I thought I would play about to see if I could easily adapt my datamodel to take account of potential multi-user write conflicts. So, I wouldappreciate you checking my logic/reasoning to see if this kind of thingwill work. Below I have a stored procedure that will simply delete a givenrecord from a given table. I have appended a "_Written" counter to thecolumns of the table. Every time the record is written, the counter isincremented. Clients store the current _Written count in their objects andpass this in to any write procedure executed.The procedure explicitly checks the _Written count within the transaction tosee if it agress with the written count passed in by the client. If it doesnot, the client throws an error. Note I am explicitly checking the_Written count precisely so I can determine exactly why this operation mightfail, rather than checking @@ROWCOUNT after an update.Thanks.RobinCREATE PROCEDURE dbo.proc_DS_Remove_DataSet@_In_ID INTEGER,@_In_Written INTEGERASDECLARE @Error INTEGERDECLARE @WRITTEN INTEGERBEGIN TRANSACTIONSET @Error = @@ERRORIF @Error = 0BEGINSELECT @WRITTEN = _Written FROM MyTable WHERE ID = @_In_IDSET @Error = @@ERRORIF @WRITTEN <> @_In_WrittenBEGINRAISERROR ('10', 16, 1)SET @Error = @@ERRORENDENDIF @Error = 0BEGINDELETE FROM MyTable WHERE ID = @_In_IDSET @Error = @@ERRORENDIF @Error = 0COMMIT TRANSACTIONELSEROLLBACK TRANSACTIONRETURN @Error
Do single commands (or stored procedures) execute concurrently, or they are executed one by one. How do you perform a lock during the execution of a command (or stored procedure).
I have a user object that is stored in the session for each user but what if an administrator updates a certain user and I want to reflect the update to the user if they are logged in?One possible way of solving this is:Each time the user goes to a page, check the user table and compare the timestamp. That would mean if 30 users refresh the page..the db would hit 30 times lol. I don't think that would scale very well.Any ideas on how to solve this?
I have a table where I count how many emails of a given type are sent out each day. This incrementing is wrapped in a sproc that either inserts a new row, or updates the existing row. The column that counts the value is named Count of type INT. Below is the sproc, seems like a straightforward thing. However, I'm seeing email counts higher than they should be when there's a high number of concurrent executions of the sproc. I'm pretty sure it's not a problem in the calling code, so I'm wondering about the UPDATE statement, since it updates a column based on the value of the column. I would think this should work since it's wrapped in a SERIALIZABLE transaction, anybody have further insight? SQL Server 2005 by the way. Sean CREATE PROCEDURE [dbo].[IncrementEmailCounter]( @siteId SMALLINT, @messageType VARCHAR(20), @day SMALLDATETIME) ASBEGIN SET NOCOUNT ON; SET TRANSACTION ISOLATION LEVEL SERIALIZABLE BEGIN TRANSACTION IF (SELECT COUNT(*) FROM EmailCount WHERE SiteId = @siteId AND MessageType = @messageType AND [Day] = @day) = 0 INSERT INTO EmailCount (SiteId, MessageType, [Day], [Count]) VALUES (@siteId, @messageType, @day, 1) ELSE UPDATE EmailCount SET [Count] = [Count] + 1 WHERE SiteId = @siteId AND MessageType = @messageType AND [Day] = @day COMMIT TRANSACTION SET TRANSACTION ISOLATION LEVEL READ COMMITTEDEND
I'm wondering whether the following code would work if users are RAPIDLY registering (assumption) WITH the same username.public bool UsernamExists(string username) { string sql = "SELECT true FROM [users] WEHRE username = @username;"; return Convert.ToBoolean(comm.ExecuteScalar()); }
//update or insert sql for user etc blah blah } If two users try to signup AT THE VERY SAME TIME (DOWN TO THE NANOSECOND), would this technique work? Do I have to wrap it in a transaction, stored procedure?? Thanks.
Hi,I'm trying to implement Optimistic Concurrency in asp 2 but so far it has caused me nothing but problems.First, when doing an UPDATE I tried to use the primary key & a timestamp field which I had in SQL Express.. VS 2005 generated the stored procedures fine however when it came to the actual updating I think there was a problem with the conversion of the timestamp field when it was being stored in a text box (in a FormView control). So.. as a result that failed. And also I checked sooo many places online and haven't been able to find any examples of code where a timestamp was used with success in asp2.Next, I got ride of the timestamp type (in SQL Express database) and used a datetime and then.. I just implemented Optimistic Concurrency by passing in ALL the values (ie all the original values) like is proposed http://www.asp.net/learn/dataaccess/tutorial21vb.aspx?tabid=63 . This... works however I really do not want to have to pass in ALL these values (ie original and new).Ideally I would like to be able to use the primary key & the datetime field to handle the Optimistic Concurrency checks where only the original values of both those fields are passed back into the stored procedure. Now.. I tried this as well, but I kept getting an error that suggests that (for some reason) the FormView or DataSource is passing ALL the values (original & new) into the dataset as opposed to only the original primary key & datetime fields & the new set of values.Can ANYONE offer any help? I really would like not to have to pass in all these values.Thanks in advance!
Hi! I'm building a web application with ASP.NET, and using MS SQL 2000 for my database server. How should I do to guarantee the integrity of the data in spite of the concurrent access? Meaning... how can I make sure that more than 1 user can update 1 table at the same time, while no error will occur? Do I need to add some codes at my aspx file? Or do I need to do something to my database? Or do I not have to worry about it? Thank you.
Can anyone help with concurrency issues. Small network and only one person at a time can log into the database. It was originally written in MS Access and converted to SQL 7.0 with a VB front end.
Is there any way to get the sample below working so that both "threads" are guaranteed to get unique and incrementing values?
I'm suspecting the answer is no. You can use transactions on completely database oriented operations that read/write to a database and complete. But there aren't complete synchronization controls for operations like below that try to return a value to an outside process.
IF OBJECT_ID('SimpleTable') IS NOT NULL DROP TABLE SimpleTable
CREATE TABLE SimpleTable ( A INTEGER ) INSERT INTO SimpleTable (A) VALUES (1)
-- Run in one window DECLARE @value INTEGER
BEGIN TRANSACTION SELECT TOP 1 @value = A FROM SimpleTable WAITFOR DELAY '00:00:05' UPDATE SimpleTable SET A = @value + 1 COMMIT TRANSACTION
SELECT @value SELECT A FROM SimpleTable
-- Run in a second window DECLARE @value INTEGER
BEGIN TRANSACTION SELECT TOP 1 @value = A FROM SimpleTable UPDATE SimpleTable SET A = @value + 1 COMMIT TRANSACTION
Did I understand correctly the Pesimistic access: When we choose pessimistic access -we lock all the rows of the table. right. -other users still can access the table if they specify read only mode meaning if their intention is to only read the data and not modify it. am I right
In a previous post, the theme of cursors and concurrency was touched as a secondary subject. I have a specific question about it as the primary one:
if we have -------- create proc myProc as declare cursor for select * from mytable go ---------- if two or more clients(webpages for example) execute myProc concurrently will the cursor be safe ? or would I have to make special arrangements, there are a couple of procs (that use cursors)that somebody else did and would not like to modify but we want to make the procs web available,
Hi, I was wondering if it is possible to call a stored procedure from sql server 2005 (call it sp_1) that calls an assembly which takes a message, wraps it in soap and calls a webservice and waits for a reply from that webservice (the stored procedure is clr not t-sql). This WebService needs to then call sp_1 to perform some other tasks. Is this possible or does sp_1 need to have finished what it was doing before it can be called again.
I have been trying to do this and have received a number of errors one of which looks like;
'The context connection is already in use.'
Sorry if I haven't worded it very well, I will try to clear up any questions if you need me to.
I want to centralize my previous standalone application. Previous application was using VB.NET and Access XP. Now I want to keep a centralized database (SQL Server 2005) and VB.NET 2005. At this point of time thousands of concurrent users will connect to the database at the same time.
In my application, when a ticket is being issued to a tourist, an SQL query finds the max(ticketno) for the current month from the main table and reserves this number for the current ticket. When the operator has finished entering information and clicks SAVE button, the record is saved to the main table with this ticket no. Previously there was no issue since the database was standalone.
I want to know how to block the new ticket no so that other concurrent users are not using the same number for saving a record. How to better tune the database for thousands of concurrent users at the same time? I also want that the other user must not get an error message when he attempts to save a record. It should be automatically handled by the database.
I created an ETL Process which loads four different types of files into different tables in parallel. There is no issue with this parallelism as the sources and destinations are distinct. But I have a common log table where I log the status and timings of each load for any file type. When ever I start a new file load, I create an entry in this log table with the FileTypeID and LoadInProcess as 1 (this will be set to 0 for all other records of the same file type). At different stages of the load, I will pull the active LoadID of the current file type and update the same record with the timings and results. My code looks like this -
Code Snippet SELECT
@LoadLogKey = LoadLogKey FROM
SystemLoadLog (NOLOCK) WHERE
FileTypeID = 1 and LoadInProcess = 1
IF @LoadLogKey is NULL
RAISERROR('Unable to retrive LoadLogKey for the current load!')
Process1Result = x, Process2Result = y, Process3Result =z WHERE
LoadLogKey = @LoadLogKey
The first SELECT query is giving problems as different processes are using the same table to log the results and timings. The source files I load are too small that the data load finished in 1 or 2 seconds most of the time and within this timespan, I update the log atleast 10 times. So, if four different file types are loading, the hits to the SystemLoadLog can be as bad as 20 to 30 times in 1 second.
There are 17 Client PC connected to a Server with SQLExpress 2005.
17 Client will do verification of identity before sending data to display at server in first in first out basis using Datagridview ( the earliest data received will be
display first) and stored for review at later stages.
What should I do? I plan to use VB2005 after trying the EXpress.The Tasks are simple:
Data send --> Server Diplay and Stored---> Someone at Server will Acknowledge by
Button--> Messages will be sent to inform Client data received.
I could have 17 different Table (But with same fields!) and displaying the Data send by reading all 17 tables and display it with Datagriedview. But this definately will
be slower than Just read from 1 table!
I'm concerned about Concurrency as there is chances that May be more than 1 user
might trying to update the Database at the same occasion. Can someone provide me a
Tips and advice?
Note: I had came across something call CurrencyManager which is related to
I have a number of SqlDataSource objects in my application, which don't have Optimistic Concurrency option enabled. The SDS objects use custom Sql statements so I can no longer select the Advance button to enable Concurrent Concurrency. How can I enable this option? Is there a designt ime property, and even a run time property that can be set? The only method we have so far is to create a new SDS, with Optimistic Concurrency switched on, then copy and paste my custom Sql into it and rebind my components.. Any help on this matter is appreciated. Regards, Steven
i'm dealing with Concurrency Issue in SQL Server 2005,
let me explain me what i want to do
I have a table
UserInfromation
ID (PK - Int autogenerated )
Name ( Varchar(20) )
Age ( int )
LastModifiedDateTime
User 'A' inserts a record in UserInformation Table
1 John 20 12/12/2005 15:30 PM
i have written Stored Procedure which Get's the records from UserInformation Table
again i have one more stored Procedure which updates the UserInformation already entered in UserInfromation Table
if User 'A' runs the Get StoredProcedure on his machine and binds the Dataset ( result ) to GridView at 10:00 AM
A User 'B' runs the Get Stored Procedure on his machine and binds the DataSet ( Result ) to GridView at 10:01 AM
both users are looking at the same same data which was entered by User 'A'
now User 'A' Updates the Record (i.e)
1 John 20 12/12/2005 15:30 PM
to
1 Kemp 50 12/12/2005 10:05 PM
at 12/12/2005 10:05 PM
but the User 'B' is still looking at the data which contains
1 John 20 12/12/2005 15:30 PM
which means the data is invalid,
so my question is how User 'B' is goin to get the notification that the data which he is currently seeing is old one and someone else has modified the data
To solve this problem i have a LastModifiedDateTime Column in UserInformation table which keeps the record of when this data( row ) was modified
what i do is when i get the data from my get stored procedure i get all the columns from the Table and when i modify the selected record i pass the required information in Input Parameter ie. ID ,UserName ,Age , LastModifiedDateTime ( this is the datetime which was saved when the particular record was modified ) , now i'm using the LastModifiedDateTime value and comparing it with the same ID's record.
e.g.
while Running the Get Stored Procedure i'm getting
1 John 20 12/12/2005 15:30 PM
when i'm executing Update Procedure i'm passing values as
1 Kemp 50 12/12/2005 15:30 PM
in my update Stored Procedure i'm comparing the Passed date 12/12/2005 15:30 PM with the current value in the same Id's i.e. ID = 1 LastModifiedDateTime Column if the date which is passed by the user as input parameter is different then the passed ID's LastModifiedDateTime columns value then the stored Procedure will raise and error that the "Data has been changed , request user to Refresh the Data"
my Question is , Is there any other way that i can implement concurrency issue in SQL Server 2005 . Please let me know
