I use cursors inside stored procedures, they are generally 20 - 50 records. I have been told that cursors are very resource intensive. Am I setting myself up for scaling problems when we have hundreds of users all running these procedures? The cursors are only used within the context of the stored procedure. Any opinions/insight on this would be appreciated.
Mike
I have a few questions about the amounts of resources used by the fuzzy grouping transformation. I am running a little less than 5mil records through a fuzzy grouping that exact matches one column and fuzzy matches one. The server executing the package is a dual-core xeon with 2gb ram, running a default instance of sql 2005 enterprise.
I have been attempting to execute this package for a while now but it keeps erroring out for various reasons. At first, it was from a lack of available memory. I limited the memory usage of sql server to 256mb and set the buffer temp storage path, which alleviated those errors. However, now, my tempdb transaction log is growing significantly. It failed once for not being able to grow and reallocate quickly enough, but enlarging the auto-growth factor fixed that. Then, it filled up the volume the tempdb log was on, so now I have moved it to the san and am about to try again.
I was wondering, does anyone have a general idea on approximate resource usage by fuzzy grouping? Specifically, is there an approximate relation between the number of records grouped and the amount of ram/pagefile required? Also, on the database backend, how big can I expect the tempdb data/log files to get?
I'm attempting to update a table of around 100,000 records with a table of 20,000 records using a cursor since the update is based on a row by row criteria. When doing this I'm getting an error
--Resource is low some results are dropped--
I then cut down the table with 20,000 to a table of 5,000 and still get the same error. I've also tried to use a fast_forward cursor but still no luck
Can any-one help. I know there is a way to do this using a quick update statement but I need to know this for other insert statements anyway.
Help Help
How to restrict resources usage based on individual Databases in resource governor?
We have many databases in one instance; I would like to restrict resource usage to each database respectively.
I created 2 pools as pool_login, pool_DBNAME, and 2 workload groups as GroupLogin,GroupDBNAME, and also the classifier function.After setup above, I use following statement to check what sessions are in each group .
Even if there are spids which are accessing database DBNAME, I can’t see that they fall into the group GroupDBNAME and pool pool_DBNAME.
SELECT s.group_id, CAST(g.name as nvarchar(20)), s.session_id, s.login_time, CAST(s.host_name as nvarchar(20)), CAST(s.program_name AS nvarchar(20))
FROM sys.dm_exec_sessions s
INNER JOIN sys.dm_resource_governor_workload_groups g
ON g.group_id = s.group_id
ORDER BY g.name
GO
Following is the code to create pool, group,classifier function:
USE master
GO;
-- Create a resource pool pool_login.
CREATE RESOURCE POOL pool_login
WITH
[Code] ....
-- Create a workload group to use this pool.
CREATE WORKLOAD GROUP GroupLogin
USING pool_login;
GO
CREATE WORKLOAD GROUP GroupDBNAME
USING pool_DBNAME;
[code]....
-- Register the classifier function with Resource Governor.
ALTER RESOURCE GOVERNOR WITH (CLASSIFIER_FUNCTION= dbo.rgclassifier_v1);
GO
hi guys
i have a table that contains a tremendous amount of row. i have written a stored procedure that takes a summary of that information and updates it's master table as well as another table. the problem is it takes very long to do. is what i am doing correct or is there a better way. here is the source
CREATE PROCEDURE update_cvrbatches
AS
declare @code varchar(25),@type varchar(3),@batchno varchar(10),@batchqty Float,@issued float,@returned float,@transfered float,@itemcount float,@totestcost float,@totactcost float,@reserved float,@warehouse varchar(3)
Update cvrwarehouse set BoughtQty =0, IssuedQty = 0, ReservedQty =0 ,Returned = 0 ,Transfered = 0
DECLARE getbatches CURSOR
for
select Code,Type,BatchNo,sum(BoughtQty) as BoughtQty,sum(IssuedQty) as IssuedQty,sum(ReservedQty) as ReservedQty,sum(ReturnedQty) as ReturnedQty,sum(TransferQty) as TransferQty,count(Barcode) as ItemCount,
sum(EstCost) as EstCost,sum(ActCost) as ActCost,Warehouse
from cvrbatches
Group by Code,Type,Colour,Quality,CustomField,BatchNo,Warehouse
OPEN getbatches
FETCH NEXT FROM getbatches into @code,@type ,@batchno ,@batchqty,@issued ,@reserved,@returned ,@transfered ,@itemcount ,@totestcost ,@totactcost ,@warehouse
WHILE @@FETCH_STATUS = 0
BEGIN
--doen iets hier
update cvrbatchctrl set BatchQty = @batchqty, Issued = @issued, Reserved = @reserved ,Returned = @returned ,Transfered = @transfered, ItemCount = @itemcount,TotalEstCost = @totestcost,TotalActCost = @totactcost
where Code = @code and Type = @type and Warehouse = @warehouse and BatchNo = @batchno
update cvrwarehouse set BoughtQty =BoughtQty + @batchqty, IssuedQty = IssuedQty + @issued, ReservedQty = ReservedQty + @reserved ,Returned = Returned + @returned ,Transfered = Transfered + @transfered
where Code = @code and Type = @type and Warehouse = @warehouse
FETCH NEXT FROM getbatches into @code,@type ,@batchno ,@batchqty,@issued ,@reserved,@returned ,@transfered ,@itemcount ,@totestcost ,@totactcost,@warehouse
END
CLOSE getbatches
DEALLOCATE getbatches
is there a better way??
I have a client program that writes to sql server database 10 records per second . i want to compute the CPU usage and the memory usage for the whole program or CPU usage,memory usage for the insert statement in the program .
Can anybody help me with this?
Hello, When I am seeing SQL Server 2005 Management studio Server Dashboard> I am seeing my(USERS) databases and msdb database usage is very small % of in CPU Usage(%), Logical IO Performed (%) Usage pie chart.
90% of Total cpu usage is showing for Adhoc Queries. what excatly this means in Dashboard? if application uses more than it would have shown in Database level or not?
sicerely this dashboard is good, if any one is watching daily, please advice their experiences here.
Thanks in advance. Hail SQL Server!
providing a query for fetching the data for CPU Usage, Memory usage, blocking and all details ...
I want to create a job which will run on a Node every 15 min and store data in a table for each instance...
DMV is not giving more stuff and xtended events not sure if i can store that data into a table?
In MSDN file I read about static cursor
STATIC
Defines a cursor that makes a temporary copy of the data to be used by the cursor. All requests to the cursor are answered from this temporary table in
tempdb; therefore, modifications made to base tables are not reflected in the data returned by fetches made to this cursor, and this cursor does not allow modifications
It say's that modifications is not allowed in the static cursor. I have a questions regarding that
Static Cursor
declare ll cursor global static
           for select name, salary from ag
 open ll
            fetch from ll
Â
             while @@FETCH_STATUS=0
              fetch from ll
               update ag set salary=200 where 1=1
Â
  close ll
deallocate ll
In "AG" table, "SALARY" was 100 for all the entries. When I run the Cursor, it showed the salary value as "100" correctly.After the cursor was closed, I run the query select * from AG.But the result had updated to salary 200 as given in the cursor. file says modifications is not allowed in the static cursor.But I am able to update the data using static cursor.
Hello,I have a test database with table A containing 10,000 rows and a tableB containing 100,000 rows. Rows in B are "children" of rows in A -each row in A has 10 related rows in B (ie. B has a foreign key to A).Using ODBC I am executing the following loop 10,000 times, expressedbelow in pseudo-code:"select * from A order by a_pk option (fast 1)""fetch from A result set""select * from B where where fk_to_a = 'xxx' order by b_pk option(fast 1)""fetch from B result set" repeated 10 timesIn the above psueod-code 'xxx' is the primary key of the current Arow. NOTE: it is not a mistake that we are repeatedly doing the Aquery and retrieving only the first row.When the queries use fast-forward-only cursors this takes about 2.5minutes. When the queries use dynamic cursors this takes about 1 hour.Does anyone know why the dynamic cursor is killing performance?Because of the SQL Server ODBC driver it is not possible to havenested/multiple fast-forward-only cursors, hence I need to exploreother alternatives.I can only assume that a different query plan is getting constructedfor the dynamic cursor case versus the fast forward only cursor, but Ihave no way of finding out what that query plan is.All help appreciated.Kevin
View 1 Replies View RelatedI'm trying to implement a sp_MSforeachsp howvever when I call sp_MSforeach_worker
I get the following error can you please explain this problem to me so I can over come the issue.
Msg 16958, Level 16, State 3, Procedure sp_MSforeach_worker, Line 31
Could not complete cursor operation because the set options have changed since the cursor was declared.
Msg 16958, Level 16, State 3, Procedure sp_MSforeach_worker, Line 32
Could not complete cursor operation because the set options have changed since the cursor was declared.
Msg 16917, Level 16, State 1, Procedure sp_MSforeach_worker, Line 153
Cursor is not open.
here is the stored procedure:
Alter PROCEDURE [dbo].[sp_MSforeachsp]
@command1 nvarchar(2000)
, @replacechar nchar(1) = N'?'
, @command2 nvarchar(2000) = null
, @command3 nvarchar(2000) = null
, @whereand nvarchar(2000) = null
, @precommand nvarchar(2000) = null
, @postcommand nvarchar(2000) = null
AS
/* This procedure belongs in the "master" database so it is acessible to all databases */
/* This proc returns one or more rows for each stored procedure */
/* @precommand and @postcommand may be used to force a single result set via a temp table. */
declare @retval int
if (@precommand is not null) EXECUTE(@precommand)
/* Create the select */
EXECUTE(N'declare hCForEachTable cursor global for
SELECT QUOTENAME(SPECIFIC_SCHEMA)+''.''+QUOTENAME(ROUTINE_NAME)
FROM INFORMATION_SCHEMA.ROUTINES
WHERE ROUTINE_TYPE = ''PROCEDURE''
AND OBJECTPROPERTY(OBJECT_ID(QUOTENAME(SPECIFIC_SCHEMA)+''.''+QUOTENAME(ROUTINE_NAME)), ''IsMSShipped'') = 0 '
+ @whereand)
select @retval = @@error
if (@retval = 0)
EXECUTE @retval = [dbo].sp_MSforeach_worker @command1, @replacechar, @command2, @command3, 0
if (@retval = 0 and @postcommand is not null)
EXECUTE(@postcommand)
RETURN @retval
GO
example useage:
EXEC sp_MSforeachsp @command1="PRINT '?' GRANT EXECUTE ON ? TO [superuser]"
GO
In Oracle & Sybase you can set login resource limits to restrict, time of day, number of i-o's, cpu use etc for any login, at the login method. All actions done from a resource limit constrained login inherit the constraints.
Is there any way to implment this with any MS SQL Server version from 200-2005/SP2?
Before anyone answers, please do not suggest set rowcount etc.
thanks.
How to find the physical path of resource db files from SSMS query?
------------------------
I think, therefore I am - Rene Descartes
I have a deadlock chain that shows 9 parallel insert jobs into the same table. The resource that is locked (with an exclusive lock) shows a HOBT_ID...which corresponds to a clustered index.
My question is how would INSERT statements cause a whole index to lock (there is no TABLOCK hint).
Hi,
I would like to know witch is the best practices to make a .rdl file multilenguaje, that is, that the same .rdl file shows the text €œAmount€? on a label when the user is English or the text €œCantidad€? when the user is Spanish.
There are not something like the resource files in the in a VS.NET web application????
Thanks,
Hi Community:
I am new to SSIS, and have been struggling recently with SSIS development. I would like to find out if there are some good books out there on SSIS besides, the online resources, and BOL. Possibly a good book or tutorials. Thanks.
MA
Hi,
I would like to know witch is the best practices to make a .rdl file multilenguaje, that is, that the same .rdl file shows the text €œAmount€? on a label when the user is English or the text €œCantidad€? when the user is Spanish.
There are not something like the resource files in the in a VS.NET web application????
Thanks,
part 1
Declare @SQLCMD varchar(5000)
DECLARE @DBNAME VARCHAR (5000)
DECLARE DBCur CURSOR FOR
SELECT U_OB_DB FROM [@OB_TB04_COMPDATA]
OPEN DBCur
FETCH NEXT FROM DBCur INTO @DBNAME
WHILE @@FETCH_STATUS = 0
BEGIN
SELECT @SQLCMD = 'SELECT T0.CARDCODE, T0.U_OB_TID AS TRANSID, T0.DOCNUM AS INV_NO, ' +
+ 'T0.DOCDATE AS INV_DATE, T0.DOCTOTAL AS INV_AMT, T0.U_OB_DONO AS DONO ' +
+ 'FROM ' + @DBNAME + '.dbo.OINV T0 WHERE T0.U_OB_TID IS NOT NULL'
EXEC(@SQLCMD)
PRINT @SQLCMD
FETCH NEXT FROM DBCur INTO @DBNAME
END
CLOSE DBCur
DEALLOCATE DBCur
Part 2
SELECT
T4.U_OB_PCOMP AS PARENTCOMP, T0.CARDCODE, T0.CARDNAME, ISNULL(T0.U_OB_TID,'') AS TRANSID, T0.DOCNUM AS SONO, T0.DOCDATE AS SODATE,
SUM(T1.QUANTITY) AS SOQTY, T0.DOCTOTAL - T0.TOTALEXPNS AS SO_AMT, T3.DOCNUM AS DONO, T3.DOCDATE AS DO_DATE,
SUM(T2.QUANTITY) AS DOQTY, T3.DOCTOTAL - T3.TOTALEXPNS AS DO_AMT
INTO #MAIN
FROM
ORDR T0
JOIN RDR1 T1 ON T0.DOCENTRY = T1.DOCENTRY
LEFT JOIN DLN1 T2 ON T1.DOCENTRY = T2.BASEENTRY AND T1.LINENUM = T2.BASELINE AND T2.BASETYPE = T0.OBJTYPE
LEFT JOIN ODLN T3 ON T2.DOCENTRY = T3.DOCENTRY
LEFT JOIN OCRD T4 ON T0.CARDCODE = T4.CARDCODE
WHERE ISNULL(T0.U_OB_TID,0) <> 0
GROUP BY T4.U_OB_PCOMP, T0.CARDCODE,T0.CARDNAME, T0.U_OB_TID, T0.DOCNUM, T0.DOCDATE, T3.DOCNUM, T3.DOCDATE, T0.DOCTOTAL, T3.DOCTOTAL, T3.TOTALEXPNS, T0.TOTALEXPNS
my question is,
how to join the part 1 n part 2?
is there posibility?
What are some good CASE programming to use in comjuction with SQL 7. What are some good resources for researching. Also, are there any good DB confrences coming up?
View 1 Replies View RelatedHow can I get my hands on the Microsoft SQL Server resource kit?
In particular, I need the "Load Simulator" application.
Any information would be greatly appreciated.
Jim
after moving the resource database files with this command:
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=data, FILENAME= 'new_path_of_mastermssqlsystemresource.mdf');
GO
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=log, FILENAME= 'new_path_of_mastermssqlsystemresource.ldf');
GO
I am getting this error trying to do anything in the instance while I have it started in minimal mode (/f /t3608)
(the instance WILL NOT COME UP UNLESS I USE THE /F /T3608 from a command promt.. please .. any suggestions??????????????????????
Also.. I checked and the primary file is NOT READ-ONLY.
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource.ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource.ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
Msg 945, Level 14, State 2, Line 1
Database 'mssqlsystemresource' cannot be opened due to inaccessible files or insufficient memory or disk space. See the SQL Server errorlog for details.
Msg 5069, Level 16, State 1, Line 1
ALTER DATABASE statement failed.
We have a JDBC project that works with SQLServer, along with otherDBs. During development, we noticed that resource useage on SQLServerseemed to grow steadily - Processes, Process Locks and/or Object Locks,according to the "Current Activity" section of Enterprise Manager.Fairly quickly (a few hours), SQLServer would use so many resources itused up all available system memory and the system would crash.Without understanding much about why that was happening, mostly out oftrial and error, we started using transactions, which seemed to fix theproblem. Now, one of our customers seems to be seeing the problem again:511 Process Locks, 18 Object Locks, 526 Processesafter a few hours. The system runs out of memory and crashes. We havemultiple test configurations, including Linux, Win2K, XP, but we donot see the same behaviour - we typically see no more than 20 or 30processes, process locks or object locks, and our tests seem to runindefinitely. Since we can not reliably reproduce the symptoms that ourcustomer sees, it is very difficult for us to analyze, let alone, fixthe problem.Does anyone - especially SQLServer pros - have any insight as to what isgoing on here and/or how to fix it? Like how does a process, processlock or object lock relate to JDBC? process <-> connection,object <-> row, table... or what, locks?Thanks,Gary WhittenJoin Bytes!
View 2 Replies View RelatedDear All,
Just downloaded a not too great white-paper (sponsored by HP) called SQL Server Infrastucture Optimaztion and it had a brief but eye catching section on something called 'Pooled Resource Clustering'. See below
Pooled-Resource Clustering
Pooled-resource clustering is a combination, of sorts, of Windows clustering and virtualization.
Essentially, it€™s a means of allowing SQL Server instances to become €œvirtual SQL Servers€? in
the sense of true VMs. They€™re encapsulated and can be easily and quickly moved between
physical computers. It borrows concepts from Windows clustering but does so with a crucial
difference that eliminates the resource management overhead that comes along with Windows
clustering. Another term for this technique is shared storage clustering.
Technology Overview
With pooled-resource clustering, a cluster of servers€”which can all have different hardware
specifications€”are connected to a single, shared storage system (typically a SAN). By
leveraging a Windows-based cluster file system, each of the nodes in the cluster can €œsee€? the
same storage area. That is, they all have (for example) an S drive,
I googled this and can't find any more about it. So my question is simple can anyone provide more info about this method. I tried tried the authors web site burt its all sales info address(
On the surface this seems a bit of a hack to me?
Thanks
Simon
I have a 2005 server that is upgraded to SP2 and the error log indicates it is version 9.00.3042.00. However, the system resource database for the same server is reporting as version 9.00.2047.00. From another post I have found out the some replication problems I am having are due to this discrepancy.
I have reapplied SP2 hoping it would change the resource db version, but it did not. Is there another way I can upgrade the resource db without re-installing SQL from scratch?
Thanks!
We've been working hard with our teams here to get better/more/good information out to our users. We€™ve created a new a customized Windows Live search, that limits results to Books Online. Check this out, and make sure you let your contacts know to visit it and provide feedback:
http://search.live.com/macros/sql_server_user_education/booksonline
We want to generate as much traffic as possible here so that we can see if this is useful to our users. We€™d love to hear back from everyone we can!
Are there any good resources for data mirror in SQL 2005 SP1?
I tried to search on microsoft.com, there is an article, but it is outdated, it only described data mirror in SQL 2005 RTM.
appreciate any links or input.
Owen
Hello All,
I was watching Bob Tabor's SQL Server 2005 Express for Beginners videos from the ASP.net 2.0 website http://www.asp.net/learn/videos/default.aspx?. In lesson 5 Manipulating the Database Data he refers to download the sample database SQLVideoResources.zip file from the above website.
I searched and did not find it. Can anyone please direct me?
Thanks,
Hi,
I am using SSIS for sending E-Mails based on certain transactions in SQL Server. I need to dynamically populate the E-Mail content as the content some times needs to be in Japanese text. I would like to use resource files for this. Could anyone please help me on using resource files in SSIS.
Thanks in advance.
after moving the resource database files with this command:
Code Snippet
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=data, FILENAME= 'new_path_of_mastermssqlsystemresource.mdf');
GO
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=log, FILENAME= 'new_path_of_mastermssqlsystemresource.ldf');
GO
I am getting this error trying to do anything in the instance while I have it started in minimal mode (/f /t3608)
(the instance WILL NOT COME UP UNLESS I USE THE /F /T3608 from a command promt.. please .. any suggestions??????????????????????
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource.ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource.ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
Msg 945, Level 14, State 2, Line 1
Database 'mssqlsystemresource' cannot be opened due to inaccessible files or insufficient memory or disk space. See the SQL Server errorlog for details.
Msg 5069, Level 16, State 1, Line 1
ALTER DATABASE statement failed.
I got a task to get resource consumption (CPU, storage etc.) for stored procedures in certain database. I found nice script ([dbo].[usp_Worst_TSQL]) but looks like script written for SQL 2005 and we use SQL 2012.how to get resource consumption details.
View 9 Replies View RelatedI`m having difficulty performing a SQL dump using a network drive. I have successfully created a backup device on a network drive but when I go to perform a backup using it I get the following error message: "Can`t open dump device `RSS4DATARSA3_Dump.Dat`, device error or device off line. Please consult the SQL Server error log for more details. (Message 3201)" I can successfully perform a backup using a local drive but not this network drive. I have checked the permissions on the network drive and is seems ok. I use the following command to try to perform the backup: "DUMP DATABASE RSA3 TO DISK = `Rss4DataRSA3_Dump.Dat WITH STATS = 10, INIT". Any help would be most appreciated. Thanks in advance!
View 2 Replies View RelatedI get the message when loading the bcp. I check the path variable and the sqlserver BINN directory is there, but twice. If I try opening the command window and write bcp, I get the error, if I enter the whole path c:...80 oolinncp there is no problem. I wonder what could it be?
I've manually reinstalled many times but still having trouble.
Thanx in advance
SQL SERVER 2000 or SQL SERVER 7 (I've tried with both)
WINDOWS XP
after moving the resource database files with this command:
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=data, FILENAME= 'new_path_of_mastermssqlsystemresource.mdf');
GO
ALTER DATABASE mssqlsystemresource
MODIFY FILE (NAME=log, FILENAME= 'new_path_of_mastermssqlsystemresource.ldf');
GO
I am getting this error trying to do anything in the instance while I have it started in minimal mode (/f /t3608)
(the instance WILL NOT COME UP UNLESS I USE THE /F /T3608 from a command promt.. please .. any suggestions??????????????????????
Also.. I checked and the primary file is NOT READ-ONLY.
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource .ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
File activation failure. The physical file name "E:MSSQLKOCSQLDEV01Datafilesmssqlsystemresource .ldf" may be incorrect.
The log cannot be rebuilt when the primary file is read-only.
Msg 945, Level 14, State 2, Line 1
Database 'mssqlsystemresource' cannot be opened due to inaccessible files or insufficient memory or disk space. See the SQL Server errorlog for details.
Msg 5069, Level 16, State 1, Line 1
ALTER DATABASE statement failed.