Indexes Maintenance In A 24x7 Environment...
Apr 14, 2003
Hi, I maintain a 24x7 SQL server on a claster with a big table (one of the 900 others) and few indexes on it. It takes up to 4hrs to rebuild those indexes on this table (alone) every week on Sunday morning, and cause of that users who use the server complain that the application is "down" and they can't access the data and blah, blah, blah. I tried all the possible scenarios of index maintenance and no way to fit it within our 1hr window. So I just wondering how you guys as DBAs of the 24x7 systems facing the same issue (if you have it indeed). Would be nice to know your expirience on that.
Thx
Dim
View 2 Replies
ADVERTISEMENT
Feb 1, 2002
hi,
I have SQL 2000 ProductionBox.It is in 24x7 environment.
We need to maintain data only for 30 days.
Even if I schedule deletetion of data on daily basis - SQL will take the lock as data we receive is too huge.
Secondly,Since the indexes are heavily used - defrag don't work for them.the only option I think I am left with is to rebuild the indexes.Though in SQL2K - index creation is on fly - but here we are talking of table sizes of 8-10GB.
I suggested my Boss to bring down the box for few hours for maintenance.but he insists that since this is 24x7 - Box can never be brought down.
I am finding it hard to convice him and do my job.
Any idea on how to rebuild the indexes & how to delete this many records(avg.50k per day-data of xml type)without creating a block is highly appreciated...or how to convince my boss to give me a window for maintenance...:)
TIA
View 3 Replies
View Related
Nov 30, 2004
Many people know the importance of creating indexes on SQL Server database tables. Indexes greatly improve the performance of a database. However, while many people create indexes on their SQL Server tables, many people don't maintain them properly to ensure queries run efficiently as possible.
Thought you may be interested in a new article.
http://www.orcsweb.com/articles/index_overview.aspx
Thank you.
View 1 Replies
View Related
Apr 24, 2006
I'm using SQL Server 2005 SP1 Standard.
On the Rebuild Index Task there is a checkbox at the bottom that says 'Keep index online while reindexing'.
Great I thought, I'll check that.
Later, when I tested the job, I got this error:
'Online index operations can only be performed in Enterprise edition of SQL Server.'
Why have that checkbox available to check, if I'm running a version that doesn't allow it? Where's the bug?
Thanks
Ed
View 1 Replies
View Related
Aug 23, 2015
Normally we use rebuild, reorganize indexes when it is required, I used a SQL job using maintenance plan to run daily and rebuild, reorganize indexes and update statistics but I do not know if it runs either they are required or not. Should this plan automatically execute the build upon required indexes to be rebuild or it fires either they are required to be executed or not.
View 2 Replies
View Related
Feb 13, 2008
in a prior "legacy" life we couldn't imagine 24x7 implementations because it was important to 1) reorganize databases periodically to remove fragmentation that adversely affected performance and 2) back up databases just in case.
In a 24x7 SQL Server 2005 implementation, high level only, how are these and other maintenance related things accomplished with confidence?
I dont think SQL cleanses its own page splits unsolicited. Are DBAs totally reliant on logs in full recovery installations where db must be up 24x7? What if the devices those logs sit on fail? What if the logs become too large? Is it likely that if you want 24x7 you're looking at Enterrise Edition only?
I'm totally aware of and confident in the sliding window partitioning thing but it seems to me there must be more out there in terms of periodic, more frequent maintenance activity.
View 3 Replies
View Related
Nov 16, 2005
I have finished a change request from our client. I need to update clients' database with the one in developments.Here is the changes i made to database:Added/Changed some tablesAdded/Changed some stored proceduresAdded data to some dictionary tableThe data in clients' current database MUST be kept. So how can I merge the changed information to clients' database?
View 3 Replies
View Related
Jul 1, 2014
I'm working to improve performance on a database I've inherited, and there are several thousand indexes. I've got a list of ones which should definitely exist within the database, and I'm looking to strip out all the others and start fresh, though this list is still quite large (1000 or so).
Is there a way I can remove all the indexes that are not in my list without too much trouble? I.e. without having to manually go through them all individually. The list is currently in a csv file.
I'm looking to either automate the removal of indexes not in the list, or possibly to generate the Create statements for the indexes on the list and simply remove all indexes and then run these statements.
As an aside, when trying to list all indexes in the database, I've found various scripts to do this, but found they all seem to produce differing results. What is the best script to list all indexes?
View 5 Replies
View Related
Aug 17, 2007
Hello,
I have a question that I hope someone can clear up for me. I have come across a number of different suggestions on DB maintenance, for example reindexing with the following script:
USE DatabaseName --Enter the name of the database you want to reindex
DECLARE @TableName varchar(255)
DECLARE TableCursor CURSOR FOR
SELECT table_name FROM information_schema.tables
WHERE table_type = 'base table'
OPEN TableCursor
FETCH NEXT FROM TableCursor INTO @TableName
WHILE @@FETCH_STATUS = 0
BEGIN
DBCC DBREINDEX(@TableName,' ',90)
FETCH NEXT FROM TableCursor INTO @TableName
END
CLOSE TableCursor
DEALLOCATE TableCursor
My question is, doesn't the maintenance plan have this functionality inherent in it when you create the maintenance jobs to reindex? Is there a benefit to scripting things out vs just using the maintenance plan wizard for this sort of thing and any of the items it covers? I came from an Oracle background where this was a no-brainer but I am a bit confused on the choices with SQL Server.
Thanks.
View 1 Replies
View Related
Sep 18, 2007
So I'm reading http://www.sql-server-performance.com/tips/clustered_indexes_p2.aspx and I come across this:
When selecting a column to base your clustered index on, try to avoid columns that are frequently updated. Every time that a column used for a clustered index is modified, all of the non-clustered indexes must also be updated, creating additional overhead. [6.5, 7.0, 2000, 2005] Updated 3-5-2004
Does this mean if I have say a table called Item with a clustered index on a column in it called itemaddeddate, and several non-clustered indexes associated with that table, that if a record gets modified and it's itemaddeddate value changes, that ALL my indexes on that table will get rebuilt? Or is it referring to the table structure changing?
If so does this "pseudocode" example also cause this to occur:
sqlstring="select * from item where itemid=12345"
rs.open sqlstring, etc, etc, etc
rs.Fields("ItemName")="My New Item Name"
rs.Fields("ItemPrice")=1.00
rs.Update
Note I didn't explicitly change the value of rs.fields("ItemAddedDate")...does rs.Fields("ItemAddedDate")=rs.Fields("ItemAddedDate") occur implicitly, which would force the rebuild of all the non-clustered indexes?
View 4 Replies
View Related
Jun 25, 2015
I have a requirement to only rebuild the Clustered Indexes in the table ignoring the non clustered indexes as those are taken care of by the Clustered indexes.
In order to do that, I have taken the records based on the fragmentation %.
But unable to come up with a logic to only consider rebuilding the clustered indexes in the table.
create table #fragmentation
(
FragIndexId BigInt Identity(1,1),
--IDENTITY(int, 1, 1) AS FragIndexId,
DBNAME nvarchar(4000),
TableName nvarchar(4000),
[Code] ....
View 5 Replies
View Related
Sep 17, 2006
What is the difference please?
View 1 Replies
View Related
Jun 18, 2015
I am testing some maintenance tasks sql commands such as index rebuild, index reorg, update statistics and db integrity check on a SQL Server 2014 Database. This is a new non-production vendor database (DB Size 500 GBs, Log Size 25 GBs) which eventually will be created in production. Currently, it is in full recovery model and without log backups. The database has a whole lot of indexes. I am just trying to rebuild and reorganize all the indexes (that need it), in addition to trying to get an idea of how long these maintenance task will take and the space needed in the log file to complete these tasks/commands. I would like to execute these tasks manually (the first time) to gather the duration and space required information. Eventually, I would probably schedule a weekly job to perform this maintenance.
I ran the index rebuild task on the database and noticed that the log file grew by over 50 GBs. I killed the process and truncated and shrunk the log file back down.
1. Does the index rebuild, index reorg, update statistics and db integrity check commands all use the log file?
2. Does Indexs Reorg have less impact on log file then Index Rebuild?
3. Should a truncate log and shrink log file be performed after these maintenance commands?
4. Should a full database backup be performed after these maintenance commands? Or before the maintenance commands?
I have read and understand that shrinking is not good for the database (could lead to more fragmentation and more data file growth when data is added) and I know about rebuilding indexes when fragmentation is GT 30% and reorganizing indexes when fragmentation is GT 5% and LE 30%.
Since this is a non-production database maybe I should set the recovery model to simple, run the maintenance commands and leave the database in simple recovery model unless the vendor needs it in full recovery model for some unknown reason.
5. With the simple recovery model the log file should be reused in a circular manner and not grow during these maintenance tasks. Is this correct?
View 3 Replies
View Related
Jun 12, 2007
Good morning,
I am a DBA and my boss recently recommended that we change our QA environment so that we don't have any databases on it unless they are actively being tested. This would be to save hardware costs.
The only issue I can think of at this point is that promotion to our QA environment would take up to 2 hours for some of our larger databases if we have to restore production databases to qa for every QA run.
Is this a good idea? How do you run your QA (full or partial copy of prod)? Any input appreciated.
Thank you.
View 3 Replies
View Related
Dec 5, 2007
Hi!
I work on a company where we today have one SQL Server Standard Edition and Reporting Services (SSRS) and Analysis Services (SSAS) installed on the same server.
Now we want to install SQL Server Enterprise Edition, but still have the Standard Edition installed.
We are gonna invest in one more server.
I wonder if its possible to install the database engine for both versions on one server and then install instances of SSRS and SSAS on the other server?
Can Standars Edition have SSRS and SSAS on another server than the Database Engine?
And is it different versions of SSRS and SSAS between SQL SE and SQL EE, or does SSRS and SSAS get the SQL EE benefits if the database engine is SQL EE?
Thanks in advance!
View 3 Replies
View Related
Sep 29, 1999
I have about 23 SQL servers running 6.5 SP3 or SP5a in a 24 hour environment. Most of the activity takes place between 6am and 11pm, with few transaction after 11pm. What is best to do with the main DB's transaction log, have the truncate at checkpoint option checked OR back up the transaction log a couple times a week? The Database is backed up every 6-8 hours.
Thanks in advance for your opinions/help.
LN
View 3 Replies
View Related
Nov 21, 2005
I have about 40 DTS packages that I want to run against three different databases on the same server. Can someone suggest an easy way to run these jobs and differentiate each time which SQL or INI file to use.
Thanks,
John Shaening
View 1 Replies
View Related
Jan 14, 2004
Hello, everyone:
What is difference between testing environment and product environments for MS SQL Server? Thanks a lot.
YTZ
View 1 Replies
View Related
Mar 12, 2007
Jimmy writes "We use a software that stores its database in SQL. We currently have a server box running Windows 2000 Server with SP4 and SQL Server 2005 with SP2 which holds the database. The server is wired in but we have several other stations that connect to the database wirelessly.
The problem is with our wireless stations.
When a wireless client travels from one access point to a repeater, it'll drop the connection for that moment. Once it picks up the wireless connection again, it requires closing out of the software and going back into it so it reestablishes the SQL connection to the server.
Is there a solution for a seamless reconnection with SQL for our wireless clients? Is this a problem with our software or SQL? Please advise. Thank you."
View 2 Replies
View Related
Nov 6, 2007
Hi Guys,
Im new to SQL Server 2005.
In our organization, I was tasked to implement and maintain
MS SQL 2005 database.
We have several system developer and they are using MS SQL 2005
as a backend database.
Currenty, they are responsible for designing their own databases required by their application.
My concern is that I want to restrict access to my SQL server that only the DB administrator can access the
database server.
My question is that, how they can design their databases without accessing the database server. Is it
possible for them to access SQL Server with some restriction? I mean, I want to impose some security measures
that they can only access objects within their scope.
Our current scenario is that they have MS SQL Express version installed in their pc and from that terminal
they can design and test their application and after everything is in place, Its me who will migrate their
respective databases for production in MS SQL 2005 server.
Hoping you can provide me the best alterntive to this query.
Thanks a lot.
View 3 Replies
View Related
Jul 20, 2005
Trying to figure out what development enviroment we need in order todo the following:- develop a non-native SQL server stored procedure;- call a web service or java program from the stored procedure;- return static values;- call the stored procedure from a view.How do I get a hold of the right tools and what do I need to put thepieces together?Obviously, I've not used SQL server and I'm looking for the basicstarting point.Thanks!
View 5 Replies
View Related
Aug 23, 2007
Hi,
I'm currently using the setup below for my RDA testing. Is there any problem with this setup?
connected connected
Client Apps (SQLCE 3.0) -----------------> Windows Server 2003 (Web server) ----------------> Windows XP (SQL2005)
previously was using windows XP to act as web server and have SQL server reside inside the same machine but having 10 connection limitation from windows xp where only 10 client can connect to the machine. The current setup moves the web server out to windows server 2003 and i believe it solves the 10 concurrent connection limitation but how about the SQL server? is it limited to 10 connection from windows server 2003 also? (Windows XP is my testing server, Windows Server 2003 contains important test data for the whole company) . I tried with concurrent RDA pull for 40 client concurrently with 1 pc having 10 client apps but obtain not really satisfying results. Pulling one table (20Mb) needs 1 to 2 mins through LAN networks but pulling concurrently with 40 clients takes up to 20 - 30 mins.
Any advice? Thank you and have a nice day.
Regards,
Ben
View 1 Replies
View Related
May 5, 2006
Novice SQL Express User...
Now that I've installed SQL 2005 Express Advanced, shouldn't there be a DB Environment I can work with? There must be a configuration mistake because I can't see the "container?" Prior to SP1 I had SQL 2005 Express installed and I could open and use SQL; however, once I loaded SP1 that stopped. I thought if I load the "Advanced" I would be "back in business."
Thanks,
Tony
View 1 Replies
View Related
Sep 25, 2007
i am working in hospital environment. i am a novice in SQL. i have an urgent issue to answer which is around numbering the order of theatre event for the same patient based on the into theatre time. Patients can go to theatres several times in the single hospitalisation. we need to order as 1, 2, 3 and so on based on the into theatre time which is date/time format. your help is much appreciated. thanks.
View 5 Replies
View Related
Jul 17, 2006
hi,
can you show me how to get the value of an environment variable from a script task?
thanks!
View 3 Replies
View Related
Dec 12, 2007
Hi
I have a SSIS package. Right now its doing a data flow task from flat file to an OLEDB destination.
Now If i have to move to a new environment , I have the exactly the same tables but the server name is different.
Is there any way i can configure this from .NET CODE.
thanks
Sai
View 5 Replies
View Related
Nov 11, 2002
Do you guys know how to fix this error?
windows cannot find the local profile and is logging you on with a temp profile? how do you get around this? Thanks.
View 1 Replies
View Related
Jun 25, 2004
Sould one has a seperated environment for production and test system? How do you do it on a same server? Install two instance? How do you seperate test DBs from the production DBs?
Please advise...Thank you
View 2 Replies
View Related
Mar 28, 2007
I just got my first job doing some DBA work (junior level) in a small company using SQL Server 2000.
I would like to make a copy of the production DB and use it for development of SP's, DTS packages and views.
What is the safest way for me to copy the entire production DB, to a new DB on the same server?
Should I create a new DB, and do a restore of the production backup?
Any help would be appreciated,
Thank you.
View 3 Replies
View Related
Jun 20, 2007
I am embarking on a project to upgrade our SQL server environment. I'm curious for some opinions on the relative benefits of Log Shipping versus a Clustered environment and you have any experience that has helped form your opinion on the issue?
Thanks,
Marc
View 3 Replies
View Related
Aug 18, 2005
I'd like to allow students in a lab to use the Express Manager and T-SQL to create their own databases. I think I've figured out just about everything - but the last step. Here's my thinking on how to do this:
1. Students are power users, not local admin
2. Created a login for the builtinpower users group as follows:
create login [BUILTINPower Users] from windows with default_database=[master]
go
exec master..sp_addsrvrolemember @loginame = N'BUILTINPower Users', @rolename = N'dbcreator'
go
3. Now students can start the Express Manager and connect to:
localhostsqlexpress using Windows Authentication
4. After they do, they can open and run a script creating a database and populating it with tables and records.
5. All good up to here... but when trying to access the new database using VB Express (file based, not a remote connection) access is denied.
The problem is in the NTFS file permissions being assigned to the new database mdf and ldf files. Local administrators and the builtin Network Service accounts have permissions, but the student who created the database gets nothing... So the student is denied access to the mdf and ldf files when trying to make a connection to them using VB Express.
I can go in with a different account having admin privileges are assign privileges to power users for the mdf/ldf files after they're created but this isn't what I need (students need to work whenever they want without waiting for an admin to fix the file permissions).
Maybe I'm going about this all wrong? If I have to I can insist on students always using VS 2005 instead of VB Express and use connections to a remote database (no problems doing this), but I'm still hoping for an express solution.
I'm new to this forum, so apologies if this is a dumb question (but even if it is - can anyone point me in the right direction?)
Thanks
Mike Morrison
View 1 Replies
View Related
Mar 15, 2007
any tutorial on how to setup SQL Server in a dual redundant environment ?
thanks
View 3 Replies
View Related
May 2, 2007
Hello,
I want to offer a SQL 2005 server in back-end configuration for my hosting clients. Basically this means that they administer the DB with a webbased tool and the DB server it self is configured in the backend and has no direct connect to the internet. The DBs can only be access from the frontend web server.
- What security considerations should I take to use this server in a public hosting environment?
- We only allow webbased administration, no direct connect to the server are allow and possible.
- Multiple databases will exist on the same server from different customers.
I really would like to have as many information as possible. There is not much usefull information available on the web or in the books I own about SQL.
The question should actually be: what do you want to prevent from happing on your servers by authenticated users and ofcourse unwanted users. And how to do this.
View 6 Replies
View Related
