Performance Degradation On Data Transfer
Jul 20, 2005
Hello guys,
Wonder if any of you could help me out here. I have just created an
new empty database and imported data from another database into it.
This was done with the import wizard from MMC.
First thing that I noticed was the size difference, the old database
was well over 1GB, but the new one was only about 400MB.
Second thing I've noticed, and this is the problem, is that accessing
the new (smaller) database instead of the old one causes a huge speed
degradation, about 5 times slower than the old version.
We are using MS SQL Server 7. Any help would be very gratefully
received.
Regards
Gethyn
View 1 Replies
ADVERTISEMENT
May 20, 2008
Hi,
I have an ASP.NET application used in my university for student management. Any now and then the application throws an error like "DataBinding: 'System.Data.DataRowView' does not contain a property with the name XXXX" where XXX may be different. Of course that this properties exist and they are generated ok by the stored procedures.
After an recopilation everything seems to work nomally for a while.
I did not succeed in identifying the moment when the error is thrown but I suspect some reports in sql reporting services that lead to a server overload ??? that also is strange because the server specifications are quite ok, I think:
- OS: Windows 2003 R2, 64 bit
- SQL Server 2005 Standard, 64 bit
- 8 GB RAM
- Intel Xeon E 5345 2.33 Ghz (2 quad-core)
I would need help for:
- identifying the moment when this error occurs and _why_
- how could I repair it
- how could I distribute the load on more cores (from time to time Process Explorer from Sysinternals shows that only 1 core from 8 is working at full capacity)
Thanks,
Catalin
View 11 Replies
View Related
Apr 11, 2001
Hi all,
Up until recently one of our SQL 7 databases has been running quite happily. However over the last 2 weeks the users have started to complain about performance levles, operations that would normally take 2-3 seconds now run for about 40 seconds. I have rebuilt all indexes and even ran update statistics althought both the 'Auto create Statistics' and 'Auto update statistics' are turned on. This failed to help so I ended up stopping and starting SQL server but still no luck.
I have run a DBCC SHOWCONTIG and the fragmentation is well within acceptable levels, scan desnity is at 94%. The only other thing I can think of is to reboot the NT server as it has been up for 67 days now. Can anyone else think of anything I might have overlooked?
All replies welcome.
Thanks.
View 2 Replies
View Related
Mar 27, 1999
At approximately what db size is sql 6.5 known to degrade in performance?
Also, what is the maximum db size 6.5 can handle?
thanks in advance...
View 1 Replies
View Related
Apr 2, 2008
Thanks in advance !
We are having a situation (PROBLEM) with our DW - SQL SERVER 2000 SP4 ENT X86, it suddenly slowed a lot.
CPU Usage : 20%
IO : AVR DISK QUEUE LENGHT Between 1.5 and 2 (rarelly spikes (20/40)).
MEM : 8 GB, 6GB to SQL SERVER.
All the code that is running against the DB is fined tuned ( Most tables are Index Seeked with Clustered Indexes ), biggest table 450 GB.
No Lock Waits ( Except the main process(spid) that is showed has locked by it's own spid ( latch_xx (sh,ix)).
I guess that the problem is related to storage, because it is only doing 1-3MB sec (sometimes 20MB/sec).
PerfMon ( PROCESS SQLSERVER ( DISK Read Bytes ( between 1-3MB sometimes 20 MB/s), Disk Bytes Write Bytes/Sec same as Reads).
No more sql server instances or other software hogging the server.
I can't understand why the SQL SERVER is never using the IO it is used to use (25MB/S).
I don't see any DISK QUEUE on the Partitions that are used to store the datafiles/logfiles)
No Pages splits in the SQL SERVER ACCESS METHODS.
Sometimes I get about 1 GB in dirty buffers.
98 % Cache Hit Ratio.
ALL points to IO contention, but the counters from windows don't indicate this.
All help is REALLY appreciated.
Best Regards.
View 1 Replies
View Related
Oct 21, 2007
Hello,
Working with SQL Server 2000, I have a table with the following structure:
ID (INT)
userID (INT, foriegn key)
productID (INT)
productQTY (DECIMAL(5,2))
purchaseDate(smalldatetime)
I have about a 1000 users, entering about 20-30 rows per day each, i.e ~20,000 - 30,000 new rows per day. The table might be queried with a simple "SELECT" for the products a user ordered per day or per time frame (purchaseDate column).
My question (finally) is - when should I expect to see performance degradation? Is there anything I can do to prevent it (i.e splitting this table somehow to several tables)?
Thank you all in advance
View 2 Replies
View Related
Dec 14, 2006
Hi all.
Any assistance would be greatly appreciated.
We recently created transactional replication to hopefully improve performance issues we were expereincing. The replication is between 2 SQL Servers (2000), and since we have introduced the replication, the performance has degraded considerably.
I will try and explain the scenario.
We have a primary db that our internal users use and we also have the newly replicated db that our website and another application use. The users are complaining that the website and the internal application is extremely slow and I was just wondering if it is possible to do an Index Tuning on both the primary db and replicated db based on trace files so as to create new indexes or would this have an impact on the replication?
Thanks in advance.
View 4 Replies
View Related
May 30, 2008
Is it possible/advisable when transfering very large amounts of data from server to server to:
trasnfer the data to a new table first
second alter new table adding indexes, defaults, ets based on original table
if it is what flow item would be used to transfer/alter the indexes and defaults?
I'm very new to ssis so the more detail you can give the better.
Thanks
View 5 Replies
View Related
Mar 24, 2008
Hi all,
I am experiencing performance problems with one of my stored procedures. When the stored procedure is first compiled an executed, it behaves as expected (it usually takes 1 or 2 seconds to complete). But its performace it is degradated, so in 1 day, it usually takes 120 seconds to complete !!!. Once the stored procedure is compiled, its performance it is then the expected.
It is a complex stored procedure with two integer parameters with only one select, but composed by multiple views and sub-queries. We have been trying to break the query into small pieces using temporary tables but without success. The SQL Profiler shows an unusual number of reads when it goes wrong (more than a million reads).
I think the problem is in the execution plan. I know than compiling the stored procedure, the problem is fixed, but I do not know exactly when and why it starts to happen.
The stored procedure is running under the following configuration:
- Microsoft SQL Server Standard Edition (64-bit).
- Version: 9.00.1399.06
- RAM 16 MB
- 8 CPUs
Anyone has any ideas or possible solutions?
Thanks in advance,
Carlos.
View 2 Replies
View Related
Mar 19, 2014
In the full recovery model, if i run a transaction that inserts 10MB of data into a table, then 10 MB of data is moved in the data file. Does this mean then that the log file will grow by exactly 10MB as well?
I understand that all transactions are logged to the log file to enable rollback and point in time recovery, but what is actually physically stored in the log file for this transactions record? Is it the text of the command from the transaction or the actual physical data from that transaction?
I ask because say if I have two drives, one with 5MB/s write speed for the log file and one with 10MB/s write speed for the data file, if I start trying to insert 10 MB of data per second into the table, am I going to be limited to 5MB/s by the log file drive, or is SQL server not going to try and log all 10 MB each second to the log file?
View 6 Replies
View Related
Jun 11, 2007
My vendor requires data to be sent in Excel format. Some of my tables have rows over 65,536 so I need to use Excel 2007 (Max of 1,048,576). Right now my data sits in SQL 2000. I am using MS SQL Enterprise Manager 8.0 to prepare the data. Is there some kind of add on or selection I am missing to use DTS to export from SQL to Excel 2007?Thanks in advance.
View 3 Replies
View Related
Jun 9, 2013
I have two database(MYDB1 , MYDB2) on two different server's(SERVER1 , SERVER2) . I want to create an store procedure in MYDB1 on SERVER1 and get some data from a table of MYDB2 on SERVER2. How can i do this?
View 5 Replies
View Related
Nov 15, 2006
I have an excel sheet that contain colummns as in a table in a sql database i want to transfer this data from the sheet to the table frombusiness logic code layer not from the enterprise manager by wizardwhat can i do?? ...please urgent
View 1 Replies
View Related
Aug 29, 2006
I have created a SSIS package that transfer data from a Foxpro database to an instance of SQL Server 2005 Express. I used the wizard to create the package but I load and execute the package within a custom application that I have written in C#.
The way the custom application is intended to work is that the user can have the database in any location on the computer and all he has to do is specify the location then the application programatically changes the location of the source on the package that it has loaded and then execute it. When I initially run the package the first time (using the original path), it works fine and transfers the data. However, every subsequent time I run the application and specify a different path, the database on the SQL Server side gets created as expected but the data is not transfered!
Where am I going wrong? Do I need to save the package after I modify the source then reload and run it again or do i need to change something else in the Data Flow to make this work?
View 4 Replies
View Related
Nov 26, 2015
I am newbie to MDS of SQL,want to know how we can transfer tables from two different SQL Databases to MDS.Suggest me the steps to proceed with any examples.
View 2 Replies
View Related
May 8, 2007
Hi,
I have a SSIS project where I am transferring data from DB2 table to SQL Server table. There is a column called REC_ID which I need to encrypt before we store it in SQL Server. Now, SQL Server has buildin encryption functionality and we need to use that as there are views that will decrypt this column and give data to authenticated users.
So, the question is, is there anyway that I can encrypt the column data in my SSIS package using my target SQL server database key and using SQL server encryptbykey function while transferring?
Thanks,
Ujjaval
View 1 Replies
View Related
Feb 1, 2007
Hi,
Can I transfer data between two dataflow.
Is it possible through anyway?
Thanks
Dharmbir
View 4 Replies
View Related
Aug 22, 2005
Hi everyone,I need some help transfering my database(SQL2005) to the host's server.In SQL 2000 I had the Management tools > DTS or ImportExport tools.SQL2005 lacks this, all I've got is Express Manager > can't connect to multiple databases.Can connect to one database and has a screen to excute TSQL commands.I don't want to have to recreate the whole database on the server.....This would be crazy... 150 stored procedures and 30 tables. Not to mention all the individual settings for each column.I know there is SQL Studio Management tools for the full version of SQL 2005. Anyone got any idea's ?Any input/suggestions is greatly appreciated.Thanks,JShep
View 1 Replies
View Related
Aug 3, 2000
can any body can tell how data trnsfer from oracle database to sql server database. what is the methods i can use? is it required to write scripts.
if scripts required, can anybody can give me sample scipt.
View 1 Replies
View Related
Nov 16, 2000
SQL v7.0 - DTS
Tying to transfer all object info, sp's, constraints and data in to a fresh new database in the same instance, but it's hit and miss when it comes to getting everything transferred. Followed step by step instructions (GUI/Scripts) and sometimes the table structure will transfer without PK's, as well as some data and if you're lucky, some constraints. Stored proc's have a tendency to show up 20 minutes later. I'm testing this on a machine with IE 5, SP2 and fresh new Dll's (just in case something was corrupted). Is there a priority as far as what to transfer first? For example, tables only 1st, then constraints on down to records parent to child? I am assumming you should be able to transfer all at the same time since it's built in to the utility. Or, does it come down to something in the schema? If anyone out there has experienced something similar and found a solution, please advise.
View 1 Replies
View Related
Jun 14, 2000
hi,
I am having two servers one is 6.5 and another is 7.0.
I would like to export a one database from 6.5 to 7.0.
when i was trying to transfer the data it is saying u have to upgrade the server of 6.5.
pls tell me how i have to transfer data from 65 to 7.0
without bcp.
--raj
View 2 Replies
View Related
Nov 15, 1999
Hi,
here we have 5 servers,application server,datawarehousing server,web server,QA server and production server. so i suppose to transfer(by using DTS) the total data(GDWReports) from production server to QA server. so actually i exported that data from production server to one destination by using export wizard and i tried for import that data to qa server by using VB script.but i got one error that "login failed like that". so how to import the data. pl give the suggestions asap.
thanx
Janreddy
View 1 Replies
View Related
Nov 25, 2004
I want to transfer data from a sql2k database to access file.
How can I make a program which I can specify the database?
Can SQLDMO or bcp make it? then how?
thanks
View 1 Replies
View Related
Jan 10, 2006
I would like to ask about the Data transfer . I have huge data in Access database and want to transfer in the MS SQL Server 2000. Can some body help me how i can do it.
Thanks
View 3 Replies
View Related
Jun 5, 2006
I would like to transfer data from an SQL Server 2000(standard edition) on a server located outside of the department TO a laptop/notebook using MSDE located within the department. This will be 1 or 2 times a year of transfering the data from a server to a laptop. So what are some ways or the best ways of transferring data?
Thanks,
Don
View 14 Replies
View Related
Jul 23, 2007
We are working with a Mexican developer to share data between our English database (SQL 2005) and his Spanish database (SQL 2000). We are thinking the best way to gain access to his data (since our website will need data from both databases) is to have them Export data from their Spanish tables into English tables within their database and replicate those tables to our database several times a day. Does this seem like a good idea - any suggestions for a better way to share the data? Thanks
View 3 Replies
View Related
Jul 23, 2005
I have a table in a database that has just over 1 million records, eachrecord about 50-60 characters. I need to transfer this data to anotherdatabase. I implemented two options:1) Read the data record by record and insert into the destinationdatabase, using ODBC. I played with different commit intervals, up to100,000. This version takes about 12 minutes. Having indexes on thedestination table or removing them made little difference.2) Dump the data into a flat file, and use bulk copy to read the fileinto the destination table. This takes less than a minute.Are these results within the normal ranges? I am particularlyinterested in a way to improve upon the first method.
View 3 Replies
View Related
Aug 22, 2006
hi,My problem is I am creating a new database. I need to all the tablesand procedures fromone databse to another database in sql server 2000, both in sameserver.Kalaivanan.
View 1 Replies
View Related
Jul 20, 2005
Hi,We have a unique situation here that is puzzling me. I have a programthat uploads data to our SQL Server. The program runs fine on WIndows95. I have installed it on a Windows 2000 machine and it will connectto our data but will not upload. It processes the file but the datadoes not appear in the database.I have checked the ODBC setup and everything is the same except I usedsqlsvr32.dll instead of sqlsrvr.dll for the 32 bit driver.I know this isn't a lot of information to go on, but the program waswritten by a contractor who has since been replaced and I don't reallyhave an idea of even where to begin checking.Any suggestions would be appreciated.Thank you,
View 1 Replies
View Related
Jul 10, 2007
Using SSIS, how is it possible to transfer the content of an xml file into an xml/varchar(max) field of a table in sql server 2005?
Thanks
View 1 Replies
View Related
Sep 4, 2006
Hi,
Not certain whether this is the right forum to post this question - please advise.
I am fairly new to SQL Server and need to know the best way to transfer data from one data base to another.
For example:
I have a database running via SQL Server 2005 developer edition and another running using SQL Server 2005 Express edition.
If I do a backup on the developer edition I get an error and failure when attempting to upload the data on to the Express edition.
What am I doing wrong can anyone advise?
Also what is the best way to add/remove/update stored procedures and or change the database table structures for a current database (MySql for example allows one to type command line calls direct to the relevant database to alter database tables).
Thanks Andrew
View 3 Replies
View Related
Jul 26, 2007
i hv got the following tables
table1
title form vol issue
dssc 23 12 5
fdfa 11 33 4
dssaa 43 23 5
wqee 112 76 4
table2
formname id
werd 23
sql 11
dera 43
qsdv 112
i transferred the data of table2 to a new table3 with new id
formname formid
werd 145
sql 655
dera 656
qsdv 657
i created another new table for vol transferringdata from table1
volid formid vol
123 145 12
124 655 33
125 656 23
126 657 76
i creayted another table for issue transferred data from table1
issueid issue formid volid
221 5 145 123
222 4 655 124
223 5 656 125
224 4 657 126
now i need to transfer data from table1 to another table like the form
title formid volid issueid
dssc 145 123 221
fdfa 655 124 222
dssaa 656 125 223
wqee 657 126 224
i tried my best but couldnrt get the correct ans could
any one help
View 4 Replies
View Related
Apr 28, 2008
Hi everyone,
I have the following scenario:
two laptop computers with sql server 2005 express
and a server in the office with sql 2000 server,
what I need to do is, when a laptop user is in the office, to sync all the data from the sql server 2005 express to the
sql 2000 server and vice versa.
what are the options to achieve that?
thanks,
Sharon.
View 4 Replies
View Related
