SSIS Advantages
Jan 3, 2007
This may be too general a question but I'm going to ask it anyway.
I'm moving data from a source DB (say A) to a target DB (say B). On A I need to join 3 tables and, after some lookups etc., I need to populate several tables in B. Inserting into B's tables involves sequential operations because in many cases I have to get back the value of an Identity column to use as in input value in a another table 'downstream'. Additionally, the tables in B are populated as a group i.e. if the insert on any one fails the entire group's insertion needs to be rolled back.
I set up a set of stored procedures to do this. The master Stored Proc opens a read-only cursor and for each row of the cursor executes the other SPs in proper sequence. Some of the SPs are 'enclosed' within a transaction to enable a Rollback on the group.
My major concern with this approach was the 'known' inefficiency of the cursor and the huge memory requirement it's use would entail (the cursor would pull about 15 million rows).
So I began looking into SSIS thinking it would be able manage the system resources aspect effectively and offer better performance overall. I've realized, however, that even in SSIS I would essentially need to first pull the 14 mil rows into a memory-resident object (or a temp table - whose benefit I'm not convinced of or haven't fully understood) before looping through each row to perform the data inserts into B.
So, is there any real advantage to this over the first approach ? Perhaps I haven't looked deep enough or wide enough. Any constructive suggestions / feedback would be highly appreciated.
Thanks.
View 5 Replies
ADVERTISEMENT
May 3, 2002
Hi,
I was looking for some information / papers giving the advantages of Sql 2k over sql7.
Thanks!
View 1 Replies
View Related
Apr 20, 2004
hi ! my boss is thinking of redoing our accounting system which is currently running on FOXPRO - we are planning on a VB/SQL SERVER platform.but he isn't convinced that the benefits of SQL server outweigh those offered by FOXPRO especially since everyone in the office is very comfortable with Foxpro.Can anyone give me some solid advantages of SQL SErver or any other RDBMS over Foxpro ?
View 14 Replies
View Related
Oct 4, 2006
Hi,
If I have an application that has at most 20 users with an average of 3-4 concurrent requests to the server and the databases size is 1 gig probably to grow to at most 1.5 gigs in the next 5 years why would I choose Express over MSDE?
MSDE can take advantage of more than 1 gig of memory and can use 2 CPUs. I really don't see any benefit whatsoever in my case to go to SQL Express, in fact all I see is drawbacks.
I hear about upgrading all over the place but I just don't see any good reason in my situation. Am I missing something here?
View 7 Replies
View Related
Jun 22, 2007
What is the advantages/disadvantages of using Database Diagram and link all the tables in MS SQL Server Management Studio versus letting the application check and link the different tables at run time? Currently, I do not have all my tables linked in a Database Diagram. I do everything at run time in my application code behind. What are the best practices? Which is easier or perhaps more secure?
View 4 Replies
View Related
Jun 20, 2008
Hi to all, Can anybody tell me what are the main advantage's of sql server 2005 ?
View 1 Replies
View Related
Aug 3, 2004
Hi,
Generally I write all my SQL in Stored Procedures instead of using adhoc queries. But I dont feel good about stored procedures when I come across situations like this.
Lets say that I have a stored procedure something like this
CREATE PROCEDURE dbo.proc_MYSP
@CaseID char(10)
AS
SELECT * FROM TABLE1WHERE CASEID = @CASEID
Suppose in future if the field CASEID is changed to char(20) then I need to change the declaration of CaseID in all my stored procedures that take CaseID as input parameter. If I write adhoc queries then I need not worry about this. Is there any effective solution for a situation like this.
Thank you.
View 5 Replies
View Related
Oct 9, 2007
hi guys,
im new to sql server...
i am currently studying sql server 2000
i know this subject has been asked before...
i would just like to ask if you know some related articles regarding advantages of using sqlserver over vfp dbf/dbc?
i am going to discuss it to my class.
thanks very much!
any help is very much appreciated!
Joel
View 4 Replies
View Related
Feb 13, 2008
hi,
Can any body help me in knowing what are the advantages and disadvantages of all the three replication types?
View 1 Replies
View Related
Dec 18, 2006
I have a content site where everything is currently in one SQL ServerDB. As I add features to the site, for example message boards andblogging, does it make sense to put those features in a separatedatabase? What would I lose and gain in doing so? Thanks so much.Erik
View 3 Replies
View Related
Mar 11, 2008
Can I get answer of this ? with some of examples if it is possible.
View 2 Replies
View Related
Jul 12, 2000
Hi, I would appreicate your opinion/ feed back about Being consultant vs Being employee.
What are the advantages/disadvantages.
Does consultant makes more money than an employee and why so
Thanks for your response
Ali
View 2 Replies
View Related
Aug 5, 2005
Are they're any real disadvantages or advantages in having 1 massive disk partioned to create 2 logical drives (not including the C drive) and separating the SQL Database File & Transaction Log so that it doesnt reside on the same logical drive?
After all, it is still a single disk.
thanks.
View 3 Replies
View Related
Nov 6, 1999
Just wondering - on a straight RAID 5 system is there any advantage, performance or otherwise, to splitting a SQL 6.5 database over multiple database devices? Or for simplicity's sake am I just further off creating a single device and manually extending it as the database grows?
Thanks
RM
View 1 Replies
View Related
Jun 12, 2008
Dear All,
what are the advantages of changing compatibility level from 80 to 90? are there any disadvantages doing this on production machine? will it take any downtime?
i've searched the google but i didnt get the correct info.
Arnav
Even you learn 1%, Learn it with 100% confidence.
View 2 Replies
View Related
Nov 23, 2007
Please reply me as soon as possible.
View 4 Replies
View Related
Sep 27, 2007
Hello,
I am working on the Reporting Services 2005, I don' know anything about Business Object.
Please let me know what are the advantages of Reporting Services 2005 over the Business Object.
Any specific link will be useful for me.
Thanks in advance.
Bye.
View 5 Replies
View Related
May 14, 2015
Give the Advantages Over SQL SERVER Always on over Clustering....
View 4 Replies
View Related
Mar 19, 2008
I am trying to evaluate the pros and cons of using SQL Server over oledb connection to an access database.
So far
Pros Cons
Access: Doesnt need to be installed by user. 2GB Data limit
SQLExpress:
Not sure yet - more than 2gb data User has to install SQL Server compact.
Is there anything iv missed?
Iv run a quick test to decide on speed my results seem to suggest that oledb is faster at writing data, and SQL Server is faster at reading.
The test program clears the database:
and times how long it takes to insert 10000 records, the read the 10000 records back for OLEDB, then SQL Express.
Code Snippet
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Data.OleDb;
using System.Data.SqlClient;
using System.Timers;
namespace ConsoleApplication1
{
class Program
{
static int a = 0;
static int b = 0;
static void Main(string[] args)
{
Timer tmr0 = new Timer(1);
Timer tmr1 = new Timer(1);
tmr1.Elapsed += new ElapsedEventHandler(tmr1_Elapsed);
OleDbConnection oledbcon = new OleDbConnection("Provider=Microsoft.Jet.OLEDB.4.0;Data Source=C:\database1.mdb");
oledbcon.Open();
OleDbCommand oledbcmd = new OleDbCommand("INSERT INTO Table1 (Can) VALUES ('1')",oledbcon);
oledbcmd.CommandText = "DELETE * FROM Table1";
oledbcmd.ExecuteNonQuery();
tmr0.Elapsed += new ElapsedEventHandler(tmr0_Elapsed);
tmr0.Enabled = true;
for (int i = 0; i < 10000; i++)
{
oledbcmd.CommandText = "INSERT INTO Table1 (Can) VALUES ('" + i.ToString() + "')";
oledbcmd.ExecuteNonQuery();
}
int aa = a;
a = 0;
oledbcmd.CommandText = "SELECT * FROM Table1";
OleDbDataReader oledbreader;
oledbreader = oledbcmd.ExecuteReader();
while (oledbreader.Read())
{
oledbreader.GetInt32(0);
}
tmr0.Enabled = false;
SqlConnection sqlcon = new SqlConnection("Data Source=localhost\SQLEXPRESS;Initial Catalog=;Integrated Security = SSPI");
sqlcon.Open();
SqlCommand sqlcmd = new SqlCommand("CREATE DATABASE Test",sqlcon);
try
{
sqlcmd.ExecuteNonQuery();
}
catch { }
sqlcmd.CommandText = "CREATE TABLE Table1 (num INT)";
try { sqlcmd.ExecuteNonQuery(); }
catch { }
sqlcmd.CommandText = "DELETE FROM Table1";
sqlcmd.ExecuteNonQuery();
tmr1.Enabled = true;
for (int i = 0; i < 10000; i++)
{
sqlcmd.CommandText = "INSERT INTO Table1 (num) VALUES ('" + i.ToString() + "')";
sqlcmd.ExecuteNonQuery();
}
int bb = b;
b = 0;
sqlcmd.CommandText = "SELECT * FROM Table1";
SqlDataReader sqlreader = sqlcmd.ExecuteReader();
while (sqlreader.Read())
{
sqlreader.GetInt32(0);
}
tmr1.Enabled = false;
Console.WriteLine("OLEDB");
Console.WriteLine("Inserted 10000 records in "+aa.ToString()+"ms");
Console.WriteLine("Read 10000 records in " + a.ToString() + "ms");
Console.WriteLine("TOTAL: " + ((a + aa).ToString()) + "ms");
Console.WriteLine("SQL SERVER");
Console.WriteLine("Inserted 10000 records in " + bb.ToString() + "ms");
Console.WriteLine("Read 10000 records in " + b.ToString() + "ms");
Console.WriteLine("TOTAL: " + ((b + bb).ToString()) + "ms");
Console.ReadKey();
}
static void tmr1_Elapsed(object sender, ElapsedEventArgs e)
{
b++;
}
static void tmr0_Elapsed(object sender, ElapsedEventArgs e)
{
a++;
}
}
}
For the access database create a access2003 mdb file with a table "Table1" and a colomn of type integer called "Can";
save it as C:database1.mdb
Then compile and run above.
My results wereslow machine)
OLEDB
Inserted 10000 records in 1512ms
Read 10000 records in 6ms
TOTAL: 1518ms
SQL SERVER
Inserted 10000 records in 1853ms
Read 10000 records in 1ms
TOTAL: 1854ms
Does this
View 2 Replies
View Related
Jan 19, 2007
Dear Sirs and Madams,
it's quite hard to find informations about OLAP mining I think. So I have some questions to you:
What advantages do I have by using Olap Mining instead of "normal" mining (relational databases)?
Is it just faster or are there other advantages?
What are the disadvantages? The data can be overaggregated (no detailled results), can not? Are there other disadvantages?
What problem do I have to face?
Whats going on with empty cells?
Thank you very much in advance and have a nice weekend.
Thorsten
View 1 Replies
View Related
Jul 3, 2006
Hi everyone,
When we create a clustered index firstly, and then is it advantageous to create another index which is nonclustered ??
In my opinion, yes it is. Because, since we use clustered index first, our rows are sorted and so while using nonclustered index on this data file, finding adress of the record on this sorted data is really easier than finding adress of the record on unsorted data, is not it ??
Thanks
View 4 Replies
View Related
Apr 23, 2006
I am wondering what the advantages of using CRL Sprocs over T-SQL sprocs and what not.
Looking for such comparison and articles on websites resulted in only "how to create CRL sprocs" but none of them were talking about what they are used for in what situations.
I would really appreciate it if you guys can post comments, links and external articles.
Thank you in advance.
View 1 Replies
View Related
Jan 22, 2007
running ssis package with ssis run time compoenents and sql server 2000...
Is it possible to run ssis packages that point to servers on sql server 2000
without installing sql server 2005 ?
Can we just install runtime for ssis and run the packages ?
Please explian with links if possible
thanks a lot
View 18 Replies
View Related
Oct 9, 2015
I want to achieve the following in (SSIS/SSDT for SQL 2012) -Â
I have a generic SSIS package which simply sends out email notifications using SMTP email task (this package is within its own project, and has project level input parameters).
I need to be able to call this package in the Event handler section of every package (numbering in about less than 60) that we have. These packages are within their own respective projects.
I thought I could use the "execute package task", but it turns out , using this, I cannot call a package that is part of some other project. I also cannot call a package that is stored in the CATALOG. Is there any way I can do this ?
When I call the child package , I should be able to send in parameters like - error information and package name of the Parent package.
View 8 Replies
View Related
Oct 29, 2007
I have an SSIS package (TransAgentMaster) that I recently modified to include a call to a child package via the file system. The child package creates a text file. When I run the package in dev studio then the child package/text file is produced.
I then imported the TransAgentMaster as a stored packagesfilesystem package into SQL SSIS and executed the package. The child package produced the text file.
I then ran the SQL Server Agent to see if the child package would work and it did not generate the text file. Thus after updating a SSIS package importing the package into SSIS the job that calls the package will not call the child package. Please not that the TransAgentMaster package calls 7 children packages €¦ just not my new one.
Any thoughts why the agent will not run the child newly crated childe package?
View 3 Replies
View Related
Jul 11, 2007
Run the SSIS import/export wizard.
(xls -> sql table)
Select the tasks created.
Copy.
Here is the error that occurs.
p.s. Does anyone have any needles I can borrow? I think sticking them in my eyes would be nicer than working with SSIS.
===================================
An error occurred while objects were being copied. SSIS Designer could not serialize the SSIS runtime objects. (Microsoft Visual Studio)
===================================
Could not copy object 'Preparation SQL Task' to the clipboard.
(Microsoft.DataTransformationServices.Design)
------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%u00ae+Visual+Studio%u00ae+2005&ProdVer=8.0.50727.762&EvtSrc=Microsoft.DataTransformationServices.Design.SR&EvtID=SerializeComponentsFailed&LinkId=20476
------------------------------
Program Location:
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
at Microsoft.DataTransformationServices.Design.ControlFlowClipboardCommandHelper.InternalMenuCopy(MenuCommand sender, CommandHandlingArgs args)
===================================
Invalid access to memory location. (Exception from HRESULT: 0x800703E6) (Microsoft.SqlServer.ManagedDTS)
------------------------------
Program Location:
at Microsoft.SqlServer.Dts.Runtime.PersistImpl.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.SqlServer.Dts.Runtime.DtsContainer.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
View 14 Replies
View Related
Apr 26, 2008
Hi. I need to import excel file in database. i first need to do an unpivot task. the column names are dates and SSIS seems to be unable to pick up the column name as it is replaced by F2 F3 F4etc Can you advise of a solution. thanks ken
View 1 Replies
View Related
Jun 2, 2006
Hi,
I'm finding that the standard components often just don't quite meet my
needs, but would only need some fairly minor changes to save me and my team a lot of
work (and produce more elegant solutions). So I was just wondering whether the source code was available for the standard components that come with SSIS, or if there is anyway to extend their functionality?
Or do you just have to start form scratch?
Thanks,
Lawrie
View 4 Replies
View Related
Aug 1, 2007
I need to build an asp.net/C# application to read values from an Excel spreadsheet. Once the values are read from the spreadsheet, the C# code will do some elementary statistics on the values read. Then the values read and their computations will be written to a sql server database.
My manager suggested that SSIS might be a good candidate technology for doing this type of work. Does that sound correct? My only hesitation with using SSIS is that I want to keep the application as simple as possible, so that the code can be more portable. Maybe might argument is not a good one, but maybe someone can help me out here.
Ralph
View 1 Replies
View Related
Apr 11, 2008
Hi,
I have two variables
1. strStatement datatype (string)
2. objTable object (user tables)
the string strStatment returns a dataset
and is assigned to objTable.
I want write the data from objTable to a sql table
and it seems not to work.
Here is what I did.
I used data flow task to either select from a a string or objectTable.
but it give me an error.
View 1 Replies
View Related
Jan 4, 2008
Dear Friends,
I store several configurations in the main database of my SSIS packages. I need to get the servername from a xml or txt file in order to get those configurations stored in my database.
How you think is the better way to do that?
Using a FlatFileSource to read the file and a script to save the value into a SSIS variable?
Using the package configuration I cant do that... maybe I dont know, but I can save the SSIS variale in the configuration file, but what I need is to do the inverse, read the configuration file and save the value in the SSIS variable.
How the best way you suggest?!
Regards!!
Thanks.
View 18 Replies
View Related
Apr 22, 2008
We have SQL 2008 in development but only SQL 2005 in production. I have an SSIS package that was created in 2008 but need to deploy it to a SQL 2005 server. The '05 server will not import the package because of its version. Is there a way to convert back or 'save as' SSIS '05?
View 6 Replies
View Related