Scalability OF SSIS

Nov 23, 2005

I am trying to find some information on recommended deployments, preferably with a diagram for a presentation.

View 12 Replies


ADVERTISEMENT

How To Test Scalability

Dec 5, 2007

Hi,

Whats the best way to test scalability on a database? I'm working on a new app, and have handed off developing the database to someone with more experience. Some tables will grow to many million records, and I don't want it to bottleneck. I need to have it fully tested before it goes live.

Is it reasonable to ask the person helping me to fill it with 10's of millions of rows to test performance? Is this a decent solution? If so, what would the best way to fill it be? If not, what steps should I take?

Thanks very much!
mike123

View 2 Replies View Related

SQL Server Scalability

Jul 23, 2005

Could someone out there please help me to answer these questions?Thanks in advance.1. What aspects of SQL Server allow it to reliably scale up to supporta large global enterprise? And, when does SQL Server reliabilitybegin to fail?2. Given a role-based security model and without doing a benchmark,are there potential performance issues of using a SQL Server database ?How would this change if more of the security was moved to theapplication level or moved to the database?3. How does SQL Server manage access to data at the record and datafield level?4. w do support and administration requirements compare between SQLServer (or MSDE) and Oracle? Consider levels of expertise needed fromcentral server to desktop implementations.

View 1 Replies View Related

Scalability Of Ssrs

Feb 14, 2007

hi all

i want to know that how much performance of ssrs will be vary when i m installing ssrs on same machine where my database is stored, or when i m storing ssrs on different machine and database on different machine.

View 3 Replies View Related

Performance And Scalability

Nov 7, 2006

Hi, I'm looking for some recent surveys on the performance of ETL-Tools including SSIS and relates it to other ETL-vendors. Any ideas where to find valid stuff?

S.

View 1 Replies View Related

SQL7 User Scalability

Mar 10, 2000

Hello All,

I was just looking for some rough estimates on the number of simultaneous users that SQL7 EE can support in a Web (IIS/ASP) environment. I know there are a lot of configuration issues that will effect the answer, but assume that there are a couple of IIS servers running WLBS that need to connect to the SQL database for query and update functionality. Of course, all access to the database will be controlled through stored procedures. Any thoughts would be most appreciated...

Thanks,

Chris

View 1 Replies View Related

Performance With Respect To Scalability

Dec 5, 2007

Our databases were working fine in terms of performance until over the last 2 months wherein the timeouts and deadlocks have started increasing. We are having growing clients with huge real-time transactions. We have been adding NOLOCKs on queries that are being used frequently etc but the timeouts are still an issue. Not sure what the best way to identify problem areas is. The CPU utilization has also been on the higher side. Profiler identified long queries are being indexed etc. But the performance is still a concern. Any ideas? What am i not looking at? HELP HELP..

Thanks,
Sri

View 16 Replies View Related

Scalability With Mount Points

Feb 28, 2008

I understand mount points help scalability in easier maintenance.
By scalability do we mean more than 26 drive letters or it means adding more space to the same mount point letter on with more ease .

Can I add more space to a mountpoint if required later on by adding hard disks .

Also if one can give some pointers to good file group configuration guidelines / storage align partitions , it will be very much helpful

Further I my server CPU has 4 cores , will having 4 filegroups help me in improving system performance.


If SAN has 2 controllers , is it preferred to run data file partition on one controller and log file partition on another.

Thanks in advance.

View 1 Replies View Related

High Availability And Scalability ...

Jul 12, 2006

We have a multi-lingual website (English, Spanish and German). We have a table called Posts that is potentially getting really big.

We are in the initial design phase of the database and would like to know what the experts are suggesting to keep our database mean and lean in the long run.

We have been talking about splitting the database up into 3 separate databases, one for English, one for Spanish and one for German. The language specific databases would also be hosted in countries where the language is spoken eg. the German database would be hosted in Germany.

Or maybe database partitioning by language???

Making changes to 3 databases once launched seems like a nightmare. It would be nice to have one main database and maybe 2 (Spanish and German) €œsatellite€? databases or something like that €“ any ideas???.

Any suggestions of how to deal with this problem the best way would be greatly appreciated. We are using SQL Server 2005.

Newbie!

View 4 Replies View Related

Balancing Scalability With Availability

Jun 16, 2006

We are beginning to design a new application with SQL Server 2005. Our current production environment is slated to be two SQL Server 2005 machines with the databases residing on an EMC SAN. We have requirements to both have automatic failover between servers for availability and also be able to balance the load over two hot servers for scalability.

Can anyone point me in the right direction for things I need to consider in order to be able to implement both of these requirements? Can I implement database mirroring (for failover) and transactional replication (for balancing) given the hardware configuration I'v mentioned? Is more information needed? Where should I turn next?

I am coming off a mainly Oracle background for the last ten or so years with a smattering of SQL Server mixed in. I've tried to hit the ground running on this project, but sometimes find myself hitting the wall running instead.

Thanks,

Larry

View 3 Replies View Related

Scalability Issues With Using IDENTITY Columns

Jul 21, 2000

We have a high load site that requires some redesign. We would like to move the PK generation from a custom scheme to IDENTITY columns.

What are the any scalability issues for using IDENTITY? Will contention issues arise because of row locking?

Thanks in advance.

View 7 Replies View Related

Scalability Questions For Extended Stored Procedure

Jan 25, 2006

Hi,First I would like to apologize for cross posting in three groups asI did not know which one would be the appropriate group. If some onepoints me to the correct one I will use that in the future.I am trying to findout the scalabilty of an user written extendedstore procedure. I have created a dll using a C program(modified/plagarized from some of the examples) . The main function ofthis extended SP is to act as a passthru to connect to an third partyODBC driver. All this is supposed to do is take the passthru sqlstatement, userid, passsword and connect to a remote server (IBM 3090Mainframe in our case) using a system ODBC connection and pass thereturned result set back to the stored procedure calling this extendedSP. I am trying to find out the answers for the following questions.1. What are the limitations of this approach.2. What would happen say if 2,000 concurrent calls per minute are madeto the extended SP from the web app.3. What would happen if this continued for say 4 hours. Will the memoryusage increase to point that will cripple the server assuming there isno memory leak in the dll.4. Are there any connection pooling concerns that I should payattention to specifically from an Extended SP point of view.5. Apart from compiling the dll using the "MultiThread" option should Ibe using other options to make sure the dll is threadsafe.SQL server Environment :OS - Windows 2000 Advanced Server SP4SQL - SQLServer 2000 Enterprise edition SP3Hardware - 8 way 2 node cluster with 6Gb RAMAny help regarding this is greately appreciated.Prahalad

View 3 Replies View Related

Running Ssis Package With Ssis Run Time Compoenents And Sql Server 2000...

Jan 22, 2007

running ssis package with ssis run time compoenents and sql server 2000...

Is it possible to run ssis packages that point to servers on sql server 2000
without installing sql server 2005 ?

Can we just install runtime for ssis and run the packages ?

Please explian with links if possible

thanks a lot

View 18 Replies View Related

Integration Services :: Executing Child SSIS Package In Parent SSIS

Oct 9, 2015

I want to achieve the following in (SSIS/SSDT for SQL 2012) - 

I have a generic SSIS package which simply sends out email notifications using SMTP email task (this package is within its own project, and has project level input parameters).

I need to be able to call this package in the Event handler section of every package (numbering in about less than 60) that we have. These packages are within their own respective projects.

I thought I could use the "execute package task", but it turns out , using this, I cannot call a package that is part of some other project. I also cannot call a package that is stored in the CATALOG. Is there any way I can do this ?

When I call the child package , I should be able to send in parameters like - error information and package name of the Parent package.

View 8 Replies View Related

SSIS Called From Agent Job Not Calling New Child SSIS Package Addition

Oct 29, 2007

I have an SSIS package (TransAgentMaster) that I recently modified to include a call to a child package via the file system. The child package creates a text file. When I run the package in dev studio then the child package/text file is produced.

I then imported the TransAgentMaster as a stored packagesfilesystem package into SQL SSIS and executed the package. The child package produced the text file.

I then ran the SQL Server Agent to see if the child package would work and it did not generate the text file. Thus after updating a SSIS package importing the package into SSIS the job that calls the package will not call the child package. Please not that the TransAgentMaster package calls 7 children packages €¦ just not my new one.


Any thoughts why the agent will not run the child newly crated childe package?

View 3 Replies View Related

Could Not Serialize The SSIS Runtime Objects When Attempting To Copy Tasks Created By SSIS Wizard

Jul 11, 2007

Run the SSIS import/export wizard.

(xls -> sql table)

Select the tasks created.

Copy.



Here is the error that occurs.



p.s. Does anyone have any needles I can borrow? I think sticking them in my eyes would be nicer than working with SSIS.





===================================

An error occurred while objects were being copied. SSIS Designer could not serialize the SSIS runtime objects. (Microsoft Visual Studio)

===================================

Could not copy object 'Preparation SQL Task' to the clipboard.
(Microsoft.DataTransformationServices.Design)

------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%u00ae+Visual+Studio%u00ae+2005&ProdVer=8.0.50727.762&EvtSrc=Microsoft.DataTransformationServices.Design.SR&EvtID=SerializeComponentsFailed&LinkId=20476

------------------------------
Program Location:

at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
at Microsoft.DataTransformationServices.Design.ControlFlowClipboardCommandHelper.InternalMenuCopy(MenuCommand sender, CommandHandlingArgs args)

===================================

Invalid access to memory location. (Exception from HRESULT: 0x800703E6) (Microsoft.SqlServer.ManagedDTS)

------------------------------
Program Location:

at Microsoft.SqlServer.Dts.Runtime.PersistImpl.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.SqlServer.Dts.Runtime.DtsContainer.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)

View 14 Replies View Related

SSIS: Excel Import: SSIS Not Reading Dates

Apr 26, 2008

Hi. I need to import excel file in database. i first need to do an unpivot task. the column names are dates and SSIS seems to be unable to pick up the column name as it is replaced by F2 F3 F4etc Can you advise of a solution. thanks ken

View 1 Replies View Related

Source Code For The Standard SSIS Components That Come With SSIS?

Jun 2, 2006

Hi,

I'm finding that the standard components often just don't quite meet my
needs, but would only need some fairly minor changes to save me and my team a lot of
work (and produce more elegant solutions). So I was just wondering whether the source code was available for the standard components that come with SSIS, or if there is anyway to extend their functionality?
Or do you just have to start form scratch?

Thanks,
Lawrie

View 4 Replies View Related

Use Of SSIS In Reading And XSL File. Should I Use SSIS Or Just Straight C#

Aug 1, 2007

I need to build an asp.net/C# application to read values from an Excel spreadsheet. Once the values are read from the spreadsheet, the C# code will do some elementary statistics on the values read. Then the values read and their computations will be written to a sql server database.
My manager suggested that SSIS might be a good candidate technology for doing this type of work. Does that sound correct? My only hesitation with using SSIS is that I want to keep the application as simple as possible, so that the code can be more portable. Maybe might argument is not a good one, but maybe someone can help me out here.
Ralph

View 1 Replies View Related

Ssis Select From Ssis User Table

Apr 11, 2008

Hi,
I have two variables
1. strStatement datatype (string)
2. objTable object (user tables)

the string strStatment returns a dataset
and is assigned to objTable.

I want write the data from objTable to a sql table
and it seems not to work.

Here is what I did.
I used data flow task to either select from a a string or objectTable.
but it give me an error.

View 1 Replies View Related

SSIS - Get ServerName From A XML Or TXT File Into SSIS Package

Jan 4, 2008

Dear Friends,
I store several configurations in the main database of my SSIS packages. I need to get the servername from a xml or txt file in order to get those configurations stored in my database.
How you think is the better way to do that?
Using a FlatFileSource to read the file and a script to save the value into a SSIS variable?
Using the package configuration I cant do that... maybe I dont know, but I can save the SSIS variale in the configuration file, but what I need is to do the inverse, read the configuration file and save the value in the SSIS variable.
How the best way you suggest?!
Regards!!
Thanks.

View 18 Replies View Related

Execute SSIS Package Without SSIS Console

Jul 25, 2005

Hello,

View 13 Replies View Related

Convert SSIS 2008 To SSIS 2005

Apr 22, 2008

We have SQL 2008 in development but only SQL 2005 in production. I have an SSIS package that was created in 2008 but need to deploy it to a SQL 2005 server. The '05 server will not import the package because of its version. Is there a way to convert back or 'save as' SSIS '05?

View 6 Replies View Related

Creating GUI With SSIS Or Passing Parameter(s) In SSIS

Apr 23, 2007

Hello All!

I have two questions to ask in this one thread. I would appreciate any feedback.

1. Is it possible to create GUI from SSIS using macro so that it can display forms or dialogs? If so how can I create a form that can be used to pass the parameters for the execution of the SSIS??

2. Is it possible to pass parameter(s) to SSIS? If yes, how can we do it...Please provide me with any example.

I wait to hear from you!

Thanks,
Niben

View 1 Replies View Related

SSIS - Tracking An SSIS Package Execution

Oct 3, 2007

I would like to see if someone can help me out.

Scenarion:
1.- SSIS Package execute tasks on 2000 SQL Server Database
2.- Execution takes places using Business Intelligence Studio
Question:
1.- How can I tracked that SQl 2000 tasks took place using a SSIS Package?

Thanks

View 1 Replies View Related

SSIS Newbie - Separating SSIS && DB Engine

Oct 10, 2007

Hi Gurus,

I am new to SSIS. I am trying to install just the SSIS in one machine("SSIS Machine") and just the DB Engine ("SQL Server Machine") in another machine. What I am trying to do is, separating the SSIS service and packages from the Database Engine and trying to run in in another machine. I have few questions on this topic. I searched on this forum but I couldn't find a concrete answer to those questions. Forgive me if it already answered/asked multiple times.

1. When I install SSIS in "SSIS Machine", do I need to install client components also in the same machine?
2. I already established this setup (SSIS with client components in one machine and SQL Server in another) but when I tried to connect to the SSIS thro' Management Studio from Sql Server machine, I keep getting "Access Denied" error. Is it possible to connect to SSIS server from another machine (using Management studio)? I tried the DCOM security permission options I found in the internet(I don't have domain id so I gave "Everyone" full access) but still I get the same error. Any help would be appriciated.
3. Do I need 2 SQL Server Licenses (Enterprise) if I go with this environment?
4. Is it possible to configure SQL Job to run SSIS installed in another machine?

I would appriciate any help on this issue.

Thanks

View 4 Replies View Related

SSIS Design Question - New To SSIS, Please Comment! :)

Feb 20, 2008

Hello everyone!!

I am completely new to SSIS and have been given a large project (of course with a tight deadline) that has the absolute requirement of using SSIS. I am/was very, very good with DTS and could easily accomplish what I need to do with an ActiveX script task in DTS in no time, but as this is new development, we are not to use ActiveX script tasks within SSIS since it will not be supported in the next SQL Server release. I'm thinking script task, but please give some comments on how you would accomplish the following in SSIS (please remember I'm new to SSIS, so don't assume I know anything. )

I must accomplish this: in a nutshell, I need to create separate tab delimited text files of customer informaion. One for each region. Each region consists of X amount of states and we have X amount of regions. (Pseudo code followed by standard explanation)

Select a max value from region lookup table in SQL (this is the # of regions)

for N=1 to MyMaxValue

select states from region lookup table where region code = N (the current region we are on)
'this returns a list of states in a region, need these in array or recordset object or something
Open an output file which will be a tab delimited text file we will write results below in loop to (in DTS I would programatically kick off a transformation task in the package)
'loop thru states returned, so if in a rs object...
do while not rs.eof

execute customer stored procedure, passing as a variable the current state we are on
'this will return all customers within a state, this whole result set (approx 1 million) needs to go to the tab delimited file
'I have to execute this stored procedure for each state & then write results to the SAME file, until we are onto a different region

rs.movenext
close file
loop
next

OK, so basically, as you can see, Its sort of simple in a way what I need to do, i just have no idea how to go about doing this in SSIS. I can not hard code any state or region values. I MUST read them in from the lookup tables as region codes are constanatly changing and we are constantly adding in new states and new regions, so with above coding idea, it would always dynamically pick up any new states, new regions or changes.

So in a nutshell, I need to create separate tab delimited text files of customer informaion. One for each region. Each region consists of X amount of states and there are X amount of regions. Pretty strait forward, huh? The requirements are strait forward, but SSIS is throwing me for a loop... it does not seem flexible enough to be as dynamic as I need it to be to do this. I'm sure it is, just my understanding of it is very basic so far.

Please provide your suggestions! I think a lot of newbies would benefit from some SSIS design info... how to do common things in SSIS, but beyond just retrieving a recordset and writing it to a file... what do you do when you need to add just a few layers of decision processing, and retriving recordsets and writing files based on that decision processing?????

THANK YOU!!!!!!
Kathy

View 7 Replies View Related

Loading SSIS In ActiveXscript Within SSIS

Apr 9, 2008

I am trying to load a dtsx file in the SSIS package ActiveXscript.
But i am getting the following error

Error retreiving the filename for a component failed

In DTS the syntax was
LoadFromStorageFile(UNCFile,Password,[PackageID],[VersionID],[Name],[pVarPersistStgOfHost])

and for SSIS Sql Server 2005 its :
app.LoadPackage("C:ProjectsTestPackage.dtsx", Nothing)

some how its not working for me.Is it because of me using ActiveX scipt
Please help
Thanks in advance.

View 1 Replies View Related

Can One SSIS Packet1 Run SSIS Packet2?

Sep 10, 2007



Hi,

If I have 2 SSIS packets, can one start the other?

Thank you.

View 3 Replies View Related

Job Running SSIS Package Keeps Failing But The SSIS Package By Itself Runs Perfectly Fine

Aug 30, 2006

Hey, I've a few jobs which call SSIS packages. If I run the SSIS package, it runs fine but if I try to run the job which calls this package, it fails. Can someone help me troubleshoot this issue? None of my jobs that call an SSIS package work. All of them fail.

Thank you

Tej

View 7 Replies View Related

Fuzzy Search - Exposing SSIS Fuzzy Capabilities Outside Of SSIS?

Apr 15, 2008



I've been looking into ways to accomplish a fuzzy search and SSIS makes that possible if I want to do a bulk import or something like it. But what it I just want to look stuff up at any given time not haveing to run the package?

Is it possible to expose the fuzzy lookup outside of SSIS to for example t-sql?

Here's an example:
I want to lookup the music artist "Notorious BIG" but in the database it is "Notorious B.I.G." if I use the SSIS fuzzy lookup I basically get what I'm looking for. But how would I call this from a web application? So then I tried Full text search but this doesn't really work out as well.

Will I have to re-write the logic that the fuzzy lookup uses to enable it to work? i.e. using Full Text Indexes and FreeTextTable, ContainsTable, SoundEx and the like to somewhat even come close to what the Fuzzy Lookup has?

View 6 Replies View Related

Can I Return A Value In A Variable From A SSIS Program Back To C# After The SSIS Program Is Run From C#?

May 21, 2007

Can I return a value in a variable from a SSIS program back to C# after the SSIS program is run from C#?

View 1 Replies View Related

FTP In SSIS And .bat Files In SSIS

Mar 5, 2008

I am new to using FTP and executing .bat files in SSIS.
First, the .ftp file should run. When it runs the FTP process, the user should be prompted for username and password. Then, it should run the .bat file.
What all are the steps I need to do and how to set the properties for FTP and the Execute process task (which holds the .bat file).

Thank you.

View 7 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved