SSIS Deployment With Configuration Values In SQL Table
Oct 15, 2007
I have 4 packages in one solution. I have created one configuration table in SQL server for all the packages. For each package, I have a different configuration filter in the same table. Everything works fine in the development environment.But when I create a deployment utility and deploy the packages, the values are not picked from the configuration table although I have re-created the configuration table in the new database.It tries to pick up the values from the database used in the development environment and thus it fails. I have changed all the connection strings in the package after deployment but still of no use.
I am not getting where I am going wrong. Any help would be highly appreciated.
View 3 Replies
ADVERTISEMENT
Aug 15, 2007
Hi,
Please can you let me know which of the following 2 is a better method to deploy SSIS packages
File System deplyment OR SQL Server deployment
What are the advantages of one over the other?
Thanks,
Mrinali
View 4 Replies
View Related
Jan 17, 2007
Hi:
I have a SSIS package on my local machine, and would like to deploy it to DEV server. Which files should i be moving to the SQL DEV Server? and where? How do I modify connection managers or is there a way to do that from the Management Studio or some other way? Thanks and I would definitely appreciate some prompt advise.
View 11 Replies
View Related
Mar 6, 2006
I've been searching for an answer to my question quite some time now and I've not been able to figure it out yet.
Situation:
- I've created a SSIS package containing a bulk insert task.
- I've added a package configuration containing the appropriate connection manager (i.e. dev, beta or live)
- CreateDeploymentUtility = true
- I've copied the deployment folder to our beta server and I started the manifest file to install the package to the sql 2005 server, after that I specified the config file location and changed the value so the approriate connection manager is used.
- When I execute the package from the sql server the package doesn't read the value from the xml config file, it uses the connection which was originally specified in the package, whereas when I run the package from my BIDS it is reading the value from the xml config file?
I can't seem to figure out why this is happening? am I missing something here?
Thnx.
View 1 Replies
View Related
Jun 29, 2006
I've been doing some VB6 app development against a SqlExpress database, but have confusion with issues of deployment and configuration. It's my intention to distribute the app and db to client installations, both as stand-alone and network-ready shared access. Here's basically what's occurred thus far:
The database originated as an Access mdb file.
Downloaded and installed SqlExpress, Tools, Manager, and sample database(s).
Used the Upsizing Wizard in Access to create a SqlExpress db.
Attached to the database in Express Manager so I could examine and access the table data.
Hit the data through the application with the following connection string:
Provider=SQLNCLI.1;Integrated Security=SSPI;Persist Security Info=False;Data Source=.sqlexpress; AttachDBFileName=(MyDataPathAndFileNameHere)
Been developing against this db ever since.
Now, some points of my confusion thus far with regard to deployment:
1. Named Instance and User Instance. I assume I'm using a Named instance with the preceding connection string. Honestly, I don't recall doing any kind of adminstative setup/configuration of the db except attaching to it in Express Manager, so I'm confused over why I would need a User Instance for a local copy of the database. Are there setup steps I've missed or did the Upsizing Wizard do them for me? I've read the white paper on user instance usage, but it raises as many questions to me as it answers. I do understand User instance is intended for local copy of the db, even though I'm not using it that way in development.
2. Do I distribute both the MDF and LDF files? I saw mention somewhere not to distribute the LDF log file, but the app doesn't work without it being there.
3. What has to be done for deployment to a server for shared acccess. Aside from installing SqlExpress, and possibly Manager, I'll need to configure for remote connection usage using Configuration Manager or Surface Area Configuation tools. Does this need an administrator to create and establish users accounts, rights, and such?
4. Are there any reference books out on this stuff yet, besides books online, which I don't find satisfactory.
5. Can SqlExpress coexist on Sql 2000 server? I realize SqlExpress is essentially Sql 2005, but our existing server is Sql 2000. Should it go on a different server?
Sorry for the myriad of newbie questions, but I'm a programmer and not a db admin.
TIA,
Rick
View 6 Replies
View Related
Oct 1, 2007
Currently within the Configuration manager you are able to set the Target Deployment parameters such as serverurl , folder etc.. However is there a way to set the Datasource within these configuration settings. For example we have Dev,Demo, and Production sql servers that ideally would be set to to switch with their corresponding deployment target areas DEV,Prod,Demo Reporting service servers. However as it stands I find myself having to manually change the datasets to point to different Servers for testing and then back to the production when its ready to roll out.
did I miss some feature that allows me to do this within the vs ide or does this have to be done programatically?
View 3 Replies
View Related
Apr 19, 2007
Hello all,
I have an issue with my SSIS package not using the package configuration specified in my SQL server table. This is a simple scenario where I need to move data from a csv file to a SQL server table.
I have 2 connection Managers - one for the location of CSV file and another for the SQL database connection string. I chose to Enable Package configuration. Two configurations -
a. Environment variable to store the database connection string.
b. SQL server table configuration for flat file connection manager.
The location of the CSV file is dynamic..so the idea is to change the path as and when needed in the SQL table.
No errors..everything works fine except that the properties of the flat file connection manager is not being pulled from the SQL server configuration table. It uses the location I had specified during design time.
How do I force the SSIS package to use the configuration specified in the SQL table always.
I've been spending a lot of time on this with no success. Please help..
Thanks
Karthik
View 17 Replies
View Related
Oct 20, 2015
I want to maintain all configurations in Single table, what is the best way to approach it.
View 5 Replies
View Related
Jan 22, 2007
Hi,
We are trying to create a deployment utility for a solution. The issue we are facing is, we are using a single package configuration file and when we try to build the solution to create the deployment utility, the build process fails saying that the package configuration file already exists. THe reason for this is while trying to build, the utility copies the configation fiel for the packages, it copies for one, but for the second onward, when it tries to copies, it fails saying the file already exists.
Any idea how to overcome this, or else any suggestions how to perform the similar steps to create a deployment utility for a solution in which the packages share a single package configuration file.
Any suggestion would be really appreciated.
Thanks in Advance,
Manish Singh
View 5 Replies
View Related
Nov 3, 2015
We deployed the ssis package to SQL server and now trying to configure but it only allow use to change environmental variables there is no option to browse and select XML configuration file. Does this mean when you are using SQL server deployment mode u can only use environmental variable ?
View 3 Replies
View Related
Sep 28, 2005
I am getting following error when "CreateDeploymentUtility" is set to true and I try building the solution. It tries to copy a file that already exits in inDeployment folder. I am using Sept. CTP.
View 4 Replies
View Related
Apr 1, 2008
dear list can anyone figure out a workaround as to why OLEDB Provider MSDORA cannot store passwords
I have all the info stored in a table (Project Real Best Practise)
The user id I have stored in string ConfiguredValue gets transfered to OLEDB Provider MSDORA named (SQL_REAL_Source_myoradb) but not the password
To workaround this bug only with MSDORA can aynonne sugest a setting I should use in package security
ie the default is EncryptSensitiveWithUserKey?
thanks Dave
CREATE TABLE [admin].[Configuration](
[ConfigurationFilter] [nvarchar](255) NOT NULL,
[ConfiguredValue] [nvarchar](255) NULL,
[PackagePath] [nvarchar](255) NOT NULL,
[ConfiguredValueType] [nvarchar](20) NOT NULL
) ON [PRIMARY]
ConfiguredValue = Provider=MSDAORA.1;Password=abc;User ID=myuserid;Data Source=myoradb;Persist Security Info=True
PackagePath = Package.Connections[SQL_REAL_Source_myoradb].ConnectionS
View 5 Replies
View Related
Feb 8, 2007
I am trying to load a SQL 2005 table that consists of two guid values in two fields. I have a flat file in tab delimited form that has guid values as strings to load into the table. I used a flat file source module in SSIS; which then goes to a Data Conversion module that takes the flat file and does a conversion to type unique indentifier [DT_GUID]; this goes to a OLE DB destination which is a SQL 2005 table that has no records and only those two fields. I get this following primary error:
[Data Conversion [498]] Error: Data conversion failed while converting column "Column 0" (373) to column "Copy of Column 0" (511). The conversion returned status value 2 and status text "The value could not be converted because of a potential loss of data.".
An example of the two values in the .txt flat file source:
84d92cbb-4b4b-435b-8d8a-789ea930283c 328340cd-85fd-4210-8d82-000024093d7c
Any ideas what may be causing this? This should be pretty straight forward load. But it is guid which seems to always cause cast issues.
View 4 Replies
View Related
May 14, 2008
I have a very odd problem. I have a package which uses some custom tasks that were written in C#. When the package is deployed to our production server, *some* of the property values for *some* of the tasks are cleared. For example, I have these five tasks:
FP Export File Logger
FP Import File Logger
FP Import Table Logger
FP Instance Logger
FP Job Reader
All of them inherit (of course) from Microsoft.SqlServer.Dts.Runtime.Task. All of them have custom members (some similar, some different), and of course, different implementation (though they are mostly the same). This test package has one instance of each of the different tasks.
As I said above, when we deploy to our production server, *some* of the property values for *some* of the tasks are cleared -- but when deployed to our dev server, everything remains intact.
Here is what is cleared:
- On 4 of the 5 tasks, the Description property (inherited by Task) is cleared, but the other one remained intact
- On 3 of the 5 tasks, the Connection property (custom property in all tasks) is cleared, but the other two remained intact
- 3 of the tasks have other string properties that were set, and all of these were cleared
We can reproduce this on two different production servers, and these two servers have some different configurations, suggesting these would not be the culprit:
- They have different service packs (one is build 2047, the other build 3042)
- One has the custom SSIS components installed (in the GAC), the other one does not
Our development server, where the package is deployed as expected, has build 2047 w/ the components installed.
Here are the packages, where you can compare and see the differences (using a text comparison tool):
Dev-GOOD.xml
Prod-BAD.dtsx
These were created after being deployed by importing within a Visual Studio SSIS project from the server.
Any suggestions would be *greatly* appreciated, as we are totally stumped as to why this is happening.
EDIT: Additional clues, this package is deployed to the MSDB. If it's deployed to the File System, it remains unmodified.
Thanks in advance.
Jerad
View 2 Replies
View Related
May 12, 2015
I am trying to insert in table using execute sql task.
I want to pass value of Load_Frequency through parameter
But I am getting below error
[Execute SQL Task] Error: Executing the query "Insert Into [dbo].[ETL_LOAD_MAIN] (
[Load_Fr..." failed with the following error: "The statement has been terminated.". Possible failure reasons:
Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.
Insert Into [dbo].[ETL_LOAD_MAIN] (
[Load_Frequency]
,[Load_Start_DateTime]
,[Load_Overall_Status]
) Values (?,getdate(),'In Progress')
View 2 Replies
View Related
Sep 13, 2007
Is there a way that would allow me to deploy ssis for end user in a given file, where the end user simply clicks some icon that will tiger the ssis deployment process?
View 2 Replies
View Related
Oct 19, 2007
Hi All,
I am able to execute my ssis package from BID environment using SQL Server Authentication. However, when I deploy the package on SQL Serve 2005 using Windows Authentication, the package fails. The package is a simple one, it read two servers, truncate tables and load the data on the destination server.
I am not sure why this fails when I execute the package on the server environment, but works fine when I run it from BID.
Any help would be greatly appreciated.
Thanks
View 4 Replies
View Related
Mar 11, 2008
Hi
I am looking at deploying some ssis package's as files, my question can I install just integreation services on on server to run the packages or do I need the full installation of sql server 2005
Bimal
View 4 Replies
View Related
Jun 1, 2006
Hi,
I would like to deploy my SSIS Package in my web server rather than Database Server. So anyone please give me some suggestion to implement this.
Also I wanted to know whether I should have a SQL Server instance in the server where I am deploying my SSIS package?
Its pretty urgent. Help please.
Thanks & Regards,
Prakash Srinivasan.
View 3 Replies
View Related
Oct 18, 2006
Hello,
I would like to know how to set up the SSIS package with the DATABASE, SERVER NAME and Connection String into variables, so that I can change these parameters of the deployement, on another name of server and database (and connection string).
Thanks a lot for your advices !
Marie-Thérèse
View 7 Replies
View Related
Oct 18, 2006
Hello,
What should I do to change the server name and the database when I deploy a package on another machine ?
SHould I change the value inside the configuration file (format XML) ?
Thanks in advance for your advices !
View 4 Replies
View Related
Oct 23, 2006
I ahve read previous posts on this but didnt get a clear answer for what I am trying to do.
I have couple of SSIS packages running in y dev environment, we will be moving this into production soon. These pachakes will be called from the webapp to run once the flat files are uploaded.
Production environment has separate web server and Sql server box. Now how do I deploy the packages and where...on webserver or sql server box?
workflow is user uploads a file which is saved on the webserver and then the package will start to upload the data to the SQL Server db. I have seen that while storing the location of the flat file in the configuration file for the package it stores the hard coded path of the flat file is there a way for to save the UNC path or how can I tell the SSIS config file to look for the file on the webserver?
During deployment if I want to save the SSIS packages on to the SQL server do I still have to install SSIS components on the webserver...? or if I choose to save it as file system on the Webserver what do I neeed to install on the webserver so that the packages can be executed from the web app?
Excuse my long post but wanted to give a clear overview of the problem...
Appreciate your help in advance...
Regards
View 4 Replies
View Related
Jul 14, 2006
Several SSIS are deployed from a server A to a server B (Integration Services) with a SQL user and are stored in MSDB
- Most of the SSIS have their connection only after SSIS have been launched ; Delayvalidation is set to true.
- Application user the same SQL user from server A can launch the SSIS.
- But the same application on server C cannot launch the SSIS. The error is : OLE DB Connection error for the connection string
- Server A, B , C are Windows 2003 Server and belong to the same Windows Domain.
Can you suggest me some tips ?
View 1 Replies
View Related
Apr 16, 2008
Hi all,
I would like to deploy my SSIS project on the production server. As far as I know from the last deployment, I had to change configuration managers to data sources to the ones of the production server. I had to go through all packages and change it. What is the best way to do this? I.e. Can I do it through a configuration file?
Thanks.
View 1 Replies
View Related
Apr 12, 2007
hi,
i wanna know ,where to keep configuration parameter values either in an config file (xml), or a parameter table. i have it in xml and its working fine , but for a few of them , i need a greater fleximibility to change the values at any time, so was considering a param table.
the problem is that , a common package which reads the config from xml , now will need to read it from a table , while in case of xml , a file path can be assigned to a variable to be used by the package, but here, i dont have any db connection specification, it may be loaded on various servers. is it feasible..to use a parameter table...??
View 10 Replies
View Related
Oct 12, 2007
I have developed the SSIS project, but I have a problem with deployment. My users are statistic people and SSIS packges they use are cleaning the raw data for them. Since they would like to run this SSIS package by themselves whenever they want, I need some deployment method that is easy for them to run (they are really not IT oriented people). The problem I encountered is that there is no visual studio (integration service client) installed on there computer, but they are allowed to access several dbs and server on the net.
Can someone tell me what is the best solution for this type of deployment?
View 4 Replies
View Related
Apr 12, 2006
I'm very new to the use of SSIS in a real enterprise environment. I've used DTS in the simplistic method of import/export but little else. As myself and a few others new to the tool are working through some things two questions have come up.
1.) What is the best way to execute an SSIS package using Java?
2.) Is it possible to deploy an SSIS package to a server that does not have SQL Server installed? I've read a few things that suggest that embedding the SSIS runtime environment in an application is possible but definitely not a beginner type operation.
Any quick guidance you can provide would be greatly appreciated.
View 3 Replies
View Related
Mar 8, 2007
Sorry to start a new thread, actually Darren answered my first question on SSIS dependencies but I have a clarification and somehow the software of this forum doesn't allow me to post again on my previous thread. (my posts disappears after some time).
My question is that if I choose to deploy the SSIS packages in SQL Server, then SSIS would have a dependency on SQL Database.
Do we know where the deployed packages are stored in SQL. This information is needed so that I can maintain and monitor the DB where the deployed packages are stored.
Also, do you think its a best practice to deploy the packages in SQL ( I think it will be good because then I can have consistent version of a package deployed on many machines... since I store my packages on one consistent DB rather than multiple file folders on each machine).
regards,
Abhishek.
View 1 Replies
View Related
Oct 31, 2007
1) Every package has to have its own configuration file? There's no configuration on a project level?
2) is there anything in particular I have to do with a configuration file before running a build? When I run deployed package it seems like it ignores my configuration file and takes the connection string of conn. manager i use in development.
View 10 Replies
View Related
Jun 13, 2006
Hello, we are interested in upgrading our Data Warehouse environment to SQL Server 2005 to take advantage of SSIS. Our current data warehouse environment consists of 2 production servers with over 900 DTS packages between the 2 servers.
Are there any white papers out there detailing what type of deployment works well for an Enterprise wide use of SSIS? We're trying to determine if we should use SSIS on the same server hosting our databases, or separate SSIS onto its own dedicated box. If we went the dedicated route, what type of horsepower would we need on the SSIS box (procs, RAM, etc.)? Also, if we went the dedicated route, does it make sense to have 1 SSIS server that handles the data warehouse packages and the OLTP packages, or should that be separated into 2 SSIS servers having one server for each environment?
Thanks for any help you can provide on this subject!
Eric
View 1 Replies
View Related
Feb 25, 2008
Hi all,
I am trying to write a simple application which simplifies package deployment to SSIS. Basically it allows one to select a folder which contains dtsx-packages and the it would upload those files to the MSDB in a folder of choice on the MSDB.
To do this I thought it would be nice to use the Integration Services API (Microsoft.SQLServer.Dts) and use the objects DTS.Runtime.Application and DTS.Runtime.Package.
The result would be this in a nutshell:
Dim dtsApp As New Dts.Runtime.Application
Dim pkg As Dts.Runtime.Package
pkg = dtsApp.LoadPackage(File.FullName, Nothing) --loading the package from the filesystem
dtsApp.SaveToSqlServerAs(pkg, Nothing, strPackagePath + PackageName, strDestinationServer, Nothing, Nothing)
However if I try to execute this the I end up with an Strace-assertion error.
Searching for that error lead me to the following post: http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=2173800&SiteID=1
After some more research I found the cause of my problems. I only had SSMS (The workstation components) installed on my development-pc. Someone suggested that installing Integration Services would solve it and after testing this it indeed solved it, but this still didn't solve my problem. The tool I am writing is going to be used on production-workstations which only have the Workstation components installed and installing Integration Services there isn't likely going to happen. Mostly because having SSIS installed locally doesn't have a function; the packages will be deployed to a remote server right after they are loaded from the file.
Trying to find an alternative lead me to Dtutil which miraculously enough does seem to work if given the right parameters, but to me this feels like a dirty solution. I feel it shouldn't be necessary to resort to using System.Diagnostics.Process to manually start Dtutil in the background when I have this nice api specifically designed for SSIS.
Is there anyone here that has a suggestion or an idea how to deploy packages using the Dts.Runtime.Application without installing SSIS on my local workstation?
View 6 Replies
View Related
May 6, 2014
I have 2 identical tables one contains current settings, the other contains all historical settings.I could create a union view to display the current values from table A and all historical values from table B, butthat would also require a Variable to hold the tblid for both select statements.
Q. Can this be done with one joined or conditional select statement?
DECLARE @tblid int = 501
SELECT 1,2,3,4,'CurrentSetting'
FROM TableA ta
WHERE tblid = @tblid
UNION
SELECT 1,2,3,4,'PreviosSetting'
FROM Tableb tb
WHERE tblid = @tblid
View 9 Replies
View Related
