Retaining And Using Same DB Connection For Whole Package
Apr 7, 2007
Hello,
I need some help to solve an issue we have with SSIS, perhaps someone could help us.
We need to extract data from a remote database. We would like to use SSIS to extract data from that DB. But our actions are very restricted in that DB; we can query the DB views and create (local, global) temp tables only.
So, we created an SSIS package with two SQL execution tasks. In the first task, we create two local temp tables and insert some results into them. In our second task, we need to access the values stored into the temp tables, so we have the two tasks connected and we set the RetainSameConnection to true.
But when we execute, the second task always fails reporting €śinvalid object name€? (referring to the temp table names). It looks like each task is using a different DB, making impossible for us to use the temp tables we created in the first task. We tried both ADO.net and OLEDB without much luck so far.
Any ideas how to solve this problem? Any hints and recommendations are much appreciated.
As a side note, we are trying to avoid global tables because our test team will need to test our code and if the code is run by both SSIS and our test team at the same time, then we€™ll have problems. Unless we synchronize access to the tables, or pass some sort of caller identifier to prefix or suffix each temp table name with that caller identifier. No option looks very elegant so far, but anyway.
So, do you know if just one database connection could be used for the whole flow (or not)? And if yes, how?
Thanks and regards,
Claudio
View 2 Replies
ADVERTISEMENT
Sep 6, 2007
For my db connection managers the password is not being saved. I have 'remember password' checked for each connection manager, but when I close down the BIDS and open it again, I have to re-enter the password again. Even when I import the dtsx file into SQL IS, its not in the connection manager information. I have to re-enter the password again every time prior to running it,.
What is causing this? I don't want to have to enter in the password everytime I run it because the jobs are going to be scheduled and no user interaction unless one fails.
View 15 Replies
View Related
Aug 28, 2015
I have an SSIS package that uses an FTP connection manager. When running the package in BIDS, it runs fine and maintains the password for the remote ftp site's user account.
Once I deploy the package and attempt to run it, it fails with the following error:
Started:Â 4:06:15 PM
Error: 2015-08-27 16:06:20.09
  Code: 0xC001602A
  Source: Export and FTP New Jobs Connection manager "FTP Connection Manager"
  Description: An error occurred in the requested FTP operation. Detailed error description: The password was not allowed
End Error
Error: 2015-08-27 16:06:20.09
  Code: 0xC002918F
  Source: FTP Jobs Listing to Concur FTP Task
  Description: Unable to connect to FTP server using "FTP Connection Manager".
End Error
DTExec: The package execution returned DTSER_FAILURE (1).
I've tried Don't Save Sensitive With Password and that still fails.
Does the FTP connection manager just not retain passwords outside of BIDS?
View 3 Replies
View Related
Jul 6, 2006
Dear All,
I now have two SSIS package, "TESTING" and "LOADING". The "TESTING" package have an execute package task that call the "LOADING" package. When I want to execute the TESTING package, how can I setup the connection string so that I can edit the password of the database connected by the "LOADING" package?
Regards,
Strike
View 8 Replies
View Related
Jun 29, 2006
I am using execute pacakge task to execute another package . I am giving the Connection string for the package to execute. It works fine in my development machine but when i try to run in another server after i deployed it. It looks for the datasource path of the DTSX file in the same location.
how do i set the path according to each server where the dtsx file is stored. or any other method of storing it like connection string.
if i store it in theparent package variable where should i point to...
thanks
aa
View 1 Replies
View Related
Apr 26, 2006
I am receiving an error on my master package that executes a number of other packages. The individual packages work fine when executed by themselves. However, I am getting the following error when I attempt to execute it from another package:
Error: Failed to acquire connection "conneciton". Connection may not be configured correctly or you may not have the right permissions on this connection.
Thanks in advance for your help.
View 1 Replies
View Related
Mar 29, 2007
Both the OLE DB Connection and ADO.Net Connection in SSIS Package does not remember password.
Im connecting to a SQL Server 2000 box using its sa password as test.
The SSIS package runs fine when you first set up the connection in bids
The bottom line is that SSIS keeps forgetting the password I feed into
the two Connections that I'm using. I double-click a connection,
type the password in, check "Save my password" and hit "OK" but the
password disappears from there whenever I run the package or
double-click the connection again.
is there any known workaround for this issue as I would like to schedule my SSIS package using a SSIS Step in a SQL Server 2005 Agent job.
the only thing I found when googling this error was link below but the workaround described here is a little harsh
http://www.developersdex.com/sql/message.asp?p=1921&ID=%3C1146409399.447345.7470@j73g2000cwa.googlegroups.com%3E
thanks in advance
Dave
the box SSIS is running on is Windows 2003 Server Standard Edition latest service pack
SQL Server 2005 (no service packs )
View 14 Replies
View Related
Dec 30, 1999
Is is possible to upgrade from 6.5 to 7.0 and have all the logins that have been granted the ability to make a trusted connection to 6.5 be created the same capability in 7.0?
When I did it the logins were created as standard logins in 7.0
View 1 Replies
View Related
Apr 12, 2006
Hey guys, I have a table full of data that has duplicate records except for two date columns (date1 and date2). What I would like to do is remove the duplicates while retaining the most recent record, how can I do this?
So record 1 looks like this:
Code:
John | Smith | 08/08/2000 | 10/10/2000
Record 2 looks like this:
Code:
John | Smith | 08/10/2005 | 10/10/2005
I'd like to remove the first instance and keep the second (most recent one).
Ideas?
Thanks!
View 5 Replies
View Related
Apr 10, 2008
I have a table employee_test having the sample data. The rows with EmployeeID=6 are duplicate rows. I want to delete the duplicates retaining one row for the employeeid=6.
Note :- I don't want to use a temporary table. I want to do this using a single query or at the most in a SP query batch. Please advise.
EMPLOYEEID
ENAME
SALARY
MANAGERID
1
Anee
1000
11
2
Rick
1200
12
3
JOHN
1100
13
4
ABC
1300
14
5
DEF
1400
15
6
DEF
1400
15
6
DEF
1400
15
View 22 Replies
View Related
Apr 12, 2007
I'm designing a database to store information about jobs that are in progress at a property. More than one job can be in progress at a property at one time and each different kind of job can contain different data, although they all share some common fields such as StartDate.
So I have a table that stores the property details PropertyDetails:
*ID
PropertyAddress
PropertyPostCode
Then I have a table that stores all of the jobs' shared details:
*PropertyID
*JobID - These three make up a compound primary key
*JobType
StartDate
EndDate
Then I have individual tables for each of the Jobs, for example BuildingWork:
*JobID
BuildingContractor
InsuranceCompany
Which works great, and enables me to query all basic job details from one table (JobDetails) rather than multiple tables for every job type.
BUT: I don't know how to enforce the referential integrity of the database. Obviously I can use a constraint to cascade deletes from the PropertyDetails table to the JobDetails table through the PropertyID, but there doesn't appear to then cascade the deletes from the JobDetails table to the individual Job tables as JobDetails has no idea what tables are there.
If I store the relevant individual table name as the JobType in the JobDetails table, could I use a trigger to somehow delete the related record from that table?
Littlecharva
View 7 Replies
View Related
May 15, 2008
Hi All,
I am writing a SP where I need to pass an value to maintain records of last n days. In this SP I am deleting a couple of tables based on the value passed to this SP. For e.g. If the SP is passed the value 10, then only TOP 10 records is maintained, the rest are deleted.
I have formed the following logic, which I feel can be improved vastly.
I create a temp table and
CREATE TABLE #TempAuditTbl (Rownum int PRIMARY KEY, Orderid uniqueidentifier)
INSERT INTO #TempAuditTbl
SELECT ROW_NUMBER() OVER (ORDER BY orderdate desc) AS rownum, Orderid FROM Orders
DELETE Orders FROM Orders INNER JOIN #TempAuditTbl adt ON adt.Orderid = Orders.Orderid AND rownum > @TopnRows
DROP TABLE #TempAuditTbl
OR
DELETE FROM Orders WHERE orderid NOT IN ( SELECT TOP @TopnRows OrderID FROM Orders ORDER BY OrderDate desc)
This way I am able to keep the top n records.
Which of these two solutions is more efficient? Is there a more efficient way to achieve the same.
Please help.
Thanks & regards
Sunil
View 13 Replies
View Related
Jul 17, 2007
Dear Friends,
I want to retain the formulae defined in the Reporting Services to be retained when I export the report to Excel. I want to know the best possible way to achieve the same.
Scenario:
I have a report which has 4 Columns.Column 1 and Column 2 are fetched from Database. Column 3 is empty and Column 4 (Formulae defined using expressions) is computed with the formulae using the previous 3 Columns.
My requirement is that upon rendering of the report, I'll download the report to excel and the end user enters some values in the column 3 and based on the value entered, Column 4 Formula has to be computed. But when I download the Report to Excel, my Formulae expression is not retained.
Kindly let us know if there is any other means of doing this in reporting services itself. Else please suggest an appropriate alternative, either through third party or in any other way.
Thanks in Advance,
S Suresh
View 1 Replies
View Related
Sep 17, 2007
Hi all,
I've developed few reports
I'm passing values to few parameters in a report from menu report.
when I click on "View Report" button values are changed to default for parameters eventhough I've not changed specifically any values for parameters. thus report is missing few parameters and not able to execute properly..
this error occurs only in web environment.. after publishing reports.. they are working fine in developer suite(Visual Studio)
please suggest any ways to overcome this issue..
seniors.. pls throw some light ..
thanks in advance
View 1 Replies
View Related
Jul 23, 2005
HiI have been working since 2 days to device a method to export sql tableinto csv format. I have tried using bcp with format option to keep thecolumn names but I'm unable to transfer the file with column names. andalso I'm having problems on columns having decimal data.Can any one suggest me how to automate data transfer(by using SP) andretaining column names.ThanksNoor
View 1 Replies
View Related
Dec 26, 2007
Hi,
I am looking to implement a custom event handler that will also retain the original event arguments (in addition to several custom arguments).
Specifically, I am looking to pass custom arguments into a SqlDataSourceStatusEventHandler, but also want to be able to access the Command.Parameters.
I have implemented a new Event Arguments class (derived from System.EventArgs), new Event class and delegate, but do not know how to retain the SqlDataSourceEventArgs. I would really appreciate your suggestions!
Thanks!
View 2 Replies
View Related
Nov 29, 2006
I am using BI Dev Studio for SS2005 in a research (as opposed to a production) environment. Often I want to compare the results of multiple models using the same attributes. If I switch to a different model, the Design view completely resets. Is there any way to retain the same field names with different models in the Design view?
My current workaround is to give my models similar names with AR, DT, CL, LOG, NN suffixes and make global changes in the DMX.
I have consulted the following without finding an answer:
http://msdn2.microsoft.com/en-us/library/ms178445.aspx
http://msdn2.microsoft.com/en-us/library/ms175642.aspx
http://msdn2.microsoft.com/en-us/library/ms175678.aspx
http://msdn2.microsoft.com/en-us/library/ms175637.aspx
Thanks for your help,
Sam
View 3 Replies
View Related
Nov 21, 2000
I' m using Sql Server 7 and i have a connection problem.
When i connect to a server, i give a login name and a password there no
problem
but after when i try to access to the local package i have an error
'Error Source : Microsoft OLe DB Provider for SQL Server'
Error Description : Login failed for user 'name of user'
i have the same problem when i open a table i need to give me login and my
password
i have only this problem with one server
if someone have an idea ?
Thanks
Cyril Caillaud
View 1 Replies
View Related
Sep 28, 2000
I'm trying create a DTS package on a remote server (accessed over the Internet) to do a data load.
I can connect and update the database in Enterprise Manager. However when running the wizard to create the DTS package I get an error trying to establish a connection.
Error Source: Microsoft OLE DB Provider Error for SQL Server
Error description : [DBMSSOCN] General Network Error.
Any suggestions why this might be or how I can get around it?
View 1 Replies
View Related
Feb 5, 2007
Hi,
I'm using MS SQL 2000 and I want to export data from MS SQL
database to MS Excel file. So, I choose the DTS package tool to do
this job.
I try to create the connection to the Excel file, which located in the
shared location by using the UNC path, e.g.
\servernamefoldernamefilename.xls However, I cannot provide the
username/password to connect to the file's location. So, the connection
does not work.
Do you have any idea how to create the Excel connection along with
shared username/password ?
Anyway, if it is not possible :o any advices about exporting MS SQL
data to MS Excel sheet via DTS packages are still welcome....
(The reason that I prefer DTS package bec. I can schedule the job
to run it automatically)
Thank you in advance.
View 5 Replies
View Related
Jun 4, 2008
[Connection manager "CLRDB_Connection"] Error: An OLE DB error has occurred. Error code: 0x80040E4D. An OLE DB record is available. Source: "Microsoft SQL Native Client" Hresult: 0x80040E4D Description: "Login failed for user 'CLR.Test'.".
I got this error i cant resolve this. i deployed the package to other server using sql authentication. and i create the package using windows authentication on my local computer. i try to run my package in my local computer and i got this error.
View 2 Replies
View Related
Mar 1, 2006
I am having a very frustrating issue--
Essentially I have a package with an OLE DB Connection manager and a Data Flow Task.
The OLE DB Connection points to my SQL Server (using SQL authentication with a user who has sysadmin and dbo access to the DB)
All the Data Flow Task has is an SQL OLE DB Transform that runs a
SELECT * FROM <Table>
Obviously, this package does nothing...but I have stripped it down for test purposes.
Long story....longer:
When I debug this package from my local computer, the package completes successfully.
However, when I build the package and import it as a job on the server, it fails when it runs.
I get the following error in the Event Log:
Login failed for user 'xxxxxx'. [CLIENT: <local machine>]
I enabled logging on my package; it says:
OnError,....The AcquireConnection method call to the connection manager "xxxxxx" failed with error code 0xC0202009
Why can I debug the package successfully on my computer, yet when the server runs the package, locally, it fails?
View 6 Replies
View Related
Nov 5, 2007
I've been planning on putting all my connection strings for my SSIS packages into package configurations. So far, I've been using XML config files, and these strip out the passwords in connection strings which then have to be retyped every time in notepad.
Has anyone got some better guidance regarding this? Could I use another type of package config to avoid this problem?
My contraints are such that I cannot use integrated security for the packages, so the password MUST be in the connection string. However, I can place the config files in a secure location where only the package and admins have access to them.
View 1 Replies
View Related
Oct 5, 2006
I have a SSIS package which needs to connect to 5 different servers to import data. I want to schedule one task to run this one .dtsx but run once for each server connection( 5 different servers).
Is it possible? how can i accomplish it? Is Package configuration possible? How to go about it if so?
thanks,
kushpaw
View 6 Replies
View Related
Apr 27, 2008
Hi,
I am new to SSIS and i have to develop a ssis package which will run in a production machine through VB.Net(2003) exe.I am facing a problem while setting connection string of SSIS package dynamically.Can anybody help me on this?
View 1 Replies
View Related
Feb 13, 2007
Hello,
I am connecting with various sqlservers in a package to get the information. If connection failed with any sqlserver, package failed after 3 tries.
I would like that if connection failed with any sqlserver, package should not end rather move ahead and connecto next sqlserver.
I already tried to increase the number of error from 3 to 1000 but still package failed as soon sqlserver connection failed.
Any help is appreciated.
Thanks.
--
Farhan
View 3 Replies
View Related
Mar 13, 2008
I have created a SSIS package to import data from DBF files using a OLE DB Jet 4 driver, which works very well in Visual Studio, however doesn't work via a SQL Job. It states the the path isn't valid.
The file path in the connection manage is \servernamedbf (dbf being a shared folder I have permissions and security to)
The server is on another domain, which is trusted. I added the server's IP address to the host file and through windows explorer can navigate to the dbf folder with out a password prompt.
Why can't I get this to work???
Cheers
View 1 Replies
View Related
Aug 4, 2006
It seems there a lot of problems running SSIS packages under the sql agent. I have read the knowledgebase articles regarding permission issues etc but I still can't get my job to run. I can run any package as a job apart from a package that connects to an external database via an odbc connection. Has anyone had any luck with this and can let me in on the secret.
View 14 Replies
View Related
Feb 5, 2007
Hi!
I create a SSIS Package for ETL on my own machine. During development database was also on my machine. For access to this database an OLE DB connection was defined within a package in BI Development Studio. Everything worked well both in debug mode and testing package itself.
Finally I need to load data to a database on a different machine using this package.
I used several scenaries:
1) simply copied the package-file to estination machine, open it for execution, in section "Connection Managers" I edited connection string manually - changed server name and Initial Catalog. And try to execute.
2) on the destination machine I manually created an OLE DB connection (using Microsoft Data Link) to a different database (test succeded), Changed the extention of the connection file 'udl' for ' txt ' and copied its connection string to the field connection string in section "Connection Managers" (pointed in variant 1) ).
3) use Package Configurations, copied the deployment to destination machine, installed the package the way like written here - http://msdn2.microsoft.com/en-us/library/ms365338.aspx. Changed exported properties - Server name, Initial Catalog and also the whole Connection String. Also try to execute.
In all cases I recieved the same error execution message :
"Errors in the metadata manager. Either the database with ID of " OLD_DATABASE_NAME " does not exist in the server with ID of " NEW_SERVER_NAME " or the user does not have permissions to access the object."
As for access (username/pass) settings they are the same for both of them, I have the same administrative rights on both machines. And more with the same rights the ole db connection made was made manually in variant 2 - succeded!!! So I don't think the problem is here.
As for Error message - I think somewhere the OLD name of database (Initial Catalog) is saved, though I tried to change it. Though the NEW value for the server name is substituted.
Please, help me. I don't know what else can I try. And it is not a single case for my practice. So I think - something wrong in my actions.
View 9 Replies
View Related
Jul 19, 2007
Hi,
We are using a €śFlat File Connection Manager€? in our SSIS package.
The package fails occasionally while loading in the validation phase with the error
€ś-1073659899,0x,The connection type "FLATFILE" specified for connection manager "<some name>" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.
This error is not returned always.
Also I feel €śFLATFILE€? is a valid type of connection manager. This value €śFLATFILE€? is inserted by the editor and not manually typed. This is a weird behavior of SSIS.
Sometimes I get this error with respect to some other connection manager used in the package as well. €śOLEDB€? is the type of that other connection manager.
Has anybody faced similar issue earlier?
Please let me know some thoughts, suggestions, and possible work-arounds to avoid this error as this is very critical for us.
Regards
Madhavan.TR
View 2 Replies
View Related
May 2, 2007
Hi,
I want to make a SSIS package with Oracle and deploy it in no of oracle databases, for it every time I have to open package and change connection information.
How can I make oracle connection information as variable value so that when I deploy my package on Oracle database it will pick all oracle connection information(User Id, Pwd, Server Name) automatically.
Please let me know about this.
Thanks
View 4 Replies
View Related
Jan 12, 2008
I'm new to SSIS. Is there some way to change the connection strings used by a package installed in MSDB? We created a package using the Import wizard in SQL2005, but now the source Access mdb file has moved. I tried using Mgt. Studio Object Explorer to connect to SSIS to look for the properties of the package, but right-click on the package name does not offer a Properties option. I understand the package editor is now in Visual Studio, but I was unsuccessful opening the installed package in VS.
View 6 Replies
View Related
Jul 11, 2007
create a package with a connection manager
reference the manager with a bunch of tasks
change the name of the manager
stand back in disbelief as you receive the following message
Error: 0xC004800B at Data Flow Task, DTS.Pipeline: Cannot find the connection manager with ID "SourceConnectionExcel" in the connection manager collection due to error code 0xC0010009. That connection manager is needed by "runtime connection "OleDbConnection" (8)" in the connection manager collection of "component "Source - 'DCD MANUAL$'" (1)". Verify that a connection manager in the connection manager collection, Connections, has been created with that ID.
SSIS? SSUX
View 7 Replies
View Related