Copy An Olap Database To A Remote Server Using SSIS
May 2, 2008
How to add a task to copy an OLAP database to a remote Sql server in control flow using SSIS 2005? This OLAP database is existed in the remote server and I just want to replace the existing one with the one just been updated in the SSIS package and the last task in the package is to copy the updated OLAP database and replace the one at the remote server. Hopfully during the copy and paste process it will not screw up the reports that are using the OLAP cubes at the remote server as the report data source. Thanks.
I have a SSIS package which is used to update the OLAP database daily. It includes various processes from the initial dropping of the raw data source tables, rebuilding it, dropping of the OLAP datamart tables (dimension tables and fact tables), re-building it, updating the OLAP dimensions and finally updating the OLAP cubes. I wrote a series of the Sql scripts to perform the tasks except the updating of the OLAP dimensions and cubes, and assigned them to the SSIS package. Everything is working great and it was scheduled with the sql agent to execute at the early hour everyday. We have a single server enviroment for the "Production/Processing" i.e. Database engine, SSIS, SSAS, SSRS are all installed on a single server. By the way we are using Sql 2005.
Recently we split the "Production/Processing" enviroment into two seperated servers. We purchase another server "Production" server and use the existing server as the "Processing" server. I want to copy the success updated OLAP database from the current server "Processing" server to the new "Production" server. How to copy an OLAP database between servers?
Idealy, I believe that the following 5 processes should be assigned after the completion of the OLAP cubes updated at the "Processing" server:
Stop the SSAS at the "Production" server.........I know how to do this in SSIS
Re-name the existing OLAP database at the "Production" server.......not sure how to do this
Copy the newly updated OLAP database from "Processing" server to the "Production" server. If the copy process is succeed, drop the OLAP database that has just been re-named at the "Production" server. If the copy process is failed, re-named the OLAP database that has just been re-named back to the original name.....not sure how to do this. Should it be a Sql script?
Start the SSAS at the "Production" server........I know how to do this in SSIS Thanks
I set up DB mirror between a primary (SQL1) and a mirror (SQL2); no witness. I have a problem when I issue command:
alter database DBmirrorTest Set Partner = N'TCP://SQL2.mycom.com:5022'; go
The error message is:
The remote copy of database "DBmirrorTest" has not been rolled forward to a point in time that is encompassed in the local copy of the database log.
I have the steps below prior to the command. (Note that both servers' service accounts use the same domain account. The domain account I login to do db mirror setup is a member of the local admin group.)
1. backup database DBmirrorTest on SQL1
2. backup database log
3. copy db and log backup files to SQL2
4. restore db with norecovery
5. restore log with norecovery
6. create endpoints on both SQL1 and SQL2
CREATE ENDPOINT [Mirroring]
STATE=STARTED
AS TCP (LISTENER_PORT = 5022, LISTENER_IP = ALL)
FOR DATA_MIRRORING (ROLE = PARTNER)
7. enable mirror on mirror server SQL2
:connect SQL2
alter database DBmirrorTest
Set Partner = N'TCP://SQL1.mycom.com:5022';
go
8. Enable mirror on primary server SQL1
:connect SQL1
alter database DBmirrorTest
Set Partner = N'TCP://SQL2.mycom.com:5022';
go
This is where I got the error.
The remote copy of database "DBmirrorTest" has not been rolled forward to a point in time that is encompassed in the local copy
Hi and thanks in advance for your help. I have a dilemma and I need some expert help with this. I am trying to make a copy of a remote Database and then replicated the DB and it's contents on my local machine so I can build a test site to run data with. I tried to remot into the server machine but I guess that feature is not allowed by the honest of the remote machine. Since I build on my local machine and would like to be able to test data on my local machine.... I would like to copy the remote DB to my local computer and then I can run my test app on my local server. The version of SQL on the remote machine is SQL Express 2005 and I have SQL 2005 on my machine. Please give me how to accomplish this please.
I am using vb.net in windows form. I have made a module which is connected to sql server 2000.
Now, I want to have a fresh copy of the remote database of SQL Server at my local computer and whenever there is change in remote database(insertions,deletion or updation), my local database copy may gets synchronized(i.e changes get reflected in this local copy).
Can any one help me? If it is possibel by using Vb.net code, it is very well, and if there is some Sql Server wizard that can help me do that, please reply to me.
When I start creating a new DTS Package and I choose the Analysis ProcessingTask icon, I only have the option of working with the local MicrosoftAnalysis Server.How can I choose a remote server's Analysis Server in order to process itsdatabase?Thank you
I try to copy database from remote SQL Server(6.5) to our local SQL Server(7.0). I try this way: First, in Enterprice Manager, I try "NEW SQL SERVER REGISTRATION" using "Register SQL Server wizard". The remote server give me the IP, login name and password. then, I try connect option by "login using SQL Server". But I got message say:"specialted server not found, Connection open,create file". some times say:"client server access denied..." some times say:"timeout". What's going on here? So, I can not get going on with "Import data wizard".
Does anyone know how to solve this problem? Any answer would be of great assistance!
I try to access an OLAP Server from a remote compute, using ADO MD Library with following string conection : "Datasource=SERVNAME; Provider=msolap; Initial Catalog=FoodMart 2000;" I recive the following error code: -2147467259 (0x80004005), "Unspecified error" Can sombody help me
One of the step in sql agent job is to execute the SSIS package to copy files from remote shared location to local server where sql server is installed. The account on which SQL agent runs as has access to remote shared location. However SSIS package always fails with following error:
An error occurred with the following error message: "Access to the path '\sharedlocationBCKTST105092008.csv' is denied.".
We have tried using proxies but same issue come with proxy also. When using proxy, we created a proxy for a user who has access on that shared folder on Windows server(from which files are to be copied). If we login to SSIS server with the above user and execute SSIS package manually it works fine. However if we login with different user and run the job via SQL agent using proxy of the above user, then job fails throwing same above mentioned error
I am having problems setting up database mirroring (SQL Server 2005). I made a backup of my database and transaction log, I restore this on my Mirror server with NoRecovery mode. I established the end points and I set the partner on my mirror server, I then received the error "The remote copy of database "DBNAME" is not recovered far enough to enable database mirroring". when attempting to set the partner on my primary server.
I have a SqlExpress DB on my server. I have a remote copy for security/backup reasons. Because the DB file(and .bak file) is about 2 Gb, it take a while to copy the whole thing to the remote machine. I believe there is a way to use the log file to simply update my remote copy ratherr than copying whole files, but I don't know what this process is called to research it. I have Brust's book on Sql Programming, but I have not found what I am looking for in there. Can anyone tell me where I should be looking and what this process is called?
Here is my problem: I'm trying to copy a few tables from an ODBC database located on a PC on my LAN to a SQL Server on a remote server.
To do this I have created a DTS package on the SQL Server which runs smoothly, copying the data as it should, but only as long as it copies the data from the ODBC database on my own computer where I have Enterprise Manager installed. The moment I try to copy data from another PC in the network where Enterprise Manager is not used to execute the DTS package the task fails to run.
I'm quite at a loss here and would very much appreciate a notch in the right direction. Perhabs some source or book which I may read to solve the problem.
I am trying to copy a database from our company's external SQL Server(production) to our local SQL Server(development). The Copy Database wizard fails on the step "Execute SQL Server Agent Job". Following is the error in the log file.. Please advise
InnerException-->An error has occurred while establishing a connection to the server. When connecting to SQL Server 2005, this failure may be caused by the fact that under the default settings SQL Server does not allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server)
Can a SSIS server, i.e. staging server be used to create packages that update SQL Server 2000 Analysis services objects on another server running SQL server 2000 OLAP?
It appears that the OLAP connection manager ion SSIS supports only connections (and thus updates) to 2005 OLAP objects. I work for a company that has a huge investment in a 3rd party DW that uses Analysis Services 2000. the DW tool vendor will not support an upgrade to SSAS 2005. We wish to extend the DW from other data sources. My thought was to use a staging server with SSIS, used solely as the ETL tool for all new development (thus no more DTS development), and to update the sql server 2000 operational data store on another box.
I can find no documentation on how to process sql server 2000 analysis services objects from within an SSIS package. Any ideas?
I've been assigned the task of setting up access to our SQL Server 2005 box. A consultant developing for us has accessing to 2 databases and I've set this up fine. It appears however that one of these databases is re-copied over to the server every night to keep data reasonably current.
I'm not interesting in changing this method as I'm not the maintainer (as yet).
Basically I would like to know if I've setup access to this database (it works fine), when the database is updated (with an SSIS package) the account seems to get deleted. Do the original permissions from the source database overwrite those of its destination?
how to copy a content of a table from one remote server to another,. server A does not see server B (B doesn't see A) - I cannot even ping to one from another.I do have SQL Studio installed on server C, which IT team configured to allow access to both A and B.So what I did so far is to periodically:
1. connect from the studio on server C to server A 2. run the following script on server A: SELECT * FROM A.myTable FOR XML PATH('ROOT') 3. copy the result 4. connect from the studio on server C to server B 5. to write something like
DECLARE @xmlData XML; SET @xmlData = pasting here my result from item 3 above
6. INSERT INTO SELECT
ref.value ..... FROM @xmlData.nodes('/myElemnet/ROOT') xmlData( ref );
so it works. now there is a requirement to schedule this update to run periodically and I need to implement it..
We currently have a PPTP connection set up for our developers toaccess our development SQL server through a VPN tunnel. When theyneed to copy tables up to the dev SQL from their local machine theysimply do a DTS copy.However, we are now moving to a thin client solution where they willbe working on a terminal server. They will have access to thedevelopment SQL servers and SQL tools such as EM and QA. However,they will not have access to their local SQL server and, therefore,will not be able to directly perform DTS copies. We have exploredseveral possibilities such as exporting tables to a .csv or .mdb fileand then importing them on the development SQL server but this is notideal because things are lost in that process (e.g. primary keys,field names, data types, etc.)My question is this: Is there a way to export and then import SQLtables without losing dependent objects such as primary keys and datatypes in the process? If any of you are working with a similarsituation I would really like to hear how your remote users copyobjects from their remote location to your SQL servers. Thanks!Ryan--Posted using the http://www.dbforumz.com interface, at author's requestArticles individually checked for conformance to usenet standardsTopic URL: http://www.dbforumz.com/General-Dis...pict211310.htmlVisit Topic URL to contact author (reg. req'd). Report abuse: http://www.dbforumz.com/eform.php?p=722630
When I use SSIS for extract data from ssas, that means,I use mdx query.
then random error occured.
Hope some one can understand my poor English....
And the Error Info show below.
Code Snippet
Error: 0xC0202009 at Data Flow Task - For Individual User Tech Points, OLE DB Source 1 1 [31]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E05. An OLE DB record is available. Source: "Microsoft OLE DB Provider for Analysis Services 2005" Hresult: 0x00000001 Description: "Error Code = 0x80040E05, External Code = 0x00000000:.". Error: 0xC004701A at Data Flow Task - For Individual User Tech Points, DTS.Pipeline: component "OLE DB Source 1 1" (31) failed the pre-execute phase and returned error code 0xC0202009.
1) Scenario Source Oracle database with 400 tables, each table has a field 2 common fields Change_date and Company_ID
2) Required To copy 50 tables to at least 2 different SQL Server databases based on the Change_date and Company_ID
for Compnay_ID = €˜A1€™ and Change_Date = Last_Working_Date , copy 50 tables to Database1 for Company ID = €˜A2€™ and Change_Date = Last_Working_Date , copy 50 tables to Database2
Also I am not copying all the fields from each table, just a subset of fields
3)What I have done so far to create Database1 a) Created a SSIS project b) Create 5 individual packages for the project. c) Each package has 10 pairs of OLE DB source to OLE DB source representing the transfer of data for 10 individual tables. d) For each data source, I use SQL command as the data access mode
E.g Select field1, field2, fiedl10 from Table1 where Compnay_ID = €˜A1€™ and Change_Date = Last_Working Date
4) What I want to do However, since the where condition is the same for all tables (Compnay_ID = €˜A1€™ and Change_Date = Last_Working Date) , I want to find a way to set this as variable, so if the where condition changes, I only have to change it once.
Any assistance with this would be greatly appreciated.
I have a problem when I try to copy a Database using ths SSIS packs. The copy is from SQL 2000 to SQL 2005 SP1.
The process show a warning:
Source: SQLSERVERAGENT Catagory: Job Engine Event id: 208 Descripcion: SQL Server scheduled job "xxxxx" .Status: failed. Invoked on: date. Message: The job failed. The job was invoked by user "xxxx". The last step to run was step 1
And then an error:
Sourceqlisppackage Category:none Event id: 12291 Error on the packet
Hi all, I am using Visual web developper 2005 with sql server express 2005 and i have also sql server management studio express. it's all free now . my web site is ready I didn't have problem to upload my site to my hoster. Now I want to upload all my tables and my stored procedure create locally with VWD express How can i do it ? NB: I know i can't design DB (create/modify tables and stored proc) with express edition thank's for your help
I am developing an SQL Server application on my local SQL Server. When I want to put this on the remote SQL server I do a restore of the whole thing by copying the database files by myself.
I have the fallowing question:
I there a tool which i can use to create a script to create the whole db with tables and all the stuff an the SQL Server? Like phpmyadmin.
And is there a tool to create this script based on an existing db
I am having a problem creating an Integration Services package which executes an MDX query and place the results in a local DB.
I am using an OLE connection to connect to cube. However when I run the package I get the following error ....
[OLE DB Source [175]] Error: Cannot create an OLE DB accessor. Verify that the column metadata is valid. AND [DTS.Pipeline] Error: component "OLE DB Source" (175) failed the pre-execute phase and returned error code 0xC0202025.
Hi I'm new in SSIS I'm trying to create SSIS that can copy tables,permission,index,constrant... to a sqlserver2000 from sqlserver2005. Can any one help stepbystep.
I originally posted this issue on the SSIS forum and it was suggested I cross post here. I'm trying to connect to the MSDB database on a remote SSIS server using the integration services connection listed in the drop down box on SQL Server 2005 Management Studio. Every connection attempt ends with an 'Access Is Denied' error message. I have full db_dtsadmin rights on the remote server. We followed the MSDN whitepaper on connecting to a remote SSIS server (the section on eliminating the Access Is Denied error - configuring rights for remote users). Nothing works, I always get the generic access denied error message. Are there other permissions that need to be assigned in conjunction with db_dtsadmin to get this to work? I wonder if there is something simple we're overlooking.
After reading some threads on this forum about accessing OLAP data from SSIS via an OLE DB Source component (and trying it myself and getting that "pcrsstore.cpp line 325" error), I have worked around the problem by using a Script Task component.
This calls a .NET assembly I wrote that uses ADOMD.NET to get at the data using an MDX query, and then actually posts an event to a Notification Services instance via a stored proc.
Writing, deploying, and maintaining a .NET assembly is more than I wanted to do, but it was worth the effort since now I know a little about extending SSIS when I need to.
But what I really wanted to do was the following, all from within the core components of SSIS:
Import my OLTP data into my relational warehouse (already done using SSIS) Process the cube (already done using SSIS) Access the cube via MDX and post an event to Notification Services It's this last step that needed some special work because of SSIS's apparent limitation accessing cube data (although posting the event to NS would be easy because SSIS can call a stored proc on the NS application database). So I'm hoping that a future release or service pack of SSIS will give us some components to run MDX and get the OLAP data into the pipeline as if it were from any other source. Thanks for reading, and if anyone has any suggestions on a better way to achieve what I need please let me know! -Larry
I am using data flow task.And data flow source uses ole db for olap 9.0 to connect my ssas. sql comment is my access mode. A mdx query extracts data. Data flow destination is sql server table. Error said Data Flow Task: OLE DB Source [579]: The output "OLE DB Source Output" (589) references an external data type that cannot be mapped to a Data Flow task data type. I guess it is a implicit data type convertion problem. But how to solve it???
I am currently moving everything from SQL Server 2005 SP2 to SQL Server 2012. I have a method for getting users, logins, roles and SQL jobs. But I also have to get copy all of the SSIS packages from 2005 to 2012. I know I can go to the 2012 SQL Server and click on the MSDN folder and choose import. However, this only enables me to import one package at a time. I have 95 packages. Is there a way to get them all from the 2005 SQL Server to the 2012 SQL Server in one shot? I am not a SQL developer nor am I a DBA but I have been assigned this task.
I'm looking for a way to copy/migrate all of my SSIS packages from 1 SQL2005 server to another SQL2005 server. I see export/import options but they are for 2000 DTS packages. And it seems like I can only do this one package at a time, which is tedious. Anybody out there who's done all packages at once? Thanks!
I€™m using a Script Component in SSIS to call a Web Service. The web service is wrapped, using the wsdl tool. The package works, on my local enviroment. Script component calls the web service and returns the data. I€™ll move the web service to another server, web service as Anonymous access is enable. Deployed the Package on a SQL server. But, when excuting the package I get the below error. I can view and invoke the web method and see data even. SSIS is running under a NT AUTHORITYNetworkService account. I know that the problem is permission, but how would I resolve the issue.
Error: OnInformation,SERVER,DOMAINSqlAdmin,MISPackage,{190832FB-4FF1-4ECD-BF53-4A49864089B4},{D7BF27CD-BDF1-418A-ABFE-BA0A24B921FB},3/14/2007 10:59:11 AM,3/14/2007 10:59:11 AM,0,0x,System.Net.WebException: Unable to connect to the remote server ---> System.Net.Sockets.SocketException: No connection could be made because the target machine actively refused it at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress) at System.Net.Sockets.Socket.InternalConnect(EndPoint remoteEP) at System.Net.ServicePoint.ConnectSocketInternal(Boolean connectFailure, Socket s4, Socket s6, Socket& socket, IPAddress& address, ConnectSocketState state, IAsyncResult asyncResult, Int32 timeout, Exception& exception) --- End of inner exception stack trace --- at System.Net.HttpWebRequest.GetRequestStream() at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters) at ScriptComponent_6386cd9eab6a49e7b1a90f69dcc24beb.Service.GetMISAccounts() at ScriptComponent_6386cd9eab6a49e7b1a90f69dcc24beb.ScriptMain.CreateNewOutputRows()
