Any Embedded Tool In Win2003 Or SSIS For Extracting The Files From ZIP
Jun 20, 2007Who knows whether exists embedded tool in win2003 or SSIS for extracting the files from ZIP?
Thanks in advance.
Who knows whether exists embedded tool in win2003 or SSIS for extracting the files from ZIP?
Thanks in advance.
We have several hundred very simple ETL SSIS 2K8 package files (*.dtsx).
I'd like to be able to interrogate them to determine source and destination fields.
There's no great need to map source to dest or to extract data types.
So far, the most promising candidate is to load them using OPENROWSET into an XML field in a SS table.No problem there, but querying using OPENXML has me stumped.
The package files will change a couple of times per year, so the process needs to be repeatable with minimal manual intervention.
I have created a package which extracts data from a table and creates several files. This works fine on my PC (WinXP SP2), but when i deploy it to the server it doesn't work. I have also tried to create the package from scratch on the server as the administrator and it still has the same problem. Anyone have any ideas?
View 7 Replies View Related
I have a zip file that requires a password to extract the file inside of it. Is there away to do this automatically? Can't find any software that does this.
Mike
I wanted to know that when I create a table using SQL Server, does the table metadata like schemaname and catalogname is stored in memory or in hard-disc. I am trying to extract schemaname and catalogname when the database is down or correctly when I have no connection string. I know about sysindexes, systables etc, but i am not able to understand whether it stores the data which is useful to me like catalogname.
sql query to extract the column names from sysindexes?
My warehouse app employs a distributed architecture. Extractions from disparate (wildly so) systems, and transformations and loads into a standardized schema are performed at various locations close to the source systems (both physically and "logically" speaking). There are security and other reasons for this. However this causes some related design and implementation challenges for the ETL processing.
For one, the ETL processes must be successfully operated by non-technical medical administrators, who actually have little interest in the application and sometimes even the analytics produced by the system, who have other more pressing day to day work they want to be doing, in organizations where turnover is high,training is spotty, and LANs are fragile and often congested.
So, real-time feedback to the operator during processing is pretty dern important. I have built a fairly sophisticated GUI (using .Net forms inside a script component) for the operational interface-input boxes just wouldn't cut it).
But that interface is lacking real time feedback as to processing progress at runtime.
Anyone got that T-shirt yet? I'm thinking I need progress bars and real-time task and component progress reports. Also. is there a way to capture the built in logging output in real-time?
On another thread a poster suggested that you can experience performance gains in Ssis by not using stored procedures.
I asked if I could have some Microsoft articles that articulated this position, but received no response.
Does anyone have links to Microsoft supported articles articulating when/if it is appropriate from Ssis to Not exec Stored Procedures for data manipulation or data collection?
Hi all,
I am supposed to maintain a bunch of excels documenting all the mappings I'm doing in SSIS. The excels have the following format:
Target Field | Target Type | Source Table | Source Field | Source Type | Transformation Rule
Apart from being incredibly tedious, it is hard to keep every excel current, as there are other people adding and taking information from the database model.
I plan to extract this information from SSIS and create the excels dinamically, but, apart from parsing the .dtsx for each package, I see no other way of getting what I need.
Any suggestions on how I should do this? Is there an easier way?
Cheers,
David Leal
I am using data flow task.And data flow source uses ole db for olap 9.0 to connect my ssas. sql comment is my access mode. A mdx query extracts data. Data flow destination is sql server table. Error said Data Flow Task: OLE DB Source [579]: The output "OLE DB Source Output" (589) references an external data type that cannot be mapped to a Data Flow task data type. I guess it is a implicit data type convertion problem. But how to solve it???
I appreciate for all suggestion. Thanks.
Source System : Oracle
Target System : Ms Sql Server 2012
ETL Tool Used : SSIS
My source data is present in XML File which is stored in CLOB column Of Oracle. CLOB column is compressed.I need to Migrate data by Uncompressing XML to SQL 2012 .
Do I need to define XML column in SQL Server 2012 for storing Uncompressed CLOB values ?
How to uncompress the clob and extract the required data from XML using SSIS .
I am currently working on a BI project and I am meant to use AtTask Project Management Application as one of my data sources for the ETL.which SSIS component that I can use to load data from the AtTask into my data warehouse.
View 4 Replies View RelatedI want to import date from excel file from the row if this row has a character like 'TableName', and I don't know the rownumber and end column number ,so I can't use openrowset 'select * from Sheet$ A11:N'. And I am thing if I can get the rownumber of the row contain string 'TableName' and the max column ,that May be easy to extract data.
View 2 Replies View RelatedSSIS as a ETL tool
Guys,
I currently doing microsoft's hands-on training tutorial for SSIS. I realized that its not an comprehensive ETL tool as it was advertised to me. I see it more of a package tool for all imports, exports which include DML scripts.
In my scenario I have to convert 10 source data tables to destination schema tables. i normally use DML scripts to convert the data. Once I have mapping between source and destination tables it does not take more than hour to write DMl scripts. But when I try to use SSIS its taking me more time to create data flow tasks and create a package. And does SSIS support all the sql server 2005 string functions.
Any comments/inputs would help.
Thanks
We have a web application using SQL Server 2005 to store and serve the data to forms made using .Net 2. The forms are used by customers to enter fifteen or so items if data. An important part of what the app does is to validate these 15 items of data against data brought in from the main application which is in Access 2003 (for example, did the customer enter a valid part #, did they actually purchase that part number in the qty stated, etc).
I want to periodically (nightly) schedule a copy of the lookup data from Access (2 different databases) into tables in SQL Server. The copy process would simply overwrite the existing lookup data in SQL server with the new data each night. My guess that about 250 mb of data would be copied. The two different databases are identical in structure, but different in data. They are used in two different countries.
The process as I see it would be to:
1. Delete existing lookup data.
2. Copy in data from database 1
3. Copy in data from database 2
I need to use something with enough programming power to resolve issues with primary keys, eg not copy Access table columns which contain them, and perhaps populate a column in the SQL Server lookup tables which indicate which Access database a given record came from.
If we use SSIS, then I will need to learn it, which is great as long as I am going down the right path in the first place.
Would SSIS be the right tool? Is there something more appropriate? Is there a good tutorial?
Many thanks
Mike Thomas
Hello,
At our company we are considering building an architecture for file
imports and processing and considering both Biztalk and SSIS at this
time.
My understanding from reading the material out there regarding this
subject that Biztalk is more suited for integrating applications and
real time communication of information and SSIS is more suited for
bulk loads into databases/data warehouses and data manipulation.
Currently we are somewhat along the lines described above, but there
is a desire to use one technology over the other for importing files
and data manipulation, and I am not sure that is practical. Also
there is a debate currently as to whether Biztalk does better at
handling logic than SSIS.
I have read through the article on microsoft site that outlines the
above - http://www.microsoft.com/technet/prodtechnol/biztalk/2004/whitepapers...
However, I would like to get some input from people who have actually
used both these tools in the real world for ETL process and could
provide some insight so as to help us make an informed decision.
Thanks
KR
I have some questions on SSIS tool I tried to read many docs to understand SSIS.
Now I am looking forward for below questions.
How to use SSIS for :
1. How to Export data from SQL Server 2005 in to Access database using SSIS?
2. How to Import data from Access .mdb file to SQL Server 2005 database using SSIS?
3. How to Import Oracle10g data in to SQL Server 2005 databvase using SSIS?
4. How to Import Oracle10g Data to Access file using SSIS?
5. How to Import SQL Server 2000 data in to SQL Server 2005?
It will be great to have step by step explanation.
Thanks in advance.
Brief overview...Running SQL Server 2003 Server Enterprise 64 bit - All Service Packs and patches current
SQL Server 2005 Enterprise Edition 64 bit Build Microsoft SQL Server 2005 - 9.00.3054.00 (X64) Mar 23 2007 18:41:50 Copyright (c) 1988-2005 Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 5.2 (Build 3790: Service Pack 2)
I cannot import any SSIS packages nor crete any new folders under stored packages. I hve googled the news groups and looked at BOL to no avail. HELP!!!!
Hi all,
I am looking for any information about using SSIS as a workflow automation (job engine) tool. My company is looking into buying a 3rd party app to do our job scheduling and I think that SSIS could do all that we need. The only issue they found with SSIS is the lack of a GUI/dashboard to view all jobs at once. We need more flexibility than the job scheduler in SQL Server Agent will allow. I have heard that it is possible to build a C# GUI app that can serve as a job engine front page.
What we need is a way to view all jobs in the system and be able to start, stop, pause all jobs manually in a graphical interface. I know of a few companies that are doing this but I am unable to find anything on line about it. My bosses are ready to give SSIS a shot if I can prove that we can build such an interface. Does anyone have any first hand knowledge of such an application or have any tips on where I should look?
Thanks in advance!
-- Craig ***
How can I add a reference to the Microsoft excel 2003 in the script tool in SSIS 2005? I need to automate Excel for formatting.
Thank you.
Dan
I am trying to migrate our processing from command line based scripts and foxpro to SQL so I need to run the SSIS packages using dtexec. I copied the dtexec file and a few dll's that are missing to our production servers but i cant execute the packages. I dont want to install the full client tools (particularly managment/business inteligence studio) on our production servers due to the overhead and limited system disk space.
Can somebody tell me what the minimum install would be so I would be able to run SSIS packages using the dtexec or dtexecui tools? I would also like to install some of the other command line client tools like osql etc.
Hi, I am less of a technical but more of a analyst professional and right now investgating on various tools / options for the new conversion project I will be leading in insurance client. One of the tools that client want to use is SSIS but the source and target database is not on SQL server but plans are to build a staging SQL server database for transformation. Does SSID supports this kind of ETL process where both source and target system are non SQL servers.
Thanks,
H Gill
Currently we use a SQL maintenance plan to do a full backup of all our databases daily (about 40 databases on our production server). As you can imagine, this eats up disk space quickly so currently we manually zip the backup files and/or move them to an archive drive. I considered writing an application to walk through the backup folder structure and zip any .bak file it finds, but I know there are some third party tools out there that will backup/restore a MS SQL database.
I was wondering if any of these also zip the backups once they are created. Any recommendations or suggestions are welcome.
i'm running a standalone server that is on windows 2003 enterprise, sql server 2000 enterprise and has active directory and dns installed.
from what i know it IS possible to go without netbios in a domain with all win2000+ comps. however is there anything that will break down in regards to sql server 2000?
We just applied SP2 to our Windows 2003 server & it has had an odd impact RS2000.
When trying to change the data source of a report to a shared data source, the browse button when clicked does not take you to the page to enable selection! It does nothing!
Does anyone have any ideas on what's going on there?
Hi,
I want to install SQL 2000 Server on Win-2003 STD Server and transfer the database that has been running on SQL-2000/Win 2K server.
Win-2003 Server has Apache services and TrendMicro AV Server running. After installation the SQL service starts automatically. But I am not able to see the database from Enterprise manager. It gives error 'A connection could not be established to <local>. Reason: Login failed for DOMAIN/USER. I am logged into Win2003 server as 'Administrator' for installation. SQL Server authentication in Mixed Mode and connect using Domain user account.
While applying update(SP3) also the same error comes after trying to validate password and the Sql service automatically stops. I tried using both Win pwd and SQL sa pwd. Both are giving same error.
How I can go abt it?
Shall be grateful for a reply,
I have googled by heart out trying to find answers to this and am onlymore confused.DB Server:Windows Server 2003 Enterprise4 GB memorySQL Server 2000 Enterprise Edition, SP4 8.00.2039The SQL server process appears to be using a steady 1.7 gb of memory.There are no other memory intensive applications running on thisserver as reported by Task Manager.I have read all about the 2gb/process limit and the /3gb boot switchand all but most of that seems to apply to windows 2000, not 2003. I'dlike SQLServer to use more of the memory if it can (assuming it wouldbe advantageous for performance).Can anyone sum this up for me?Thanks,Michael
View 1 Replies View RelatedWe have a combined network with some users on the old Windows NT 4.0 network and others on the new Windows 2003 servers using Active Directory. Will my users on the old WinNT4.0 domain have issues accessing / running reports from Report Manager?
Can anybody point me to a Microsoft official document that says anything about the support/ compatibility between SQL 2005 + SP1 and Win2003 server R2 ?
Thanks
Hello,
I am planning to install .NET on sql2k cluster on Win2003 server.
Is there any document(s) available to install .net framework on sql2K cluster on win2003 server?..
Please post the link if available.
If NOT
What is the procedure to install .NET on sql2k cluster on Win2003 server?.
Thanks for the help
mka
Hi folks.
I just tried to perform the install of SQLServer 2005 Express on a Win 2003 SP2 machine and the install failed with the rejection of the SA password. Currently, our pwd is 1 uppercase letter, 4 lowercase letters and 1 number for a total of 6 characters. Other installations on Win 2003 SP1 have worked fine in the past. I read in a recent version of Books Online that the SA pwd guidelines might have recently changed and that 8 characters might now be required.
My question is: do these new 8 character guidelines apply only to the sa pwd or to all logins?
Thanks!
Mike
Hi,I have just reinstalled Reporting Services on win 2003 server that wasadded to a domain and has been renamed. Two strange things happen:1) In IE I am prompted for an ID and password with a basic securityprompt.2) After supplying the credentials I get some of the report manager webpage but it has a 401 error instead of the folder and options to manageprojects.The page looks like this:ErrorThe request failed with HTTP status 401: Unauthorized.HomeThe reporting services error log contains the following error:Unknown!ui!ed8!2/9/2005-20:44:32:: v VERBOSE: Usermap'<Users><User><Name>DOMAINAdministrator</Name><Paths><Path>/reports/Home.aspx</Path><NrReq>1</NrReq></Paths></User></Users>'Unknown!ui!a24!2/9/2005-20:44:33:: v VERBOSE: Usermap'<Users><User><Name>DOMAINAdministrator</Name><Paths><Path>/reports/Pages/Folder.aspx</Path><NrReq>1</NrReq></Paths></User></Users>'Unknown!ui!a24!2/9/2005-20:44:34:: e ERROR: The request failed withHTTP status 401: Unauthorized.Unknown!ui!a24!2/9/2005-20:44:35:: e ERROR: HTTP status code --> 500I have not changed any of the config files that are installed.Thanks for any help in advance,Eric
View 1 Replies View RelatedI wrote a web app using an ASP front end (not .NET) connecting to a SQLServer 2000 (no SP) back end. Both the web server and the databaseserver are Windows 2003 boxes. The app was running fine two weeks agobefore I went on vacation. While I was gone my net admin appliedWindows 2003 SP1 to the web server. Upon my return I was informed thatthe app is no longer working, getting the following error:[Microsoft][ODBC SQL Server Driver]Connection is busy with results foranother hstmtSince that is presumably the only thing that changed in my absence Ibelieve the SP somehow messed up the way the ODBC was working. I triedmoving the SQL Server database to a different Windows 2003 box whichalso received the SP1 update and also includes SP3 for SQL Server, butget the same error.I am hitting the database like so:set GetData = CreateObject("ADODB.Command")GetData.ActiveConnection = SQLConnGetData.CommandText = "<stored procedure call>"Set DataRS= GetData.Execute (,,adCmdText)I appear to get the error when I execute the second call. I amlearning ASP as I go, so maybe this is a trivial problem.
View 2 Replies View RelatedThis one has me scratching my head. We can install SQL Express on many different English OS without problems, but when we try it on a French OS it doesn't work. We have several French systems and SQL Express does not install on any of them. Even just running the SQLEXPR32.EXE without paramaters give the same error. We have yet to try it on other foreign OS. The command line we use to install is:
SQLEXPR32.EXE /qb INSTANCENAME="TESTINSTANCE" ADDLOCAL=ALL SECURITYMODE=SQL SAPWD=<StrongPassword> DISABLENETWORKPROTOCOLS=0
I've tried various solutions from these links:
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=136496&SiteID=1
http://www.developersdex.com/sql/message.asp?p=1870&r=4699024&Page=1
http://www.developersdex.com/sql/message.asp?p=1870&r=4699024&page=2
However, none of them work. Has Microsoft actually tested the installer on a foreign OS? Below is the details of the setup log file:
Microsoft SQL Server 2005 Setup beginning at Thu Mar 29 14:09:31 2007
Process ID : 2232
c:f66fbb131aeb0b5e04aed9ecb936c1setup.exe Version: 2005.90.3042.0
Running: LoadResourcesAction at: 2007/2/29 14:9:31
Complete: LoadResourcesAction at: 2007/2/29 14:9:31, returned true
Running: ParseBootstrapOptionsAction at: 2007/2/29 14:9:31
Loaded DLL:c:f66fbb131aeb0b5e04aed9ecb936c1xmlrw.dll Version:2.0.3609.0
Complete: ParseBootstrapOptionsAction at: 2007/2/29 14:9:31, returned false
Error: Action "ParseBootstrapOptionsAction" failed during execution. Error information reported during run:
Could not parse command line due to datastore exception.
Source File Name: utillibpersisthelpers.cpp
Compiler Timestamp: Wed Jun 14 16:30:14 2006
Function Name: writeEncryptedString
Source Line Number: 124
----------------------------------------------------------
writeEncryptedString() failed
Source File Name: utillibpersisthelpers.cpp
Compiler Timestamp: Wed Jun 14 16:30:14 2006
Function Name: writeEncryptedString
Source Line Number: 123
----------------------------------------------------------
Error Code: 0x80070002 (2)
Windows Error Text: Le fichier spécifié est introuvable.
Source File Name: cryptohelpercryptsameusersamemachine.cpp
Compiler Timestamp: Wed Jun 14 16:28:04 2006
Function Name: sqls::CryptSameUserSameMachine:rotectData
Source Line Number: 50
2
Could not skip Component update due to datastore exception.
Source File Name: datastorecachedpropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:27:59 2006
Function Name: CachedPropertyCollection::findProperty
Source Line Number: 130
----------------------------------------------------------
Failed to find property "InstallMediaPath" {"SetupBootstrapOptionsScope", "", "2232"} in cache
Source File Name: datastorepropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:28:01 2006
Function Name: SetupBootstrapOptionsScope.InstallMediaPath
Source Line Number: 44
----------------------------------------------------------
No collector registered for scope: "SetupBootstrapOptionsScope"
Running: ValidateWinNTAction at: 2007/2/29 14:9:31
Complete: ValidateWinNTAction at: 2007/2/29 14:9:31, returned true
Running: ValidateMinOSAction at: 2007/2/29 14:9:31
Complete: ValidateMinOSAction at: 2007/2/29 14:9:31, returned true
Running: PerformSCCAction at: 2007/2/29 14:9:31
Complete: PerformSCCAction at: 2007/2/29 14:9:31, returned true
Running: ActivateLoggingAction at: 2007/2/29 14:9:31
Error: Action "ActivateLoggingAction" threw an exception during execution. Error information reported during run:
Datastore exception while trying to write logging properties.
Source File Name: datastorecachedpropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:27:59 2006
Function Name: CachedPropertyCollection::findProperty
Source Line Number: 130
----------------------------------------------------------
Failed to find property "primaryLogFiles" {"SetupStateScope", "", ""} in cache
Source File Name: datastorepropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:28:01 2006
Function Name: SetupStateScope.primaryLogFiles
Source Line Number: 44
----------------------------------------------------------
No collector registered for scope: "SetupStateScope"
00CBCFC4Unable to proceed with setup, there was a command line parsing error. : 2
Error Code: 0x80070002 (2)
Windows Error Text: Le fichier spécifié est introuvable.
Source File Name: datastorepropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:28:01 2006
Function Name: SetupBootstrapOptionsScope.InstallMediaPath
Source Line Number: 44
Class not registered.
Failed to create CAB file due to datastore exception
Source File Name: datastorecachedpropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:27:59 2006
Function Name: CachedPropertyCollection::findProperty
Source Line Number: 130
----------------------------------------------------------
Failed to find property "HostSetup" {"SetupBootstrapOptionsScope", "", "2232"} in cache
Source File Name: datastorepropertycollection.cpp
Compiler Timestamp: Wed Jun 14 16:28:01 2006
Function Name: SetupBootstrapOptionsScope.HostSetup
Source Line Number: 44
----------------------------------------------------------
No collector registered for scope: "SetupBootstrapOptionsScope"
Message pump returning: 2
We really need to get this resolved. Thanks! Jon.