Loading XML
Oct 16, 2006
I am trying to load many XML files into SQL Server 2005 Standard Edition. Each XML file contains many individual XML items, each starting with: <?xml version="1.0" encoding="UTF-8"?> The files do not have a .xml extension. I do have a schema for the data. I can also get hold of a dtd file for the data.
Since I am new both to XML and to databases I have been trying to follow examples wherever I can find them. I have not found the right example or tutorial. The closest that I found was in Kirk Haselden's book (a very nice book to learn from, by the way). On page 73 he sets up an OLE DB Source. His example works fine. But when I try to use XML Source instead of OLE DB as the source, I cannot get it to work. A typical error that I get reads as follows:
"Error at Data Flow Task [XML Source [1]]: There was an error setting up the mapping. The 'http://www.w3.org/XML/1998/namespace:lang' attribute is not declared."
Evidently I am doing something wrong, but what? Can someone point me to an example of using SSIS to load many XML documents that I could use as a model?
Thanks.
View 6 Replies
ADVERTISEMENT
Jan 4, 2002
Would using the Restore cmd be the best option to
take a backup from one database(db1) and apply it to
another database(Edb2) even though they have different names?
View 1 Replies
View Related
Apr 7, 2008
I want to load the xml files data in the sqlserver database.
Please advice..
View 1 Replies
View Related
Mar 19, 2001
We are trying to load flat text files with upwards of 7 million records into a table on SQL. The table has a clustered index on 3 fields. We are sometimes able to complete smaller tables (500,000-750,000 records) and build the indexes prior to importing the data, however when we try the larger tables an error occurs :
Error at Destination for row number 6785496. Errors encountered so far in this task: 1
Location: somerge.c:1573
Expression: mrP->mrStatus!=MERGERUN::NONE
SPID: 11
Process ID: 173
None of the recods end up importing. The row number it gives is always the total number of records that was in the text file I was trying to import. I tried to import the text files first and then build the clustered indexes but a table with only 300,000 records ran for nearly 4 days without completing before we killed it.
Please help me on where to look......:(
Thanks,
Cheri
View 3 Replies
View Related
May 18, 2001
Hi,
I am loading Data from Mainframe to SqlServer on WinNt.
Normally it was taking 35 mts do the dts job.
on last two days it runs for more then six hours still the job doesnt get over.
I am at a loss to know what to do and how to fix this problem. THe main frame ppl said sqlServer is fetching the data very slowly.
If anyone knows the solution pl post a solution
View 5 Replies
View Related
Jul 16, 2001
Hi! maybe this question is very common, but i can resolve that. I have a DB marked 'loading', and nothing seems to change this state. Is any way to revert to a normal state, or the only way is destroy and re-create?
Thanks in advance
View 1 Replies
View Related
Apr 10, 2000
What is the best way to load large amounts of data? I am working on a project where I will need to load data into approx. 20 tables. Into several of the tables I will need to load around 400,000 records. I am familiar with the concepts involved in using BCP but was hoping I could avoid the step of going to text files. I am pulling data from Access (either 97 or 2000). Any suggestions would be welcome.
View 1 Replies
View Related
Jan 5, 2001
I gave the command to restore database and in the middle of recovery i canceled it. now the database is showing 'loading'. I am not able to do any thing to it.please suggest how to make it operational.I also want the data
upto the time, I gave the command 'recover database'.
thanks.
View 1 Replies
View Related
Nov 17, 1999
Help !!!!
How would you fix these two problems.
1. On the window of Enterprise Manger and under the databases, the database shows one of the databases like this manag_dat(recovering)rather than manag_dat. (manag_dat is the name of the database). What could cause the probem and how to fix it?
2. Same position as above, but instead it shows manag_dat (loading). I tried to delete its device and the database. it hang. How would it happen and how to fix it?
Thank you ahead of time
View 2 Replies
View Related
Nov 20, 2002
I've a server X with 100 logins. Peridiocally this X server gets new logins created and gets the users password reset. Aside from this, I've a Y server. what I would like to do is, Have all my logins from X server get created on Y server with the same login/password every end of the day.
I've tried BCP. But i dont know, If BCP will work or not. Is there a way to do this?
Please help.
Thanks,
View 3 Replies
View Related
Mar 10, 2003
Hi,
I have just restored one of my databases. Now, that database is no longer available to me. It has been marked as 'Database(Loading)'
I have reviewed and tried the suggestions given from previous posts of this same question, and they have not been successful (i.e. 'RESTORE DATABASE DPeople WITH RECOVERY' as well as re-restoring the database).
Any suggestions?
Jim
View 1 Replies
View Related
Jan 13, 1999
I am getting the following errors when I try to load a db dump from Prod to another db. The first error occurred on the first run and the second error occured on the second run. The db is in the 'loading' status. Any help will be great.
Thanks,
Glen
2823, Severity: 20, State: 1, Process 10 tried to remove a PROC_BUF 0x2262848 named 'sp_DPSegVolsByDealID' that it does not hold in the hold procedure linked list..
Error : 2827, Severity: 20, State: 1, Procedure 'sp_DPSegVolsByDealID' in procedure buffer 0x2262848 is not properly hashed..
View 1 Replies
View Related
Oct 4, 2004
I have a database that is in (loading) status. Don't know why, we don't have a job running on it.
How to resolve this issue.
View 3 Replies
View Related
Jul 23, 2005
I am running SQL 2000 SP2 on a Win 2000 box. I attempted to restore adB a couple of times and the restore failed, but the dB appears in EMtwice, once with Loading and the other with Read-Only. I stopped SQLand attempted to delete the LDF & MDF files, but there was a sharingviolation.How can I detach these dBs from the SQL server?? Detach is not anoption, because the 'OK' button is not clickable.HELP anyone.Larry...
View 3 Replies
View Related
Aug 21, 2006
I have created and inserted successfully images into table but when I use
Gird View, or other Control can€™t see the photo. Any help. please
Juvan
Here is the query
Create Table EmployeeProfile
(
EmpId int,
EmpName varchar(50) not null,
EmpPhoto varbinary(max) not null
)
Go
User following to to insert image:
Insert EmployeeProfile (EmpId, EmpName, EmpPhoto)
Select 1001, 'Vadivel',
BulkColumn from Openrowset( Bulk 'C:Blue Lace 16.bmp', Single_Blob) as EmployeePicture
View 6 Replies
View Related
May 15, 2007
I have to load a 4 level XML file into Relational Database.
1. The input xml file contains a DTD definition reference. (Its an external file)
2. When tried using an XML source it prompts to set the prohibitdtd setting to false on xmlreader - How to do this.
3. I have primary keys (identity columns) - which are foreign keys in the next level and these primary keys can be generated only once I insert the record into the table. - What would be the best approach for this kind of Data transformations.
View 1 Replies
View Related
Jun 14, 2007
I have been getting the error below from an SSIS Package that has been running successfully in production for 2 Months. Also, this started after we installed SP2. We had errors durring the SP2 installation durring the Notification Services and Workstation Tools install but the installation program reported that the installations were successfull so I am not sure if this is related.
Here is the error message:
Date 6/12/2007 4:53:12 PM
Log Job History (SchedulerEMailer)
Step ID 1
Server MISSRV7
Job Name SchedulerEMailer
Step Name new step
Duration 00:00:08
Sql Severity 0
Sql Message ID 0
Operator Emailed
Operator Net sent
Operator Paged
Retries Attempted 0
Message
Executed as user: XSRV7SYSTEM. Microsoft (R) SQL Server Execute Package Utility Version 9.00.3042.00 for 32-bit Copyright (C) Microsoft Corp 1984-2005. All rights reserved. Started: 4:53:12 PM Error: 2007-06-12 16:53:19.90 Code: 0xC0010018 Source: Description: Error loading value "<DTS:LogProvider xmlnsTS="www.microsoft.com/SqlServer/Dts"><DTSroperty DTS:Name="ConfigString">MISSRV7.SSISConfig.ssisuser</DTSroperty><DTSroperty DTS:Name="DelayValidation">0</DTSroperty><DTSroperty DTS:Name="ObjectName">SSIS log provider for " from node "DTS:LogProvider". End Error Could not load package "ApptEmailer" because of error 0xC0010014. Description: One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors. Source: Started: 4:53:12 PM Finished: 4:53:19 PM Elapsed: 7 seconds. The package could not be loaded. The step failed.
Any help would be greatly appreciated!!!
View 4 Replies
View Related
Jun 19, 2007
Hi,
I'm dealing with loading xml data into sql 2005 relational tables
We are trying to do with C# class objects, what would be the better method to follow to load C# entity objects with xml data.
Xml has a complex 6 level heirarchy and with huge amounts of data.
please help.
-Thanks
Shiva
View 6 Replies
View Related
Sep 17, 2006
I have an xml file I want to use as the source. It's not overly complicated, but not simple either. It has one hierachy, and one optional field and looks like this
a
1 'text'
2 'text'
b
1 'text'
2 'text' 'optional field'
Ok, now I want the data to load like this:
a,1,text
a,2,text
b,1,text
b,2,text, optional field
but when I try to use the xml source it won't create the xsd...anything I can do?
View 9 Replies
View Related
Mar 3, 2008
Well, I have a SSIS package loading data from SSIS raw file without any transformations.
My concern is its taking hell lots of time to load the data (simple source à target )
How can I improve the load speed when my target is oracle?
Its talking 9 min to load 67000 records.
&
I have other tables which have 2-3mm records
I€™m very much concerned about the performance.
Please help me out.
Thank you
View 12 Replies
View Related
Feb 3, 2006
Hi Friends please let me know how can we incrementally load a destination table with source table. bearing in mind that we need to track that there are no duplicates in the destination table. I need to load only changed or new data in the final load. Please give me some examples also. I am tryin this from last 2 days as I am totally new to SSIS.
View 11 Replies
View Related
May 1, 2008
I am trying to enhance an existing package that actually does the xml to table load, this packge is using a script component to parse and load the xml file into multiple tables (3 tables) using VB.net code, I want to add a component to it where if there are any xml rows that are erroring out , they get redirected to a different table, this log table is having only one column and the xml records are supposed to be loaded into this column in XML format. this is the existing design and I have to live with it and at the same time I am not a big .net coder, any help is appreciated.
Thanks
View 5 Replies
View Related
Jan 26, 2006
What is the fastest way I can load data into SQL SErver -- it seems to me it's with Bulk Copy and minimal logging. But that seems very slow when I look at Orace's Data Pump and DB2's LOADer. Does SSIS help here -- from what I can tell, you help me tons and tons on the ET part, but the L is what I'm wondering about...
View 5 Replies
View Related
Oct 24, 2006
I have tried to load data from .unl file into exact replica of database in SQL server 2005 but failed.
I used this syntax, but it doesn't work:
LOAD FROM 'C:something\_something.unl'
DELIMITER '#' INSERT INTO dbo.table
I am sure about the delimiter, so that's not the problem. I just get the message that syntax is incorrect near the keyword FROM and DELIMITER.
Could someone please tell me what the correct syntax would be? Or what seems to be the problem?
Thx
View 3 Replies
View Related
Jun 29, 2006
Hi,
trying to load data from sql2000 to DB2 UDB 7.2 ,
building SSIS package using wizard
case 1:
source ole db -sql2000 destination IBM ole db provider for DB2
data conversion compnent placed on data flow page , package run fine
case 2
source ole db -sql2000 destination microsoft ole db provider for DB2
data conversion component NOT placed on data flow page ,just source and destination , package fail (can't detect db2 code page)
questions
if I transfer 1000000 rows from sql to db2 ,what will happen ?
in case 1 :
is it single transaction ?
is possible to set "Maxinsertcommitsize" or other property and commit every N rows ?
case 2:
if I remember microsoft ole db driver for db2 (used in host integration server) forced commit every row. (I might be wrong)
again , any property could be set to commit every N rows ?
Thanks
Alex
View 1 Replies
View Related
Apr 22, 2007
I have been developing a genealogy application using a SQL Server 2000 database and ASP .NET 2.0. In this application a process, Ged.Parse, converts data from the GEDCOM standard format (a heirachical file format that looks as if it was designed for 80-column cards) into my SQL Server database.
As we started to load reasonable quantities of data into the system we found that the on-line response became abysmal. This problem was fixed by defining a number of secondary indexes (response times dropped to under a second, from previously exceeding 2 minutes and often timing out). Unfortunately however the processing time of Ged.Parse then tripled, and it may now take up to an hour to process a GEDCOM. I believe that this is a byproduct of defining several indexes that are not needed by Ged.Parse itself, but which are of course maintained as Ged.Parse inserts new records into the database.
I am wondering what my best strategy is, apart from putting Ged.Parse into a background task and just letting it trickle away. (I will probably do this anyway). What I'd like to be able to do is to have Ged.Parse load records without creating the secondary indexes, and then create the indexes for the newly-added records as a penultimate step just before it makes them available for general use. Of course there is no way that you can do this: records in a table are either indexed or they are not.
Proposed change: recode Ged.Parse to load data into temporary tables, say NewPeople, NewFacts, etc., with these tables having only the indexes required by Ged.Parse. Then, as the last process in Ged.Parse run a SQL procedure with code like: - Insert into People Select * From NewPeople Delete from NewPeople etc
This is a reasonable amount of programming, so before I make this change could somebody tell me: will this be significantly faster overall, or is this likely to make little or no improvement compared to the present process in which Ged.Parse loads data directly into People, Facts, etc? Two facts that may influence the answer. First, all record relationships are through GUIDs, so records in NewPeople, NewFacts, etc would already have their final key values. Second: although Ged.Parse needs to form relationships between records, these relationships are only within the new records (created from the same GEDCOM), and Ged.Parse does not need to relate any of these new records to earlier records.
Thank you,
Robert Barnes.
View 2 Replies
View Related
May 11, 2007
Helo
i want to uplaod and doenload some image from database.
For uploading the image i am doing the folowing things. and it is working fine
i am using Input file of HTML shiiped with .NET and Image control of Asp.NEt
public void OnUpload(Object sender, EventArgs e){ // Create a byte[] from the input file int len = Upload.PostedFile.ContentLength; byte[] pic = new byte[len]; Upload.PostedFile.InputStream.Read (pic, 0, len); // Insert the image and comment into the database SqlConnection connection = new SqlConnection (@"server=NewSSA;database=iSense;uid=sa;pwd=pak"); try { connection.Open (); SqlCommand cmd = new SqlCommand ("insert into Image " + "(Picture, Comment) values (@pic, @text)", connection); cmd.Parameters.Add ("@pic", pic); cmd.Parameters.Add ("@text", Comment.Text); cmd.ExecuteNonQuery (); } finally { connection.Close (); }}
now my problem is i want to downlaod the uploaded image in to my image control
for help thanks in advance
sam
View 2 Replies
View Related
Sep 20, 2007
I have an SqlDatSource that I have fully setup at design time, but I don't want it to open and load as soon as the page loads, instead I want to open it based on a condition.
How do you do that with a DataSource?
I know that I can simply remove the Select query, and then set it at run time, but I'm looking for something better, that allows me to have the Select query set at design time, in part because I have a lot of parameters.
View 3 Replies
View Related
Dec 7, 2001
I canceled a restore job, and now the database is marked (Loading). When I go to propertied it tells me "database can't be opened, it's in a middle of a restore" Yet from a Query window I can connect and run queries against that database. Should I just wait until it finishes "Loading" or should I re-start the server?
Thanks
View 1 Replies
View Related
Apr 10, 2002
I performed a database restore this morning from a backup that I had
created yesterday - the database was backed up to a file, not a backup
device.
After the restore completed, the database was left in a LOADING status. I
checked the log and it stated 'Bypassing recovery for database X because
it is marked in load. I used the enterprise tools (all tasks/restore
database) to do the restore.
I asked one of our senior dba's for help, and he followed the same process
I did and it worked fine for him.
Any idea why my database was left in a loading status? The database was
fine prior to the restore.
View 1 Replies
View Related
Jul 31, 2002
while loading the transaction log dump on a 'STANDBY' database the connection got terminated. as a result the database was marked 'LOADING' and inaccesible. i would like to know if there is a way to get the db out of this mode without having to reapply a full database dump.
P.S. please ignore the previous two messages posted with the same subject line. i inadvertently pressed post twice. sorry for the spam.
View 1 Replies
View Related
Jun 26, 2001
Hi!
I need to load text data into SQL7. The tricky part (at least for me) is that this data may be duplicated.
How can I load this data discarding the duplicated rows? AFAIK, the sql job (or DTS) will fail if a primary key is violated.
TIA,
Fabio Aneas
View 1 Replies
View Related
Jun 28, 2000
I have a table structure like this
EmpID LastName FirstName Emp_Picture
100| x |T |<BINARY>
200| W |W |<BINARY>
..
..
ETC
This table has 935 rows in it with Emp_Picture Blank.
How to insert the jpeg files into the Emp_Picture Column??
Do we have run the update statement for each and every employee or is there a
way to get around this problem..
Thanks in Advance
VENU
--------------------------------------------------------------------------------
View 1 Replies
View Related