Xml File Import - Relational Data
May 19, 2006
Hi,
I have played around with SSIS in addition to reading an SSIS book front to back, but I am still a little confused as to how to import an Xml file with relational data.
The Xml file is structured as follows:
<products>
<product>
<name>
<id>
<category>
<name>
<id>
</category>
<fields>
<field>
<name>
<value>
</field>
<field>
<name>
<value>
</field>
</fields>
</product>
</products>
Basically I want to import the Xml data into three tables: categories, products and fields. A product can belong to one or more categories and has one or more fields which store information about the product.
Using the Xml Source component I can load the Xml from the file, but I can only output one section (category, product or field) at a time. Since the relationship is infered from the hierarchical structure of the Xml (e.g. the fields don't store an ID of the product they belong to), I am not sure how to import the relationships into my tables.
If anyone has any tips on how I can go about that, then it would be most appreciated :)
Thanks!
View 2 Replies
ADVERTISEMENT
Jul 13, 2007
I'm moving data between identical tables and have to use a flat file as an intermediary. I thought: "No problem, SSIS can do a quick export to a file, then move the file to another server, then use SSIS to import the data to the new server."
Seems simple, right?
I'm hitting all sorts of surprising data conversion errors. I used the export wizard to create the export package. This works fine. However using the same flat file definition, the import package fails -- even when I have no destination. That is I have just one data flow task that contains only one control: the Flat File source. When I run the package the flat file definition fails with data type conversion and truncation errors. One of the obvious errors is for boolean types. The SQL field is a bit, SSIS defined the column as DT_BOOL, the output of the data are literal text values "TRUE" and "FALSE". So SSIS converts a sql datatype of bit to "TRUE" and "FALSE" on export, but can't make the reverse conversion on import?
Does anyone else find this surprising? I would expect that what SSIS exports, it can import given all the same table and flat file definitions. Is SSIS the wrong tool to do such simple bulk copies? I'd like to avoid using BCP because this process will need to run automatically within SQL Agent so we can leverage all the error tracking and system monitoring.
View 12 Replies
View Related
Sep 10, 2007
I have one column in SQL Server 2005 of data type VARCHAR(4000).
I have imported sql Server 2005 database data into one mdb file.After importing a data into the mdb file, above column
data type converted into the memo type in the Access database.
now when I am trying to import a data from this MS Access File(db1.mdb) into the another SQL Server 2005 database, got the error of Unicode Converting a memo data type conversion in Export/Import data wizard.
Could you please let me know what is the reason?
I know that memo data type does not supported into the SQl Server 2005.
I am with SQL Server 2005 Standard Edition with SP2.
Please help me to understans this issue correctly?
View 4 Replies
View Related
Aug 4, 2005
Hi all,
I am trying to create a diagram for our database, during the creating, I create some of the relationships which were not there(basically our original database is not relational database, that's why I am doing it)
So sometimes I have to chage data type in order to create a relationship for the coloumns in different tables. i.e. change char(16) to varchar(7) (I checked the field that make sure all the data in this field is <= 7 characters)
But when I saved the diagram, there is an error message that state:
Errors were encountered during the save process. Some of your database objects are not saved on your diagram.
'agent' table saved successfully
'VisitUSA' table
- Unable to create relationship 'FK_VisitUSA_agent'.
ODBC error: [Microsoft][ODBC SQL Server Driver][SQL Server]ALTER TABLE statement conflicted with COLUMN FOREIGN KEY constraint 'FK_VisitUSA_agent'. The conflict occurred in database 'CMC', table 'agent', column 'AgentCode'.
What does that mean? is it caused by some of the agentcode data in VisitUSA table which is not in agent table?
Thanks!
Betty
View 3 Replies
View Related
Jul 23, 2005
I have a flat file table that describes crash data in SQL Server.It contains vehicle information.I would like to know if anyone knows a SQL statement that could go fromthistable= eventsCRASHID | VEH1_TYPE | VEH2_TYPE | VEH_3TYPE-------------------------------------------555555 | CAR | TRUCK | VANTOCRASHID | VEH_TYPE | VEH_NUMBER--------------------------------555555 CAR 1555555 Truck 2555555 VAN 3Any Ideas? I am relitively new at this and can only see how it could bedone by creating multiple tables and appending them.Any help that could create the end selection in one query would begreat.Thanks,Chuck
View 2 Replies
View Related
Jul 11, 2006
Hello-
I am a complete newbie with SSIS. I started working with Flat Files today and have made some progress.
I have a task that requires me to pull out data from a | delimeted list with 160+ columns in a row. I am working with Movie and Entertainment data. So each movie has a number of actors associated with it.
For example:
MOVIEID|Zoolander|...|...|...|...|..................|Owen Wilson|Ben Stiller|Will Ferrel|...|...|...............|
I would like to take all the actors out of the middle of this long line of columns and place them in an Actors table with the movieID. However, when I look at Flat File Source, all I see is my X number of columns in the one row for all the actors (actor1-20).
Is there a way to make a new flat file that references the other flat file and can split up a certain amount of columns by rows inside of the middle of an existing row?
I hope that makes sence. Basically I would like to make a relational database schema out of ONE Flat File.
Thanks for your consideration,
Scott
View 5 Replies
View Related
Jan 13, 2005
Hi,
I backup my database through SQL Server 2000 SQL Query Analyzer :
"BACKUP DATABASE Mysite to disk = 'd:BatabaseBackupMysite.bak' ",
and got a bak file to import it to hoster server. Now I need import (backup)
database from that hoster server back to my local server. I got a bak file call
"MysiteExport.bak" file and transfer it to my computer d:BatabaseBackupMysiteExport.bak' . Then use SQL Server import wizard to import "MysiteExport.bak" and fail to do it.
How can I import/restore database from this "MysiteExport.bak" which have already
under my computer. If use SQL Query Analyzer, what is the correct statement.
Please help.
Lin
View 6 Replies
View Related
Nov 3, 2003
I have no previous experience in MS SQL and i have this little problem : i import data into a table from a txt file (log file after process) and i want to put the time/date string into a column with data type timedate, but i cant make it, there is an error message (cant store char data into timedate field...)
Any help??
thanx in advance :P
View 3 Replies
View Related
Mar 15, 2004
I have a .csv-file which is imported into my database using DTS.
When look at the DTS package in design-mode i can see that it creates a table and then copies the data from the file into the created table.
Nothing wrong there.
But when the contents of the file changes (e.g. column added or removed) the create table script raises an error. The script is not dynamic, it is created when the package is created and only changes when the package itself is re-created.
Is there a way to make the create table script be dynamic so that the table is dropped re-created according to the format of the .csv-file?
Thanks in advance
View 3 Replies
View Related
Mar 3, 2008
hello there!
I'm newbie here and I would appreciate a little help..
I have a .ttx file like this
"xxxxxxxxx" "dc8" "184:30" "168:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" "00:00" 0 0 0 1
I want to put every value between double quotes in an exact column of a table (lets say it IMPORT table). The problem is that values in quotes refer to hours. So I'd like to
get a result 184,5 hours for "184:30".
Thanks in advance!
View 1 Replies
View Related
Mar 3, 2008
hii all,
i've to import bulk data from excel file to sql server 2000 , i'm using asp.net 1.1 with C# and i've to make a front end(windows application) for this.
help me out if any1 knows that...
Thanks & Regards
anant vijay
View 2 Replies
View Related
Jan 30, 2002
Hi,
I am having my present database system in DB2. Recently, I have transferred to SQL Server 6.5 and have created a database there.
I want to import all my data from dbase to SQL Server 6.5.
I have created a CSV file from the dbase database.
How can I import this data into a table in SQL Server 6.5 ??
I can't find any DTS component in SQL 6.5 like we have in SQL 7.0 and 2000.
Thanks.
View 1 Replies
View Related
May 16, 2003
Hi, does anyone know how to access the *.evt file (SysEvent.Evt) from SQL in order to import a data from a file into a server table?
When you run EventViewer there is an option to save the log file as *.csv file and then use it. I want to eliminate this step (or make it automatic) and get the data into SQL right away.
Any ideas?
Thx
Dim
View 13 Replies
View Related
May 22, 2008
Hi Guys We're designing a system to import Retail Sales Till data from 800 Shops with fairly modern Tills which will hold Transactions in Client Access Databases. Basic Data is(Shop_ID,Till_ID,Receipt_No,Receipt_No,Receipt_Lin e_No,Sales_Date,Item_Category,...........)Record Width of above in one De-normalized SQL Table is 46 BytesAverage is 1.5 Transactions per ReceiptAverage File size per shop is 150k - SFTP server will receive 800 of these per day.As we will be owning the software on each of the tills we expect the data is going to be very clean in terms of validation. All this has to be loaded into a SQL2005 Box overnight The Question is what File format should we choose to receive at HQ Current proposal is .XML - My proposal is CSV Another Question is how best to import the data Current Proposal is to write a .NET application to perform import - My Proposal is to just use SQL to do it. What do you guys think & why Sorry I've not been able to find a previous topic on Subject but will happily read if you have any links Further info on request GW
View 14 Replies
View Related
Oct 3, 2007
Hi,
i have a package that uses a ForEach loop component to import flat files, and uses an OLE DB Destination component to insert the data into some staging tables (using table fast load with a max insert commit of 1000 rows), the biggest individual table import would be circa 5000 rows. At the end of each file import a stored proc is called to transfer the data into production tables, then the next file is imported.
Periodically (when importing more than 5 or 6 files) the process fails with the error message:
The transaction log for database 'blah' is full. To find out why space in the log cannot be reused, see the log_reuse_wait_desc column in sys.databases
This occurs when committing the data to staging. I do not start any transactions during this process, and the staging tables are cleaned out by truncating them, so i'm not sure exactly what is causing the log file to fill up (i'm not a DBA).
I know this is not specifically a SSIS problem, but can anyone give me a suggestion about the best way to handle the log file during an SSIS import? Should i execute a DBCC SHRINKFILE before each flat file is imported? Is there some other approach i should be taking to either insert the data or to move it from staging to production?
Thanks!
View 3 Replies
View Related
Oct 26, 2007
I have exported a table from a sql 2000 database. This table contained an image column. How can I import this csv file into an sql 2005 database. When I try I get a data overflow error. When I tried defining the import data type to image I get an error this data type is not supported.
I then imported the data using dt_text. This performed the import but changed the data. I would guess it assumed unicode input.
Does anyone know how I can import this correctly.
Thanks
View 4 Replies
View Related
Jul 3, 2007
Hi,
I wanted to know if there was a way to import data from a flat file without specifiying the delimiters. I want to import each line in one row so that i can use the substring function to break of the data as an when i want and not as per the delimited format file or the wizard.
i.e if row one had "abc"|"1453"|"Jack"|"Smith"| etc.... rather than importing these as different columns and rows. I want this all in one row, one column.
Is it Possible?
View 7 Replies
View Related
Nov 20, 2007
Hello,All:
I have two sql 2000 servers,one for production and the other is for backup server,I used the sql agent to create bakup daily in Sql server Enterprise Manager.
Now I want to import the backup data(generated by production server),I don't know how to do it.
Is it possible to do it ? anyone can give me a soluation ?
thanks in advanced!
View 1 Replies
View Related
Apr 1, 2008
Hello all,
We have been trying now for the past 2 days to import data from a flat file to sql server database but with no luck.
The real issue here is that one of the field names has a very long value.
As a result, the import fails because it is unable to truncate the value.
We really don't want the value truncated but we have not been able to import the entire data file.
We have used nvarchar(max) but it doesn't work.
Can someone please let me know if you have encountered this type of issue and how was it resolved?
Thanks in advance.
View 12 Replies
View Related
Jun 7, 2007
I receiveed the error:
Error 0xc0202055: Data Flow Task: The column delimiter for column "Column x" was not found.
I would like to have the import continue., even the error occur. I have the error output to ignore, but doesn't seem to be working. Any suggestion on what to do next, or how to skip the row that create the problem.
thanks
View 1 Replies
View Related
Oct 3, 2007
Hi All,
I am trying to import data via DTS from a CSV file. I have the "empty" tables already created with proper column names. Now, I have a subset data of each of these tables, which I am trying to import. I am facing problem in that, there is a datatype conflict between the source (CSV file) and destination (table already in the DB). All the data in the CSV file appears to be of DBTYPE_WSTR, where as in the table it is different (some are DBTYPE_WSTR, some are DBTYPE_DATE, and so on). Is there a way that I can import data successfully? This has become a work stoppage issue now. I had to actually go for this approach of creating the empty tables first and then importing data because, the backup file was very very large and could not be copied to our domain. Please help me out in this.
Thanks a lot.
Mannu.
View 4 Replies
View Related
Jun 29, 2007
Hi Guys,
Can anyone tell me how can I achieve the file import of XLS file and read the data inside to insert into the respective table in my SDF database in the mobile devices?
Thanks.
Regards,
Jenson
View 8 Replies
View Related
Feb 23, 2005
i want ot import data from excel .xls file to sql server 2000
into an existing table.
should i use some stored procedures or else
View 5 Replies
View Related
Sep 16, 2005
I have tried my file name vendor_insertFromFile2.sqlBULK INSERT (dbo.vendors VendorName, Street, City, Region, Country, PostalCode, Telephone, PortalId, Fax, Email, Website, CreatedDate, Unit, LastName, Cell) from 'D:AccessNAICSxPortal0_SampleData.txt'error messageServer: Msg 170, Level 15, State 1, Line 2Line 2: Incorrect syntax near '('.Data in the "CompanyName","Address","City","State","country","fullzip","FullPhone","Portal","Fullfax","Email","URL","date","ID","Contact_1","800No""DAVID STRAWN","460 FLOWERING TRL","GRAYSON","GA","United States","30017�,"770-277-8709",0,"“,"bkroom@bellsouth.net","WWW.BACKROOM4MEN.COM","09/02/05",1,"DAVID STRAWN","BRADRUSS","3353 S MAIN ST STE 130","SALT LAKE CITY","UT","United States","84115�,"801-975-0374",0,"“,"rusbrad@msn.com","WWW.BADANDNASTY.COM","09/02/05",2,"BRAD JENSEN",Thanks in advance on what is wrong or a link with working examples
View 2 Replies
View Related
Dec 24, 1998
I needs export data on table to text file so I can process this data
with another database engine ie. Informix.
Can anybody help me to solve this problem ?
View 2 Replies
View Related
Aug 10, 2004
Hello,
Is there a way to import data from a text file with DELPHI toward a SQL Server table.
I heard about BCP ...?
Does someone know?
THANKS.
View 5 Replies
View Related
Sep 21, 2005
Can anyone guide me how to import data from excel file to Microsoft SQL Server? My excel file just have the data, no column name.
Thanks.
View 3 Replies
View Related
Sep 30, 2014
In Access, I can import a txt file data(e.g. Claims.txt) as below specifications:
Choose the delimiter that separates your fields: Other (|)
First row contains field name: Yes
Text Qualifier:"
I need to create a store procedure to read txt file data (d:cliamcliams.txt) first column (ClaimNumber) into a temp table (#claim)
(This #claim table will use for my .Net program)
There about 5 txt files need to process every day.
View 1 Replies
View Related
Jun 12, 2007
Is it possible to import data from a word table into sql table? How to import data from access and excel worksheet into sql table?
vishwa mukh
vishwamukh
View 2 Replies
View Related
Jul 20, 2005
Hi all,I have a huge excel format file wants to export to sql serverdatabase. One of the field has combination of numeric andalphanumeric. When I import the excel format to sql server database,the numeric is successfully imported but the alphanumeric does notimport at all.Does anyone know how to solve my problem?Thanks.-HS Phuah
View 2 Replies
View Related
Aug 2, 2007
Hello!
I have a CSV file that encloses all the data fields with quotation marks. Here is a sample:
"08/01/2007","3","021200012","123","0.03"
Is there any way in SSIS that I can tell the Flat File wizard to ignore the quotation marks? I don't want to import the quotes in the database since that will really mess up other applications that need to use the data.
Thanks in advance,
Harry
View 11 Replies
View Related
Mar 20, 2008
I have several bcp output files I need to import into tables. I do not have format files for them. As far as I know they are in native format. I do not know the layout of the destination table they would populate.
1) how can I determine from the bcp file itself the schema of the destination table? Once I know that I should be able to import the data into the table.
Thanks
View 6 Replies
View Related
Nov 9, 2006
Hi All
I have a huge excel format file wants to export to sql server
database. One of the field has combination of numeric and
alphanumeric. When I import the excel format to sql server database,
the numeric is successfully imported but the alphanumeric does not
import at all.
Does anyone know how to solve my problem?
I am using SQL 2k and the spreadsheet is excel 2003
Thanks
Rich
View 1 Replies
View Related
