I have played around with SSIS in addition to reading an SSIS book front to back, but I am still a little confused as to how to import an Xml file with relational data.
Basically I want to import the Xml data into three tables: categories, products and fields. A product can belong to one or more categories and has one or more fields which store information about the product.
Using the Xml Source component I can load the Xml from the file, but I can only output one section (category, product or field) at a time. Since the relationship is infered from the hierarchical structure of the Xml (e.g. the fields don't store an ID of the product they belong to), I am not sure how to import the relationships into my tables.
If anyone has any tips on how I can go about that, then it would be most appreciated :)
I'm moving data between identical tables and have to use a flat file as an intermediary. I thought: "No problem, SSIS can do a quick export to a file, then move the file to another server, then use SSIS to import the data to the new server."
Seems simple, right?
I'm hitting all sorts of surprising data conversion errors. I used the export wizard to create the export package. This works fine. However using the same flat file definition, the import package fails -- even when I have no destination. That is I have just one data flow task that contains only one control: the Flat File source. When I run the package the flat file definition fails with data type conversion and truncation errors. One of the obvious errors is for boolean types. The SQL field is a bit, SSIS defined the column as DT_BOOL, the output of the data are literal text values "TRUE" and "FALSE". So SSIS converts a sql datatype of bit to "TRUE" and "FALSE" on export, but can't make the reverse conversion on import?
Does anyone else find this surprising? I would expect that what SSIS exports, it can import given all the same table and flat file definitions. Is SSIS the wrong tool to do such simple bulk copies? I'd like to avoid using BCP because this process will need to run automatically within SQL Agent so we can leverage all the error tracking and system monitoring.
I have one column in SQL Server 2005 of data type VARCHAR(4000).
I have imported sql Server 2005 database data into one mdb file.After importing a data into the mdb file, above column data type converted into the memo type in the Access database.
now when I am trying to import a data from this MS Access File(db1.mdb) into the another SQL Server 2005 database, got the error of Unicode Converting a memo data type conversion in Export/Import data wizard.
Could you please let me know what is the reason?
I know that memo data type does not supported into the SQl Server 2005.
I am with SQL Server 2005 Standard Edition with SP2.
Please help me to understans this issue correctly?
Hi all, I am trying to create a diagram for our database, during the creating, I create some of the relationships which were not there(basically our original database is not relational database, that's why I am doing it) So sometimes I have to chage data type in order to create a relationship for the coloumns in different tables. i.e. change char(16) to varchar(7) (I checked the field that make sure all the data in this field is <= 7 characters)
But when I saved the diagram, there is an error message that state: Errors were encountered during the save process. Some of your database objects are not saved on your diagram.
'agent' table saved successfully 'VisitUSA' table - Unable to create relationship 'FK_VisitUSA_agent'. ODBC error: [Microsoft][ODBC SQL Server Driver][SQL Server]ALTER TABLE statement conflicted with COLUMN FOREIGN KEY constraint 'FK_VisitUSA_agent'. The conflict occurred in database 'CMC', table 'agent', column 'AgentCode'.
What does that mean? is it caused by some of the agentcode data in VisitUSA table which is not in agent table? Thanks! Betty
I have a flat file table that describes crash data in SQL Server.It contains vehicle information.I would like to know if anyone knows a SQL statement that could go fromthistable= eventsCRASHID | VEH1_TYPE | VEH2_TYPE | VEH_3TYPE-------------------------------------------555555 | CAR | TRUCK | VANTOCRASHID | VEH_TYPE | VEH_NUMBER--------------------------------555555 CAR 1555555 Truck 2555555 VAN 3Any Ideas? I am relitively new at this and can only see how it could bedone by creating multiple tables and appending them.Any help that could create the end selection in one query would begreat.Thanks,Chuck
I am a complete newbie with SSIS. I started working with Flat Files today and have made some progress.
I have a task that requires me to pull out data from a | delimeted list with 160+ columns in a row. I am working with Movie and Entertainment data. So each movie has a number of actors associated with it. For example: MOVIEID|Zoolander|...|...|...|...|..................|Owen Wilson|Ben Stiller|Will Ferrel|...|...|...............|
I would like to take all the actors out of the middle of this long line of columns and place them in an Actors table with the movieID. However, when I look at Flat File Source, all I see is my X number of columns in the one row for all the actors (actor1-20).
Is there a way to make a new flat file that references the other flat file and can split up a certain amount of columns by rows inside of the middle of an existing row?
I hope that makes sence. Basically I would like to make a relational database schema out of ONE Flat File.
I backup my database through SQL Server 2000 SQL Query Analyzer : "BACKUP DATABASE Mysite to disk = 'd:BatabaseBackupMysite.bak' ", and got a bak file to import it to hoster server. Now I need import (backup) database from that hoster server back to my local server. I got a bak file call "MysiteExport.bak" file and transfer it to my computer d:BatabaseBackupMysiteExport.bak' . Then use SQL Server import wizard to import "MysiteExport.bak" and fail to do it.
How can I import/restore database from this "MysiteExport.bak" which have already under my computer. If use SQL Query Analyzer, what is the correct statement.
I have no previous experience in MS SQL and i have this little problem : i import data into a table from a txt file (log file after process) and i want to put the time/date string into a column with data type timedate, but i cant make it, there is an error message (cant store char data into timedate field...) Any help?? thanx in advance :P
I have a .csv-file which is imported into my database using DTS. When look at the DTS package in design-mode i can see that it creates a table and then copies the data from the file into the created table.
Nothing wrong there.
But when the contents of the file changes (e.g. column added or removed) the create table script raises an error. The script is not dynamic, it is created when the package is created and only changes when the package itself is re-created.
Is there a way to make the create table script be dynamic so that the table is dropped re-created according to the format of the .csv-file?
I want to put every value between double quotes in an exact column of a table (lets say it IMPORT table). The problem is that values in quotes refer to hours. So I'd like to get a result 184,5 hours for "184:30".
hii all, i've to import bulk data from excel file to sql server 2000 , i'm using asp.net 1.1 with C# and i've to make a front end(windows application) for this. help me out if any1 knows that... Thanks & Regards anant vijay
Hi, does anyone know how to access the *.evt file (SysEvent.Evt) from SQL in order to import a data from a file into a server table?
When you run EventViewer there is an option to save the log file as *.csv file and then use it. I want to eliminate this step (or make it automatic) and get the data into SQL right away.
Hi Guys We're designing a system to import Retail Sales Till data from 800 Shops with fairly modern Tills which will hold Transactions in Client Access Databases. Basic Data is(Shop_ID,Till_ID,Receipt_No,Receipt_No,Receipt_Lin e_No,Sales_Date,Item_Category,...........)Record Width of above in one De-normalized SQL Table is 46 BytesAverage is 1.5 Transactions per ReceiptAverage File size per shop is 150k - SFTP server will receive 800 of these per day.As we will be owning the software on each of the tills we expect the data is going to be very clean in terms of validation. All this has to be loaded into a SQL2005 Box overnight The Question is what File format should we choose to receive at HQ Current proposal is .XML - My proposal is CSV Another Question is how best to import the data Current Proposal is to write a .NET application to perform import - My Proposal is to just use SQL to do it. What do you guys think & why Sorry I've not been able to find a previous topic on Subject but will happily read if you have any links Further info on request GW
Hi, i have a package that uses a ForEach loop component to import flat files, and uses an OLE DB Destination component to insert the data into some staging tables (using table fast load with a max insert commit of 1000 rows), the biggest individual table import would be circa 5000 rows. At the end of each file import a stored proc is called to transfer the data into production tables, then the next file is imported.
Periodically (when importing more than 5 or 6 files) the process fails with the error message:
The transaction log for database 'blah' is full. To find out why space in the log cannot be reused, see the log_reuse_wait_desc column in sys.databases
This occurs when committing the data to staging. I do not start any transactions during this process, and the staging tables are cleaned out by truncating them, so i'm not sure exactly what is causing the log file to fill up (i'm not a DBA).
I know this is not specifically a SSIS problem, but can anyone give me a suggestion about the best way to handle the log file during an SSIS import? Should i execute a DBCC SHRINKFILE before each flat file is imported? Is there some other approach i should be taking to either insert the data or to move it from staging to production?
I have exported a table from a sql 2000 database. This table contained an image column. How can I import this csv file into an sql 2005 database. When I try I get a data overflow error. When I tried defining the import data type to image I get an error this data type is not supported.
I then imported the data using dt_text. This performed the import but changed the data. I would guess it assumed unicode input.
I wanted to know if there was a way to import data from a flat file without specifiying the delimiters. I want to import each line in one row so that i can use the substring function to break of the data as an when i want and not as per the delimited format file or the wizard.
i.e if row one had "abc"|"1453"|"Jack"|"Smith"| etc.... rather than importing these as different columns and rows. I want this all in one row, one column.
Hello,All: I have two sql 2000 servers,one for production and the other is for backup server,I used the sql agent to create bakup daily in Sql server Enterprise Manager. Now I want to import the backup data(generated by production server),I don't know how to do it. Is it possible to do it ? anyone can give me a soluation ? thanks in advanced!
Error 0xc0202055: Data Flow Task: The column delimiter for column "Column x" was not found.
I would like to have the import continue., even the error occur. I have the error output to ignore, but doesn't seem to be working. Any suggestion on what to do next, or how to skip the row that create the problem.
Hi All, I am trying to import data via DTS from a CSV file. I have the "empty" tables already created with proper column names. Now, I have a subset data of each of these tables, which I am trying to import. I am facing problem in that, there is a datatype conflict between the source (CSV file) and destination (table already in the DB). All the data in the CSV file appears to be of DBTYPE_WSTR, where as in the table it is different (some are DBTYPE_WSTR, some are DBTYPE_DATE, and so on). Is there a way that I can import data successfully? This has become a work stoppage issue now. I had to actually go for this approach of creating the empty tables first and then importing data because, the backup file was very very large and could not be copied to our domain. Please help me out in this.
Can anyone tell me how can I achieve the file import of XLS file and read the data inside to insert into the respective table in my SDF database in the mobile devices?
I have tried my file name vendor_insertFromFile2.sqlBULK INSERT (dbo.vendors VendorName, Street, City, Region, Country, PostalCode, Telephone, PortalId, Fax, Email, Website, CreatedDate, Unit, LastName, Cell) from 'D:AccessNAICSxPortal0_SampleData.txt'error messageServer: Msg 170, Level 15, State 1, Line 2Line 2: Incorrect syntax near '('.Data in the "CompanyName","Address","City","State","country","fullzip","FullPhone","Portal","Fullfax","Email","URL","date","ID","Contact_1","800No""DAVID STRAWN","460 FLOWERING TRL","GRAYSON","GA","United States","30017�,"770-277-8709",0,"“,"bkroom@bellsouth.net","WWW.BACKROOM4MEN.COM","09/02/05",1,"DAVID STRAWN","BRADRUSS","3353 S MAIN ST STE 130","SALT LAKE CITY","UT","United States","84115�,"801-975-0374",0,"“,"rusbrad@msn.com","WWW.BADANDNASTY.COM","09/02/05",2,"BRAD JENSEN",Thanks in advance on what is wrong or a link with working examples
Hi all,I have a huge excel format file wants to export to sql serverdatabase. One of the field has combination of numeric andalphanumeric. When I import the excel format to sql server database,the numeric is successfully imported but the alphanumeric does notimport at all.Does anyone know how to solve my problem?Thanks.-HS Phuah
I have a CSV file that encloses all the data fields with quotation marks. Here is a sample:
"08/01/2007","3","021200012","123","0.03"
Is there any way in SSIS that I can tell the Flat File wizard to ignore the quotation marks? I don't want to import the quotes in the database since that will really mess up other applications that need to use the data.
I have several bcp output files I need to import into tables. I do not have format files for them. As far as I know they are in native format. I do not know the layout of the destination table they would populate.
1) how can I determine from the bcp file itself the schema of the destination table? Once I know that I should be able to import the data into the table.
I have a huge excel format file wants to export to sql server database. One of the field has combination of numeric and alphanumeric. When I import the excel format to sql server database, the numeric is successfully imported but the alphanumeric does not import at all.
Does anyone know how to solve my problem?
I am using SQL 2k and the spreadsheet is excel 2003
