Hi..
I am working on sql server integration services..New to this topic...I want to transfer data from flat file to sql database by doing it programatically.Creating source,destination and transform adapters
my basic question is should the source,transform and destination adapter be bulid for each file i am trying to transfer.
What is the advantage of this doing it this way.
Would anyone let me know about this..
Thanks
Hello,
I am trying to bring the data from Oracle to SQL Server. And, I need to write this in C#. All that I have is a source table in Oracle and a source table in SQL Server. I need to have some samples.
Can you please guide in the right direction?
Your response will be helpful.
thx,
amrith
I have been creating SSIS packages programmatically and have run into somewhat of a dead end. I have found the examples provided with the SQL 2005 install very helpful, but they only cover setting up three tasks: Sort task, OleDB Source and a Flat File Destination.
Does anyone have any examples or knows of examples of using the Merge Join task and the Conditional Split task?
I'm doing it all programmatically and so far I'm having trouble finding much in the way of documentation or examples.
Any help would be great!
Thanks,
Mark
Hi,
Can you please suggest the books which cover SSIS programming in C#?
Regards,
Gopi
Hello. I am attempting to use SSIS to import a table from MS Access in to SQL Server. However, when i set the destination component properties I get the following error:
Exception from HRESULT: 0xC0204006
The table exists within the destination database and if I comment the line out, it is able to acquire the connection.Anyone have any ideas?
Thanks
ConnectionManager connMgr;
ConnectionManager connMgr1;
//Create the package
Microsoft.SqlServer.Dts.Runtime.Package package = new Microsoft.SqlServer.Dts.Runtime.Package();
//Create to connections to the package
Connections packageConns = package.Connections;
connMgr1 = package.Connections.Add("OLEDB");
connMgr1.ConnectionString = accessModelConnectString;
connMgr1.Name = "OLEDB ConnectionManager";
connMgr = package.Connections.Add("OLEDB");
connMgr.ConnectionString = sqlConnectionString;
connMgr.Name = "OLEDB ConnectionManager1";
//Add a dataflow task to the package.
MainPipe dataFlowTask = ((Microsoft.SqlServer.Dts.Runtime.TaskHost)package.Executables.Add("DTS.Pipeline")).InnerObject as MainPipe;
IDTSComponentMetaData90 sourceComponent = dataFlowTask.ComponentMetaDataCollection.New();
sourceComponent.ComponentClassID = "DTSAdapter.OleDbSource.1";
sourceComponent.Name = "yyy";
// Get the design time instance of the component.
CManagedComponentWrapper instance = sourceComponent.Instantiate();
// Initialize the component
instance.ProvideComponentProperties();
// Specify the connection manager.
if (sourceComponent.RuntimeConnectionCollection.Count > 0)
{
sourceComponent.RuntimeConnectionCollection[0].ConnectionManager = DtsConvert.ToConnectionManager90(package.Connections[0]);
sourceComponent.RuntimeConnectionCollection[0].ConnectionManagerID = package.Connections[0].ID;
}
// Set the custom properties.
instance.SetComponentProperty("AccessMode", 2);
instance.SetComponentProperty("SqlCommand", "SELECT Test FROM Test");
// Reinitialize the metadata.
instance.AcquireConnections(null);
instance.ReinitializeMetaData();
instance.ReleaseConnections();
IDTSComponentMetaData90 destinationComponent = dataFlowTask.ComponentMetaDataCollection.New();
destinationComponent.ComponentClassID = "DTSAdapter.OleDBDestination.1";
destinationComponent.Name = "xxx";
// Get the design time instance of the component.
CManagedComponentWrapper instance1 = destinationComponent.Instantiate();
// Initialize the component
instance1.ProvideComponentProperties();
// Specify the connection manager.
if (destinationComponent.RuntimeConnectionCollection.Count > 0)
{
destinationComponent.RuntimeConnectionCollection[0].ConnectionManager = DtsConvert.ToConnectionManager90(package.Connections[1]);
destinationComponent.RuntimeConnectionCollection[0].ConnectionManagerID = package.Connections[1].ID;
}
instance1.SetComponentProperty("AccessMode", 3);
instance1.SetComponentProperty("OpenRowSet", "[PedestrianFlow].[dbo].[OLE DB Destination]");
// Reinitialize the metadata.
instance1.AcquireConnections(null);
instance1.ReinitializeMetaData();
instance1.ReleaseConnections();
// Create the path.
IDTSPath90 path = dataFlowTask.PathCollection.New();
path.AttachPathAndPropagateNotifications(sourceComponent.OutputCollection[0],destinationComponent.InputCollection[0]);
IDTSInput90 input = destinationComponent.InputCollection[0];
IDTSVirtualInput90 vInput = input.GetVirtualInput();
// Iterate through the virtual column collection.
foreach (IDTSVirtualInputColumn90 vColumn in vInput.VirtualInputColumnCollection)
{
string y = vColumn.Name;
// Call the SetUsageType method of the design time instance of the component.
instance1.SetUsageType(input.ID, vInput, vColumn.LineageID, DTSUsageType.UT_READONLY);
}
Microsoft.SqlServer.Dts.Runtime.DTSExecResult result = package.Execute();
foreach (DtsError pkgerror in package.Errors)
{
string err = pkgerror.Description;
Console.WriteLine(err);
}
I've got some machines that output text files after each shot of parts. I'd like to take the data in those files and parse it and insert it into a SQL Server database for future massaging. The text files look like the example I've posted below. Can SSIS parse out the set points and actual values even though the file isn't CSV or tab delimited and the data is kind of 'strewn' all over the report? Each report does have the exact same format so the report format doesn't change from report to report, just the data. Thanks in advance.
Ernie
WP4.57 C Y C L E P R O T O C O L
Order data 18.05.06 11:27:57
Order number : 2006 Recipe no. : 15761
Machine number : 7 Recipe name : Stabilizer Bar Innsulator
Machine Operator: 1257 Art.descrip.: Stabilizer Bar Grommet
Shot Volume : 285.8
Part quantity : 100096 Type of mat.: M370-34
Shot quantity : 782 Batch number: 20124-125
-------------------------------------------------------------------------------
Temperatures in øC
Set Act Set Act
Fixed heat.platen right 182 182 Tempering screw 83 83
middle 180 180 Tempering inject.cylinder 85 85
left 182 182 Tempering circuit 3 90 91
Tempering circuit 4 0 39
Movab.heat.platen right 182 182 Tempering circuit 5 0 39
middle 180 180
left 182 182 Mould temperature 1 0 39
Mould temperature 2 0 39
Third heat.platen right 0 39 Mould temperature 3 0 39
middle 0 39 Mould temperature 4 0 39
left 0 39 Mould temperature 5 0 39
Mould heating circuit 6 0 39 Compound temp.after screw 104 104
Mould heating circuit 7 0 39 Compound temp.after nozzle 0 39
Mould heating circuit 8 0 39
Mould heating circuit 9 0 39
Mould heating circuit 10 0 39
---------------------------------------------------------------------------
Times in sec
Injection time 51.20 Transfer time 1 2.00
Internal mould press.time 0.00 Transfer time 2 2.00
Dwell pressure time 7.00 Transfer time 3 2.00
Controlled cure time 180.00 Transfer time 4 2.00
Calculated cure time 0.00 Transfer time 5 2.00
last cycle time 276
last opening time 25
---------------------------------------------------------------------------
Measure when injecting Measure at injection end
max. injection speed mm/s 11.9 Injection length mm 2.0
Injection energy kNm 247.2 Injection time sec 51.20
max. int.mould pres. bar 2 Hydraulic pressure bar 190
max. dwell pressure bar 192 Internal mould pressure bar 0
Pad mm 0.4
---------------------------------------------------------------------------
Stock Temperatures and Pressures During Metering
Stock Temperatures(C) Set Actual Metering Pressures(bar) Set Actual
Temperature 1st Step 105 106 Pressure 1st Step 135 131
Temperature 2nd Step 105 106 Pressure 2nd Step 135 129
Temperature 3rd Step 105 105 Pressure 3rd Step 135 122
Temperature 4th Step 105 106 Pressure 4th Step 135 135
Temperature 5th Step 105 109 Pressure 5th Step 135 137
Protocol Complete
Recently I try to create a package completely by c# code,not the ETL tool.
View 9 Replies View RelatedHi,
I am creating a SSIS Programmatically. I facing problem in setting name to data flow compenent.
here is the sample code
IDTSComponentMetaData90 oledbItemMasterSource;
oledbItemMasterSource = dataFlow.ComponentMetaDataCollection.New();
oledbItemMasterSource.ComponentClassID = "DTSAdapter.OLEDBSource";
oledbItemMasterSource.Name = "InventTable";
oledbItemMasterSource.Description = "Get Item Master";
After creating this package i found that 'InventTable" is not set to OLE Db Source component. where as i can set name to OLE DB Flat File destination component.
Kindly suggest me a way fix this issue.
Thanks-
aravind
Hi,
I have a VB.NET program which creates a Job (Microsoft.SqlServer.Management.Smo.Agent.Job) and schedules it, to load and run a existing SSIS package, which is on a different server.
I'm using the following assemblies for this purpose.
Microsoft.SqlServer.ConnectionInfo.dll
Microsoft.SqlServer.Smo.dll
Microsoft.SqlServer.SqlEnum.dll
To make this application run in my application server, do i have to install any SQL server components or SSIS rumtime components? Or Is it enough if i copy only the above mentioned dlls to my applications bin directory, in my application?
Note: I have the enterprise edition of SQL Server 2005 installed on my database server.
Thanks in advance.
Karthik
I am trying to add a custom dll(IncrementTask avalilable in SQL Server DTS Samples)
as an executable(Task) to an SSIS package.
The following console application consumes the Custom dll:
using System;
using Microsoft.SqlServer.Dts.Runtime;
using Microsoft.SqlServer.Dts.Tasks.FileSystemTask;
using Microsoft.SqlServer.Dts.Samples;
using Microsoft.Samples.SqlServer.Dts;
namespace Microsoft.SqlServer.Dts.Samples
{
class Program
{
static void Main(string[] args)
{
Package p = new Package();
// Add a File System task to the package.
//This Line of code works fine.
//TaskHost execPkghost = (TaskHost)p.Executables.Add("STOCKQLTask");
//This line throws the following error: Object reference not set to an instance of an object.
TaskHost execPkghost = (TaskHost)p.Executables.Add("Microsoft.Samples.SqlServer.Dts.IncrementTaskUI,IncrementTaskCS,
Version=1.0.0.0,Culture=Neutral,PublicKeyToken=b23be0feabed1355");
TaskHost thFileSystemTask = execPkghost as TaskHost;
// Iterate through the package Executables collection.
Executables pExecs = p.Executables;
foreach (Executable pExec in pExecs)
{
TaskHost taskHost = (TaskHost)pExec;
Console.WriteLine("Type {0}", taskHost.InnerObject.ToString());
}
Console.Read();
}
}
}
I am getting a runtime error that "object reference has not been set to an instance of the object".
Any help on this is higly appreciated.
What I want to do is remove part of a result from a query. I am selecting the srvname from sysservers as follows.
SELECT srvname from sysservers
Where srvid ='0'
When the name is returned some times it might be like servernameinstance. What I need to do is cut off the and everything after that so that my result is just servername. I am then using this result in a cursor to go after server shares. The length of the servername varies. Any suggestions.
Hello:
I'm scheduling DTS packages to run as a job but when I do that, the job siply does not works, someone tolds me that it's a problem with the SQL and Windows NT authentication and security and he gaves me this URL http://support.microsoft.com/default.aspx?scid=kb;EN-US;Q269074.
but it not so clear to me, i'm working with SQL Server 200 and Windows Server 2000.
What can I do?
I dont know how to write a SQL Programming code from the table to the table (As the photo)
Would it be possable to help me?
Thanks so much!
Hi,
Currently I am using the BCP functionality to import/export tables between different SQL Server 2005 databases. The process is working ok, but it creates alot of manual work, when 70 or more tables need to be transferred, every week. I am new to RMO development and am interested if the following may be possible.
- I would like to build an interface in VB.net allowing users to select a source database, and select the tables that need to be transferred from the Source DB, to the Destination DB.
-Put in place RMO funtionality to replicate the source database tables into flat files.
-Within the Vb.net app transfer the created flat files into the destination database.
I would greatly appreciate any advice on this, or if there may be a better approach at replacing the BCP functionality.
Thanks,
Hi,
Need help from experts on web service (ReportingService class).
I am trying to change a datasourcereference of a report from one location to another location. I am kind of stuck at this point where i am able to get the location but only dataSource.Item, dataSource.Name are not enough items for me to solve this problem.
any possible help or any threads already answered these type, greatly appreciated.
thanks
kodru.
Hi!I want some tutorials on how to actually program database applications. Everything seems so bound with the data controls provided by Visual Studio and coming from PHP I don't like to not have full control over my applications. So where can I learn about creating my own database applications without using repeater, gridview or formview?Thank you in advance!
View 1 Replies View RelatedI need to create a database with one table and its column names.
I got this script from the query analyzer templates as a database basic template:
IF EXISTS (SELECT *
FROM master..sysdatabases
WHERE name = N'<database_name, sysname, test_db>')
DROP DATABASE <database_name, sysname, test_db>
GO
CREATE DATABASE <database_name, sysname, test_db>
GO
I am not sure what it all means, what I need to do it name the database a certain name each time. and then create one table with 6 column names.
can someone give me guidance please...
I have a table containing almost 700000 records. The table contains the following fields:
table_id, member#, car_eff_dt, car_term_dt, mbr_occur.
A member can occur more than one time and his effective date/termination date are sorted sequentially.
An example would look like this:
table_id member# car_eff_dt car_term_dt mbr_occur
1 12345678901 01/01/1995 12/31/1995 null
2 12345678901 01/01/1996 12/31/1996 null
3 12345678901 01/01/1997 12/31/1997 null
4 10987654321 07/15/1998 02/16/1999 null
5 10987654321 04/01/2000 12/31/9999 null
Using Transact-SQL, is it possible to generate a unique number for each occurance of a particular member#?
table_id member# car_eff_dt car_term_dt mbr_occur
1 12345678901 01/01/1995 12/31/1995 1
2 12345678901 01/01/1996 12/31/1996 2
3 12345678901 01/01/1997 12/31/1997 3
4 10987654321 07/15/1998 02/16/1999 1
5 10987654321 04/01/2000 12/31/9999 2
Currently, I am running the code in an Access/VBA module through an ODBC connection, but I would like to be able to run all my code directly on the server.
Thanks in advance for any help you might be able to provide.
Just curious,
What do all of you use to create and edit stored procedures? I am looking for a better way to code than to use the default window supplied with Enterprise Manager.
Do most of you use the Query Analyzer? Are there third party products you like using better?
Thanks for the info..
Eugene
I am looking into a production geared software called MassGroup. (www.massgroup.com) It says that its FactoryServer builds are on a standardized SQL framework and web architecture for data collection, work order requests, reporting and asset management. My questions are:
1. Is SQL its own programming language? If not what is it?
Answer: After going thru several pages and reading the fine print I discovered they use VB, ASP, COM technology, and Crystal Reports.
2. How powerful do you think this would be at gathering data and does it have the capability of creating a number sequence automatically? (example: 0001; 0002; 0003...)
Any help would be appreciated.
Thank you in advance!!!!!
hi to all,
What is the best language or compiler used in web database programming. Any have an idea pls help me.
Thankss.
I have just started in Sql 6 months ago. I was an IT major in graduate school and am now in my late 30's (career change). It took me 4 years to finally get what I thought was my dream job. Well, I was promised training which I have yet to receive and bascially went from doing basic queries that I did in class in college to doing advance Sql - stored procs, etc. I completely hate it. I do not know if it is from the lack of training or if it just not for me. I am completely bored out of mind. I am also tired of struggling everyday to complete assignments. The first 2 assignments I received were way out of my league. I was told this by a project mgr who did a similiar assignment and they have years of sql experience and it took her 3 months with assistance to complete it. I have been with the company for almost 6 years. I am not sure if I should just complete my current assignments and ask if they can reassign me to a different IT department, look for a new job or just continue to struggle and pull my hair out. Please give me some feedback as to how you would handle this situation.
View 8 Replies View RelatedGuys ..Im a very very confused Jr DBA/Dev here !
I need to know what exactly other languages [C#/VB.net/ADO/XML/ASP.net..etc] that I should learn in order for me to be able to excel in SQL Development.
I started getting my hands dirty with some SSIS / SSRS & SSAS, but inorder for me to handle situations such as [Find if file exist in ftp before loading, Checking a certain row of a data file before processing/ Zipping and Unzipping data files and etc...] What should I need to know well in order for me to add more value to my skills?
I would like to learn 1 language and master it pretty well.What are your suggestions?
And what is this CLR that is being talked about ?Does it use other language besides SQL?
Do guide this lost JR .......
Are there any good resources (books, websites, etc) for programming SQLServer using Visual C++? I am currently using C# but I really want to learnhow to do it using C++, but it appears to be much more difficult using C++.Thanks
View 2 Replies View Relatedi need to access an .sdf database using microsfot visual forpro
what drivers/connection strings do i need?
I currently have a table with the fields:
- StudentID as an Identity and is the Primary Key field (PK)
- FName as varchar(15)
- LName as varchar(20)
When I use a combo box, I place the information in it as follows:
- LName, FName/StudentID Ex: Rogers, James/4
In order to find our the student I want, I parse the above field for the StudentID.
Question:
How can I display the student's name only and still get to their StudentID?
Would I have to use an array holding/pointing to the StudentID? Or What?
Thanks In Advance.
Hi all,
I know how to basically change SSIS variables from within a C#. NET winform application. But can anyone point me on how to change the contents of a connection manager SSIS connection from withing C#.net please. That is..how do i parameterize a connection manager connection to basically accept the connection information from within the winform app.
Thanks
Hey, i have an installer that places ms sql express onto a machine. thats is fine. i want to create a post setup application that runs after ms sql server is installed. what for example i want to do is be able to create a user and have the DB allow remote connections. i can provide instructions for a 'peon' to make the required post setup changes but i want to see if i can cover that with an application. thanks
Charles Rezsonya
Not sure if this is right place to ask this. I have a table where I want a single field to show up in separate columns. (wow its hard to describe what I want. Here is an example
Store_Group_Product_Tbl
store, group id, product
Let's say we have these records:
Store 1 - group 1 - hats
Store 1 - group 1 - clothes
Store 1 - group 1 - shoes
Store 1 - group 2 - drink
Store 1 - group 2 - food
I want my select statement to return:
Store 1 - group 1 - hats - clothes - shoes
Store 1 - group 2 - drink - food - NULL
(and in this case I will be selecting on where store = a selected store)
Is there a way to join it back to itself to get the data I want? Or will I have to select everything into an array and then manipulate that array to get everything columned up correctly?
Could some one please help in coding a OLE DB Command, to fire a stored procedure which takes 2 parameter's
Help me in the coding, by which I should be able to fire a SP that takes 2 parameters, by mapping 2 feilds from the source table to the SP parameter's
The Below sample fires a SP without any parameter's
ConnectionManager cm = package.Connections.Add("OLEDB"); cm.Name = "OLEDBConnection"; cm.ConnectionString = "Data Source=.;Initial Catalog=AdventureWorks;Provider=SQLOLEDB.1;Integrated Security=SSPI;Persist Security Info=False;Auto Translate=False;"; // Create the source component.
IDTSComponentMetaData90 component = dataFlow.ComponentMetaDataCollection.New(); component.Name = "OLEDBSource";
component.ComponentClassID = "DTSAdapter.OleDbSource"; // Get the design time instance of the component.
CManagedComponentWrapper instance = component.Instantiate(); // Initialize the component
instance.ProvideComponentProperties(); // Specify the connection manager for Source.
if (component.RuntimeConnectionCollection.Count > 0) {
component.RuntimeConnectionCollection[0].ConnectionManagerID= package.Connections["OLEDBConnection"].ID;
component.RuntimeConnectionCollection[0].ConnectionManager = DtsConvert.ToConnectionManager90(package.Connections["OLEDBConnection"]); } // Set the custom properties. instance.SetComponentProperty("AccessMode", 2); instance.SetComponentProperty("SqlCommand", "Select * from HumanResources.Employee");
// Reinitialize the metadata. instance.AcquireConnections(null); instance.ReinitializeMetaData(); instance.ReleaseConnections();
IDTSComponentMetaData90 m_SQLCommand = null;
m_SQLCommand = dataFlow.ComponentMetaDataCollection.New(); m_SQLCommand.ComponentClassID = "DTSTransform.OLEDBCommand.1"; IDTSDesigntimeComponent90 oledbDesignTime = m_SQLCommand.Instantiate(); oledbDesignTime.ProvideComponentProperties();
if (m_SQLCommand.RuntimeConnectionCollection.Count > 0){m_SQLCommand.RuntimeConnectionCollection[0].ConnectionManagerID = package.Connections["OLEDBConnection"].ID; m_SQLCommand.RuntimeConnectionCollection[0].ConnectionManager = DtsConvert.ToConnectionManager90(package.Connections["OLEDBConnection"]);} oledbDesignTime.SetComponentProperty("SqlCommand", "Exec Test");
Hi ,
i am using VS.NET 2003 for programming and SQL sever 2005 is my database.
while creating DTS packages,
i am using code as follows
Public Sub Task_Sub4(ByVal goPackage As Object)
Dim oTask As DTS.Task
Dim oLookup As DTS.Lookup
Dim oCustomTask4 As DTS.DataPumpTask2
oTask = CType(goPackage, DTS.Package).Tasks.New("DTSExecuteSQLTask")
oCustomTask4 = CType(oTask.CustomTask, DTS.DataPumpTask2)
oCustomTask4.Name = "Copy Data from contact_info to [content_shriya].[dbo].contact_info] Task"
oCustomTask4.Description = "Copy Data from contact_info to [content_shriya].[dbo].[contact_info] Task"
oCustomTask4.SourceConnectionID = 3
oCustomTask4.SourceSQLStatement = "select * from [Content_management].[dbo].[contact_info]"
oCustomTask4.DestinationConnectionID = 4
oCustomTask4.DestinationObjectName = "[content_shriya].[dbo].[contact_info]"
oCustomTask4.ProgressRowCount = 1000
oCustomTask4.MaximumErrorCount = 0
oCustomTask4.FetchBufferSize = 1
oCustomTask4.UseFastLoad = True
oCustomTask4.InsertCommitSize = 0
oCustomTask4.ExceptionFileColumnDelimiter = "|"
oCustomTask4.ExceptionFileRowDelimiter = vbCrLf
oCustomTask4.AllowIdentityInserts = False
oCustomTask4.FirstRow = 0
oCustomTask4.LastRow = 0
oCustomTask4.FastLoadOptions = 2
oCustomTask4.ExceptionFileOptions = 1
oCustomTask4.DataPumpOptions = 0
'Call oCustomTask4_Trans_Sub1(oCustomTask4)
goPackage.Tasks.Add(oTask)
oCustomTask4 = Nothing
oTask = Nothing
End Sub
But i am geeting error in line
oCustomTask4 = CType(oTask.CustomTask, DTS.DataPumpTask2)
giving error 'System.InvalidCastException'
Additional information: Specified cast is not valid.
i changed it with oCustomTask4 = oTask.CustomTask ,
then also similar error appear.
Please solve my problem, i need to create DTS Packages by using VS.NET 2003 and Database is SQL server 2005.
Thank you
I am working on Sql Server 7.0 with a group of Visual Basic programmers that have made the following request:
1.They want all decimals/integer fields in the database to default to 0(zero).
Is there an way to do this for all fields instead of on an individual basis?
2.They don't want a null returned on any character string field.
What is the best way to take care of these 2 requests? Thanks in advance.
Karen Suenram
Hi-
Can you give me any help/assistance on the development process involved with migration from MS Access to SQL Server 7.
Specifically, I need my current MS Access data migrated to SQL, and then I need two (2) fairly simple forms developed for data input and searching on the web.
The developers I have been speaking too seem to want to buy their Hawaiian condo from this one project...which seems like A LOT OF $$ for the development of an off-the-shelf product that costs $15,000.
Any leads and/or thoughts would be GREATLY APPRECIATED.
THANKS.