Hi
I am looking for a function or so to format a number to two digits plus one decimal point.
Some examples:
- if input=4 then output= 04.0
- if input=40 then output= 40.0
- if input=4.1 then output= 04.1
- if input=4.32 then output= 04.3
Any idea?
Everything I've read says that custom data flow components are built by inheriting from the Microsoft.SqlServer.Dts.Pipeline.PipelineComponent class.
But the stock components such as the Derived Column data flow transformation must each be implemented by their own class. So how do I base my custom components on those classes? The documentation for the PipelineComponent class doesn't list any such subclasses.
Hi,
I'm finding that the standard components often just don't quite meet my
needs, but would only need some fairly minor changes to save me and my team a lot of
work (and produce more elegant solutions). So I was just wondering whether the source code was available for the standard components that come with SSIS, or if there is anyway to extend their functionality?
Or do you just have to start form scratch?
Thanks,
Lawrie
hello all -- I'm an SSIS newbie who is exploring (custom) programming functionality through third party components, to be plugged into SSIS, for SMTP, FTP, PGP, TAR, WinZIP, basically for a scheduling & automation utility.
Is there such a concept of third party components (and marketplace for this?) or is VB a much better choice for this vis-a-vis components variety, $$ and robustness ?
thanks much,
Cos
Hi,
As a hobby, I am creating custom SQL Server Integration Services components, which are installed as an add-on to out of the box components. They are mainly used to reduce the development time and minimize the maintance overhead. I would like to know, how I should market them? What are the mediums to use? Since this is the first time, I am creating a software for mass markets, I would really appreciate your help while marketing this baby.
Just FYI, the first commercially available package that I develop is for creating text based files. My package connects to any OLE DB datasource. Executes the query and stores the output in a text file. It is very useful while developing database driven custom feeds. Instead of working with multiple dataflow tasks, data flow sources, you just need to configure one single component and the rest is taken care for you. Since, the package implements the standard Microsoft Task Editor, it is very easy to learn.
Thanks for your help.
Cem
Especially interested in the CodePageConvert.
Installing the .msi just creates a project folder in my Visual Studio directory. I'm unclear how to get from this point to being able to choose this component from my Toolbox items in SSIS. There was a readme file that talked about gacutil.exe and .snk files that was a above my head.
Can anyone dumb it down for me?
How can we install the SSIS runtime components alone.
We are calling SSIS packages from .NET code. We would like to know what are the minimum components we need to install in the machine in which the .NET code is running.
Thanks,
Loonysan
Is it possible to use versioning at all with SSIS components?
My experience so far is that I have not figured out how version them at all, because if I change the version number, then apparently the <property name="UserComponentTypeName" ...> has to be changed in every single reference to the component, in every dataflow, in every single dtsx file that uses the component at all -- this will be a tremendous headache as some of this stuff is in source control. It seemsl clearly infeasible to check out and substitute and change all these references, and check them all back in, except very infrequently -- surely not feasible to do it for each small change.
I am in the habit of versioning dlls and assemblies, and actually changing at least a minor build number for each actual change, so I am a bit unhappy to find that apparently I cannot feasibly do this for a custom SSIS component :(
(I just find a dislike at apparently being forced to leave the version number invariant when I make code changes.)
What I would be very happy with, is if there were a way to adjust all the references in all the dtsx files, to refer to only the major and minor build numbers say, specifying that I am not picky about the revision numbers below those, so that it will find the latest component in the GAC matching the major and minor numbers.
That way I could still update the component version with each code change, which would make me happy, and not have to edit a zillion dtsx occurrences (not having to do that would also make me happy).
Anyone know if that is possible?
I'm hoping it is, and that it is only my ignorance at component references preventing me from doing so.
What SSIS components must be loaded onto the server?
To run an SSIS ETL program, exactly what executable, components, programs, etc. must reside on the server that will be running the program. Our developers write an test their ETL programs locally, on their desktops or laptops, but must upload the scripts to the production server for execution. Obviously, they are not going load Visual Studio and SQL 2005, etc. up to the server just to run the scripts (tho SQL 2005 may be on the same box as one of the DB engines used for ETL).
Any info would be appreciated.
MSDN states the following on: Readable Secondary Replicas (AlwaysOn Availability Groups) for SQL Server 2014:
Limitations and Restrictions:
Change tracking and change data capture are not supported on secondary databases that belong to a readable secondary replica:
Change tracking is explicitly disabled on secondary databases.
Change data capture can be enabled on a secondary database, but this is not supported.
This confuses me: You can not track the changes. However you can enable CDC?
The scenario I am trying to achieve is to use SSIS CDC components on an asynchronous secondary replica. Is this possible? If not what would be other viable approaches?
Greetings SSIS friends,
I have been attempting to implement one of our numerous ETL processes in SSIS but hit a brick wall when I tried replacing a complex stored procedure with a series of Merge Join components.
In the end, I had to settle with using a SQL task which merely calls the stored procedure and this proved to be the better option as the other version where I used SSIS components only took forever to run.
How do people cope with complex transformations?! Do you guys opt for pure TSQL to perform complex transformations and use SSIS components for control flow+simple(ish) data flow tasks?
I am confused.
I have a SQL Server 2005 Package (32 bit, 4 processors/16 GB of RAM, 3 GB switch for SSIS) with 1 DataFlow and 5 Custom Components:
> An OLEDB Source that reads a stoed proc from Sybase
> 3 Transform Components that perform: 6-required fields check, 4-lookups (3 cached, 1 non-cached), and a calculation that is performed(called) from a .NET Library.
> A SQL Destination that uses the .NET BulkCopy Class to insert the data.
It takes about 3 hours to load 1 million records that contain 46 columns (the largest being a varchar(100)). I have tried a good number of tuning options as well as indexing/SQL techniques to improve perfromance.
Some pieces of info:
1) We dynamically create the buffer during runtime based on an SSIS variable.
2) The actions of the components are determined at runtime through config files.
We do these two things so we can have multiple data flows run through the same package for better scalability and flexibility. Since we are dynamically creating the buffer I can NOT use any of the out of the box components because of lineage and metadata inconsistency issues.
3) I noticed on PerfMon that I am spooling buffers to disk after 100K rows.
I realize this is bad, but what are my alternatives?
Should I go to 64 bit? Is there anything else I can do?
Thanks in advance,
Anthony
Hi,
I have a SSIS Package which I would like to modify using SSIS API. I need to put new component between some two existing data flow's components. During this process I need to disconnect two data flow's components using SSIS API. How can I do that?
Thanks,
Rafal
How do i access global variables in SSIS scripts ?
the Dts.variables("VarName").Value
should work but doesn't ?
do i need to reference the variable another way ?
Hi,
In another thread Jamie Thomson very informatively said "The components in SSIS
are deliberately atomic (i.e. they do something very specific) so that
its easy to put them together to build something greater than the sum
of the parts". Which does make a lot of sense. However, I've been finding that I end up having to create exactly the same "pattern" of combined transform components again and again in order to solve the same problem but in different dataflows (or even within the same dataflow). Cut-and-paste-tastic! In order to obtain real re-use, it seems to me like SSIS is crying out for an easy way to create new components by using composition - i.e. the ability to take commonly-used combinations of existing components and create new "super" components (without having to write Custom Transform Components in C#/VB.Net and handle everything in code).
Does anyone know if this sort of functionality is likely to make it into SSIS in the forseeable future?
Regards,
Lawrie
The following is a list of questions that I have not been able to obtain concrete answers. I am probably missing something:
1) ReadWriteVariables -- can the updated value for a ReadWriteVariable be accessed within the same data flow? It appears not as I think the PostExecute() fires at the completion of the data flow not the end of the Script Component. Secondarily, the Script Component is a non-blocking transformation so the component does not "see" the end of the pipeline prior to sending data down stream.
2) Record Count -- Because of #1 above, How could you calculate a record count for a data stream? It does not appear that one can calculate the number of records for a data stream within a data flow and then access the count from within the same data flow.
3) FinishOutputs() -- Is the concept of FinishOutputs() applicable to Script Component Destinations? Asked another way, is FinishOutputs() executed at the end of the data stream regardless of whether there are "real" outputs for the component? I can create a "Dummy" output to create FinishOutputs() but is this ok?
4) Script Component -- It appears that the Script Component Source, Transformation or Destination are really defined based on the columns defined in "Inputs and Outputs". Can you convert an Source script component to a transformation script component by simply adding an Output?
Sorry for these basic questions but I am not getting it completely. As you can tell...
Hi,
Can anyone tell me where I might find the Class and Sequence Diagrams for the SSIS framework (for Custom Components)?
I've just started trying to create some Custom Transform Components and
I'm really struggling to get my head around the component lifecycle
(i.e what methods are called when, with what arguments, and why) with
just the BOL documentation to guide me.
Thanks in advance,
Lawrie
I created a SSIS package and several data flow componenets for this package.
What does strategy exist to deploy SSIS package and data flow components into a enterparise server?
Thanks in advance.
We're experiencing a problem where intermittently our SSIS packages will hang. There are no log errors or events in the event viewer. It will happen whether the package is executed from the SQL Job Agent or run from BIDs. When running from BIDs it appears to hang inside one of the data flows (several parallel pipes with sorts, merge joins etc...). It appears to hang in multiple pipes within the data flow component. The problem is reproducable, we just kill it and re-run, and it appears to hang in the same places.
Now here's the odd thing: as we simply open and close some of the components in the pipe line after the place it hangs, a subsequent run will go further in the pipeline before hanging. If we open and close all the components after the point it initially hung, the data flow will run fine, from there on out. When I say "open and close" I mean no changes are made, we simply double-click the component, like a merge join, then click 'close.'
To me this does not seem like a memory problem but likely something is wrong with the metadata, where opening a component and closing it somehow alters the metadata to "right it".
This seems to occur intermittently after we make modifications to the package. It's like if you make any mod, even unrelated to the data flow, you then have to go through and open and close every component in your package to ensure it will work. Again, no errors or warnings are fired.
Has anyone seen this type of problem?
Hi All,
I am not sure if this is a correct forum to discuss on the document posted @ http://www.microsoft.com/downloads/details.aspx?familyid=1c2a7dd2-3ec3-4641-9407-a5a337bea7d3&displaylang=en on SQL Server Integration Services (SSIS) Hands on Training - Creating Custom Components.
I am assuming Microsoft Developers are constantly monitoring this forum.
In the document - SSIS Creating a Custom Transformation Component .doc on Page 2 -
Exercise 1 - Writing the no-op data flow transformation component -
Task 1 - Create a new C# Class Library Project
The textual description talks about creating a new Visual C# Class Library project in VS 2005 but the screenshot accompanying it shows the creation of new "Integration Service Project" in VS 2005.
Please change the screenshot appropriately to avoid confusions.
Thanks,
Loonysan
Hi,
In my case I have to log the errors raised by any task in a package to either windows event log, text file or SQL server. Also I need to send an email notifications to a group of people telling them about the error.
Now can I use SSIS package logging for logging the errors into the required destinations. I mean right clicking on the package and selecting Logging, then adding the required log providers and enabling the events for logging into those. I think I have to upfront select the log providers to log the error, I will not have the liberty to log the error to the destination, the name of which is passed as a variable to the package. This is okay with me though.
Now what will a custom log provider help me to do in this case. Also can I somehow configure my package to call the send mail task everytime an error is raised.
Also, one more option can be developing a package that only does the error handling. It will take in the paramters or the error codes and descriptions, the destination to write to and a flag to send mail or not for that particular type of error.
What do you think? Kindly advise.
Thanks in advance for your help and time.
Regards,
$wapnil
Gurus,
I have a job that contains a step to run a DTS task (DTSRUN /S.....etc.) via a batch file.
I can run either the DTSRUN command line, or the batch file that contains it just fine,
but when I try to run the job, it reports success but does not actually do the work.
I dont get an error message. I am using the sa account to run the DTS task from the command line.
I know this must be a permissions issue. As I am working at a Defense contractor, I cannot get a
domain admin account to run SQL Agent.
Any ideas where to look?
Kevin
Hi,
How can I tell whether I have SQL Server 7 Components on my computer?
Thanks,
Denise
Can any one give me brief useful explanations or guide me to a usefulresource of what Development Tools component and Profiler are?Is there anything I should be aware of if I want to install ClientConnectivity component (don't want to overwrite anything)?Thank you in advance.
View 1 Replies View RelatedI am not sure why when the packages are run, the components dissapear. The only thing I see is the result in the output.
So there is no visual on the tabs.
Thanks
Hi, help please!!
View 23 Replies View RelatedI am just a novice, and am curious.I
I was trying subscription, but an error occured: "Microsoft Server Management Studio is un able to accessreplication components because replication is not installed on this instance.
I went to change, located my setup exe, installed. but at the end, I get this message: No selected features can be installed or upgraded. Setup cannot proceed since no effective change is being made to the machine......
I downloaded the Express edition via MSDN download.
May somebody please help? What wrong did I do? What did I miss to do?
I have a question about client components. I read someplace where if sql client components are preinstalled
(if you delete sql express-client components cannot install, even if they are preinstalled
I have sql express default installation from vs 2008 pro
I have not installed sql express (client components, database components
I wish to install cd standard edition on my computer for reporting services
Also wanted to add enterprise server so I need report manager
office 2007 installed by myself. I came across this article kb909967.
Is there anyway to check make sure I can install client components installs on standard edition
I also read kb 964164 installing sql on vs 2008 vista ultimate Thanks
Hi again, All!!
I'm having a problem with problems with some custom components I built. I have a custom Connection Manager and Data Flow Source that I have built.
My local PC is 64-bit, but I followed the MS instructions on building and deploying custom components. They run fine inside of VS2005, as long as I have 'Run64BitRuntime" set to 'False'. When I try to run packages using the custom components in 64-bit mode, I get:
Error: 0xC0014005 at : The connection type "<MyConnectionManagerType>" specified for connection manager "PRI" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.
I suspect I need to either change the way I build or deploy the custom components. Can someone shed some light on this?
Thanks,
Frank
Hi
I have installed SQL Server 2005 but Integration Services is just not there. I have uninstalled and reinstalled several times and in the process uninstalled an old version of Visual Studio.NET (manually because it wouldn't uninstall automatically) and Visual Web Developer, just in case they were interfering with Integration Services. No luck, in fact it got worse, now Analysis Services also does not work because it can't find devenv.exe!
I have installed exactly this same software on another clean PC (ie. no previous Visual Studio variants on it) and it installs perfectly.
There seems to be some kind of clash between old versions of Visual Studio and SQL Server 2005 that prevents SQL Server from properly installing products like Integration Services that use the Visual Studio interface (ie. devenv.exe).
I now can't even reinstall the old version of Visual Studio.NET, and devenv.exe is nowhere to be found on my PC although it is referenced throughout the registry.
Has anyone got any suggestions, all I am after if a full and clean install of SQL Server 2005 so I can develop against it using Visual Web Developer.
Thanks
Thanks in advance for your help...
I have been trying to create, then call an activeX object. I use sp_OAcreate and then sp_OAmethod to create the object, the call the method within. I have registered the DLL but I can not get it to work. I used the examples within T-SQL help but it doesn't seem to work. I am calling from within a sp within the northwind db. I need to pass 4 parms to the method. Here is the proc.
CREATE PROCEDURE SIMPLE2_SP
(@CUSTOMERID nVARCHAR(25) = NULL,
@ORDERID INT = NULL)
AS
DECLARE @BLOB nVARCHAR(1200),
@PARM1 nVARCHAR(25),
@SF INT,
@pOBJ INT
/***Make sure that the customerid is specified, if not, get out. sfogli 7-17-00
***/
IF (@CUSTOMERID is NULL) OR (@CUSTOMERID = '')
BEGIN
RAISERROR('Must specify a CUSTOMER name.',-1,-1)
RETURN (1)
END
/***Hardcode the path, customerid, and orderid for testing purposes. sfogli 7-17-00.
***/
--SELECT @BLOB = 'PATH=C:REPORT.HTM;CUSTOMERID=' + @CUSTOMERID + ';' + 'ORDERID=' + CONVERT(VARCHAR(5),@ORDERID)+ ';'
SELECT@PARM1 = 'PATH=C:REPORT.HTM;'
/***Append BLOB with revelant data from customer table, sfogli 7-17-00.
***/
SELECT @BLOB = (SELECT'CustomerID=' + CUSTOMERID + ';' +
'CompanyName=' + COMPANYNAME + ';' +
'ContactName=' + CONTACTNAME + ';' +
'ContactTitle=' + CONTACTTITLE + ';' +
'Address=' + ADDRESS + ';' +
'City=' + CITY + ';' +
--Contains null values'Region=' + REGION + ';' +
'PostalCode=' + POSTALCODE + ';' +
'Country=' + COUNTRY + ';' +
'Phone=' + PHONE + ';' +
'Fax=' + FAX + ';'
FROMCUSTOMERS
WHERECUSTOMERID = @CUSTOMERID)
/***Make sure that the orderid is specified, if not, raise message. sfogli 7-17-00
***/
IF (@ORDERID is NULL) OR (@ORDERID = '')
BEGIN
RAISERROR('To continue process, please specify an ORDERID and retry.',-1,-1)
PRINT @BLOB
RETURN (1)
END
/***Append BLOB with revelant data from orders table, sfogli 7-17-00.
***/
SELECT@BLOB = @BLOB + (SELECT'OrderID=' + CONVERT(VARCHAR(5),ORDERID) + ';' +
'CustomerID=' + CUSTOMERID + ';' +
'EmployeeID=' + CONVERT(VARCHAR(7),EMPLOYEEID) + ';' +
'OrderDate=' + CONVERT(VARCHAR(15),ORDERDATE) + ';'
/***'RequiredDate=' + REQUIREDDATE + ';' +
'ShippedDate=' + SHIPPEDDATE + ';' +
'ShipVia=' + SHIPVIA + ';' +
'Freight=' + FREIGHT + ';' +
'ShipName=' + SHIPNAME + ';' +
'ShipAddress=' + SHIPADDRESS + ';' +
'ShipCity=' + SHIPCITY + ';' +
'ShipRegion=' + SHIPREGION + ';' +
'ShipPostalCode=' + SHIPPOSTALCODE + ';' +
'ShipCountry=' + SHIPCOUNTRY + ';'
***/
FROMORDERS
WHEREORDERID = CONVERT(VARCHAR(5),@ORDERID))
EXEC @SF = SP_OACREATE "PMIDocHandler.HTMLDocs", @pOBJ OUT
IF @SF <> 0 GOTO ERR
--(sPath, sCustomer, sContractID, sKeyValuePairs)
EXEC @SF = SP_OAMETHOD @pOBJ, "CreateDocument" ,@PARM1, @CUSTOMERID, @ORDERID, @BLOB
IF @SF <> 0 GOTO ERR
ERR:
RAISERROR('THIS IS ONLY A TEST.',16,1)
--SELECT @BLOB AS 'VARIABLES PASSED'
RETURN
Hello,
Say I have a composite index, how can I programmatically find the components knowing only the table name?
For example, an index was created as follows:
CREATE UNIQUE INDEX [some_table_index] ON [some_table]([col1], [col2]) ON [PRIMARY]
Now, I'd like to get back 'col1' and 'col2' when I search for 'some_table'.
Thank you
I have a Windows XP machine that I have run SQL Server on in the past.I recently re-formatted the hard drive and re-installed XP from scratch,and now when I try to re-install SQL Server 2000, I get an error messagesaying that the "server component is not supported on this operatingsystem. Only client components will be available for installation." Ihave a hard time understanding why the server components can't beinstalled on XP, especially since I've installed them before on thissame machine.Can anyone explain why this might be, and what I can do (if anything) sothat it can be installed again?Thanks.Steve
View 1 Replies View Related