So I have a Web Service that works just fine when I enter the parameter values myself. I get results and can parse it out, storing the results into a table. I even have it working in a "For Each Loop" for one of my variables. The issue I have is that the Web Service accepts 3 variables, the first being an Array. How can I populate the array variable for web service?
View 5 RepliesWhen you pass a complex type (the one represented by class) to a web service the BIDS UI allows you to enter values for every field of that type as constants. But what if you want to pass a variable? Once again the UI allows you to specify a variable for that complex type parameter. But how to make this variable in SSIS?I understand it should have the type of Object. But how to specify what the runtime type of this object is? And how to assign all fields to that object?
View 6 Replies View RelatedWe'll be using 2014 enterprise to populate some excel spreadsheets. We may not have the option of using ssrs so here is the question.
The excel spreadsheets have some pretty fancy heading structures, multiple tabs and in a few cases graphs that i'm sure are dependent on data sitting somewhere in the spreadsheet. The heading have variable info in them (eg FYxx where xx is a parameterized fiscal year, month names etc). Sometimes those headings have sub headings (with variable info) and so on.
Generally speaking how (if at all) do folks deal with this kind of excel challenge when limited to using ssis? I don't know if templates are going to be a good idea. I don't know if i'll be looking at a fair amount of c# etc code behind the scenes. I can be more specific depending on the feedback.
This is part of a conversion from 2 of the larger BI and statistical tools out there to the MS sql stack. Obviously with some shortcuts that we may wish we didn't take.
I use a ole db to get data from database as source data, and use ole db destination to put data into excel, destination component connect to an excel file . and got below warning:
Warning 10 Validation warning. {9FA859ED-E4C7-4EA1-AE32-11F21CFDC23D} OLE DB Destination [136]: Truncation may occur due to inserting data from data flow column "sMessage" with a length of 2000 to database column "sMessage" with a length of 255. how to populate data length >255 to excel
We have table where we want to populate the fields from Active Directory using Script Task in ssis 2008 .
CREATE TABLE [ZPTSMGR].[ActiveDirectoryRaw](
[Id] [int] IDENTITY(1,1) NOT NULL,
[LoginName] [nvarchar](50) NULL,
[LastName] [nvarchar](100) NULL,
[MiddleName] [nvarchar](50) NULL,
[FirstName] [nvarchar](100) NULL,
[code]...
Hi, I want to populate the array with a single column values from database(sqlserver 2000)Ex. name ageaaaa 23bbbb 43cccc 18 Now i want to populate the array with name field values. Please anyone guide me how to do this.Thanks in advanceBala
Using the SqlDataReader, I am retrieveing records from a SQL Server 2005 DB table. Since I am using the SqlDataReader to retrieve the records from the DB, I have to use the Read method of the SqlDataReader like this:Dim sqlReader As SqlDataReaderWhile(sqlReader.Read) Response.Write(sqlReader.GetValue(0) & "<br>") Response.Write(sqlReader.GetValue(1) & "<br>") Response.Write(sqlReader.GetValue(2) & "<br>")End WhileThe records retrieved can only be accessed inside the While loop. I want to access the records outside the While loop as well. Is there anyway by which I can do this, maybe by populating the recordset in an array variable & then using it outside the While loop?
View 3 Replies View RelatedI have an SSIS package that creates a csv file based on a execute sql task.
The sql is incredibly simple select singlecolumn from table.
In the properties of the execute sql task I specify the result set as "full result set" when I run it I get the error that: Error:
The type of the value being assigned to variable "User::CSVoutput" differs from the current variable type.
Variables may not change type during execution. Variable types are strict, except for variables of type Object.
If I change the resultset to single row then I only get the first row from the DB (same if I choose none), If I choose XML then I get the error that the result is not xml. What resultset type do I need to choose in order to get all the rows into the CSV? The variable I am populating is of type string and is User::CSVoutput
We are using SSIS 2008 . A variable abc has been defined with sql script Select firstName,LastName from Employee.I need to edit the variable and add a where condition like SELECT firstName,lastName FROM employee where Name like '%Fr%' I tried to replace it with new script and saved also but when i ran the package it was still using the old sql script .
View 4 Replies View RelatedHi,
I'm hoping someone has tried something similar before. I am trying to run an integration from a remote computer using a web service. I have set up the web service and the bog standard launch package routine works fine. What i'd like to be able to do is to launch a package and also specify any parameters associated with it. I have the following code which is identcal to the main launch sub with the exception of an extra argument (jagged array of varible name and value variablePair[4][2]). It also processes the variable array and sets them on the DTSPackage object.
[code]
[WebMethod]
public int LaunchSSISPackageWithVariables(string sourceType, string sourceLocation, string packageName, string[][] variableArray)
{
string packagePath;
Package myPackage;
Application integrationServices = new Application();
// Combine path and file name.
packagePath = Path.Combine(sourceLocation, packageName);
switch (sourceType)
{
case "file":
// Package is stored as a file.
// Add extension if not present.
if (String.IsNullOrEmpty(Path.GetExtension(packagePath)))
{
packagePath = String.Concat(packagePath, ".dtsx");
}
if (File.Exists(packagePath))
{
myPackage = integrationServices.LoadPackage(packagePath, null);
}
else
{
throw new ApplicationException("Invalid file location: " + packagePath);
}
break;
case "sql":
// Package is stored in MSDB.
// Combine logical path and package name.
//if (integrationServices.ExistsOnSqlServer(packagePath, ".", String.Empty, String.Empty))
if (integrationServices.ExistsOnSqlServer(packagePath, ".", "executeSSIS", "p4ssw0rd"))
{
//myPackage = integrationServices.LoadFromSqlServer(packageName, "(local)", String.Empty, String.Empty, null);
myPackage = integrationServices.LoadFromSqlServer(packageName, "(local)", "executeSSIS", "p4ssw0rd", null);
}
else
{
throw new ApplicationException("Invalid package name or location: " + packagePath);
}
break;
case "dts":
// Package is managed by SSIS Package Store.
// Default logical paths are File System and MSDB.
if (integrationServices.ExistsOnDtsServer(packagePath, "."))
{
myPackage = integrationServices.LoadFromDtsServer(packagePath, "localhost", null);
}
else
{
throw new ApplicationException("Invalid package name or location: " + packagePath);
}
break;
default:
throw new ApplicationException("Invalid sourceType argument: valid values are 'file', 'sql', and 'dts'.");
}
//Variables var = myPackage.Variables;
//foreach (string key in variablePairs.Keys)
//{
// var[key].Value = variablePairs[key].ToString();
//}
Variables var = myPackage.Variables;
for (int i = 0; i < variableArray.Length; i++)
{
var[variableArray[0]].Value = variableArray[1].ToString();
}
return (Int32)myPackage.Execute();
}
[/code]
For some reason the above code runs and passes back the value that it succeeded. Yet the package doesn't do what it should. Does anyone have any ideas as to why this might be the case or even a better way to pass the variables.
Many thanks,
Grant
I have tried with this thing for hours and I can't get it to parse.
Trying to get last year so the expression should evaluate today as of "12/31/2014"
I looked all over on Google and couldn't find an expression to copy so I've been playing with it.
Here is what it is in SQL Server:
SELECT DATEADD(dd,-1,DATEADD(yy, DATEDIFF(yy,0,GETDATE()),0))
Absolutely could not get it to parse..even with DT tags, etc...
Why the index value is used in variable mapping while using for each loop container. In one of ssis package I saw the index value as 2. What 2 indicates in index?
View 3 Replies View Relatedim creating an sql2005 integration services project ( DTS). i am creating a user variable. i want to be able to use that variable inside a script task. how do i reference the variable so that it can be seen within the script task??
View 2 Replies View RelatedIt's SQL 2008 R2. I need to bring data from Oracle using .Net Providers/ODBC Data Provider to MS SQL table converting Oracle UTC dates to PST. The source connection type cannot be changed as it's given. For the Destination I'm using the OLE DB.
As the truncate all and load could take time I'm trying to use a temp table or a variable to use it further with t-sql merge or not exists to bring/add the only new records to the destination table.
I'm trying different scenarios that is all failed.
Scenario A:
1. In DTF after OLE DB Source I'm using the Derived Colum to convert dates. It's working well.
2. Then use Recordset Destination with an object variable User::obj_TableACD. It's also working well.
3. Then I created a string variable with a simple query that I could modify later "select * from " + (DT_WSTR,10)@[User::obj_TableACD] trying to get data from the recordset object variable but it's not working.
Scenario B:
1. Created a store procedure to create a temp table.
2. Created a string variable to execute SP str_CreateTempTable: "EXEC dbo.TempTable". It's working well with the SQL Task with SQLSourceType as Variable.
3. Then how to populate the temp table from the Oracle source to bring data into the Destination?
I have created a SSIS package that runs several reports exporting the file output to a shared directory. Then I email these files as attachments to an email group. I got everything working so far. But when I checked the email there are only some of the attachments (3 out of 6 files).I have created a variable that uses an expression to concatenate several filenames and their paths separated with a "|". When I evaluate the expression it list all six files. When I use the variable in an expression when assigning the "FileAttachments" property in the Expressions tab in the Send Mail Task editor and I evaluate the expression, it only shows 3 out of the 6 files.
Each file name and path is less than 100 characters. Why is this task only grabbing 3 out of the 6 files. If I check the shared directory all 6 files are there. Also, there are two paths in the package that input into the Send Mail Task each creating a different set of report files. Only one of the paths files are getting attached. The connectors to the Send Mail Task are set as Evaluation operation: "Constraint" and the Value: "Completion". Under Multiple constraints I have selected "Logical AND, All constraints must evaluate to True".
I have one scenario. I am calling all columns result set to an variable and inside for each loop container using script task to get message about how many columns are coming in the loop.
At last using send mail task to send automated mails to group of people,but issue it is taking only person's mail id and coming out of loop.
how to call object type variable ?
Hi,
A coworker of mine is experiencing some problems with SQL Server Integration Services (SSIS) and long running Web Service calls. Any feedback on the problem would be greatly appreciated.
The problem is as follow:
He has a large SSIS-package that, among other things, contain a few Web Service Tasks. All of the tasks are executing as expected for small amounts of data. All the Web Service Methods have in common that they have a long running time. The running time depends on the amount of data.
During requests with large amount of data the Web Service task fails with the error message The operation has times out?, but on the server they see that the service call completes as expected (after quite some time, approx 200sec).
The Web Service tasks are using an HTTP Connection Manager?, created in the SSIS package. The timeout-value is set to 300 sec (which is the largest value for the property). My coworker expected that this value was the same as setting the timeout value for a Web Service proxy object for any other project.
After testing the Web Service from a Console application, with 300 sec timeout, the app executed as expected with no timeout exception.
After doing some testing, hes quite sure that the SSIS task times out after 100 seconds, which is the default .NET 2.0 timeout value for a WS proxy, even though the timeout property in SSIS is set to 300 seconds.
As a work around he have created a console application that does the web service call, and then use the execute process task? in SSIS. This is off course a dirty? hack, and he wants to use the HTTP Connection Manager? task instead.
So the question is: Have anyone experienced this problem before? Is there a limitation on the HTTP Connection Manager task? Is the timeout value on the HTTP Connection Manager task the same as setting the timeout property on a WS proxy? Why isnt this timeout? value picked up my SSIS?
Again, thanks for any help!
I have a table is SQL server database A that is my source.
I have another database B which is accessed via webservice call.(its a CRM server basically).
My intention is to transfer data from A to B while B is accessible only via web service. I need to Trasnfer the data from the source database A to the destination Database B by calling the webservice.
Is there a way where I can retrieve whole set of rows in source table in preexecute(), And transfer the data to Database destination B by calling the webservice?
I have created one variable name migration_start datetime which give me default format of 6/11/2015 1:26 AM...But I expecting to get in 2015-06-11 01:26:22.813 format.I have used below expression betting getting issue with that
(DT_STR, 4, 1252) DATEPART("yyyy" , @[User::migration_start]) + "-" + RIGHT("0" +
(DT_STR, 2, 1252) DATEPART("mm" , @[User::migration_start]), 2) + "-" + RIGHT("0" + (DT_STR, 2, 1252) DATEPART("dd" , @[User::migration_start]), 2)
I have enabled SSIS logging for a Package.
Is it possible for SSIS logging to output the value of a variable.
Currently, it is only outputting the name of the variable, such as:"User::FilePath"
I am having trouble finding the correct syntax to access a variable. I have a variable defined in the Variables window: The variable name is formatedDate. The DataType is String.
I am successfully setting the value of the variable in a Execute SQL Task. The SQL is as follows:
SELECT LEFT(CONVERT(VARCHAR, MAX(ReportDate), 120), 10) as formatedDate
from DimReportDates
The Result Set is set to “Single Row” and properly set up.
No problem so far. I can see with a watch that the variable has the correct value, something like:
‘2015-09-30’
Now, in a subsequent step, a Data Flow Task, I want to access the variable. Actualy it is in the SQL statement of a OLE DB source in the Data Flow… I have the following:
Declare @sDate smalldatetime
SELECT @sDate = xxxxx
I have tried several things substituting xxxxx above, but nothing seems to work. One variation was
@[User::formatedDate])
Another was
((DT_WSTR, 10) @[User::formatedDate]).
I think I’m close, but just can’t get it. What is the correct syntax.
I am using a sql task to get all tablenames and then passing the output to another sql task inside a for each container.
So that the 2nd sql task will be executed for each table. My query looks like SELECT DISTINCT b.EmailAddress FROM ? ......
Since I am passing the tablename as a variable (output from the 1st sql task), I get the following error:
[Task Execute SQL] Error:
Failed to execute the query 'SELECT DISTINCT b.EmailAddress FROM? AS a INNER... ':' Failed to extract
the result in a variable of type (DBTYPE_I4)'. Possible causes include the following: Problems with the query, not properly fixed ResultSet property, not properly set parameters or not properly established connection.
how to pass a tablename as a variable to a query?
I have one main package from which i am executing 5 other packages.I want to use one single DB connection in all the packages which i am declaring in Main package and it should be available in all the child packages. How can i Do this?
Few Variables are common is all the packages so i want to keep it Globally so how can i access those variables ?
How can i schedule package in sql server?
Thanks
I have a set of .dtsx files that connect to an Oracle database. The Oracle username and pw values are saved in variables set up in the .dtsx files. These two variables do not have expressions, rather, these two variables feed other variables and their expressions.Theses files are now moving from one environment to another and the Oracle username and pw must be updated to connect to the new Oracle environment.
Upon updating the variables, the packages expressions update as expected, however, when saving the file to disk, the updated variables aren't saved and the values revert back to the original values.
How are variables updated in .dtsx packages that will allow changes to be saved?
I have to import a number of excel spreadsheets. I'm using the classic Foreach Loop inside another Foreach loop approach. The outside loop (Foreach File Enumerator) cycles through the Excel files, while the inside loop (Foreach ADO.NET Schema Rowset Enumerator - ExcelSchema - Tables) to cycle through the individual Excel sheets in each file.
Nothing special there; however, for some reason these excel files have some "phantom" tabs that should not be imported. I call them phanton because they show up as an importable tab in a SSSIS import wizard but actually are not listed in the excel file structure (no, they are not hidden tabs, I checked).
My idea is to use a constraint to NOT import those phanton tabs. The name convention should allow me to do that because the normal tabs have the name 'AAAAAAyyyymmdd$' and the phantom tabs show up as 'AAAAAAyyyymmdd$'_xlnm#_FilterDatabase (the line below was captured from the Local Variable window and show one of the phantom tabs name).
+ User::WorksheetName {'AAAAAAyyyymmdd$'_xlnm#_FilterDatabase} String
I tried using Len (@[User::WorksheetName]) == 17, which corresponds to the length of the normal tabs name ('AAAAAAyyyymmdd$'). However, it does not work. For some reason the portion of the phantom tab name after the ending single quote (_xlnm#_FilterDatabase) appears to be ignored.
I tested with a number of different expressions, including reversing the variable, to no avail. It seems that internally just the standard name between quotes is what the constraint sees.
I need to create a variable expression that will be passing yesterday's date to a sql command but when I create the variable there is only the datetime datatype, how can I trim the time portion from this expression to get the date portion :
DATEADD( "day", - 1 , GETDATE() )
I've created a SSIS Package and it's connection is based on Environment Variable(please seeprocedure).
Now, I'm trying to create a job that calls this package and it seems that when you view Data Sources, it still pointing to the old server.
But when you open-up the package through BIDS in the same server, it's using the new reference that I have specified in the environment variable (please refer to the first image).
I came across this blog with the same issues as mine. He suggested to re-start the SSIS Service which I already did but nothing happens. I even re-started the SQL Agent but still no luck.
I'm not sure what else is missing except for re-starting the machine which is the last thing I want to do as this is PRODUCTION server.
I am using Execute sql task in my SSIS package, and I am trying to make the following query:
<o:p></o:p>
Select max(sqlid) from archive.dbo.Archivebbxfbhdr
where timein <= ?<o:p></o:p>
Where ? is my input parameter variable migration_start which is a datetime.<o:p></o:p>
My issue is that variable name migration_start which give me default format of 6/11/2015 1:26 AM
But I expecting to get in 2015-06-11 01:26:22.813 format.<o:p></o:p>
How I can I change the datetime format of my variable to be (yyyy/mm/dd)hh:mm:ss)?<o:p></o:p>
My Execute SQL Task will store the file name into a variable(mFile) of type string datatype.
Now I wanted a script task (C# code) to create a filename from the variable (mFile) value.
Since it is a common issue I tried a lot in the internet but none of the queries worked.
We have one package in production. variable var_date has an expression already defined to it. How can we overwrite this variable value from config file or from cmd file. We don't want to make changes to the package and redeploy it.
View 2 Replies View RelatedI have a Master Package that executes a number a child packages.
In my SSIS Package Configuration:
1. I have an SSIS Configuation table that holds the connection string.
2. An XML Configuration File with a setting of configuration location stored in an enviornmental variable.
3. And finally, an Eveniornmental variable with the setting of ProjectFolderAbsolutePath value, where it is the full path of the project folder.
The project functions normally but everytime I open it I get the following error.
" Warning loading MasterPackage.dtsx: The configuration environment variable was not found. The environment variable was: "EnviorVariable". This occurs when a package specifies an environment variable for a configuration setting but it cannot be found. Check the configurations collection in the package and verify that the specified environment variable is available and valid."
I receive a data feed from a third party in a pipe delimited file. From time to time, they add a column at the end. I would like my ssis package to continue to process the data even if they add a column with out it breaking. How best do I handle this situation?
View 6 Replies View Relatedpublic Sub Main()
Dim url, destination As String
destination = Dts.Variables("report_destination").Value.ToString + "" + "Report_" + Format(Now, "yyyyMMdd") + ".xls"
url = "http://localhost/ReportServer?/ssis_resport_execution/ssis_ssrs_report&rs:Command=Render&ProductID=" + Dts.Variables("ProductID").Value.ToString + "&user_id" + Dts.Variables("user_id").Value.ToString
+ "&rs:Format=EXCEL"
SaveFile(url, destination)
Dts.TaskResult = ScriptResults.Success
End Sub
How to pass more than one variable values in ssis as parameter values to ssrs. With the above code its showing as empty.If i am taking single variable i am able to render the data into excel sheet.