My Execute SQL Task will store the file name into a variable(mFile) of type string datatype.
Now I wanted a script task (C# code) to create a filename from the variable (mFile) value.
Since it is a common issue I tried a lot in the internet but none of the queries worked.
CREATE TABLE Test
(
EDate Datetime,
Code varchar(255),
Cdate int,
Price int
);
drop table Test
[Code] ....
I have this Query and the below output:
EDate Code CDate Price
2015-06-24 RX 20150701 22
2015-06-24 RX 20150701 28
2015-06-24 RX 20150701 43
[Code] ....
Now the task is to create SSIS package which will create different .txt file for each Code
1) RX20150624.txt
2015-06-24 00:00:00.000 RX 20150701 22
2015-06-24 00:00:00.000 RX 20150701 28
2015-06-24 00:00:00.000 RX 20150701 43
2) NG20150623.txt
2015-06-23 00:00:00.000 NG 20150701 43
3) HO20150624.txt
2015-06-24 00:00:00.000 HO 20150701 43
And so on..
But the requirement is to have a dynamic query where we can have more number of Codes or less number of codes and similarly the package should generate dynamic text files, one .txt file per code. What is the best way to create a package which can meet the above requirement?
I have created a File System task which is contained in a Foreach Loop Container. I have .bak files that are populating a directory from a maintenance backup plan.
There is a point where I need to delete the .bak file's after I've zipped them all up.
How do I set the SourceVariable to read through the directory and pick up just the .bak file's in the directory to delete.
As part of my package, i require a date (Only date, not DateTime) which is 10 months previous to get date.Eg: for today if the package executes, then i want 12/1/2014 , which i will use in my package as a filter like 'where date='?' where ? is a paramter which is is derived from the above logic
So, I have a project parameter @ppdate with value as -10. I create a variable with DateTime (because there is NO date type for SSIS) and gives the expression as below
dateadd("Month",@ppdate, DATEADD("D",-(DAY(GETDATE()))+1,GETDATE())) , I am getting '7/1/2011 11:33:38 AM' which i don't want - i want only '12/1/2014'. How can i get it?
To get '12/01/2014', If i change the variable from DateTime to string, then i think i cant use the value in the filter condition like ''where date='?' because this does not accept string. Is this correct?
I have one requirements below..
Table input
Eno ename Eloc
Edept
1 Sid
Pune 101,201,301,401,501,601
Output:
Eno ename Eloc
Edept
1 Sid
Pune 101
1 Sid
Pune 201
1 Sid
Pune 301
1 Sid
Pune 401
1 Sid
Pune 501
1 Sid
Pune 601
I've been working on an issue in an SSIS package and getting strange results using a package variable named "UnprocessedFileCount". I'm looping through files in a directory (using a Foreach Loop Container) to process data into the database, and after a certain amount of time, I stop processing the files and short circuit the loop to finish the package faster. I was tasked with counting the number of files that weren't processed and it seemed easy enough to count how many times the loop "short circuited" by incrementing a variable in a script task. I then wanted to send out an email and include the incremented variable in the body of the message.
I ran into issues when I used the variable name "UnprocessedFileCount". The variable was incrementing within the loop as expected. However, it was always resetting back to "0" after the ForEach file Loop Container completed.
After some heavy searching on the subject, to no avail, I eventually found that changing the variable name did not reset the variable.
I'm still using SQL Server 2008.
I have a requirement wherein I have to setup the flat file connection manager to accept columns on fly. Meaning I want to retrieve list of columns/column count from the database when the package is run and set the connection manager with those many columns.
View 6 Replies View RelatedPublic Class ScriptMain
Inherits UserComponent
Dim smpid As String
Dim Prdt As String
Dim rcnt As Int64
[code]...
Using the Vb script above I am expecting to read the first row from a flat file source and transferring the data into two variable using script component.
SQL server 2008.
Script task Custom Properties:
Script Task Input Columns:
I get the following errors one after the other:"The collection of variables locked for read and write access is not available outside of PostExecute." "Object reference not set to an instance of an object."
I am creating one SSIS package where my source is oracle. I have transferred the data from Oracle to flat file as per client requirement.I have to create single package for 2 country 1 is US and another is CANADA Columns are below
ZONE_ID,
ZONE_NAME
Zone Id having data like 10001,10002,10003,20001,2002,2003
Where zone_id start with 1000 is US Zone and Zone_Id start with 2000 is Canada Zone.
For US:
1. Load geography data from DB tables into flat files
2. Load geography data from flat files to Spectrum DB tables
For Canada:
1. Load geography data from DB tables into flat files
2. Load geography data from flat files to Spectrum DB tables
Now I want to look from flat file if Zone_id start with 1000 then it must go to US_DFT and if Zone_id start with 2000 then it must go to CANADA_DFT.
I use an execute sql task and excel connection manager to craete excel file.
Execute sql task:
In the connection:
It works. But when i choose file path to: C:1111.xlsx
And excel version to micorsoft excel 2007. When open the file it created,it promotes the format is not correct. How to solve this?
Problem: I need to export data from a table in a database. I have an SSIS that converts data to this table. To export the data using the SSIS the file needs to be already created (from my understanding). This export location is on another server and the folder location is empty.
Question: How do I create an empty CSV file at this location using either a Script Task, SQL Query, or Space Magic? I have been searching all over for about 4 hours now to no avail.
I am downloading a webpage as a text file in order to read a specific string to assign it as a variable/parameter in order to create an output file name. I would like to know how would I be able to look for a specific string and output as another variable for the rest of the package.
2015 Conforming Loan Limits
------------------------------------------------------------------------
o _Loan Limits for Calendar Year 2015--All Counties _[XLS]
</DataTools/Downloads/Documents/Conforming-Loan-Limits/FullCountyLoanLimitList2015_HERA-BASED_FINAL_FLAT.xlsx>_ ,
_[PDF]
</DataTools/Downloads/Documents/Conforming-Loan-Limits/FullCountyLoanLimitList2015_HERA-BASED_FINAL.pdf>_
o _List of 46 Counties with Increases in Loan Limits for 2015
[Code] ...
To explain it a more better way, I have a sample webpage text here. I should be searching for "FullCountyLoanLimitList" appended by the current year (like FullCountyLoanLimitList2015) and copy the entire file name in the text file and assign it to another variable so that I can download that specific file using WebClient connection.
I can set the propperty of the checkpoint file to a local drive, but not to a UNC path mapping, mapping to my host server. (loop back)
Example: "I:FILEFILE1$InputArchiveOntwikkel " is possible as checkpoint file property.
S11487O$InputArchiveOntwikkel is not possible, though this is the same folder on the local host.
For data source both unc path and drive mapping are allowed. Why this difference?
I have a Stored proc which on execution, will generate data in the view .
My requirement is using SSIS, how can I create a Flat file pointing to this view ?
I have requirement like to develop dynamic package for inserting data from flat file to table.
Find below points for more clarification :--
1) if I changed the flat file values and name in source variable AND the table name should be also changed based on variable value .
2) it should dynamically mapped with column values with source file as we have to insert data in target table.
See below diagram for more clarification.
I have an SSIS package that creates a csv file based on a execute sql task.
The sql is incredibly simple select singlecolumn from table.
In the properties of the execute sql task I specify the result set as "full result set" when I run it I get the error that: Error:
The type of the value being assigned to variable "User::CSVoutput" differs from the current variable type.
Variables may not change type during execution. Variable types are strict, except for variables of type Object.
If I change the resultset to single row then I only get the first row from the DB (same if I choose none), If I choose XML then I get the error that the result is not xml. What resultset type do I need to choose in order to get all the rows into the CSV? The variable I am populating is of type string and is User::CSVoutput
I have an application in C# in which i have few events like download,Import and I have written all the code for that and its working fine but I have to schedule these processes so that I need not to run it manually daily. I am trying to write an Integration services package through which I could handle the required event, without rewriting the whole code.
Please Reply.
Thanks,
Pooja
bajaj.puja@gmail.com
Before we release an SSIS package into our test environment and then eventually into our production environment, we set the package protection level to "EncryptAllWithPassword"
The "View Code" feature is a nice tool to find things that might be buried in the package somewhere (e.g an complex expression to a variable).
PROBLEM : After one sets the package protection level to "EncryptAllWithPassword", one cannot see the xml source code any longer. It's like compiling and saving cs to the bin. Is their a way to view the code again??
We are using SSIS 2008 . A variable abc has been defined with sql script Select firstName,LastName from Employee.I need to edit the variable and add a where condition like SELECT firstName,lastName FROM employee where Name like '%Fr%' I tried to replace it with new script and saved also but when i ran the package it was still using the old sql script .
View 4 Replies View RelatedHi all.
I have a Application developed on VB2005 with the reports (processed local) from Microsoft Reporting Services 2005.
I would like to know how can i use the value of a variable to be displayed on a textbox on my report.
Thanks for the help.
Best regards.
dp
When I double click on dtsx package , i am getting XML code. I am unable to get the Graphical View. Recently I have installed Visual 2013.
View 6 Replies View RelatedI have tried with this thing for hours and I can't get it to parse.
Trying to get last year so the expression should evaluate today as of "12/31/2014"
I looked all over on Google and couldn't find an expression to copy so I've been playing with it.
Here is what it is in SQL Server:
SELECT DATEADD(dd,-1,DATEADD(yy, DATEDIFF(yy,0,GETDATE()),0))
Absolutely could not get it to parse..even with DT tags, etc...
Why the index value is used in variable mapping while using for each loop container. In one of ssis package I saw the index value as 2. What 2 indicates in index?
View 3 Replies View Relatedim creating an sql2005 integration services project ( DTS). i am creating a user variable. i want to be able to use that variable inside a script task. how do i reference the variable so that it can be seen within the script task??
View 2 Replies View RelatedIt's SQL 2008 R2. I need to bring data from Oracle using .Net Providers/ODBC Data Provider to MS SQL table converting Oracle UTC dates to PST. The source connection type cannot be changed as it's given. For the Destination I'm using the OLE DB.
As the truncate all and load could take time I'm trying to use a temp table or a variable to use it further with t-sql merge or not exists to bring/add the only new records to the destination table.
I'm trying different scenarios that is all failed.
Scenario A:
1. In DTF after OLE DB Source I'm using the Derived Colum to convert dates. It's working well.
2. Then use Recordset Destination with an object variable User::obj_TableACD. It's also working well.
3. Then I created a string variable with a simple query that I could modify later "select * from " + (DT_WSTR,10)@[User::obj_TableACD] trying to get data from the recordset object variable but it's not working.
Scenario B:
1. Created a store procedure to create a temp table.
2. Created a string variable to execute SP str_CreateTempTable: "EXEC dbo.TempTable". It's working well with the SQL Task with SQLSourceType as Variable.
3. Then how to populate the temp table from the Oracle source to bring data into the Destination?
I have created a SSIS package that runs several reports exporting the file output to a shared directory. Then I email these files as attachments to an email group. I got everything working so far. But when I checked the email there are only some of the attachments (3 out of 6 files).I have created a variable that uses an expression to concatenate several filenames and their paths separated with a "|". When I evaluate the expression it list all six files. When I use the variable in an expression when assigning the "FileAttachments" property in the Expressions tab in the Send Mail Task editor and I evaluate the expression, it only shows 3 out of the 6 files.
Each file name and path is less than 100 characters. Why is this task only grabbing 3 out of the 6 files. If I check the shared directory all 6 files are there. Also, there are two paths in the package that input into the Send Mail Task each creating a different set of report files. Only one of the paths files are getting attached. The connectors to the Send Mail Task are set as Evaluation operation: "Constraint" and the Value: "Completion". Under Multiple constraints I have selected "Logical AND, All constraints must evaluate to True".
I have one scenario. I am calling all columns result set to an variable and inside for each loop container using script task to get message about how many columns are coming in the loop.
At last using send mail task to send automated mails to group of people,but issue it is taking only person's mail id and coming out of loop.
how to call object type variable ?
Default code page in ETL package is 1252 which will not work if the collation is different e.g in Japanese_CI_AS, it is 932.
My question is how to write a generic ETL package so that it can cater any collation or any code page.
I have a requirement in which i have to create a custom .net class library for Ex:-I retrieve password(s) from a thrid party component. Below is what i am doing.
(1) Created a custom class library which reads a custom .xml file from a drive Ex:- "D:MyAppMYAppCofig.xml" and sets to my properties of my custom class library and inside it i created an instance of third party component's class and passed these values. Since i need to use this .net custom class library both in web and ssis/database side i am using this custom .xml file.
(2) After validating passed data (properties set in custom .net class library) the thrid party component instance object created in my custom .net class libraty returs a password to me own custom .net class libray.
(3) This password I use in my web app for connecting to database. This code is working fine.
(4) My question is how to execute a custom .net class library code through ssis and to use the my same custom .net class library and pass the password to my SSIS component / taks so that that code block also uses the returned password to connect and do any needed tasks? In other words how to use custom .net class library from SSIS.
My Environment is as follows:-
SQL Server is : 2008 R2
VS.NET 2013
I have created one variable name migration_start datetime which give me default format of 6/11/2015 1:26 AM...But I expecting to get in 2015-06-11 01:26:22.813 format.I have used below expression betting getting issue with that
(DT_STR, 4, 1252) DATEPART("yyyy" , @[User::migration_start]) + "-" + RIGHT("0" +
(DT_STR, 2, 1252) DATEPART("mm" , @[User::migration_start]), 2) + "-" + RIGHT("0" + (DT_STR, 2, 1252) DATEPART("dd" , @[User::migration_start]), 2)
I have enabled SSIS logging for a Package.
Is it possible for SSIS logging to output the value of a variable.
Currently, it is only outputting the name of the variable, such as:"User::FilePath"
I am having trouble finding the correct syntax to access a variable. I have a variable defined in the Variables window: The variable name is formatedDate. The DataType is String.
I am successfully setting the value of the variable in a Execute SQL Task. The SQL is as follows:
SELECT LEFT(CONVERT(VARCHAR, MAX(ReportDate), 120), 10) as formatedDate
from DimReportDates
The Result Set is set to “Single Row” and properly set up.
No problem so far. I can see with a watch that the variable has the correct value, something like:
‘2015-09-30’
Now, in a subsequent step, a Data Flow Task, I want to access the variable. Actualy it is in the SQL statement of a OLE DB source in the Data Flow… I have the following:
Declare @sDate smalldatetime
SELECT @sDate = xxxxx
I have tried several things substituting xxxxx above, but nothing seems to work. One variation was
@[User::formatedDate])
Another was
((DT_WSTR, 10) @[User::formatedDate]).
I think I’m close, but just can’t get it. What is the correct syntax.
So I have a Web Service that works just fine when I enter the parameter values myself. I get results and can parse it out, storing the results into a table. I even have it working in a "For Each Loop" for one of my variables. The issue I have is that the Web Service accepts 3 variables, the first being an Array. How can I populate the array variable for web service?
View 5 Replies View Related