Integration Services :: Querying SSIS Catalog Info
Oct 29, 2015
I've deployed a SSIS project (having some packages) on SSIS catalog and I've created a job to invoke the related packages. I'd like to query the SSIS catalog to get the info about the execution of the job to understand if it is completed with success.I've seen the tables internal.executions and internal.operations. Which of these two tables contains the more useful info about the execution job (f.e. the job name, the execution status)?
in order to maintain a deployed project into an Integration Services Catalog I'd like to know if it is possible to import it into a new project inside SSDT.
We run std 2008 r2. When I deploy and run a pkg from the catalog, how can I get that flat file system log we always instructed ssis to write to when we ran from the command line? I believe it was the /L param . Not sure at this point if i'll use sql agent or somehow employ task scheduler to kick off the pkg.
By my customer, the jobs scheduler tool is Control-M.
I haven’t seen information about the SSISDB catalog but just the “old/classic” deployment for SSIS package on a SQL Server through msdb in the Control-M Documentation.
I writing a new achitecture concept for this customer with the SSISDB catalog.
How Control-M can work with a SSISDB architecture?
CLR's not registered as SAFE are disallowed on our Network. It appears that the key associated with the assembly (ISSERVER) may be able to link to the Service Master Key. If the service master key is created with a (CA) Certificate Authority, is it possible to create the SSISDB that accompanies the Integration Services Catalog as a SAFE assembly?
[adding] BY CA meaning:
ALTER SYMMETRIC KEY [mykey] ADD ENCRYPTION BY CERTIFICATE [myservercertname]
I set up a connection to mysql using ADO.NET's ODBC Data Provider. And I'm running a simple query to return one table's maximum ID(int32 unsigned).But when I bind the result to a variable and excute task. It gives out error message: "An error occurred while assigning a value to variable "MaxAuditLogID": "Result binding by name "MaxID" is not supported for this connection type. " I tried to change the type of variable around but with no luck.
Hi All, I have a requirement where in for a given View name, I need to programatically find out all the tables that are used in the view and I also need to find out how each table in the view is linked.
For example, if I create a simple view like CREATE VIEW XYZ AS
SELECT * FROM TableA INNER JOIN TableB ON TableA.ID = TableB.FKID INNER JOIN TableC ON TableA.ID = TableC.FKID
I need to find out all the Tables involved in the view i.e. TableA, TableB and TableC. I also need to find out how TableA and TableB, TableA and TableC are linked (i mean the join Condition).
Could some one please point me to resources that can help me find the answer to this.
I am building an intranet application for my company .. similar to code generator
I am developing ASP.NET Application for this
1) How do I display list of SQL Server on the Network
2) Once I have list of SQL Server, I asked user to select once of the Server, provide credential for that server and obtain list of Database for that Server
3) Once I have list of Database, I need list of table under particular database
"SSIS 2012 Catalog doesn't have option to give read access to SSIS Catalog to view package run reports" ... Any luck allowing power developers / operators access to READ the SQL 2012 SSIS Execution Reports without granting them SSIS_Admin or Sysadmin?
According to this link posted back in 2011 (w/ Microsoft's feedback in Nov 2011: "We’re closing this issue as “Won’t Fix.” At this point the bug does not meet our bar for resolving prior to SQL Server 2012 RTM. As we approach the SQL Server 2012 release the bar for making code changes gets progressively higher." URL....Regarding Permissions to SSIS Catalog, here are the findings. We can give access in three ways:
1. READ Access – We can provide a user db_datareader access. With this the user can see the objects within the SSIS catalog database, but cannot see the reports.
2. SSIS_ADMIN – Add the user to this database role in SSISDB. With this the user can view the reports. But it also provides them privileges to modify catalog information which is not expected. We can add it using below script EXEC sp_addrolemember 'ssis_admin' , 'REDMONDPAIntelAnalyst'
3. SYSADMIN - Add the user to this server role. This will make the user an admin on the SQL server. This is not intended. Is there any method available which will have provision to give read only access to see SSIS Catalog package execution reports and not having modify Catalog access.
I've been trying to use Analysis Services 2005 Cube as a data source, query it via MDX and then use the data returned elsewhere in SSIS.
However, I've been unable to get this working and can't find any information regarding how this can be done. Surely it should be possible when I can get this working even in Excel?
I've looked in December edition of BOL and no luck - have also sent a feedback to BOL regarding this and have been told that "it should be possible, since there is a way to send SQL queries to AS." However the person I was speaking with knew of no one who had actually tried this scenario and to try posting here.
Any help as to how to get this done would be greatly appreciated.
I want to achieve the following in (SSIS/SSDT for SQL 2012) -
I have a generic SSIS package which simply sends out email notifications using SMTP email task (this package is within its own project, and has project level input parameters).
I need to be able to call this package in the Event handler section of every package (numbering in about less than 60) that we have. These packages are within their own respective projects.
I thought I could use the "execute package task", but it turns out , using this, I cannot call a package that is part of some other project. I also cannot call a package that is stored in the CATALOG. Is there any way I can do this ?
When I call the child package , I should be able to send in parameters like - error information and package name of the Parent package.
if there is any way to accurately size a single server using SSIS. The server will be a virtual machine. The data being loaded will be approximately 200 MB per load with loading to a 150 GB database on a separate server.
I have scheduled SSIS package through Sql Agent and when I right click on job start job as step package runs successfully but when I schedule job it dosent run.
Can anyone help regarding the SQL server integration Services(SSIS), ETL We have requirement like this: We have Live Database( LIVE_DB ) and Reports Database (REP_DB) I want to trasfer the few tables data from LIVE_DB into the REP_DB for end of the day using SSIS If any new records are added, updated or deleted in LIVE_DB, these should reflect in the REP_DB, Our requirement is not to delete the old data, we should append or delete or insert the new transaction data in REP_DB.
Thanks in advance, if anyone help me in resolving this issue.
I have a maintenance plan which consist db full backup and log backup ( in two subplans), I execute both on SQL agent, and both failed.The DB Log Backup : DB FULL BACKUP LOG:
I have a ssis package with an oledb connection using windows authentication. i want to understand when i promote this package to the server and add it to a job, then a user login to the server with sql server authentication and run this job. Which/what windows authentication this package gonna to use to connect to the server ?
I have installed VS community edition 2013 on a widows 7 PC. When I try to create a ssis package the ssis tool bar comes up empty.It just says "loading" on the panel .
Win 7 SP1 x64 PC. I installed SQL Server 2014 Dev Edition + Visual Studio 2015.
I'd like to create some basic ETL SSIS packages, and I worked very comfortably in 2008R2.
For 2014, I started with this tutorial:[URL]However, it says to go to Start->All Programs->Microsoft SQL Server->SQL Server Data Tools.
I did explicitly install SSDT when I installed VS2015. I also installed it separately. I see SSDT listed in Programs, and SSIS is running according to SQL Server Config Manager, and Services. Half of Microsoft's docs seem to be 2012 era, which is a shame because 2014 is out and it's nearly 2016...
how do I get to the GUI where I can design ETL packages?
We'll be using 2014 enterprise to populate some excel spreadsheets. We may not have the option of using ssrs so here is the question.
The excel spreadsheets have some pretty fancy heading structures, multiple tabs and in a few cases graphs that i'm sure are dependent on data sitting somewhere in the spreadsheet. The heading have variable info in them (eg FYxx where xx is a parameterized fiscal year, month names etc). Sometimes those headings have sub headings (with variable info) and so on.
Generally speaking how (if at all) do folks deal with this kind of excel challenge when limited to using ssis? I don't know if templates are going to be a good idea. I don't know if i'll be looking at a fair amount of c# etc code behind the scenes. I can be more specific depending on the feedback.
This is part of a conversion from 2 of the larger BI and statistical tools out there to the MS sql stack. Obviously with some shortcuts that we may wish we didn't take.
we have a table with xml column. This column has a large xml data . I am trying to use ssis to import xml from sql column (table a) to destination (another table).
steps which i did in ssis:
1. execute sql task:
fetch the xml column by query and store "full result set" into an object variable.
2. foreach loop:
select Ado enumerator option and select variable which has reset set of execute sql task. In variable mapping selected a new variable of type string.
when I run package I get below error:
"Error: ForEach Variable Mapping number 1 to variable "User::variable" cannot be applied".
Have Visual Studio 2008 R2 with SP 2 installed. Due to a merger we now have a MySQL database that we need to update from SSIS. Everything works except for the table insert or update. Would upgrading to SP 3 or SP 4 maybe useful with that?
We have installed the latest driver from MySQL. Have tried the ADO.Net and ODBC drivers with similar results when we try to update the database.
I have a ETL ( SSIS ) Process in which i am loading around 150 tables in each run. ( Truncate and Insert ). I have four packages each from different sources. ( Each package loads different tables and different numbers )These are run on weekly basis one after the other. Each package is taking around 60 to 90 minutes each. Now i want to track the progress of the ETL on my front End application.
We want this in two ways.
First Way : I need to show the user how much percent of ETL Process is completed
Second Way : I need to show the No of tables completed and how many rows have been completed in the ongoing table ( which is in process )
Im newto SSIS. I want to develop package for data validation.
FirstName
1. Mandatory field checking: if Null, reject the record 2. If field length > 50, then reject the record
SSN
1. If field length > 12, then reject the record 2. If SSN is not in valid format, issue warning and process rhe record without SSN value. 3. Valid format: 9 digit numeric values should present after striping off all non-numeric characters. 4. Only send 9 digits to MDM
Like these i have 30 rules. And I have to shop the error msg if the validation fails like "Mandatory feild is missing".
I'm unable to find a solution to this truncation error on google.This happens only on one field which has comments. The offending Excel row/column has text that was entered in two lines i.e they entered the data and pressed "enter" and wrote a new line in the same row.Im using an Excel file source in SSIS and an OLEDB Destination (SQL Server) but one column keeps erroring out and I have tried to do the following:
1) Change output column width in advanced editor (still errors)
2) Data conversion tool between the source and destination (still errors)
