Is it possible to import the SSIS workflow diagram into visio? Is there a way to extract the images and import them into SSIS for use with creating a workflow, or better yet, is there a way to re-engineering the workflow in SSIS with Visio?
For an initial step, I would like to re-create the SSIS workflow in Visio for presentations.
Dan
Hi, all experts here,
Thank you for your kind attention.
Data mining add-in for Office Visio 2007 is great. But what I am concerning is-to end users (to technical users) how could we deliver the data mining models results in a better way (e.g. integrate with other possible clients ) to make it dynamically and easily undertood?
Hope my question is clear for your help.
With best regards,
Yours sincerely,
Programmatically generating HTML visualizations of models using DM Add-ins the thread in sqlserverdatamining.com contains a code block listed below. This code doesn't work it fails in the statment : "helper.DrawDecisionTree(helper.ActivePage, parameter);" . It says "Visio rendering failed"..
I didn't understand the part "parameter.ConnectionName = "AdventureWorksConnection";" in the code block. Which type or object is expected by parameter.ConnectionName ? An Adomdconnection or Oledbconnection. Type is string but does it expect us the name of connection? Please help me because i didn't figure out the solution.
By the way i'm using Visio2007 and installed everything which has told in the article and added as reference.
Code Block
using System;
using System.Collections.Generic;
using System.Text;
using System.IO;
using Microsoft.SqlServer.DataMining.Office.Visio.Programability;
namespace DMDigramUsingViso
{
class Program
{
//This is the folder where the data mining addins have been installed.
public const string DMAddinInstallPath = @"C:Program Files (x86)Microsoft SQL Server 2005 DM Add-Ins";
//This is the name of the Visio template file for the data mining addins.
public const string VisioTemplateName = @"Microsoft Data Mining.vst";
//This is the name of the target HTML file.
public const string WebFileName = @"TargetMail.htm";
static void Main(string[] args)
{
try
{
string visioFile = DMAddinInstallPath + "\" + VisioTemplateName;
string webFile = System.IO.Directory.GetCurrentDirectory() + "\" + WebFileName;
Console.WriteLine("DM Addin install path : {0}", DMAddinInstallPath);
Console.WriteLine("Visio Template : {0}", VisioTemplateName);
Console.WriteLine("Output : {0}", webFile);
//----------------------------------------------------
// Create the parameter object for the decision tree
// drawing and populate the required parameters
//----------------------------------------------------
ParameterDecisionTree parameter = new ParameterDecisionTree();
//Friendly name for the connection
parameter.ConnectionName = "AdventureWorksConnection";
//Name of the Analysis Server
parameter.DataSourceName = "localhost";
//Name of database
parameter.CatalogName = "AdventureWorks";
//Name of the mining model
parameter.ModelName = "Target Mail";
//Name of the decision tree predictable
parameter.TreeName = "Bike Buyer";
//Flag to hide the progress dialog
parameter.Silent = true;
//----------------------------------------------------
// Optional properties for the parameter object
//----------------------------------------------------
//Shade tree nodes using support
parameter.GradientType = GradientType.SupportGradient;
//Show support in the nodes
parameter.ShowSupport = false;
//Fill color for the nodes
parameter.FillColorArgb = System.Drawing.Color.Aqua.ToArgb();
//Fill pattern color for the nodes
parameter.PatternColorArgb = System.Drawing.Color.Azure.ToArgb();
//----------------------------------------------------
// Drawing helper object which performs the actual rendering
//----------------------------------------------------
DMDrawingHelper helper = new DMDrawingHelper(visioFile, false);
//Start the Visio application
helper.Start();
/*
Helper object allows access to Visio object model using the following methods:
helper.CreateNewDocument();
helper.CreateNewPage();
helper.ActiveDocument;
helper.ActivePage;
helper.Application;
*/
//Render the decision tree on the current active page
Console.WriteLine("Rendering decision tree using the visio engine...");
helper.DrawDecisionTree(helper.ActivePage, parameter);
//Convert all the pages of the drawing to HTML
Console.WriteLine("Converting to HTML using the visio engine...");
helper.SaveDocumentAsWebPage(helper.ActiveDocument,
-1,
-1,
webFile,
DMDrawingHelper.ShowNavigationBar | DMDrawingHelper.ShowPanAndZoom | DMDrawingHelper.ShowPropertiesWindow | DMDrawingHelper.ShowSearchTool);
//Close the Visio App
helper.Close();
Console.WriteLine("HTML File is generated at : {0}", webFile);
}
catch (Exception ex)
{
Console.WriteLine("DMDigramUsingViso Error : {0}", ex.Message);
}
}
}
}
Hi
Can any one provide sample for work flow in SSIS . and how to excute package conditionaly like if package1 is sucess then excute package2 else excute package3 .( more like writeing batch file in Data Stage ETL Tool ).
Thanks & Regards
Jegan.T
Hi all,
I am looking for any information about using SSIS as a workflow automation (job engine) tool. My company is looking into buying a 3rd party app to do our job scheduling and I think that SSIS could do all that we need. The only issue they found with SSIS is the lack of a GUI/dashboard to view all jobs at once. We need more flexibility than the job scheduler in SQL Server Agent will allow. I have heard that it is possible to build a C# GUI app that can serve as a job engine front page.
What we need is a way to view all jobs in the system and be able to start, stop, pause all jobs manually in a graphical interface. I know of a few companies that are doing this but I am unable to find anything on line about it. My bosses are ready to give SSIS a shot if I can prove that we can build such an interface. Does anyone have any first hand knowledge of such an application or have any tips on where I should look?
Thanks in advance!
-- Craig ***
I have a "Execute DTS Package 2000 " task in SSIS. The SQL 2000 DTS has one task which precedence is "completion". Using SQL2000 it works properly, but when I invoke it from SSIS it doesnt respect the precedence. So, when the task above fails it ends the DTS execution.
Is it possible to configure the task to respect the precedences?
Hi,
I wants to import data using DTS package from Excel 2007. I have tried this by using DSN but i'm not getting Excel 2007 types.
Please suggest me how to Connect to Excel 2007 using DTS package to import data.
Thanks!
Has anybody seen this? Is there a configuration setting or something that needs to be changed?
Working with the development version of SQL 2005 that comes with Visual Studio
Problem: I can't seem to get IS to work with Excel 2007 files. I've tried both BIDS and Import/Export Wizard
I've got the connection set to use ACE
The datasource is: c:BranchList - 20080331.xlsx
the extended properties property is: Excel 12.0;HDR=Yes
Test connection succeeds
Preview succeeds
If I save the Excel file as tab-delimited text, BULK INSERT succeeds
But trying to run the package against Excel I get this error, over & over. I have not yet been able to get SQL2005 to import Excel 2007 data
TITLE: SQL Server Import and Export Wizard
------------------------------
Could not connect source component.
Error 0xc0202009: Source - 'Branches $' [1]: An OLE DB error has occurred. Error code: 0x80004005.
Error 0xc02020e8: Source - 'Branches $' [1]: Opening a rowset for "`'Branches $'`" failed. Check that the object exists in the database.
------------------------------
ADDITIONAL INFORMATION:
Exception from HRESULT: 0xC02020E8 (Microsoft.SqlServer.DTSPipelineWrap)
Hi Folks,
I have got a quick question, Is it possible to use office 2007 in SSIS, If so what would be the driver?
or Could we use JET 4.0 itself?
Any thoughts and help in this regard would be appreciated.
Zulfi.
Help! My network support staff just upgraded my MS Office products from Office 2003 to Office 2007, and now I no longer get the "F5 = Run" option in Microsoft Visual Studio to run any of my SSIS packages that ran just fine yesterday, before the upgrade.
The "Debug" option does not occur in the menu choices across the top of the screen. (They are File, Edit, View, Project, Build, Data, Format, SSIS, Tools, Test, Window, Community, and Help -- no Debug.)
I store my packages in the File System. I can run many of them just fine, even today, with the Execute Package Utility. My problem occurs when I try to run them in Visual Studio.
Even if I make a simple, new package that moves a table from Access 2003 to SQL Server 2005, I see no Debug menu selection option when I am finished with the new package.
I figure it must be something simple -- I just don't know where to find it in the Visual Studio menu.
Most of the packages I am trying to run do not access Office files: they access dBase 5 files (database); they run processes on SQL Server 2005 servers. I realize that I may have to make some adjustments to connections to Access databases, should such databases be upgraded to Office 2007.
Thanks in advance.
Dan
When I connect to an Excel 2007 workbook using the new Microsoft.ACE.Oledb.12.0 provider in SSIS 2005, I notice that any tables that I've created in the worksheet are not recognized in SSIS.
In the OLE DB data source component (using the "Table or View" data access mode) the any table(s) I've created are nowhere to be found in the drop down list. Similarly, when I constuct a simple SQL query on the workbook, such as "SELECT * From MyTable" it returns the error:
Microsoft Office Access Database Engine
Hresult: 0x80004005
Description: "The Microsoft Access database engine could not find the object 'MyTable'. Make sure the object exists and that you spell its name and the path name correctly."
I know I have the name right -- I can use structured references to my named table in the worksheet without any problems.
Does the new ACE provider not support Excel 2007 tables? Am I stuck with using "overlapping" cell references to capture data from tables in my worksheet?
Hi
everybody.
I am new to VBA,.,, I Have created a folder under inbox in Outlook 2007 which stored the receipients information
like name, E-mail, which is not present in the address book of outlook.
I have imported this folder in access 2007. My problem is ... it does not display the email address.
Rest of the informations is displayed... Is there any way i could do this.??
is there any way i could get the email addresses to appear(import/get) in to the access table???
Is there any module i mite have to create??
Plz help...
thanks a million
Hello,
I made a package in SSIS to copy some data from SQL server 2005 SP2 to Excel 2007. The package works fine, but generate errors. If I replace the OLE DB destination for Excel 2007 with a Excel destination for Excel 2003 then they errors don't appear. The problem is that I have to use Excel 2007 because the data contains more than 65000 records. I thought maybe it was to much date, but if I limit the amount of data with top 100 it also generate errors.
The errors are:
SSIS package "Package.dtsx" starting.
Information: 0x4004300A at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Execute phase is beginning.
Information: 0x40043008 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Post Execute phase is beginning.
Error: 0xC0047018 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: component "Source Declaratiegegevens uit NZDF op NED_NDFSQL01" (1) failed the post-execute phase and returned error code 0x80004002.
Error: 0xC0047018 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: component "Source Declaratiegegevens uit NZDF op NED_NDFSQL01" (1) failed the post-execute phase and returned error code 0x80004002.
Information: 0x40043009 at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: Cleanup phase is beginning.
Information: 0x4004300B at Declaratiegegevens NZDF naar Excel, DTS.Pipeline: "component "Destination Excel 2007" (142)" wrote 353858 rows.
Warning: 0x80019002 at Package: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (2) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "Package.dtsx" finished: Failure.
I hope someone gots a answer...
Thanks in advantage!
Michaƫl
I am in the process of creating another database for one of our departments, I'm creating a diagram of the structure in visio 2003. I'm done with the diagram but when I try to export to sql it wont let me. Anyone ever had this problem before??
This is the Error message I'm getting
ODBC Error: 01000
[Microsoft][ODBC SQL Server Driver][SQL Server]Warning: The table 'Audit_Tbl' has been created but its maximum row size (20070) exceeds the maximum number of bytes per row (8060). INSERT or UPDATE of a row in this table will fail if the resulting row length exceeds 8060 bytes.
Can anyone compared these two products for database design, documentation,... features, or know where I can find such info?
View 1 Replies View RelatedOk, I have the following table
CREATE TABLE employees (
employee_number char(6) NOT NULL
, known_as char(20)
, surname char(20)
, job_title char(20)
, manager_number char(6) NULL
, unique_identifier char(6) NOT NULL PRIMARY KEY
)
--unique_identifier is in the format 000123456789
Now I have a conundrum when trying to create organization charts in Visio, so I figured I'd try reproduce the format that a bunch of walkthroughs suggest, which is with the first column being an int identity(1,1) column as the employeeID with the managerID being an int column also, referencing the employeeID.
Hope I've not lost you just yet ;)
So here's what I figured - create a new table with the new integer columns, slap my current data into it and then update the managerID as necessary...
Except I can't work out the update statement for this!
CREATE TABLE gvVisioTest (
employeeID int identity(1,1)
, employee_number char(6)
, job_title char(40)
, department_reference char(10)
, managerID int
, manager_number char(6)
)
GO
INSERT INTO gvVisioTest(employee_number, job_title, department_reference, manager_number)
SELECT employee_number, job_title, department_reference, manager_number
FROM employees
GO
--Update managerID with relevant employeeID
GO
DROP TABLE gvVisioTest
Any ideas?
Oh and this is legacy so the design is flawed, modified over time (the manager field is a bodge put in 5 years ago), so yeah unfortunately I have to work with what I've got :(
Hi. I need to import excel file in database. i first need to do an unpivot task. the column names are dates and SSIS seems to be unable to pick up the column name as it is replaced by F2 F3 F4etc Can you advise of a solution. thanks ken
View 1 Replies View RelatedHello,
I'm trying to use Visio 2003 Enterprise Architect version to do a basic dB table design. Can someone please help me out with the following questions:
1) how can I set a column to "auto-increment", with a seed value, and the increment amount?
2) once I've drag and dropped an Entity from the stencil onto the design surface and selected it, what is the difference between:
a) clicking on a column name, select Edit, select Check tab, and enter the check constraints, versus
b) clicking on "Check" under Categories, select Add (actually I'm not quite sure what to add here)
Thanks
I am trying to generate a report from the database. I am using Visio 2010. I would like to include the table names, column names , column types and the comments that I entered in the NOTES field associated with the tables and columns. Basically, I would like to generate a data dictionary report.
View 2 Replies View RelatedHi all,
I am having data model diagram containing 150 odd tables in MS Office Visio 2007.The Datamodel Diagram even has the Relationships between the Tables.
Do we have any Procedure to export the Datamodel Diagram from the Visio to the Sql Server carrying all the relationships.
We are having the reverse engineer procedure to export database diagrams from Sql server to the datamodel diagram in the Visio in the same way, do we have any procedure to Export DataModel diagram from Visio to SQL Server to create tables with all the relationships?
I'm running Visio 2003 on Windows XP with SQL Server 2005 Express rather than MSDE. Is this configuration supported? If yes, how does the SQL database get built since SSADMIN.exe (delivered with the Visio SDK) does not detect an MSDE compatible database when SQL Server 2005 Express is not installed?
View 5 Replies View RelatedHi,
i want to do the physical modeling using MS Visio. Whether is it availble with Microsoft Visual Studio 2005 or not?? If Yes, Could you please asssit what necessary loaded with Studio and Version Details.
Amirineni
Hi there,
I cannot seem to find a way to export a database model from Visio to Sql Server.
Can somebody provide a walkthrough how to export it?
Thanks a lot
Hello!
I'll try to explain what I'd like to do. On my SQL Server 2005, SSAS contains a mining model (In fact a cluster one).
I'd like to show a detailed diagram build from this model on a web site. This diagram (and this is why I need automation) would depend on the user who's consulting it.
For example, a firm A will see the number of its customers in each cluster, and this information will be different for another firm B
So, I thought about several steps to perform:
1) Feed the model with the data for each firm
2) Build a Visio diagram from the previous data using the DM addins for Visio 2007
3) Generate HTML using the Visio export wizard
4) Publish HTML
And (important) this should be done automatically.
I made some experiments:
Step 1 is easy to perform with SSIS
Step 3 is also easy to do with the Visio SDK (using, among others, the exportAsHtml control) and Step 4 is trivial
I failed to perform stage 2, even with the SDK, since creating a diagram from a DM template requires the user to fill a wizard. By code, I'm able to create a document from a DM template, Drop a DM Stencil but when the wizard appears I'm unable to get a handle on it. And even if I was, I dunno if it would be a "clean" way of doing.
So my question is: first of all: isn't there an easier way to generate HTML from Mining Models automatically? And if my approach to this problem is the best (or the "least bad"), how to generate datamining Visio diagrams from code automatically?
Hi all,
I've got a DTS job which has lots of tasks in it. I've also got quite a few flows of workflow and i've noticed that a task won't execute if it has both Failure and Success workflow pointing to it... It can have multiple failures pointing to it and it will execute but it can't have multiple successes or a combination of workflows...
Does anyone know a way to get around this or to change the 'AND' ing that seems to be on the workflow going into a task..
Thanks.
Howdy,
Now this one I don't think will be fixed by changing the length of a variable.
Anyway, In this nifty DTS package I've created I have it set so that on the failure of an SQL task DTS should send me an e-mail letting me know it failed. The SQL statement in the DTS task is "EXEC WEB_Check_Files". In the Stored Proc I then call RAISERROR w/ a user defined error message w/ severity 10. When I call RAISERROR the DTS packages logs everything just kosher but skips past the "on fail" e-mail message. It refuses to execute it and don't know why. Spent the last hour or two going through docs looking at RAISERROR. Tried RETURN 1 to see if that would do anything and nadda. I also don't have "Fail package on first error" checked.
Don't know if it matters but I'm executing the package through the "play" button in Enterprise Manager.
So... anyone got an idea? I'm fresh out.
Yall rock!
Thanks,
Me
I hope I've done due dilligence before posting for help. I've combed a lot of Google and dBforums search results with no luck.
Anywho, this *seems* like it should be simple: I have a Transform Data Task, into which I've introduced deliberate errors, followed by an ActiveX Script Task that is supposed to fire based on the failure of the Data Transform Task. The second task is joined to the first via an "On Failure" workflow step.
The problem: The second task never fires. The first task fails as expected, but the second one just shows the "Not Run" indicator in the package results after executing.
Here is a graphical illustration of the package and results: http://www.bountifulware.com/blogs/rex/dtsproblems.html
I've experimented with the transaction settings in the package properties, as well as the transaction settings in the workflow properties of each step. I don't particularly want the package as a whole to be couched in a transaction, but if that is part of the equation for making the "On Failure" step fire, I'll happily go along. Also, in the Data Transform task with the deliberate errors, I have the max error count set high, as I want the task to continue logging errors for each record that chokes. I've tried various settings there as well, however.
Thank you in advance -- I'll try to contribute more and leech less after this.
I would like to build a workflow system where 100 processes are requesting an item from a ~1.000.000 items large DB, process that item and move it to the next state. The problem with the current implementation I tried is that I get deadlocks....
The DB table looks like:
CREATE TABLE Transactions(
itemid CHAR(32),
status TINYINT not null default 0,
result INT not null default 0,
lockby TINYINT not null default 0,
.... (etc.)
PRIMARY KEY(refno)
);
CREATE INDEX IxStatus on transactions (status)
Each process (with his own ID) is doing 4 step:
1) update transactions set status=1, lockby=<ID> from
(select top 1 itemid from transactions where status=0) as t1
where t1.itemid=transactions.itemid
2) select itemid from transactions where status=1 and lockby=<ID>
3) process item
4) update transactions set status=2,result=<RESULT> where itemid=<ITEMID>
Does anyone has a suggestion on how to do this?
I know the idea was to seperate workflow and dataflow, but I have come across a scenario where it would be useful for a branch of a dataflow to wait until another branch has finished.
I have some transactional data which records events for the start and end of a session. I want to build a list of unique sessions with the start and end date. I currently have the list of events sorted by time, followed by a conditional split for the start and end events. I can then insert all of the start events and would like to wait until all of the starts are inserted before updating them with their relevant end times.
Is this achievable?
Does anyone else think it would be a good idea to be able to set precendence across multiple branches of a data flow?
Does anyone have a better solution?
I know this is the wrong forum, but is there a way to model this against the transactional data in SSAS, I will move this question to the SSAS forum if anyone can think this would work!
Philip Coupar
Hello,
I have a SQL Server 2000 DTS package in which the first step executes a batch file. The batch file contains FTP commands that log into an FTP server, and pull down whatever file is there.
I set up a failure workflow to send an email if the step fails. When I have a SQL Server job run this package, and there is no file to dowload, the whole package fails without the failure workflow result firing.
For the step (DTSStep_DTSCreateProcessTask_1), I have the 'FailPackageOnError' property set to -1. In the package properties, I have the check box for 'Fail Package on First Error' cleared.
What do I need to do so that the failure workflow occurs when the step fails?
Thank you for your help!
cdun2
Trouble with Workflow
Hello. I have a DTS package that executes some tasks of the type "Execute Package Task".
Every Task has a Condition of been executed just in case of success. I understand that only if the precedent task ends successfully the next one would be processed. My problem is that the DTS continues even if one of the previous steps fails. Would you have any idea?____________________________________________________________________
My escenario is something like this:
EP: Execute Package Task
ES: Execute Sql Task
______ _____
EP# 1 (on success) ----> EP# 2 (on success) ----> ....
______ _____
So, EP#1 fails but EP2# is also executed.
Hi,
I have 3 data flows connected sequentially on my workflow before processing dimensions and facts which checks data from different databases and if conditions does not meet then writes to log table. So if it writes to log table , I have to quit and finish the workflow.
How can I do that?
thanks,
J
i created a DTS package in SQL 2000 using the enterprise manager.
I have defined a SQL task to drop some temporary tables on failure of another SQL task. Also the same temporary tables need to be dropped on success of another task. the on success workflow is working fine. but when i add the on failure workflow to the temporary table dropping task, the temp table droppin is not getting excuted at all either for success nor for the failure. please help me out.