Hi,
I want to create a Data Mining Plugin-Algorithmn that uses existing mining models in the current DB. Is there a way to get a AdomdConnection from within an (Managed) Plugin-Algorithmn? This Connection should point to the current SSAS-Database.
Regards,
Manfred
Good afternoon,
I'm doing a custom clustering plugin for text to pre-process ("clean" the texts), calculate weights, estimate the number of clusters (using the PBM index) and finally, do the actual clustering.
So... I've made each of these modules on C++ and I'm putting them all togheter on the plugin.
My database (MDB file) has only one table, with only two fields within: a key (auto-incremental) and a small text. What I intend to do is to get the text in each test case, store them togheter somewhere and call my classes to cluster these texts.
I'm trying to log the texts in a file (just a test) on the ProcessCase method, in the CaseProcessor class. I've did it with no problems with numerical data.
But when I load the MDB file on the Mining Structures Wizard, it says the content type of the field holding the texts is "Continous" and the data type is "Text". Actually, when I saw it I didn't really mind.
But when I run the mining model it gives me the following error: "Error 1 Error (Data mining): The data type of the Table1.Texto mining structure column must be numeric since it has a continuous content type (Content is set to Continuous or Key Time or Key Sequence). 0 0 "
So... How do I change this content type ? (the content type combobox on the Mining Structures Wizard couldn't the changed)
Can anyone help me on this, please ?
Thanks a lot.
Good morning,
Well... As I said in other topics, I'm doing a clustering plugin for text mining. I'm facing many problems and, with your help, solving them one by one.
First of all, thanks a lot again.
Well... I've made a clustering function that is actually working very well. But I'm exporting its results to a log file I use as an algorithm trace for debugging.
My clustering method returns a vector containing information of what cluster each register belongs. For instance:
vector[0] = 1 -> The register of index 0 belongs to cluster 1.
vector[1] = 9 -> The register of index 1 belongs to cluster 9.
vector[2] = 2 -> The register of index 2 belongs to cluster 2.
...
And so on.
But... I know that none of the Navigation methods receives a structure like this one discribed above. I only use it to log the results to debug the algorithm.
But how to pass this information (what register (or test case) belongs to what cluster) to the Navigation ?
Thanks a lot again, and any help will be very appreciated.
I'm stucked in a problem and I thought if you would be so kind as to helping me to resolve it.
I'm implementing a clustering algorithm plugin for text mining. I've already read the tutorials and sample codes provided by the MSDN Library.
Well... My problem is: I can't go through the data when the Predict method is called. I've read that this method implements the "core" of the custom algorithms. Here is a small snippet of my code for you to understand my doubt:
STDMETHODIMP ALGORITHM::Predict(/* [in] */ IDMContextServices* in_pContext,/* [in] */ DM_PREDICTION_FLAGS in_Flags,/* [in] */ IDMAttributeGroup* in_pPredAttGroup,/* [in] */ DM_CaseID in_CaseID, /* [in] */ ULONG in_ulCaseValues,/* [in] */ DM_ATTRIBUTE_VALUE* in_rgValues,/* [in] */ ULONG in_ulMaxPredictions,/* [in] */ ULONG in_ulMaxStates, /* [out] */ DM_ATTRIBUTE_STAT** io_prgPredictions,/* [out] */ ULONG* out_pulPredictions) {
for(UINT i=0;i<in_ulCaseValues;i++) {
DM_ATTRIBUTE_VALUE& dmattributevalue = in_rgValues;
ULONG iAttribute = dmattributevalue.Attribute;
if (iAttribute == DM_UNSPECIFIED)
continue;
double dblValue = ::DblContinuous(dmattributevalue.Value);
char buffer[129];
sprintf(buffer,"%f ",dblValue);
RENAN_Log::log(buffer);
}
return S_OK;
}
As you can see, I'm going through in_rgValues to get its values, but i'm only obtaining the first register of the table on the database. I need to roll over a kind of resultset so I could access all the registers I need. Is there any way to do so ?
I expected Predict() received a matrix containing all my data, but the only thing I noticed that could represent the data is that in_rgValues vector. So I can go through this vector, but it holds only the first register of the table in the database (that's what's being saved on my log). I need all of the registers in order to pre-process the data and implement my clustering algorithm.
Well... That's it... I would be very pleased if you could help me.
Hi
I had created a dataminig model using "Asociattion Rules " , as the model is now working i want to get the rules out of it , so I try the following query in SQL 2005 Managanment Studio and its working fine
SELECT NODE_RULE FROM [Credit Card Table].CONTENT
Now I have to do this through code so used following code from book "DataMining using SQL Server 2005" , but the code gives error in making connection and says
"Either VMWINXP/Adminsittrator dont have right on the database SmartRulesApps or database not exsists" , now i use same credentials to run query in SQL 2005 Managmnet Studio and its working ! can you guys give me some hint whats i done wrong . One more point I check the database secuirty folder for my database SmartRulesApps and it contains dbo but how can i add VMWINXP/Adminsittrator(which is already my system admin ) to this security users ? i tried but its not working. Please let me know any thing you find that can help , you can also send me email at razi_rais@yahoo.com
private void OpenConnection()
{
AdomdConnection con = new AdomdConnection("location=localhost;Initial Catalog=SmartRulesEngine;Integrated Security=SSPI");
// AdomdConnection("location=VMWINXP;Effective UserName=VMWINXP\Administrator;Initial Catalog=SmartRulesEngine;");
try
{
con.Open();
AdomdCommand cmd = new AdomdCommand();
cmd.CommandText = "SELECT NODE_RULE FROM [Credit Card Table].CONTENT";
cmd.Connection = con;
AdomdDataReader reader;
reader = cmd.ExecuteReader();
System.Collections.ArrayList lst = new System.Collections.ArrayList();
int i = 0;
while (reader.Read())
{
lst.Add(reader.GetValue(i++).ToString());
}
reader.Close();
}
catch (System.Exception exp)
{
}
finally
{
con.Close();
}
}
Good morning everybody,
I'm here once again asking for help. Here's my problem:
I have a table that I use in my text mining clustering third-party algorithm. The table is as follows:
ID: primary key (int)
ID_DOC: an ID I use to know from what document a term came from (int)
ID_TERMO: the term ID (int)
TERMO: the term itself (varchar(max))
FREQ: the term frequency, usually TFxIDF (real)
Alright... I need the term itself to do some visualization. What I want to do is to get each case's term and store'em on a vector<char*>. So I did some changes on the ProcessCase method. In this method the data (each variable of the case) can be accessed rolling over the case using a DM_STATE_VALUE* as follows:
DM_STATE_VALUE* xpto = (DM_STATE_VALUE*) rgValue;
for(unsigned int i=0;i<_cAttribute;i++) { // _cAttribute is the number of variables
double aux = xpto.r8;
//Do some calculation using aux
}
Alright... It works quite well when I only have real and int data types on the database. But how the get the term collumn (varchar(max)) ?
How to modify the DM_STATE_VALUE union to accept strings as well ?
Any clues are wellcome.
Thanks a lot once more,
-Renan
I have a code for Nearest neighbour algorithm, I want to build a datamining algorithm using that code..
I have the following link that includes the source code for a sample plug-in algorithm written in C#.
(managed plug-in framework that's available for download here: )http://www.microsoft.com/downloads/details.aspx?familyid=DF0BA5AA-B4BD-4705-AA0A-B477BA72A9CB&displaylang=en#DMAPI.
But i am confused on where to insert my algorithm logic?
Hi,
I spent the last days programming a managed datamining plugin-algorithmn for SSAS 2005 and have troubles with the Prediction-Method.
Die Prediction-Methode of the "Shell-Algorithm" leads to an error-message on execution of the prediction-query (Internal Error: Unexprected Error ... dmxpredict.cpp Row 205 ...).
Can anyone provide me with a very simple implementation of this Method which just says that for every output-attribute the first (discrete) state should be predicted with a probability of, let's say, 90 % ?
Best Whishes
Manfred
hi,
as we know we get clustering algorithm with managed plugin algorithm API
does anyone have developed any other plugin algorithm as i want to check what are the things that needs to be modified. i am not data mining algorithm developer but i just want to check where we have to make changes. i would be better if i get source code for algorithm other than clustering
ANOTHER PLUGIN ALGORITHM REQURIED??
thanks in advanced
Good evening everyone,
I'm following the steps of the tutorial on how to construct a managed data mining plugin in C#.
Once created the Metadata, Algorithm and Navigator classes I tried to register it on Analisys Service by running the XMLA template written on the tutorial but I got the following error:
Unable to retrieve a list of supported data mining algorithms. Make
sure you are connected to the correct Analysis Services server
instance and the Analysis Services server named localhost is running
and configured properly. You can continue with a default list of data
mining algorithms
The GUID in the XMLA is correct as so the service name. The SQL Server engine runs fine.
I noticed that when I run this XMLA, the file msmdsrv.ini is modified, so in DataMining/Algorithms session a new entry is correctly created, enabled and the GUID is also set correct.
I also tried to ignore the XMLA setting up msmdsrv.ini manually but it also didn't work.
The build process is fine, both DMPluginWrapper and the Shell are registered by gacutil and I restarted (also try to stop and start) the server.
Any ideas will be very appreciated.
Thanks,
-Renan
Good afternoon,
I've developed a clustering plugin for SQL Server 2005 but now I want to port the .dll so my algorithm can run on another machine. Both machines have SQL Server 2005 installed, but different versions of Windows.
What are the steps I need to follow to port the plugin ?
Any help will be very appreciated.
Thanks a lot once more,
-Renan
Hi!
I am working on an AS Algorithm Plugin . I want to debug it in the AS Server, but I cant figure out how it works. Now I every time install and deploy the plugin, but if I catch an exception, it just shows me the message, not the stack trace. Anyone, something friendlier method?
Sorry for my poor English!
Bye,
Laci
Hi,
I am creating a custom transformation component, and a custom user interface for that component.
In
my custom UI, I want to show the custom properties, and allow users to
edit these properties similar to how the advanced editor shows the
properties.
I know in my UI I need to create a "Property Grid".
In
the properties of this grid, I can select the object I want to display
data for, however, the only objects that appear are the objects that I
have already created within this UI, and not the actual component
object with the custom properties.
How do I go about getting the properties for my transformation component listed in this property grid?
I am writing in C#.
Hi,
I tried to create a lift chart with my custom plugin-algorithmn. The chart seems to be correct, but before it is drawn, an error occours:
Function ... Row 1 ... Column 43 ... cannot be used in this context.
(I've translated the key facts of this error message from german)
What did I do wrong?
Best wishes,
Manfred
Hi,
After I've written my first Plugin-Algorithmn, I have some general questions about the Managed Plugin-Algorithmn wrapper.
What does the Property "support" express in view of predictions? Is it the overall number of cases the found rule works for?
What's the difference between AdjustedProbability and Probability ?
There is a probability for a specific StateStatistic and one for the whole AttributeStatistic.
What does the latter one express? Perhaps the overall probability that the discovered rules will lead to correct results for this attribute ? Let's say I have two rules for an attribute. Rule A has a probability of 0.5 and Rule B has a probability of 0.66. What would be AdjustedProbability.Probability in the case? The mean of 0.5 and 0.66 ?
Best whishes,
Manfred
hello,everyone,I also met a problem.
I stoped the SQL Server Analysis Services first, and registered the GAC successfully,
then modified the msmdsrv.ini manually.In fact,I found the format of my msmdsrv.ini is diffirent from the one mentioned in the tutorial,it just like below:
<DataMining>
...
<Algorithms>
.
.
.
<MyCompany_Managed_Plugin_Algorithm>
<Enabled>1</Enabled>
</MyCompany_Managed_Plugin_Algorithm>
.
</Algorithms>
<Services>
...
<MyCompany_Managed_Plugin_Algorithm>
<ProgID>44503EAB-570E-4b25-A9F4-043949A7D78E</ProgID>
</MyCompany_Managed_Plugin_Algorithm>
...
</Services>
when i restarted the the AS,
some error information displayed in event viewer,
" can't load MyCompany_Mamaged_Plugin_Algorithm data mining Algorithm provider(ProgID,
can't create Algorithm Provider program for MyCompany_Managed_Plugin_Algorithm,
ProgID does not exist in the server configuration file"
I am confused by it and have not any idea to solve it.
some one can give tips?
thanks.
We have a large number of SPs in our databases and decided it was time to get some source control. I have VSTS team explorer installed and working in visual studio, but I cannot get the plugin for SSMS to work - it just says none in the current source control plug-in dialogue box - nothing when I drop it down either.
Any ideas what I am doing wrong?
Hi,
I've created a Custom Data Flow Component and added some Custom Properties.
I want the user to set the contents using an expression. I did some research and come up with the folowing:
Code Snippet
IDTSCustomProperty90 SourceTableProperty = ComponentMetaData.CustomPropertyCollection.New();
SourceTableProperty.ExpressionType = DTSCustomPropertyExpressionType.CPET_NOTIFY;
SourceTableProperty.Name = "SourceTable";
But it doesn't work, if I enter @[System:ackageName] in the field. It comes out "@[System:ackageName]" instead of the actual package name.
I'm also unable to find how I can tell the designer to show the Expression editor. I would like to see the elipses (...) next to my field.
Any help would be greatly appreciated!
Thank you
Hi,
I'm trying to enable Expression for a custom property in my custom data flow component.
Here is the code I wrote to declare the custom property:
public override void ProvideComponentProperties()
{
ComponentMetaData.RuntimeConnectionCollection.RemoveAll();
RemoveAllInputsOutputsAndCustomProperties();
IDTSCustomProperty90 prop = ComponentMetaData.CustomPropertyCollection.New();
prop.Name = "MyProperty";
prop.Description = "My property description";
prop.Value = string.Empty;
prop.ExpressionType = DTSCustomPropertyExpressionType.CPET_NOTIFY;
...
}
In design mode, I can assign an expression to my custom property, but it get evaluated in design mode and not in runtime
Here is my expression (a file name based on a date contained in a user variable):
"DB" + (DT_WSTR, 4)YEAR( @[User::varCurrentDate] ) + RIGHT( "0" + (DT_WSTR, 2)MONTH( @[User::varCurrentDate] ), 2 ) + "\" + (DT_WSTR, 4)YEAR( @[User::varCurrentDate] ) + RIGHT( "0" + (DT_WSTR, 2)MONTH( @[User::varCurrentDate] ), 2 ) + ".VER"
@[User::varCurrentDate] is a DateTime variable and is assign to 0 at design time
So the expression is evaluated as: "DB189912189912.VER".
My package contains 2 data flow.
At runtime,
The first one is responsible to set a valid date in @[User::varCurrentDate] variable. (the date is 2007-01-15)
The second one contains my custom data flow component with my custom property that was set to an expression at design time
When my component get executed, my custom property value is still "DB189912189912.VER" and I expected "DB200701200701.VER"
Any idea ?
What I want to accomplish is that at design time the designer can enter a value for some custom property on my custom task and that this value is accessed at executing time.
View 10 Replies View RelatedI am writing a custom task that has some custom properties. I would like to parameterize these properties i.e. read from a varaible, so I can change these variables from a config file during runtime.
I read the documentation and it says if we set the ExpressionType to CPET_NOTIFY, it should work, but it does not seem to work. Not sure if I am missing anything. Can someone please help me?
This is what I did in the custom task
customProperty.ExpressionType = DTSCustomPropertyExpressionType.CPET_NOTIFY;
In the Editor of my custom task, under custom properties section, I expected a button with 3 dots, to click & pop-up so we can specify the expression or at least so it evaluates the variables if we give @[User::VaraibleName]
Any help on this will be very much appreciated.
Thanks
1) We are writing a custome Source component for Oracle with OCI calls, Could some one please let me know how to Enable Error Handling for the Same,
2) Is it possible to write Custome Error Handeling Component for SSIS? if yes could you please help me on how to write it.
Thanks in advance.
Hi,I have a sql statement: SELECT [ItemName], [Startprice], [Percentreduction], [Quantityavailable], [PhotoURL], [proID] FROM [items] WHERE ([featured] = @featured) but I would like to add in 2 more where clauses. One is AND (aswell as) the current one, soWHERE ([featured] = @featured) AND ([Quantityavailable > @Quantityavailable) ?(@Quantity available value set to 0)(is that right?)and also I want another AND which is taken from another column. i.e:WHERE ([featured] = @featured) AND ([Quantityavailable > @Quantityavailable) AND ([numberclickedin< *the number from the numtaken column*]) So I guess my 2 questions are:1. is the format right for my custom sql statements.2. how do I get the number from the numtaken column to dynamically enter into the third statement? Thanks,Jon
View 7 Replies View Related
I have a custom DLL in C# which does a lot of calculations.
I need to use it in my DataFlowTask. I wanted to add it as a reference in ScriptComponent and use it from there, but I do not see my dll there.
The dll is sign but does not have Post-build event command filled in the properties of the project and my dll is deployed and installed to assembly.
What do I do wrong?
How can I use my dll in ScripComponent? Any other options? What am I missing?
Thanks.
Hi,
i used the custom sqlsitemapprovider which is in this web : http://msdn.microsoft.com/msdnmag/issues/06/02/wickedcode/default.aspx?loc=&fig=true#fig5 but in this sample they used sqlsitemapprovider as a default sitemapprovider i dont wanna use it as a default and i wanna send a paramater which is used to filter datas to that class. I modified that class and i can take a sitemapprovider back and i wanna show it a sitemappath data source programmaticaly. i wanna create an instance object of sitemappath datasource and i wanna bind it to that class and then i wanna add a treeview control to the page then i wanna bind it to the sitemapdatasource programmaticaly too..
Thanks for your attetion.
Regards...
If I hard code the select statement everything works fine.
<asp:SqlDataSource ID="SqlDataSourceZip" runat="server" ConnectionString="<%$ ConnectionStrings:MyConnectionString %>"
SelectCommand="SELECT * FROM [Station] WHERE ([ZipCode] = '80523' OR [ZipCode] = '80521' OR [ZipCode] = '80553' OR [ZipCode] = '80522' OR [ZipCode] = '80526' OR [ZipCode] = '80527' OR [ZipCode] = '80525' OR [ZipCode] = '80524' OR [ZipCode] = '80547' OR [ZipCode] = '80535' OR [ZipCode] = '80538' OR [ZipCode] = '80551' OR [ZipCode] = '80549' OR [ZipCode] = '80550' OR [ZipCode] = '80546' OR [ZipCode] = '80539' OR [ZipCode] = '80512' OR [ZipCode] = '80537' OR [ZipCode] = '80541' OR [ZipCode] = '80650' OR [ZipCode] = '80515' OR [ZipCode] = '80513' OR [ZipCode] = '80610' OR [ZipCode] = '80534' OR [ZipCode] = '80536' OR [ZipCode] = '80634' OR [ZipCode] = '80543' OR [ZipCode] = '80532' OR [ZipCode] = '80638' OR [ZipCode] = '80615' OR [ZipCode] = '80646' OR [ZipCode] = '80648' OR [ZipCode] = '80612' OR [ZipCode] = '80631' OR [ZipCode] = '80528')"> </asp:SqlDataSource>
Want to use a label control to return data, but can't find anything that works.
<asp:Label ID="zipLabel" runat="server"></asp:Label>
[ZipCode] = '80523' OR [ZipCode] = '80521' OR [ZipCode] = '80553' OR [ZipCode] = '80522' OR [ZipCode] = '80526' OR [ZipCode] = '80527' OR [ZipCode] = '80525' OR [ZipCode] = '80524' OR [ZipCode] = '80547' OR [ZipCode] = '80535' OR [ZipCode] = '80538' OR [ZipCode] = '80551' OR [ZipCode] = '80549' OR [ZipCode] = '80550' OR [ZipCode] = '80546' OR [ZipCode] = '80539' OR [ZipCode] = '80512' OR [ZipCode] = '80537' OR [ZipCode] = '80541' OR [ZipCode] = '80650' OR [ZipCode] = '80515' OR [ZipCode] = '80513' OR [ZipCode] = '80610' OR [ZipCode] = '80534' OR [ZipCode] = '80536' OR [ZipCode] = '80634' OR [ZipCode] = '80543' OR [ZipCode] = '80532' OR [ZipCode] = '80638' OR [ZipCode] = '80615' OR [ZipCode] = '80646' OR [ZipCode] = '80648' OR [ZipCode] = '80612' OR [ZipCode] = '80631' OR [ZipCode] = '80528'
something like this, but it don't work.
SelectCommand="SELECT * FROM [Station] WHERE (<%=zipLabel.Text%>)"> </asp:SqlDataSource>
Im in the process of trying to teach myself SqlServer, comming from Oracle. How the heck do I get the equivlent of %ROWNUM pseudo-column in SqlServer? Top just isn't doing it for me.
Oracle Example wrote:
Select * from foo where foo%ROWNUM > 10 and foo%ROWNUM <20;
Not sure where to post this as it may be a form operation but here goes...I want to generate a custom unique identifier for a table similar to the Northwind Customers database (ie ALFKI, ANTON, etc...) which can be used as a descriptive identifier as well. For example, I have a Products table and I want to have my keys look like: CHR-0001-05."CHR" is my abbreviation for Chairs"0001" is the auto-incrementing number (in this case the first record of the table)"05" is the last 2 digits of the year recieved (2005)Can somebody please point me in the right direction? I'm having problems finding resources on the web relating to this topic (prolly not using the correct keywords for my searches)Cheers =)
View 1 Replies View RelatedWould anyone be aware of anyplace I could find some good information on creating DTS custom tasks? I've come across a couple of articles from SQL Server Magazine, but nothing too substantive...
Better yet, if anyone has any success (great or small), I'd like to hear from you and hear some of the things you did, what your custom task does, difficulty.
I'm just trying to get an idea of how much work I have ahead of me....
Thank You...
Hi guys.
I want to create a top 20 product list from a few thousand products. I want the rest of the products to be grouped into 'others'...
I also want the products to be ordered by the facts in the cube. Thus the product dimension would dynamically change depending on the Time dimension thats being selected.
is this plausible ?
Thanks
Tom
I've created a custom task in VB6 and compiled the DLL. wHen I run the task in DTS designer as a step it runs ok, however when I try to exectue the whole package nothing happens??
View 1 Replies View RelatedHi All!
I was thinking of creating a custom generated IDs for my table. I would like the ID to be something like "HR001" or "IT001", the two letter prefix would indicate the dept it belongs to. Initially I thought of having a table that will hold all the seed values for the IDs but I realize that this could have some concurrency problems if there will be a multiple number of users are creating a record at the same time. So now I have totally no idea on how to deal with the concurrency problem.
I will not be using this as a primary key because I already have the Identity field to be my primary key, though of course this field would definitely be unique. I will just be using this to display in the UI.
Any inputs would be greatly appreciated.
Thanks!
Hi,
I am showing my report in the web application using Report Viewer control.In the report i have start date and End date parameters.While running the report if i give startdate as '45/66/20007' it is displaying a message which is not user friendly.Is there is any way we can handle this type of errors and display our own custom error messages.
Thanks in advance