Folks,
I need help with this task. I have a set of data that needs to be plotted on
timeline chart.
Example:
Unit ProcStart ProcEnd Machine
U1 5/5/03 6:01 5/5/03 6:04 M1
U2 5/5/03 6:03 5/5/03 6:05 M1
U3 5/5/03 6:03 5/5/03 6:04 M2
:
etc. There are about 40K units and 30 serving machines. The data is in
MSAccess / SQLServer. My overall task is to plot concurrent processing at
each machine at each 1-minute interval.
Example for M1:
count
3|
2| * *
1| * * *
|______________________________
6:01 6:02 6:03 6:04 6:05 6:06
My thought is that if I can break down each row of data into smaller
timechunk, then I can do grouping and counts based on the new data -- which
is something like:
Unit ProcTime Machine
U1 6:01 M1
U1 6:02 M1
U1 6:03 M1
U1 6:04 M1
U2 6:03 M1
U2 6:04 M1
U2 6:05 M1
U3 6:03 M2
U3 6:04 M2
Then I was thinking to do query with: Machine, ProcTime, Count(Unit). Then I
can export the data into Excel and plot it.
My questions:
1) How to break the original data into smaller chunk timeframe (i.e. query,
stored procedure, etc.)?
2) Is this a sound approach? Any suggestions for better idea to achieve the
task?
hi I am new at MSSQL 2000 DBA thing. and trying to learn more about analysis service/data warehouse/data mining. so is any expert out there can Recommend some good books or web link article to read? Thanks
I have a task on my table, and Im not really sure how to do this in MS SQL 2005.
The customer wants to import data from an oracle db to a sql server 2005, this is easy. Then the customer want me to allow them to implement a few business models on top of this data... and allow them to run various simulations. The data is financial, so they already have some financial business model they want to implement in MS SQL Server 2005.
Is there some sort of service in SS 2005? I was thinking about reporting and analyzis services, but I have never worked with those before... would they solve the puzzle for me? One keyword in the request was "interative simulation"... they want to be able to play with the data and to see what changes to certain constants in the model produce the best output...
When all this is done, they want to push this data back into Oracle.
To me this sounds like Data mining and business intelligence using OLAP cubes etc. Or what do you think? Is there an easy way to do this in SS 2005? Any suggestions is helpful
I need to use cubes in VS 2005 web project. I have no clue how to create cubes or use them in my web page. I am familiar with Reporting Services but not cubes. thanks in advance!
I use MSsql server 2000 and analysis service for create cube.But when I drilldown many Dimension on Analysis manager it can not show all level. If I drilldown some level it can show data but when I drilldown many level so it have many row (I test about 60,000) it can not show result. How can I show all result in Analysis manager or other tool ? Thank you :D
Hello everyone, this is my first post here so hopefully I am not asking a common question.
I am trying to create a flat dataset in SQL 2005. Basically I run a query and I get multiple rows for the same primary key. The query I am running is quite large and has several different tables connected to it, here is a small sample of what it looks like...
Typeid(Primary Key) Individual Address
1 Sam 912 Ave. J
1 Sam 913 Ave. Q
1 Sam 914 Ave. R
2 Mike 1000 Ave. O
3 Jill 1001 Ave. O
I want it to kind of look like this
TypeID Individual Address_1 Address_2 Address_3
1 Sam 912 Ave. J 913 Ave. Q 914 Ave. R
2 Mike 1000 Ave. O
3 Jill 1001 Ave. O
As I said before, this query is pretty big, and has several variables like Address where multiple rows are being taken by one Primary Key.
If it is not possible to do this in SQL 2005, is there a program that may be able to? Right now we are using SPSS as sort of a bandaid... we run the query in small portions like the one in the sample and then restructure the in sections but this takes several hours.
Anyways, thanks for any help that you may be able to provide.
I have an existing MDX query returning the correct resultset. However, I want to add a filter so that for a combination of value in Hierarchy1 and Hierarchy2, the data is filtered out.
For example I have data like
H1 H2 Amount 1 1 100 2 1 50 3 1 45
I am getting a value of 100+50+45=195.
I want to filter the data for the combination H1=3 and H2=1. Expected result would be 100...
Does anyone out there know a way to export data from the results pane in the Analysis Manager to Excel, or even text? I had thought this would be simple and intuitive to accomplish (after all, it is reasonable to think they would assume you would need to display the results of your analysis), but have found it to be neither. Your help is much appreciated.
I have a problem to browse the data in analysis server, it displayed: unspecified error, my os is windows xp with sp1 and sql server2000 installed, Do i need to install AS SP3 on the server, but, what are AS SP3 stand for, any other solution?
I have a 40 MB database in excel format.I need to use it in Analysis Services, I imported the data by DTS (DataTransformation Services), everything is working I can see the database,but I can't load it in the analysis services.I have to construct a cube but I can't see the database in any way Itried.Thank youI hope my message is quite clearHope to find somebody that can answer me in Italian, but English is goodas well.
What I need to be able to do is somehow select based on a day, the total value of open orders. I have tried to do this in the database but it becomes fixed and quite cumbersome (this is a simplified example in reality i have line information and line component information).I am not hugely skilled with MDX and SSAS but know there are some semi-additive functions i want somebody to be able to pick a day and have the total value of only open orders.
I want to implement population data in sales cube.
Fact table has customer code which is foreign key of Customer master dimension which in turn is linked to census data dimension. Census data dimension have city wise population data having foreign keys of zone and state.
We have been trying for a while to use Power BI tools (Power Query, Power BI Designer (Desktop) and Power BI Designer (Cloud) in line with larger data sources ( 2-7m records in fact table). Unfortunately up to now with unsatisfactory results. It seems that these tools are just not designed to handle this kind of data volumes?
To my understanding it seems that the approach with PowerBI components is to always try to create a local (or cloud based) cache that only has a limited capacity. 2m+ records already seem to be exceeding this limit. So as opposed to firing off a query on demand (for example only based on distinct filter options as opposed to entire fact set) only the intermediary cache of the model can be used.
Our initial focus was to use a normalized table in SQL Server with around 4m records. First problem is that Power Query/Power BI Designer fails to provide a complete list of the distinct filter items:
This I can understand in some way as doing a distinct on a large data set like that is not trivial. As a workaround I could imagine to setup a star scheme dimension table with the distinct "dimension members". I.e. that filters are driven by this table which has only a few thousand rows. The filters there are then applied to the fact table. I haven't found a way to do this effectively with Power Query.
Another option that we have tried was using the cloud based Power BI service in conjunction with a SQL Cloud Service with the same data set. That unfortunately didn't work. The setup of the source works fine but as soon as we try to start a query by dragging a value field on the dashboard errors occur:
I want to perform a Analysis Services Processing Task using a connection manager created from a Analysis Services data source. I create the data source using the Oledb provider for Analysis Services 9.0, and it works fine. Then I create a connection manager using the "New connection from data source" option, and it seems to create it ok.
The problem is that I can't then asign this connection to the Analysis Services processing task. I get the error:
"Connection Manager MyConectionManagerFromDataSource is not a Analysis Services Connection Manager"
However, if I create directly a connection manager using "New Analysis Services Connection" it works fine.
Is it at all possible to create a Analysis services connection from a Data Source to perform a Analysis Services Processing Task?
I am trying to find what datatype I can use for variable values like below in a column
E.g. column which we get
10000.10 100 180.34 98203710231.34
From the above example, you can see some of the values contains no decimal and with decimal
Also we cant say whether the decimal comes after the 5th number or 10th number. Any other datatype to capture this values. If not last option is to give varchar2.
1. SQL Server Data Warehouse 2. OLAP CUBE in Analysis Services
My question is - If my SQL Server Data Warehouse is changed (Having Append Data) - Is that My OLAP Cube will have the Append Data?
It's possible, my OLAP Cube always having Append Data if my Data Warehouse is changed? If yes, how to do it without re-deploy and re-process my Analysis Services Project.
I have this simplified query below to illustrate what I'm looking for. I would like to get the data for the time between the two dates in the where clause ('01-05-2015' and '10-03-2015'). In SQL it would be a BETWEEN. I'm looking for the MDX equivalent.
I have these dates hard coded but what I eventually will be doing is an @BeginDate / @EndDate parameter in an SSRS report.
SELECT [Measures].[Ship Resale S&D Run Rate] ON COLUMNS, [Branches].[Region].[Region] ON ROWS FROM [Sales] WHERE [Time].[Date].&[01/05/2015]:[Time].[Date].&[10/30/2015] *WHERE @BeginDate : @EndDate
I am using the Visual Studio for Integration Services. and creating a database.I am trying to download data from a Cube table (SALES_HISTORY), using a Microsoft OLE DB provider for Analsysis services 10.0. in this table, it has visible 2 fields (SALE_TRANSACTION_ID) and (TRANSACTION DATE) but have many hidden fields, such CUSTOMER, PART_NUMBER, etc . when I try to create a query in the OLE DB source editor, I can see all the fields, and be able to create the SQL command.
However when I want to preview it or parse the query, I have the following message:
Exception from HRESULT: 0x0C0202009 error at data flow task [OLE DB Source [1]]: SSIS Error code DTS_E_OLEDBERROR. an OLE DB error has occurred. Error Code 0x80004005.
an OLE DB record is available. Source: " Microsoft OLE DB Provider for Analysis Services 2008". Hresult:0x80004005 description: Query (1,15) error from the SQL query module the 'Customer' column cannot be found in the 'SALES_HISTORY' table...how to extract the data from the visible and also hidden fields (in excel, are called properties).
I have, a SSAS 2012 tabular instance with SP2, there is a database on the instance with a read role with everyone assigned permissions. When configuring the Power BI analysis services connector, at the point where you enter Friendly Name, Description and Friendly error message, when you click next I receive the error "The remote server returned an error (403)." I've tested connecting to the database from Excel on a desktop and connect fine.I don't use a "onmicrosoft" account so don't have that problem to deal with.
We use Power BI Pro with our Office 365. As far as I can tell that part is working ok as I pass that stage of the configuration with a message saying connected to Power BI.The connector is installed on the same server as tabular services, its a Win2012 Standard server. The tabular instance is running a domain account that is the admin account for the instance (this is a dev environment) that account is what I've used in the connector configuration. It's also a local admin account. There is no gateway installed on the server.
I have a cube that we are processing nightly via an Analysis Service Processing Task in SSIS. In order to increase the performance of the processing time, we elected to use a lot of rigid dimension attributes, and do a full process of everything in the SSIS task. The issue that I am having is that after that task completes, I need to go into Visual Studio to deploy the cube becuase we are unable to browse or use the cube. This issue seemed to start once we changed the SSIS Analysis Service Processing Task to do a full process on the dimensions, rather than an incremental.
I would expect that once development is done, and it is processed and deployed, that is it. My thinking is that the SSIS task should just update the already deployed cube,
How to right choose key column in"Mining Structure" for Microsoft Analysis Services?
I have table:
"Incoming goods"
Create table Income ( ID int not null identity(1, 1) [Date] datetime not null, GoodID int not null, PriceDeliver decimal(18, 2) not null, PriceSalse decimal(18, 2) not null, CONSTRAINT PK_ Income PRIMARY KEY CLUSTERED (ID), CONSTRAINT FK_IncomeGood foreign key (GoodID) references dbo.Goods ( ID ) )
I'm trying to build a relationship(regression) between “Price Sale” from Good and “Price Deliver”.But I do not know what column better choose as “key column”: ID or GoodID ?
I am connecting to SSAS cube from Excel and I have date dimension with 4 fields (I have others but I don't use it for this case). I created 4 fields in order to test all possible scenarios that I could think of:
DateKey: - Type: System.Integer - Value: yyyyMMdd Date: - Type: System.DateTime DateStr0: - Type: System.String - Value: dd/MM/yyyy (note: I am not using US culture) - Example: 01/11/2015 DateStr1: - Type: System.String - Value: %d/%M/yyyy (note: I am not using US culture) - Example: 1/11/2015
Filtering on date is working fine:
Initially, in excel, filtering on date was not working. But after changing dimensional type to time, and setting DataType to Date, as mentioned in [URL] filter is working fine as you can see in the picture.Grouping on date is not working:
I have hierarchy in my Date dimension and I can group based on hierarchy, no problem. But user is used to pre-build grouping function of excel, and he wants to use that. Pre-build functions of Excel, Group and ungroup seems to be available as you can see in following picture:
But when user clicks 'Group', excel groups it as if it is a string, and that is the problem. User wants to group using pre-build grouping function available in Pivot table. I also find out that Power Pivot Table does not support this excel grouping functionality. And if I understood well, this pre-build grouping functionality of excel, needs to do calculation at run time, and that is not viable solution if you have millions of rows. So Power pivot table does not support pre-build grouping functionality of excel and hence we need to use dimension hierarchy to do the grouping. But I am not using Power Pivot table, I am using simple Pivot Table. So I expect grouping functionality to be working fine. Then I tried to do simple test. I created a simple data source in excel itself. And use it as source of my Pivot table. Then grouping is working fine. The only difference that I can see is (When double click the Measure value in Excel),For date values of my simple test, excel consider them as 'Date'.
For date values of my data coming from cube, excel consider them as 'General'
2.1. But value here is same as it was in simple test.
2.2. 'Date Filter' works just fine.
2.3. If I just select this cell and unselect it, then excel change type to 'Date' though for that cell.
2.4. I have created 4 different types of fields in my date dimension thinking that values of attribute of my dimension might be the problem, but excel consider 'General' for all of them.
2.5 This value (that can be seen when double clicking on measure) comes from 'Name Column' of the attribute. And the DataType defined is WChar. And I thought that might be the reason of issue. And I changed it to 'Date'. But SSAS does not allow it to change to 'Date' giving error : The 'Date' data type is not allowed for the 'NameColumn' property; 'WChar' should be used.
So, I don't know, what is the puzzle piece that I am missing.
1. Date filter works, group does not work
2. Excel consider it as 'General' string.
3. SSAS does not allow to change 'NameColumn' to Date.
I would like to know the best practice for running analysis service in terms of port usage. Is it better to run on a specific port or have dynamic ports ? We have clustered servers that run default on 2383 but not sure with non clustered what's the best way to get performance.
Trying to go through the Analysis Services tuturial. Logged in as Administrator on a 64 bit W2K server. SQL Server 2000 AS and SP4.As I come to the Design Storage step I get a message sayingData source provider error: ; Time:2006-04-10 19:51:47There are no further details given and the Event Logger has nothing.Grateful for any help.Screenshot: http://i23.photobucket.com/albums/b366/biund/sql/DesignStorageproblem.pngAnd the version Screenshot:http://i23.photobucket.com/albums/b366/biund/sql/DesignStorageproblem2.png
Cristiano writes "hi everybody. A customer of mine has had a disk "crash" few days ago. I wrote for him a dwh application and of course the backup was not working...
now some "hardware guys" said that it is possible to recover most of the files.
what I need to restore would be: 1- the sql server db 2- the sql server dts and jobs 3- the analysis service cube and dimensions
to do so is it enough for me to have: 1- the .mdf and .ldf files 2- the master.mdl /.ldf file 3- the .odb file and .dim* and .role .map ... files
right? is it enough to recover everything? if it is so, what would be the right processes to recover everything? "
I need to extract data from SSAS' cubes into a SQL Server table.
I already read examples using Linked server (with openquery), SSIS, etc. However, the result always return as many columns per dimension as levels. I need to extract all members of a dimension in a column. E.g., when excecuting the following MDX query in Adventure Works 2014:
select [Measures].[Sales Amount] on columns, Non Empty [Date].[Calendar].members on rows from [Adventure Works]
I would like to get this result (MDX query in SSMS), but with keys displayed intead of names:
I have 5 cubes, and hierachy defined for all cubes. for example:geography database with 5 continents as cubes and contries as dimensions.Now when i am doing security restrictions on my dimension ex: In USA dimension if i want only to give access to texas region then i should be able to see only texas cities. But i cansee all the states under USA even after selecting only Texas region under Dimension data tab inside ROles section in SSMS.I have tried security at database ,cube level as well as dimension level.But still not working.is that because of some wrong design of cubes or something related to database design.? I am not able to undersand that except roles everything in my cubes or datawarehouse is working fine without and defect in data.
