Arithmetic Operation Resulted In An Overflow.
Feb 20, 2008my date_Join is 8char as it is datetime in microsoft sql. cant change to more.
when i type the date 2007-12-12. it says Arithmetic operation resulted in an overflow.
my date_Join is 8char as it is datetime in microsoft sql. cant change to more.
when i type the date 2007-12-12. it says Arithmetic operation resulted in an overflow.
We've been using SQL Server 2005 for a while as the db for our web app. Everything has been working fine, until yesterday when we started getting a "Arithmetic operation resulted in an overflow. (System.Data)" error message when trying to connect from SQL Server Management Studio or from our web app. This only happens when trying to connect remotely, although remote connections have worked for us perfectly in the past. The full error message is reproduced below. Thanks ahead of time for any help. ===================================Cannot connect to serverName===================================Arithmetic operation resulted in an overflow. (System.Data)------------------------------Program Location: at System.Data.SqlClient.TdsParser.ConsumePreLoginHandshake(Boolean encrypt, Boolean trustServerCert, Boolean& marsCapable) at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity, SqlConnection owningObject) at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, Boolean ignoreSniOpenTimeout, Int64 timerExpire, SqlConnection owningObject) at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(String host, String newPassword, Boolean redirectedUserInstance, SqlConnection owningObject, SqlConnectionString connectionOptions, Int64 timerStart) at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(SqlConnection owningObject, SqlConnectionString connectionOptions, String newPassword, Boolean redirectedUserInstance) at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, Object providerInfo, String newPassword, SqlConnection owningObject, Boolean redirectedUserInstance) at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection) at System.Data.ProviderBase.DbConnectionFactory.CreateNonPooledConnection(DbConnection owningConnection, DbConnectionPoolGroup poolGroup) at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection owningConnection) at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory) at System.Data.SqlClient.SqlConnection.Open() at Microsoft.SqlServer.Management.UI.VSIntegration.ObjectExplorer.ObjectExplorer.ValidateConnection(UIConnectionInfo ci, IServerType server) at Microsoft.SqlServer.Management.UI.ConnectionDlg.Connector.ConnectionThreadUser()
View 1 Replies View RelatedWhen running a query such as this on a database view:
select count(*) from WWALMDB.dbo.v_AlarmEventHistory2
SQL throws the following error:
The datediff function resulted in an overflow. The number of dateparts separating two date/time instances is too large. Try to use datediff with a less precise datepart.
Oddly on a Table the count(*) function works.
Is there a limit on views or the count(*) function that I am not aware of?
I have a field of type numeric(5) in a SQL 7.0table that I'm trying to assign the value -100. I get an 8115 error. Does anybody know where I can find out what the possible values I can put into this field.
View 3 Replies View RelatedDear All,
Despite multiple, unsuccessful attempts, I am unable to populate a table with converted int data using the following select syntax:
select name, convert(size*8000)/1024000 as Size into 'TableName' from sysfiles
order by name
results in the following:
Server: Msg 8115, Level 16, State 2, Line 1
Arithmetic overflow error converting expression to data type int.
The statement has been terminated.
What change/code is necessary for a successful select?
Regards, John
TIA
Hello,
I am trying to get a value from a select-query that is of the datatype int. The code below will not, I think it is because I mix up datetime with int conversion. Anyway, I am not really sure how to subtract
Select datediff(day,convert(int, SUBSTRING('198001010012', 1, 8)),convert(int, getdate()))
Results in: Arithmetic overflow error converting expression to data type datetime..
I really need to get the difference because in my next select query I will use the ">" , "<" and "=" to filter the result.
If I do not convert and use this code
SELECT name, datediff(day, SUBSTRING(clientno, 1, 8), getdate()), email
FROM ...
I get this message:
The conversion of a char data type to a datetime data type resulted in an out-of-range datetime value.
clientno is of data type char(12)
Any suggestions?
hi, can someone please tell me what this error is, i am trying to create a quiz engine but i keep getting this error when i try to save the results of me quiz in the results page. i have been following the tutorial from this website. Please can someone help me, thanks
Arithmetic overflow error converting expression to data type smalldatetime.The statement has been terminated.
Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code. Exception Details: System.Data.SqlClient.SqlException: Arithmetic overflow error converting expression to data type smalldatetime.The statement has been terminated.Source Error:
Line 46: userQuizDataSource.InsertParameters.Add("UserName", User.Identity.Name)
Line 47:
Line 48: Dim rowsAffected As Integer = userQuizDataSource.Insert()
Line 49: If rowsAffected = 0 Then
Line 50: ' Let's just notify that the insertion didn't
When I try to run the query..it goes well..but says
Arithmetic overflow occurred.
at the end of the records..
What does that means..?
I have a situation where a user is multiplying 2 integers
that result in a value that exceeds 2,147,483,648 which is
the maximum number that type int can store. This
calculation results in an arithmetic overflow. However,
if I convert the operands to a type numeric or bigint then
the result works. Is there a way for SQL2000 to multiply
to integers and automatically convert the result into a
bigint if the result exceeds the type int maximum? It
does not make sense to do conversions for every row or
change the data type to big int in the table because the
operand values which come from a table are within the
integer range. Any Suggestions? See example sql below:
** completes successfully - result within integer range
select result = 1211*1773208
** results in arithmetic overflow
select result = 1212*1773208
** completes successfully if one operand is bigint or
numeric
select result = convert(bigint,1212)* 1773208
I got the following error when running a SP:
Server: Msg 8115, Level 16, State 6, Line 1
Arithmetic overflow error converting nvarchar to data type numeric.
The statement has been terminated.
The stupid thing is, that there is no data conversion at all. It's an insert into SLQ server table where data is retrieved from an Oracle View (using ADO DB link). I got 4 other SP's, doing the same thing for resp 4 other tables, which works fine. Those :mad: SP won't work. I don't know why. Below I put the table structure, view structure and SP I used:
Table:
Contract_No varchar (20) NOT NULL
Registration_Date_Time datetime NOT NULL
AGC varchar (4) NOT NULL
Salesgroup varchar (4) NOT NULL
Group_ varchar (8) NOT NULL
Activity_Type varchar (4) NULL
Type char (1) NULL
Group_Description varchar (50) NULL
Stock_Um varchar (4) NULL
B_Qty numeric(11, 4) NULL
B_Cost numeric(23, 4) NULL
C_Qty numeric(11, 4) NULL
C_Cost numeric(24, 4) NULL
D_Qty numeric(11, 4) NULL
D_Cost numeric(24, 4) NULL
Oracele view:
CONTRACT_NO VARCHAR2(20)
AGC VARCHAR2(4)
SALESGROUP VARCHAR2(4)
GROUP_ VARCHAR2(8)
ACTIVITY_TYPE VARCHAR2(4)
TYPE CHAR(1)
GROUP_DESCRIPTION VARCHAR2(50)
STOCK_UM VARCHAR2(4)
B_QTY NUMBER
B_COST NUMBER
C_QTY NUMBER
C_COST NUMBER
D_QTY NUMBER
D_COST NUMBER
Stored procedure:
CREATE PROCEDURE mis_Upload_Contract_Kosten
@strType varchar(10),
@strDate varchar(19)
AS
declare @strInsert as varchar(1000);
declare @strSelect as varchar(1000);
declare @strWhere as varchar(1000);
declare @strSql as varchar(3019);
SET @strWhere = ''
SET @strInsert = 'INSERT C_Contract_Kosten (
Contract_No
, AGC
, Salesgroup
, Group_
, Activity_Type
, Type
, Group_Description
, Stock_Um
, B_Qty
, B_Cost
, C_Qty
, C_Cost
, D_Qty
, D_Cost
, Registration_Date_Time)'
SET @strSelect = ' SELECT gLCK.Contract_No
, gLCK.AGC
, gLCK.Salesgroup
, gLCK.Group_
, gLCK.Activity_Type
, gLCK.Type
, gLCK.Group_Description
, gLCK.Stock_Um
, gLCK.B_Qty
, gLCK.B_Cost
, gLCK.C_Qty
, gLCK.C_Cost
, gLCK.D_Qty
, gLCK.D_Cost
, ' + char(39) + @strDate + char(39) + '
FROM Glovia..LIVE.C_CONTRACT_KOSTEN as gLCK
WHERE gLCK.Contract_No NOT LIKE '' IND*''
AND NOT EXISTS
( SELECT vCC.Contract_No
FROM V_Contracts_Closed as vCC
WHERE vCC.Contract_No = gLCK.Contract_No)
AND EXISTS
( SELECT cc.Contract_No
FROM C_Contracten as cc
WHERE cc.Registration_Date_Time = ' + char(39) + @strDate + char(39) + '
AND cc.Contract_No = gLCK.Contract_No)'
IF @strType = 'closed'
BEGIN
SET @strWhere = ' AND NOT(gLCK.Contract_Close_Date IS NULL)'
END
IF @strType = 'open'
BEGIN
SET @strWhere = ' AND gLCK.Contract_Close_Date IS NULL'
END
SET @strSql = @strInsert + @strSelect + @strWhere
EXEC (@strSql)
GO
I am trying to run this query:
SELECT 'D', property.parcel_number, ROUND(.23 + property_char.value * .02731, 2) AS nwcharge
FROM
property INNER JOIN
property_char ON property.id = property_char.property_id INNER JOIN property_char AS pc ON property.id = pc.property_id INNER JOIN
prop_valuation ON property.id = prop_valuation.property_id INNER JOIN
val_component ON property.id = val_component.property_id INNER JOIN
val_component AS vc ON property.id = vc.property_id
but I am getting the error:
"Arithmetic overflow error converting varchar to data type numeric".
It seems to be cause by the line: ROUND(.23 + property_char.value * .02731, 2) AS nwcharge.
Please help.
Thanks
i have an sql query that goes like this:
select CategoryID & power(2,x) from CategoryDetails
where CategoryID can range upto 15 digits eg: 137652435487090
x is the result of a formulae and can range upto 2 digits eg:95
CategoryID is the current category ID.
Number resulting from the formulae is the subcategory ID of the current categoryID.
I am getting error Arithmetic overflow error for datatype bigint.
what datatype shd I use to resolve the error or is there any way out.
Dear gurus
I want to have this query for some calculation
SELECT DATEADD(day, 1, CONVERT(datetime, @ddate, 101)) AS Expr1
@ddate is a parameter which will be passed during runtime.
when i try this is in the query window i get arithmetic overflow error
Thanks and Regards
Arun
Hi,
Below query failed which executing in sql 2005 64Bit and large memory
select count(*) AS Buffered_Page_Count
,count(*) * 8192 / (1024 * 1024) as Buffer_Pool_MB
from sys.dm_os_buffer_descriptors
Msg 8115, Level 16, State 2, Line 4
Arithmetic overflow error converting expression to data type int.
but it work fine in my test server which running 2GB of ram with sql 2005
I get an arithmetic overflow error when trying to insert DateTime.Now() as a SmallDateTime. When I set up my table definition I entered SmallDateTime and the program automatically allowed a length of 4. Any suggestions?
View 6 Replies View RelatedI have two tables which have dates in varchar fields on both. I have to
join them to get the data . I wrote the following syntax in where clause. In
one of the fields includes time and the other does not. But the thing is, I
got the Arithmetic overflow occurred error message after '01/01/2000'. Isn't
it strange?
convert(varchar(30),convert(datetime,R.request_dat e),101)=convert(varchar(30
),convert(datetime,B.request_date),101)
i have to calculate
power(2,32) in SQL Server Enterprise Manager.
here 32 is obtained through a series of calculations. no problem there. Error is in calculating power.
I am getting the foll error
Arithmetic overflow error for type int value = 4294927696.00000000
i tried convert(bigint,power(2,32)) but no use since conversion will anyway take place only after power is calculated which again gives the same error.
Hi all
Today I'm so incredibly annoyed.
I have a simple Table which has one Identity column plus an integer Column with Unique constraint and some varchar fields.When i change the value of that Unique Constraint Column , the value will change successfully But today i find a record (Just By Chance) that when i change the value of its filed i recieve the following Error: its filed has the value of 2519 and i wanted to update it to 2520 !!!
---------------------------
SQL Server Enterprise Manager
---------------------------
[Microsoft][ODBC SQL Server Driver][SQL Server]Arithmetic overflow error for type int, value = 6262227669.000000.
[Microsoft][ODBC SQL Server Driver][SQL Server]The statement has been terminated.
---------------------------
OK Help
---------------------------
As i said earlier i have no problem with other records , that's strange.
Could anyone help me Please?
Thanks in advance.
Kind Regards.
We are getting an Arithmetic Overflow Error - 8115
The error is thrown when a formula is getting calculated through the sql query
create table #temp
(
A decimal(21,4),
B decimal(21,4),
C decimal(21,4)
)
Insert into #temp
values( 171577.3139, 3376774.0000,3760846.0000)
select (A)/(0.8770/(B/C)) from
(select avg(A) as A, avg(B) as B, avg(C) as C from #temp) a
On execution of the select statement the following error message is thrown.
Server: Msg 8115, Level 16, State 2, Line 1
Arithmetic overflow error converting expression to data type numeric.
Can any one help us with a resolution.
Note: This select is part of our stored procedure.This formula is dynamically generated in our code.
We will not in a position to use cast function. We tried trace flag (107) option also. But we dont know how to set it permanently. It is effective only in the respective session. When the stored procedure is called from the application, the trace flag option does not work.
Why can't I multiply a bit variable that is set to TRUE (1) with a value larger than 0 but smaller than 1 without getting an "Arithmetic overflow error"? I have solved the problem by declaring my bits as smallints when I fetch them from the database into a stored procedure and use them in calculations, but I still would like to know why it doesn't work. I'm using SQL Server 2005. DECLARE @bit AS bitSET @bit = 0SELECT 0.1 * @bit -- Gives 0 as expected
SET @bit = 1SELECT 1.1 * @bit -- Gives 1.10 as expected
SELECT 0 * @bit -- Gives 0 as expected
SELECT 0.1 * @bit -- Gives "Arithmetic overflow error converting tinyint to data type numeric."
Ok I'm doing a simple insert query:
insert into product(CategoryID, StoreID, MallCategoryID, ProductName, Manufacturer, ProductItemNumber, Size, Color, SizeApplies, ColorApplies, Price, Discontinued, ProductDescription, GiftWrapping, Gender, Age, MinAge, MaxAge, Tax, Shipping)
values(100, 100, 80, 'test product Casdfasdf', 'test manufacturer', 'est', '', '', 0, 0, 99.95, 0, 'test desc', 0, 'Both', '', '0', '0', 0, 0)
I get this error:
Arithmetic overflow occurred.
It dosn't make sense that this would happen because the number fields are not huge at all.
Any ideas...?
here's the table layout:
CREATE TABLE dbo.Product (
ProductID smallint IDENTITY (1, 1) NOT NULL ,
ProductName varchar (100) NULL ,
Gender varchar (10) NULL ,
ProductDescription varchar (255) NULL ,
Manufacturer varchar (75) NULL ,
ProductItemNumber varchar (50) NULL ,
Tax bit NOT NULL ,
Shipping bit NOT NULL ,
ApproxWeight varchar (10) NULL ,
MallCategoryID smallint NULL ,
GiftWrapping bit NOT NULL ,
ShippingCost decimal(18, 2) NULL ,
GiftWrappingCost decimal(18, 2) NULL ,
ImageName varchar (25) NULL ,
Price decimal(18, 2) NULL ,
SizeApplies bit NOT NULL ,
ColorApplies bit NOT NULL ,
Age varchar (20) NULL ,
StoreID smallint NULL ,
CategoryID smallint NULL ,
Discontinued bit NOT NULL ,
MinAge varchar (5) NULL ,
MaxAge varchar (5) NULL ,
Size text NULL ,
Color text NULL
)
THANKS!!!!
hi, I am running a procedure, got this error:
Arithmetic overflow occurred. (Message 3606)
the procedure failed.
Can anyone tell me why this error occured,and how to solve it so I can have the process results.
Thanks
Ali
Hey everyone,
I have two tables, one is a large table (v_userviews) containing a list of all the servers and various information about those servers. The other table (l_printers) contains printer information for those servers. I am working on a view to consolidate the printer information in l_printers with the other server information in v_userviews.
I've been trying to get outer joins to work but I am getting this error:
"Server: Msg 8115, Level 16, State 2, Line 2
Arithmetic overflow error converting expression to data type int.
Warning: Null value is eliminated by an aggregate or other SET operation."
Here is my select statement:
select u.propid, u.address,
SUM((CASE u.Tree WHEN 'tree1' then 1 ELSE 0 END)) AS One,
SUM((CASE u.Tree WHEN 'tree2' then 1 ELSE 0 END)) AS Two,
SUM((CASE u.Tree WHEN 'tree3' then 1 ELSE 0 END)) AS Three,
SUM((CASE u.Tree WHEN 'tree4' then 1 ELSE 0 END)) AS Four,
SUM((CASE u.Tree WHEN 'tree5' then 1 ELSE 0 END)) AS Five,
SUM((CASE u.Tree WHEN 'tree6' then 1 ELSE 0 END)) AS Six,
SUM((CASE u.Tree WHEN 'tree7' then 1 ELSE 0 END)) AS Seven,
SUM((CASE u.Tree WHEN 'tree8' then 1 ELSE 0 END)) AS Eight,
SUM((CASE u.Tree WHEN 'tree9' then 1 ELSE 0 END)) AS Nine,
SUM((CASE u.Tree WHEN 'tree10' then 1 ELSE 0 END)) AS Ten,
SUM((CASE u.Tree WHEN 'tree11' then 1 ELSE 0 END)) AS Eleven,
SUM((CASE u.Tree WHEN 'tree12' then 1 ELSE 0 END)) AS Twelve,
SUM((CASE u.Tree WHEN 'tree13' then 1 ELSE 0 END)) AS Thirteen,
SUM((CASE u.Tree WHEN 'tree14' then 1 ELSE 0 END)) AS Fourteen,
count(u.server) as totalservers,
sum(cast(left(u.totalspace,len(u.totalspace)-2) as int)) as totalspace,
sum(cast(left(u.totalusedspace,len(u.totalusedspac e)-2) as int)) as totalusedspace,
count(p.printer) as numprinters
from serverops.dbo.v_userviews u LEFT OUTER JOIN novell_twr.dbo.l_printers p ON u.propid = p.propid
where u.os='netware'and u.state in ('ny', 'nj', 'fl')
group by u.propid, u.address
the l_printers table is in this format:
Printers Server Propid
nvarchar nvarchar varchar
Thanks for all your help. :beer:
The following function is throwing the error:
1) "Arithmetic overflow error converting numeric to data type numeric."
2) The variable @x should only be set when if condition is equal to 1. For any other values, it should not go inside if condition. Does the following if condition code meet that criteria?
ALTER FUNCTION [dbo].[fn_Calculator]
(
@abc bit
)
returns decimal(14,10)
as begin
[code]...
insert into----
select ID_NO,cast(row_number() over(partition by ID_NO order by ID_NO)as varchar(2))
from
test_222
I am trying to insert into test222 table .The id_no column is varchar field
error:
Arithmetic overflow error converting expression to data type varchar.
The statement has been terminated.
Hi allToday I'm so incredibly annoyed I have a simple Table which has one Identity column plus an integer Column with Unique constraint and some varchar fields.When i change the value of that Unique Constraint Column , the value will change successfully But today i find a record (Just By Chance) that when i change the value of its filed i recieve the following Error: its filed has the value of 2519 and i wanted to update it to 2520 !!!
---------------------------SQL Server Enterprise Manager---------------------------[Microsoft][ODBC SQL Server Driver][SQL Server]Arithmetic overflow error for type int, value = 6262227669.000000.
[Microsoft][ODBC SQL Server Driver][SQL Server]The statement has been terminated. ---------------------------OK Help ---------------------------
As i said earlier i have no problem with other records , that's strange.
Could anyone help me Please?
Thanks in advance.Kind Regards.
When I execute a stored procedure it outputs the expected value, but also throws the following exception.
Arithmetic overflow error converting expression to data type int.
The 'usp_TicketCreate' procedure attempted to return a status of NULL, which is not allowed. A status of 0 will be returned instead.
Any help would be appreciated, at the moment I am just catching the exception in my code and ignoring it, but I would like to get rid of the exception all together.
Thanks for the help.
SBProgrammer
l'm running this procedure and l get this error. All l'm trying to do is to get the size of the database and its objects and what the size should be so that its sized right. Is there a better way of doing this ?
CREATE PROCEDURE sp_totalsize as
SELECT o.name 'Table', SUM(c.length) 'Record size',
MAX (i.rows) '#of rows',
CONVERT (decimal (10, 4), SUM (c.length * i.rows)/(1024.00 * 1024.00)) 'Approx. size (MB)'
FROM sysobjects o, syscolumns c, sysindexes i
WHERE o.id = c.id
AND o.id = i.id
AND (i.indid = 1 or i.indid = 0)
AND o.type = 'U'
GROUP BY o.name
COMPUTE SUM (CONVERT (decimal (10,4), SUM (c.length * i.rows)/(1024.00 * 1024.00)))
GO
(17 row(s) affected)
Server: Msg 8115, Level 16, State 2, Procedure sp_totalsize, Line 3
Arithmetic overflow error converting expression to data type int.
Under certain circumstances I am getting the following error
"Arithmetic overflow error converting expression to data type int"
when running the following code:
SELECT Count(*), Sum(GrossWinAmount)
FROM LGSLog
WHERE
(CurrentDate >= '9/1/2004 8:00:00 AM') And (CurrentDate <= '9/27/2004 7:59:59 AM')
If I remove the "Sum(GrossWinAmount)" from the select, it works fine. I therefore believe that Sum is causing the error. Is there a version of Sum that works with larger variables, such as a BigInt? If not, is there some way to do the equivalent using larger numbers? I need to allow for the possibility of obtaining one month's summary, and sometimes the summary value is apparently too large for Sum to handle.
I've got this error message while generate the output with ASP:
"Microsoft OLE DB Provider for SQL Server (0x80004005)
Arithmetic overflow error converting expression to data type int."
it indicate that the error is related to this line:
"rc1.Movenext"
where rc1 is set as objconn.Execute(sql).
Not all outputs result like this, it happens when it has many relationships with other records, especially with those records which also have many relationships with other records.
Can anyone suggest a solution?
I've tried to increase the size of the database file, but it doesn't work.
This is the error in my query:
[Err] 22003 - [SQL Server] Arithmetic overflow error converting numeric to data type numeric.
If tried [%TAX] DECIMAL (10, 2) I have the correct output, but I need 4 decimal in my output.
Code:
MATNUMB-VER-EXENUMB-VER-RIC%TAX
a476427228.1515,17%
b9241314323.1515,50%
c7781510878.1413,98%
d7480019601.2626,20%
e877618297.099,45%
[Code] .....
I have the following code in a SP. The 2 if statements for the @@ Error I added only for testing as I suddenly started get the following error at the 1st @@Error statement
Msg 232, Level 16, State 2, Line
Arithmetic overflow error for type varchar, value = 10000.00000.
I cannot have this SP running minutes it must be done in seconds.
I have tried the folloiwng changes but then it takes to long.
-- set @new = 'x' + right('0000' + convert(varchar(5), round(rand() * 10000, 0)), 4)
-- set @new = 'x' + right('0000' + convert(varchar(4), right(round(rand() * 10000, 0),4)), 4)
declare @newvarchar(5),
@xstsint,
@new_retvarchar(5)
,@Cnt as int /* just for my testing */
set @cnt = 0 /* just for my testing */
[Code] ......
I've a SQL view performing a number of very precise calculations ie.495/(1.112 - (.00043499*((Col1 + Col2 + Col3))) + ( .00000055 * ((Col1+ Col2 + Col3)) * ((Col1 + Col2 + Col3))) - (.00028826 * Col4))) -450)/100Obviously this sometimes causes a precision issues because the floatand real datatypes don't hold precise values... My problem is thatconverting to the numeric or decimal datatype easily produces an errorif the precision is not big enough to hold the resulting output... Sohere's my questions:Does anyone see a problem with me maxing out the precision of thedecimal datatype (ie. use DECIMAL(38,8) across a couple dozeninter-related formulas?So the above code would now exec like this:495/(CONVERT(DECIMAL(38,8),1.112) -(CONVERT(DECIMAL(38,8),.00043499)*((Col1 + Col2 + Col3))) +(CONVERT(DECIMAL(38,8),.00000055) * ((Col1 + Col2 + Col3)) * ((Col1 +Col2 + Col3))) - (CONVERT(DECIMAL(38,8),.00028826) * Col4))) - 450)/100If anyone does see a problem with this approach, could you suggestanother alternative?
View 1 Replies View Related