Memory Error When Trying To Edit A Transform Task In Dts
Oct 4, 2004
I am trying to use a DTS package to get data from db2 in a s390 environment. I am able to use the Import task and then run a query on db2, save the package and execute the package.But when i try edit the transform task i get a mmc.ese application error...it says that the instruction at addres "" tries referencing memory at address "". The memory could not be read...
I installed a ibm odbc driver on my client...obviously the connection seem to work since the package executes...But then the edit issue...
If any one faced this problem or know what i am doing wrong....appreciate ur time and effort...
Thanks
I've got a package that was imported from SQL 2000 into SQL 2005. I'm trying to edit it in Business Int. Dev Studio. When I open what used to be a data pump step in 2000, I'm able to edit items. However, when I click OK, it puts an error right below the buttons:
"" is not a value type
And it won't let me save my changes. I have no idea where this error is coming from. All the data pumps in this package cause the same error. Your help is appreciated.
Today, I must to re-install VS2005 and SQL Server 2005 desktop tools in my computer, because I install SQL Server 2005 SP2 desktop tool for an special features that I need. This caused that the edition of the Script Task gives to me the following error:
Cannot show the editor for this task
Additional information: Engine returned Unknown Error (Microsoft.VisualBasic.Vsa.DT)
After the reinstalación, the error continues appearing, and I do not know that to do so that it works fine again.
I have an Access 2.0 database that holds call data on a mapped drive. I am running MS SQL Server 2000. I can open it and view the records inside. I can even run the query below and get results, if I removed the CallDate and CallTime parameters.
SELECT CallDate, CallTime, Mid(CallRecordData, 68, 3) AS Extension, 'I' AS Direction, Mid(CallRecordData, 34, 11) AS Called, Val(Mid(CallRecordData, 18, 2)) + Val(Mid(CallRecordData, 21, 2))/ 60 AS Minutes, Val(Mid(CallRecordData, 21, 2)) AS Seconds FROM CallRecords WHERE (CallDate = ?) AND (CallTime >= ?) AND (CallTime < ?) AND (Mid(CallRecordData, 30, 1) <> '9')
When I preview in the Transform Data Task, I get: Package Error Error Source: Microsoft JET Database Engine Error Description: No value given for one or more required parameters.
When I look at the parameters, they are listed. I check their values, and they have the appropriate values (DateCalled, String, 07/14/2005) (StartTime, String, 06:30) (EndTime, String, 07:00)
When I run it in the build query or in Access with a linked table to the source, I can enter the values when asked for them and it works.
I would like to know what happens when a very large reference data set for a lookup transform with full caching enabled is getting loaded during package execution and the computer memory runs out or is very low. Does SSIS a) give an out of memory error of some sort b) resort to a no caching or partial caching mode c) maintain the full caching mode but will switch to using the paging file(virtual memory).
I think it will resort to using the page file in which case the benefits of in memory lookups are lost and performance would suffer. If I cannot upgrade the memory or shrink the reference set somehow, i should switch that lookup task to use partial caching or no caching with an indexed lookup table. Would this make sense?
Hello, I am working on a module to extract data from a Teradata server to SQL database. I am using a DTS package to extract the data and need to make the data source name (database name and object name) configurable at runtime and to be read from a Config table in the SQL database. What do you suggest is the simplest and most efficient method to do this?
I am trying to use a dynamic SQL query in the data tranform task with the data source as a query. But its giving me a strange syntax error. Can we use a dynamic SQL in the query option of DTS transform task source?
I am importing data from xls file to a db table with a dts. In the time of the dts creation I am using 'Transform Data Task Properties' GUI window to map incoming xls fields (source) to the table columns (destination). Question: Is there any way to invoke the 'Transform Data Task Property' GUI window in dts runtime and use it to change the mapping dynamically in the run time? Thanks, Vadim.
The thing is I am using a DTS package to get data from db2 residing on a s390-mainframe and put it in a sql 2000 db on windows 2000 server..
I have the odbc driver that the server guys gave me..I installed it and then run a batch pgm, which i think does the database set up...in short i set up the DSN's in my local machine..I can use the dsn when i use the sql client...
I can't create a new package and then complete the task..Problem is when i try set up a transform task, i get a memory error...it says that the instruction referenced a memory location that can't be read...
So what i do is i use the import task in sql...which inturn uses the same odbc connection and runs the query on db2..inserts the results into a table in sql..then save the package...Only problem is that i can't edit the transorm task...same memory error...
Any idea why this happens ?? I would like to see how i can get past this using Odbc...
I'm still trying to learn the advantage of having stored procedures. I have a DTS that uses a Transform Data Task to append the result of a view into a table. All operations are done locally in the server.
Do I have any advantage if I write a stored procedure to insert the view into the table, and then call the stored procedure in the DTS, in stead of using the Transform Data Task ?
I am trying to read in a flat file, transform the fields and store into a destination database.
In DTS, this works using Transform Data Task Properties. I define the columns and then have a VB script on the Transformations tab that changes any bad data.
Is there a way to do this in SSIS that I can define the column transformations and re-use my VB scripts?
I have a simple question: is it possible to use Edit and Continue feature when debugging a script task in VSA?
It seems to me that after breaking the execution of the script task and adding some code in break mode, whole edit disappears after leaving VSA environment.
I have enjoyed the Edit and Continue feature when developing in VBA, so I am wondering if it is available in VSA.
I sure would like a quicker way to get to a script's code, then:
1. double-click 2. ctrl+tab to switch to script item in list 3. click on "Design Script" button.
I'm constantly editing scripts and I would LOVE to be able to right-click, "Design Script", bypassing the silly dialog. I've tried creating a macro with no success. While recording, when I click on "Design Script" from the dialog, it actually brings up the macro script in the editor. This task is frequent enough, that it deserves its own context menu entry.
i have too many DTS packages to migrate to SSIS, and while examining a DTS package in BIDS (converted with the migration utility) i tried to edit the resulting migrated package, which opened the DTS interface with the two connection icons joined by the big fat arrow with a gear on it...not exactly what i had in mind, iow, it looks like SSIS on the outside, but its still DTS on the inside. So I stripped out a series of components from a more complex package hoping that simplifying it would reveal the contents of old DTS Transformations tab at least partially set up in a Derived Column transformation. Can i get there from here, or must i recreate every stinking definition in a derived column manually from the ground up? thanks very much for your help
In my current project i have a requirement to assign value of an aggregate transform to a variable. But i need to accomplish it without using a script task.
The Browser role has the task Manage Individual Subscriptions. Fine, the user can create a subscription. The problem is that the reportserver populate the email address text box with the Windows User ID and does not let the user change this to put his email address instead. The text box is greyed out.
I found that to enable the text box I have to add the task Manage all subscriptions to the role "Browser".
This is a major security problem because with this setting any user can edit any subscription.
I suspect that I could work at the Active Directory level to populate a field that would in turn populate the email address with the correct data., however this is not an option for me. I have absolutely no way to do it or get it done. Does anybody has an idea on how I could allow a user to edit his email address in his subscriptions and not let him tamper with other users subscriptions?
Hi JayH (or anyone). Another week...a new set of problems. I obviously need to learn .net syntax, but because of project deadlines in converting from DTS to SSIS it is hard for me to stop and do that. So, if someone could help me some easy syntax, I would really appreciate it.
In DTS, there was a VBScript that copied a set of flat files from one directory to an archive directory after modifying the file name. In SSIS, the directory and archive directory will be specified in the config file. So, I need a .net script that retrieves a file, renames it and copies it to a different directory.
I have a SQL Server 2000/E with 8 GB RAM in the machine.
It is configured to use fixed memory size, at 7GB, and all the appropriate OS switches are set to use that.
Everything had been working fine, but we've been having some production problems and while looking into it, I looked at task manager and while the server performance tab shows that the server is using 7+ GB, the processes tab shows sqlservr.exe at 107,724 K.
Do you think this is a real issue, and that the server might only be using 100 mb of ram? Does anyone have any larger servers like this that they could compare?
I have an XML Task to validate an xml document on disk (size: 78,464K). When I try to validate it I get error: [XML Task] Error: An error occurred with the following error message: "Exception of type 'System.OutOfMemoryException' was thrown.".
Task Manager shows 904,492K Physical Memory Available which drops to about 586,000K when the task fails. Any ideas?
I can't for the life of me figure out why I am getting an error with this simple script. The error I get is "expected end" on line "22" which is the first "elseif" in the nested if statement. This makes no sense as obviously I don't want an end if statement there. Any ideas where my syntax is wrong would be greatly appreciated.
if txncode = "" or IsNull(txncode) then Main = DTSTransformStat_SkipRow exit Function end if
select case txncode case "210" if (Cashin > "0" and Cashin < "1000") then txncode = "210-1000" 'msgbox txncode elseif ("1000" < Cashin and Cashin < "5000") then txncode = "210-1000-5000" elseif (Cashin > "5000") then txncode = "210-5000" else txncode = "210" end if msgbox txncode Main = DTSTransformStat_OK exit function
case else Main = DTSTransformStat_OK exit function
end select
DTSDestination("TransactionCode") = txncode Main = DTSTransformStat_OK End Function
i configure the lookup transform in the data flow task "Input column has a data type that cannot be matched".
This is the query that i use to set the reference table dataset
select firstname, lastname, address, email from customers_dimension cd , cust_test ct where cd.address<>ct.address.
I basically want to try and find all those records that have the same firstname, lastname, email in the customer dimension table where the records do not match. Both the input fields and the lookup fields have the same data type [varchar(max)].
It is pretty confusing, so much so that i did the lookup against the exact same table and got the same error.
Does anyone have a better idea as to what the problem is?
Thankyou
P.S.-This is the caching statement in the advanced tab select * from
(SELECT firstName FROM Customers_Dimension) as refTable where [refTable].[firstName] = ?
I am a newbie on SQL server and my problem is this:
My SQL server runs with many client queries and after a while I can observe that the meory usage of the SQL server shown in the Windows Task Manager is growing up (e.g. 260 MB !!!).
I checked the online books and found the settings "min/max server memory" which I set to
min = 4 MB max = 20 MB
by Enterprise manager.
Then I restarted my SQL server, checked the memory settings again by Enterprise manager and started many client queries. The memory usage in Task Manager nevertheless exeeded the 20 MB.
What is my failure? How can I limit the memory usage of SQL server?
I'm trying to lookup a value in another table linking on a column of datatype DT_R8. The lookup transform is complaining that I can't link on that datatype. However, the documentation says that it should work. I'm using the April CTP. Is this fixed in a later version? Any suggestions?
I'm running a package that has a XML Task in the control flow. This task tranforms a XML file with a XSLT.
The file is about 2 megs on a daily basis, but at the end of the month there is a full dump of data that makes the file to be around 400 megs. There is where my problem is.
I run this on my 2 GB memory workstation and when the memory gauge on the task manager reaches about 1.5gb the package fails with an "Out of memory exception".
I also run this package on a 8GB Ram server, and same applies.
Is there any way of making this package utilize all the available memory, I even increased the virtual memory to see if that helped my issue, but nothing.
I'm receiving an Error Code: 0x80004005 ... a "non-specific error" when trying to use a fairly simple insert in the oleDB command transform. SQL command works fine if I specify the parameters in the values clause of the INSERT statement. If however, I try to use the parameters in setting a variable, I get the 0x80004005 error. Is this a known issue/limitation, or am I just reallly doing something wrong?
The data types ntext and nvarchar are incompatible in the equal to operator. Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code. Exception Details: System.Data.SqlClient.SqlException: The data types ntext and nvarchar are incompatible in the equal to operator.Source Error:
An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below. Thanks , John
i have sql running on a server and i have about 6 pc accessing the db using a vb project. all of a sudden when ever the user tried to update or addnew data to the db the software would hang and i would get a microsoft sql timeout error. once i stoped and restarted the service everything seems to be fine. does the service need to refreshed on a regular basis? or could someting could of set the db in some sort of lock state?
I've SQL Server 2005 Dev Edition and Windows Server 2003 ENT SP2. in the task manager i see that the server use 5GB out of 6GB,but when i arrange the process to see whom takes all the memory i see that the sqlservr.exe takes 150MB(he is the biggest). when i open Perfmon and look on the sqlservr.exe memory use, i see that he takes the 4.5G. i've a problem that the server use alot of cpu time to run users queries,i see that pages/sec counter is very big average between 600-800.
is there any problem with my memory? why the memory reading from the task manager is wrong? if my pages/sec counter is so big do i have a memory leaks + pressure?
I keep encountering this error when I try to install another SQL Server after uninstalling Express: - Performance Monitor Counter Requirement (Error) Messages Performance Monitor Counter Requirement
The System Configuration Check for Performance Monitor counter registry value has failed. For details, see How to: Increment the Counter Registry Key for Setup in SQL Server 2005, in the readme file or in SQL Server Books Online. I've looked up the solution and it says to change the Perflib entry in the register...only I don't seem to have one! this is highly annoying as I can do nothing to remedy the situation. Any ideas?
