Rants. Difficulty To Learn ETL Tools?
Apr 16, 2007
Dear Experts,
I've worked with Oracle since 1995. I have gone
very deep into many of the Oracle features, including
sqlloader, and export/import. And I've done data
modelling even longer.
At the same time, I have done ETL since 1995.
Although, at the Proc, and PLSQL, sqlloader, level.
Map the data. Take data from the source, do any
modifications/transformations that are required,
and insert or update. Easy. The hard part is
determining the mappings.
But I have not been given the opportunity to
work much with ETL tools such as:
Informatica, DataStage, Ascential, Ab Initio
The little bit of experience that I do have,
showed that Informatica was -incredibly- easy to use.
It's a GUI. It's SUPPOSED to be simple!!!
I have missed out on a number of opportunities
because I didn't have a few YEARS of experience
with ETL tools. Which seems odd, because the
tool looks like it requires a max of a week to learn!
Just how difficult are these ETL tools to learn?
Especially if you have already been working with
Oracle, and doing data mappings and loads since 1995?
I'm thinking that it can't be difficult at all.
When you search for newsgroups, there are no newsgroups
for these tools. Although the companies who make
them, might have their own newsgroup.
There are also not many books on these tools.
If you search for books on Oracle, or SQL Server,
you will find a lot of very big, and detailed
books. But there is next to nothing specifically
on the various ETL tools.
Any certifications for any of these tools look
to be much simpler than Oracle's.
To me, the real issue is the mappings. If you
come into a new environment, the data mappings
are completely esoteric to those systems.
No amount of experience with an ETL tool, or any
tool, is going to tell you what the mappings should be.
Questions:
- Just how difficult are these ETL tools to learn
for an experience Oracle pro like myself?
- Other than a GUI, making everything simple to use,
just what are the advantages of using ETL tools?
- what built in functionality do ETL tools
have, that can't be done in PLSQL?
Thanks a lot!
View 19 Replies
ADVERTISEMENT
Dec 25, 2006
I use this in a new query script in SSMS:
use dbtest1
bcp mycsvtable1 in 'C:myDevSQLCSVprojectmyCSV.txt' -T -c
but i get the error:
Msg 102, Level 15, State 1, Line 2
Incorrect syntax near 'bcp'.
I also tried:
myDatabase.dbo.mycsvtable1 and I got the same error
any help pls?
View 4 Replies
View Related
Mar 25, 2014
Am customizing SQL server MGMT tools 2012 for Mass deployment.Client had asked to remove Customer Feedback option from help menu.how to disable that.
View 6 Replies
View Related
Oct 20, 2014
The installation SQL 2008 R2 Management Tools on a Windows 7 workstation fails with the error, The specified account already exists.
Final result: SQL Server installation failed. To continue, investigate the reason for the failure, correct the problem, uninstall SQL Server, and then rerun SQL Server Setup.
Exit code (Decimal): -2068052700
Exit facility code: 1212
Exit error code: 1316
[code]...
View 10 Replies
View Related
Jun 1, 2007
I am running SQL Server 2005 x64 Enterprise under Windows 2003 x64 Enterprise. My current backup strategy uses T-SQL jobs run by SQL Agent (writes out *.bak files) and then I have an Integration Services job that copies the *.bak files to our NAS device. I have performed a restore without issue. The jobs are all automated every four hours via SQL Agent. Is this a sound strategy or are there additional benefits to using 3rd party tools? If so, what are the advantages and which tool provides them?
View 3 Replies
View Related
Jul 14, 2007
I have created a a web application on computer1 and I have now transferred it to computer2. I am trying to attach my database (db1) in VS but I get this error: "Cannot open user default database. Login failed for user: username1". However when I use Management Studio Express I am able to access db1. I'm a newbie on this.
View 3 Replies
View Related
Jan 24, 2008
Hi, I've got two tables. One is a table of metal types:
MetalID | MetalName
--------------------
1 | Gold
2 | Silver
3 | Platnum
The other is a linking table of an object's assigned metals:
ObjectID | MetalID (FK) | Weight
---------------------------------
1 | 1 | 2.00
I'd like to select all metal types, and the weight of any metal that has a matching record for a given object ID. So for ObjectID 1, I want a result set like this:
MetalID | MetalName | Weight
----------------------------
1 | Gold | 2.00
2 | Silver |
3 | Platnum |
I've tried a left outer join on the assigned metals table, but only got the one matching record back. Also if possible, the ideal result would also indicate if it had a match:
MetalID | MetalName | Weight | IsAssigned
-----------------------------------------
1 | Gold | 2.00 | 1
2 | Silver | | 0
3 | Platnum | | 0
Any help is appreciated!
View 3 Replies
View Related
Sep 20, 2007
Login failed for user 'TOSHIBA-USERASPNET'
I know that the file persmission for the web application have to include aspnet, so i keep resetting the folder permission for aspnet in file manager, but the login failed keeps coming back every day or two
problem is after working with VS05 Pro, SQL Server Management Studio CTP, somehow the aspnet persmission get changed, use alot of sqldatasource wizards and often there is a conflict/hang between the datasource wizard and the need to have the mdf in a dettached state within VS server explorer,
not sure but the procedure to fix this seems to be to reboot, detach and re-attach the mdf in the Sql server Studio tool, re-apply the aspnet file permission on the web app folders (wonder should i be doing this in IIS instead), make sure the mdf within server explorer is detached, the it works
anyway, getting real tired of the resulting delays and design time derailment, clues greatly appreciated, thanks
sometimes i can use View in Browser when in VS05 form view and i wont get the aspnet folder permission error and other times i do.
last thing, is it a bad idea to give aspnet full permission for the entire web applicaiton??
View 2 Replies
View Related
Oct 28, 2005
Hey guys, I am a newbie here, so please bear with me. I have installed SQL Server 2005 CTP on Machine A and MSDE on Machine B. Both these contain the PUBS database beside others. On Machine C, I have installed "ASP.Net Web Matrix" and I want to be able to connect to either Machine A or B to access the PUBS database. It connects to Machine B, when I put in the Servers IP address. But everytime I try to connect to Machine A, it gives me an error saying, "Unable to connect to the database. To connect to this server you must use SQL Server Management Studio or SQL Server Management objects(SMO) ". I heard that connection strings are needed to access the SQL Server 2005 but I have no idea where to begin. Do I need to create special users to access the Server or will Windows authentication work ? Could anyone help me out in connecting to the SQL Server 2005 CTP?
View 15 Replies
View Related
May 25, 2006
I am trying to transfer data into SQL Server from Excel using DTS.
I get error for a particular field:
Data for Source Column 3('Col3') is too large for the specified buffer size.
I gathered from other resources, that this error is due to some record in the excel sheet for which that particular field is too big.
and it reads only the first 8 records to determine a data type.
http://support.microsoft.com/default.aspx?scid=kb;en-us;Q281517
the fix is to chnage the registry value, as mentioned in the above link. But hat is not an option for me, as that slows down the process a lot.
Does any body else has any other suggestion for this?
I have an idea, that worked, but for that I have to manually insert a record on the top in the excel sheet, with a big size data in that field (which gives problem), and then run DTS, later delete that record.
To automate this idea, I tried to do a DTS from a dummy table (with a record with big data in it) to this excel sheet, but it puts the record at the bottom of the sheet. Is there any way to put this record on the top?
Any help in this regard will be greatly appreciated.
Thanks
Nicky
View 3 Replies
View Related
Apr 30, 2007
Hi,
I installed SqlExpress with Advanced services on to a server running Small Business server 2003.
I needed to uninstall SqlExp, and thought I did so through Add/Remove programs. For some reason it did not seem to uninstall. Foolishly I did not check, and then tried to install another copy in a different directory. I've then ended up with complete mess.
Tried to do another uninstall, but again, ended up with two incomplete versions of express.
Is it possible that part of my problem revolves around the fact I have a mirrored drive with Raid 1 installed.??
Whatever, I need to know how to clean up the mess and start again. Preferably without having to do a format and reinstall SBS.
Tailor
View 1 Replies
View Related
Dec 11, 2007
We are using a system that has uses four instances. On each client to the server we used the ODBC settings to connect to the different instances. We have since reinstalled the server, and now we are unable to find or 'see' any of the databases, except for locally.
E.g. The first database we install is named Foo, with database Bar. It is set up on port 1433.
The second named instance is Foo2, with database Bar2. It is set up on a dynamic port.
We now try to connect to the database with ODBC. We connect to SERVERFOO, and then select the BAR db. It works fine.
We then try to connect to the database SERVERFoo2, it lets us in, and then all we can select is the BAR db. I don't know what is causing this. We never before had to edit the settings in the client config for the odbc settings (e.g. to set manually to TCP port 1433) and I have checked the sql config manager to ensure that tcpip settings are allowed and will "ListenAll".
What more do we need to do? I think the browser should be installed, but my collegue disagrees.
Any ideas as to why we can only see the database referenced to 1433 port, and why no other port works, when we never had to do that before?
Thanks a bunch in advance,
Regards
Carl
View 2 Replies
View Related
Jan 31, 2005
Hello everyone! Many thanks in advance for taking the time to help me out. I’ll also apologize upfront for the longwinded email, but I seem to be really stuck in a rut. I've been writing web apps for 3+ years in ASP and am finally taking the leap into ASP.net (a bit behind the curve, i know). I have a few books and have gone over the tutorials on this site. I am realizing that the syntax (if using VB) is much the same, but also realize how much richer asp.net is in comparison to traditional ASP.
I'm having some major issues in my learning process that stem from using the tutorials and attempting to be efficient with VS2003. I feel as though I’m missing something fundamental that could be causing my problems. My area of focus right now is data access, using connections, adapters and datasets.
The tutorials on this site show all of the examples by hardcoding the data access into the ASPX page. The tutorials have me importing the proper namespaces for data and sqldata access at the top of the page. This seems to work fine and dandy if I were to be coding my pages from a standard text editor, but I would like to use the richness of the VB.NET studio gui to expedite my work.
My first problem lies if I try to manually code the data access in the private class defined for the page in the codebehind section. Because it will not allow me to import multiple namespaces, the only way I get it to work would be to include the complete namespace for the object I’m trying to use (ie: system.data.sqlclient.sqconnection). On top of this, the datasets I define aren’t available as options when I try to bind them to objects in the GUI.
On the flip side, I tried to use the SQLconnection, Dataadapter, etc objects in the gui, but I can’t seem to find where the code is dynamically written for these, nor how I can, for example make this sort of connection use an application-variable level connection string. The only way I can see to make this would be to define the connection for each web form, which seems silly when I’m trying to deploy each solution multiple times with different databases.
I apologize for my ignorance, as this is probably fairly simple to overcome. If someone could point out what I’m doing wrong, or point me in the right direction, I’d be very appreciative. I am sick of spinning my wheels with this, and keep getting tempted to go back to using traditional ASP, just so I can get my job done.
Thanks again,
Tbldev
View 2 Replies
View Related
Nov 23, 2005
does anyone know where I can learn how to make forumlas to use in my table fields?
I have two mauals on SQL Server and niether of them cover formulas.
Thanks,
token
View 7 Replies
View Related
May 15, 2006
anyone know any site that can provide "EASY" to understand examples about joins?
View 2 Replies
View Related
Jun 12, 2007
I was just looking for opinions on the best place to pick up SQL skills. Community college course? Online courses? Grad school? I've finished undergrad, if that helps anyone have an idea of my current situation.
View 4 Replies
View Related
Dec 13, 2007
hi,
I am new to sql server. I would like to learn sql server. I have knowledge of databases. Can anyone guide me on this?
View 6 Replies
View Related
Jul 23, 2005
How to learn sql from beginning?I would like to learn sql but don't have a clue.can you help me?where would I start?
View 1 Replies
View Related
Aug 22, 2005
I can't get a script to run that's supposed to generate a QueryParameters dialogue to take inputs and then run the query - forexample, the following.. . .and fl.flow_name = [[TRUE][FLOW NAME][@?]].. . .generates SQL Query Analyzer exceptions about "Incorrect syntax near'FLOW NAME'.Suggestions?
View 1 Replies
View Related
Aug 2, 2007
I have several DTS packages I need to move to SSIS. I am having trouble understanding the new tools available and how I translate my lookup and ActiveX scripts into the new format. I feel like I just need a jump start to get me on the right road. Does anyone have any good suggested links to get me started with the new technology and get my head unstuck from the old DTS?
Thanks,
Eva
View 1 Replies
View Related
Oct 25, 2007
Hi all.. I install SQL Express install.. I am looking for a job, and I see companies posting want ad's for SQL server admins.
My one question... what is the difference of SQL Server vs OpenSQL ?
Thanks,
Happy Tom
View 1 Replies
View Related
Aug 1, 2006
I am an experienced web developer using PHP and MySql have experience with VB.
What is the best way for me to learn programming pocket pc's? Is using sql server mobile the best offline database to use as I will be using MySql Compact framework to connect direcly to our Linux server.
Any help is much appreciated as I can't seem to find any useful tutorials on quering an sql databse to update, insert, read or delete. I have created a datebase however, I just don't know how to use it.
Thanks in advance.
Mark
View 7 Replies
View Related
Jun 3, 2007
Hello frdz, I have two tables in sqlserver 2005. I have created the stored procedure for insert,update data.I m creating my application in asp.net with C# Table-1 CUSTOMERFields:customerid int identity,cardid int,customername varchar(20) not null,address varchar(20) not null,city varchar(20) not null,emailid varchar(20) Table-2 CARDFields:cardid int identity,cardtype varchar(20) not null,carddetails varchar(20) not null INSERT INTO CUSTOMER (customername ,address,city,emailid) VALUES (@customername,@address,@city,@emailid) SELECT @customerid = SCOPE_IDENTITY()/* HELP HERE NOT ABLE TO GET DATA OF CARD */ SELECT @cardid = cardid from CARD where customerid =@cardid Pls tell me how to insert the data ...There is only one cardid for only one customerid both should be unique no duplication....One customer can have only one and one card...
View 5 Replies
View Related
Aug 28, 2007
I am trying to create stored procedure i Query analyzer in visual studio 2005. I am havingdifficulty though. Whenever I press the execute button, here is the error message I get:
Msg 102, Level 15, State 1, Procedure MarketCreate, Line 21Incorrect syntax near 'MarketName'.
Here is the stored procedure. Note that the very first column in named "MarketId" but I did notinclude it in the stored procedure since it should be auto generated.
USE [StockWatch]GO/****** Object: StoredProcedure [dbo].[MarketCreate] Script Date: 08/28/2007 15:49:26 ******/SET ANSI_NULLS ONGOSET QUOTED_IDENTIFIER ONGO
CREATE PROCEDURE [dbo].[MarketCreate]
( @MarketCode nvarchar(20), @MarketName nvarchar(100), @LastUpdateDate nvarchar(2), @MarketDescription nvarchar(100))
ASINSERT INTO Market( MarketCode MarketName LastUpdateDate MarketDescription)VALUES( @MarketCode @MarketName @LastUpdateUser @MarketDescription)
View 2 Replies
View Related
Feb 7, 2005
I created a web form where the user fills in some data and when he submits the form, I do an insert into he database table. The problem is, how can I get the data from the form into the insert statement?. here is the code:
Dim Message As String
Dim connStr As String
Dim myConnection As SqlConnection
Dim mySqlCommand As SqlCommand
connStr = "server=SIMIVSdotNET;Trusted_Connection=yes;database=AeroSea"
myConnection = New SqlConnection(connStr)
mySqlCommand = New SqlCommand("INSERT INTO TravelRequestEntry (CustomerID,Name) Values (1,name.text)", myConnection)
If I execute the above code, then nothing gets updated. When I change the insert staement into the following,
mySqlCommand = New SqlCommand("INSERT INTO TravelRequestEntry (CustomerID,Name) Values (1,'myname')", myConnection) then,
value 1 for customerID field and myname in the namefield is added.
I know I am doing something stupid, but can't figure it out.
I am confused. please help me.
View 2 Replies
View Related
Dec 1, 2005
This is probably a very simple question but i am having problems with inserting information into database
The function takes the values "FirstName" And "LastName" from A table Called "Customer" and the value "ProductID" from a table called "Products" and inserts them into a table called " NewOrder".
Everything compiles ok but when I press the button the information is not uploaded to thedatabase. ( There is no error message)
This is the stored procedure
CREATE PROCEDURE SP_NewOrder(@CartID char (36), @CustomerID Varchar (50))AS
INSERT INTO NewOrder (FirstName, LastName, ProductID)
SELECT Customer.FirstName, Customer.LastName, Products.ProductID
From Customer,Products Join ShoppingCart ON Products.ProductID =ShoppingCart.ProductIDWHERE ShoppingCart.CartID = @CartID AND Customer.CustomerID = @CustomerIDGO
This is the Function
Public Shared Function CreateOrder() AS String Dim customerID As integer Dim connection as New SqlConnection(connectionString) Dim command as New SqlCommand("SP_NewOrder",connection) command.CommandType = CommandType.StoredProcedure command.Parameters.Add("@CartID", SqlDbType.Char,36) command.Parameters("@CartID").Value = shoppingCartID command.Parameters.Add("@CustomerID", SqlDbType.Varchar,36) command.Parameters("@CustomerID").Value = customerID Try
connection.Open() command.ExecuteNonQuery() Finally connection.Close()
End TryEnd Function
This is the page code
Sub btn3_Click(sender As Object, e As EventArgs)Dim cart as New ShoppingCart()Dim shoppingCartID As IntegerDim customerID As Integer = Context.Session("worldshop_CustomerID")cart.CreateOrder()End Sub
Can Anyone see where I am going wrong
Many thanks
martin
View 2 Replies
View Related
Aug 21, 2006
I'm new to SQL Server and I'm using 2005 Express with SSMSE, and having trouble adding a record to a table "manually" by typing in the data.
I find I can change most of the fields by viewing the table in SSMSE and just clicking on the field and editing it then clicking "execute SQL" but for some reason the changes don't "take" when a date field is involved.
Is there a special or proper way to enter a date that I'm not aware of? I'm not having much success figuring out this online help stuff from within SSMSE, I keep getting to help on the help system itself (oops).
TIA!
View 3 Replies
View Related
Aug 27, 2007
I am probably missing something simple here but...
I have a CLR Stored Procedure where I am attempting to execute multiple SQL commands. Here is what happens.
Case One
1. Stored Procedure is invoked.
2. Create SQL Connection.
3. Open the connection.
4. Begin Transaction.
5. Create Command from Connection.
6. Set Command objects Transaction property to transaction created above.
7. Set Command Text Property to SQL Query.
8. Execute Query via ExecuteReader and get SQLReader.
9. Read query result set.
10. Close QueryReader.
11. Set Command Text Property to another SQL Query.
12. Execute Query
This is where I get one of two exceptions.
1. An Exception stating that I cannot have parallel transactions.
or
2. An Exception that I have an open SqlReader that must be closed.
Case Two
1. Stored Procedure is invoked.
2. Create SQL Connection.
3. Open the connection.
4. Begin Transaction.
5. Create Command from Connection.
6. Set Command objects Transaction property to transaction created above.
7. Set Command Text Property to SQL INSERT command.
8. Execute Insert command.
9. Set Command Text Property to SQL Query command.
10. Execute Query Command via ExecuteReader.
At this point the stored procedure appears to hang.
Could someone please enlighten me if I have missed something obvious while reading the manual, regarding what you can and cannot do?
Thanks in advance.
View 2 Replies
View Related
Nov 30, 2006
Panicked, as usual. Who says it's great being a sole proprietor?Using MS-SQLServer:Three tables: A_Appointment, AX_Appointment_Entity and E_Entity.AX_Appointment_Entity is an intersect/association table betweenA_Appointment and E_Entity. One appointment may have many attendees(Appointment_Entity). One attendee (Entity) may have manyappointments.My task is to delete all appointments and relatedAX_Appointment_Entity rows where the number of attendees is one orless.I'm great at standard select or delete queries. Because this straddlestables in a way I'm less skilled in, I'm pleading for help.Thanks for any ideas. fwiw, I'm using Transact-SQL.BLink--------------------------"The worst thing about censorship is [redacted]"
View 6 Replies
View Related
Jul 1, 2007
I have been running SQL Server 2005 Express (basic) Instance MSSMLBIZ in conjunction with Microsoft Office Accounting 2007 Professional.
I want to make a "clean install" of SQL Server 2005 Express Advanced, SQL Server2005 Express Tools, in order to create additional Reports in Microsoft Office Accounting 2007 Professional.
I ran uininstall on the basic SQL Server 2005 Express, but Native Client did not uninstall; the following message was posted:
"An installation package for the product Microsoft SQL Native Client cannot be found. Try the installation again using a valid copy of the installation package 'sqlncli.msi'."
I then attempted to install SQL Server 2005 Express Advanced, but it failed to load Native Client. I then uninstalled all instances, deleted the SQL Server Express Files in Programs, and ran "CC Cleaner" to clear the Registry.
I then attempted to uninstall Native Client again, and received the following message:
"This action is only valid for products that are currently installed."
I the returned to CCCleaner Tools to attempt to delete the residuals and received the following message
"Cannot delete msi installer."
I ran "Search - *.msi" and there is no instance of sqlncli.msi visible.
I have Removed Registry Entries for SQL Express,
except HKEY_CLASSES_ROOT instances.
Should I delete these?
Have I forgotten or omitted something??
Please Help.
View 4 Replies
View Related
Jul 7, 2006
I'm developing an application in VB 2005 Express using SQL 2005 Express. I need to put a timestamp into my table each time I create a row...
The following is a snippet...
Dim DDate As [SqlDateTime] = Now()
Dim TheQuery As String = "INSERT INTO Groups (PC_Name_Stamp, OperatorNo, Group_Type, Date_Time) VALUES ('Development', '2', 'Test',' " & DDate & " ')"
Which won't work as I am attempting to concatinate a SqlDateTime into a string.
My best guess is that I need to somehow to use a DEFAULT value in the table that persists so each time a row is created the datetime it was created is saved with the row, rather than being re-calculated each time the table is opened. There are probably several other ways of doing it and this may not be the easiest.
I'm not a programmer, just an Engineer, so I can only read Help for 5 minutes at a time.
View 6 Replies
View Related
Jul 16, 2003
Hi:
AS a newly Master degree graduate student in IT field. My M.S. degree training has been emphasized in database developer, Web developer, Web/database developer, network, and network and computer security.
My personal interesting are database and web. have experienceon java servlet and database(create a web site), try ASP and dataabase now, but I don't have any work experience(come from other country and change major)
hope can get advice from kindness prople what is suitable to learn DBA or oracle ? conside about difficult level, cost, and suite for future job market
Thank you
View 5 Replies
View Related
Sep 19, 2001
Greetings:
I would like to learn to write SQL scripts to use with SQL 2000 and would like a good reference. I read the book "SQL Queries for mere mortals" and that was a start, but really didn't provide me enough depth to write the complex scripts that I need. Idealy something that goes into the programming logic like PL/SQL in Oracle did. Basiclly, if I had something that would allow me to interperet some of the scripts I see on Swynk so I can modify them to meet my needs, I think that would be a great place to start.
Any recomendations?
Thanks.
View 1 Replies
View Related