What What Is The Best Way To Transfer Data To MySQL Periodically
Aug 1, 2007
Hi everyone, here is my situation and what I am hoping to accomplish.
I want some data from my msSQL to be seen on my website but I do not want a website to access the msSQL database due to performance etc (the database is not intended for website use).
Innitially I was thinking of exporting the data every 24hours to a text file that the website would access, but now I am thinking it would be better to have some data sent to a mySQL database that I have from my webhost.
I am not really sure what the best way to do this is, any help please?
thank a lot
View 13 Replies
ADVERTISEMENT
Apr 7, 2008
I have been working with a MySql 2005 database and a MySql database. I am using a MySql database in my C# application, and the MySql database is on-line. My application is generating queries and with those pieces of information I am updating the on-line data base.
It is working for €œtext€? information but I need to add some images, too. I see two possibilities:
1. I can either use an binary or image field in my MySql database and send this information on-line (but I don€™t know if the fields are compatible MsSql - MySql)
2. Or I can produce a folder with the images and upload that folder, in this case I have the path information in my databases.
Can you give me other possible suggestions about how to solve this problem?
View 1 Replies
View Related
Jun 25, 2015
I have a table that has a primary key that is auto incremented by 1. This table's data is cleared out periodically and as data gets added the auto id primary key continues to increase in numeric value. Once the data is cleared from the table the auto id names could be used again(the eventId is not stored) Currently the eventID is at 26,581,399. I know the maximum int value is 2,147,483,647.
How should I handle this? or rebuild the table every time the data is cleared(problematically)?
View 3 Replies
View Related
May 30, 2008
Is it possible/advisable when transfering very large amounts of data from server to server to:
trasnfer the data to a new table first
second alter new table adding indexes, defaults, ets based on original table
if it is what flow item would be used to transfer/alter the indexes and defaults?
I'm very new to ssis so the more detail you can give the better.
Thanks
View 5 Replies
View Related
Mar 19, 2014
In the full recovery model, if i run a transaction that inserts 10MB of data into a table, then 10 MB of data is moved in the data file. Does this mean then that the log file will grow by exactly 10MB as well?
I understand that all transactions are logged to the log file to enable rollback and point in time recovery, but what is actually physically stored in the log file for this transactions record? Is it the text of the command from the transaction or the actual physical data from that transaction?
I ask because say if I have two drives, one with 5MB/s write speed for the log file and one with 10MB/s write speed for the data file, if I start trying to insert 10 MB of data per second into the table, am I going to be limited to 5MB/s by the log file drive, or is SQL server not going to try and log all 10 MB each second to the log file?
View 6 Replies
View Related
Jul 13, 1999
Hello:
In order to eliminate all users who have been using the SA login, I would like to trap all users periodically who are logged in. We have changed the
sa password but just to monitor the login/userid usage, I have the following question:
1) how can I periodically write out to a log, which users are logged in to a given database at certain times of the day?
2) Which steps would I follow to do so?
Thanks.
David Spaisman
View 3 Replies
View Related
Jun 2, 2008
I have a folder on an SFTP server in our internal network which gets flat files periodically (almost every minute) from another server. The file structure is like this:
Flat File Format•Line 1—List of field names comma separated •Line 2—List of field type comma separated •Line 3—Data comma separated •Line 4—Data comma separated and so on...
All the files will be like this without the .csv extention. There are a lot of fields and creating a column for each field manually will be a pain. Heres what I am trying to do:
1. Create a process that runs periodically on the server and imports data from files into the SQL server table.
2. Use the information in line 1 and 2 to create the schema of the table and then ignore those lines in every import (the data should be appended to the existing data).
What are my options?
Thank you all,Bullpit
View 3 Replies
View Related
Aug 28, 2006
Hi,
I have my SQL server installed and running on a windows 2003 server. Sometimes, the server stops unexpectedly. I want to know if there is any mechanism to alert as and when the SQL server or SQL server agent goes down.
I guess everything is a windows service. Can we have a mechanism to test this service from a script and send an alert mail when the server goes down? How can this be done from a script?
Thanks in advance
-Sudhakar
View 4 Replies
View Related
Jul 20, 2005
Hi,I have a requirement to update a table in SQL Server through a storedprocedure,the stored procedure should run periodically, say once in a month, andupdate the table.I should not use any external programs to call thestored procedure, is there any other way to do it without using anexternal programs.Thanks in advance,Rajan
View 2 Replies
View Related
Dec 7, 2006
Hi, can I create a background process in SQL Server doing specific jobs periodically? Stored procedure is the only solution?
View 4 Replies
View Related
Feb 12, 2007
Good Morning
Has anyone successfully used cherry's oledb provider for MYSQL to create a linked server from MS SQLserver 2005 to a Linux red hat platform running MYSQL.
I can not get it to work.
I've created a UDL which tests fine. it looks like this
[oledb]
; Everything after this line is an OLE DB initstring
Provider=OleMySql.MySqlSource.1;Persist Security Info=False;User ID=testuser;
Data Source=databridge;Location="";Mode=Read;Trace="""""""""""""""""""""""""""""";
Initial Catalog=riverford_rhdx_20060822
Can any on help me convert this to corrrect syntax for sql stored procedure
sp_addlinkedserver
I've tried this below but it does not work I just get an error saying it can not create an instance of OleMySql.MySqlSource.
I used SQL server management studio to create the linked server then just scripted this out below.
I seem to be missing the user ID, but don't know where to put it in.
EXEC master.dbo.sp_addlinkedserver @server = N'DATABRIDGE_OLEDB', @srvproduct=N'mysql', @provider=N'OleMySql.MySqlSource', @datasrc=N'databridge', @catalog=N'riverford_rhdx_20060822'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'collation compatible', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'data access', @optvalue=N'true'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'dist', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'pub', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'rpc', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'rpc out', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'sub', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'connect timeout', @optvalue=N'0'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'collation name', @optvalue=null
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'lazy schema validation', @optvalue=N'false'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'query timeout', @optvalue=N'0'
GO
EXEC master.dbo.sp_serveroption @server=N'DATABRIDGE_OLEDB', @optname=N'use remote collation', @optvalue=N'false'
Many Thanks
David Hills
View 7 Replies
View Related
Mar 18, 2015
I have a job that runs nightly, rebuild index. job runs fine every night but every few weeks it fails.
USE msdb
GO
EXECUTE dbo.IndexOptimize
@Databases = 'USER_DATABASES',
@FragmentationLow = NULL,
@FragmentationMedium = 'INDEX_REORGANIZE,INDEX_REBUILD_ONLINE,INDEX_REBUILD_OFFLINE',
@FragmentationHigh = 'INDEX_REBUILD_ONLINE,INDEX_REBUILD_OFFLINE',
@FragmentationLevel1 = 5,
@FragmentationLevel2 = 30,
@SortInTempdb = 'Y',
@UpdateStatistics = 'ALL',
@OnlyModifiedStatistics = 'Y'
This calls the Sp that does the Reindex. It fails at the update statistics with a very generic message. like " Command: UPDATE STATISTICS [xxxx_DB].[dbo].[xxxx_xxx] [_WA_Sys_00000007_49C3F6B7] [SQ... The step failed."
I suspect it has more error but this is all it is showing me when I right click on the job history. therefore, I updated the job step in the advance tab with log to a txt file. Am I on the right track or there is another way to see error some where else.
I looked at the logs but they didn't show any thing.
View 9 Replies
View Related
Oct 16, 2007
for some filegroups, we are turning readwrite back on periodically to trickle some data into an archive. This lasts a few seconds and then we turn readonly back on. What is the impact of doing this while a query is running on the archive?
View 1 Replies
View Related
Mar 16, 2007
I need to import data to mysql,
and idea abt that?
thanks
View 6 Replies
View Related
Feb 12, 2007
Hello
I am looking for a way to migrate my data from a MySQL database to a SQL2005 Express data base. All of my MySQL Schemas only have 1 or 2 tables in them so I would imagine that it isn't that hard to do. I treid just exporting it to a CSV file with the intention of just using import/export in MSSQL but in the express edition, it ain't there. Like I stated all of my schemas are only 1 or two tables none are linked in any way they are independant table and the most records any one of the tables contain is around 250. Any suggestions?
View 9 Replies
View Related
Jun 11, 2007
My vendor requires data to be sent in Excel format. Some of my tables have rows over 65,536 so I need to use Excel 2007 (Max of 1,048,576). Right now my data sits in SQL 2000. I am using MS SQL Enterprise Manager 8.0 to prepare the data. Is there some kind of add on or selection I am missing to use DTS to export from SQL to Excel 2007?Thanks in advance.
View 3 Replies
View Related
Jun 9, 2013
I have two database(MYDB1 , MYDB2) on two different server's(SERVER1 , SERVER2) . I want to create an store procedure in MYDB1 on SERVER1 and get some data from a table of MYDB2 on SERVER2. How can i do this?
View 5 Replies
View Related
Nov 15, 2006
I have an excel sheet that contain colummns as in a table in a sql database i want to transfer this data from the sheet to the table frombusiness logic code layer not from the enterprise manager by wizardwhat can i do?? ...please urgent
View 1 Replies
View Related
Oct 2, 2007
We have a vendor who has an SSIS package that executes a DTS package. We've asked that they migrate the DTS code completely to SSIS, but that is something that will not be done in the near future. The package is scheduled to run every 5 minutes through a SQL Server scheduled job. 95% of the time the package executes without an error, but occassionally the following error is reported.
Date 10/2/2007 7:35:00 AM
Log Job History (Pyxis - Data Load)
Step ID 1
Server DEVSQL1V5
Job Name Pyxis - Data Load
Step Name Run SSIS Package
Duration 00:00:03
Sql Severity 0
Sql Message ID 0
Operator Emailed
Operator Net sent
Operator Paged
Retries Attempted 0
Message
Executed as user: Domain_NameSQLService. The return value was unknown. The process exit code was -1073741819. The step failed.
When I look at the DTS and SSIS package logs no errors are reported and each log indicates the package completed successfully.
Any ideas what this exit code is indicating or how to further troubleshoot the problem?
Thanks, Dave
View 4 Replies
View Related
Sep 4, 2007
Hi All,
We will replace our website which currently build in php and mysql into .net and sql server 2005. What is the best way to migrate all the user account from current database in mysql into sql server, also considering that there is different database table and fields?
Thanks in advance.
View 2 Replies
View Related
Mar 30, 2008
If this has been discussed before i apologise as i am fairly new to the asp forum and was not sure where to search for threads.
I am upgrading to a new web plan that supports asp and i noticed that godaddy supports all of the above databases. I was curious if there are any advantages to using one db over the others as far as web is concerned?
What i am looking to do is handle guestbook, logins for registered users which would control access to certain downloads and possibly pages as well. And it was also advised that i look into using a database to store and display dynamic information in my master page to only show the updated information instead of a complete new page each time. This would save on having to manage so many pages.
So i would really appreciate any advice on the databases as i will be making my decision to go with a specific web host based on this. I would also appreciate any advice on a good web host for asp and database support.
Thank you Jeff
View 2 Replies
View Related
Mar 28, 2008
problem is I don't have unfettered access to the MS SQL Server(7), so I need to send instructions on how to do it to a client.
After reading up a little, I figured "select view into ##tmp_table", and then dump the table, which, if I'm right, means I'll have an SQL dump that I can quite easily import into MySQL.
Problem,: What's the syntax to dump that temp table, or is there a better way to import the data into MySQL
TIA
View 5 Replies
View Related
Sep 18, 2006
Hi All
I'm trying to import data from mySQL database to SQL server 2005. I installed mySQL odbc driver (3.51) and configured system DSN. However when I start SQL server import/export wizard mysql is not an option in data source dropdown.
What do I miss?
Thanks,
Vlad.
View 2 Replies
View Related
Oct 27, 2007
I'm trying to use linked server to import big amount of data(around 9 million rows) from mysql to a sql 2005 table.
I plan to create a stored procedure and use job agent to run it at off-peak time everyday. The SP is like:
.....
Truncate table sqltblA;
Insert Into sqltblA(col1, col2, col3)
Select col1, col2, col3
From OpenQuery('mysql', 'Select col1, col2, col3 From mytblB')
.....
But when I tried to CREATE the above SP from management studio, seems the sql server was trying to get all data from table mytblB and ended up with failure after several minutes hang. The error message is sth. like "running out memeory". BTW, during that several minutes hang, I can't query mytblB using mysql's tool as well. it seems to me that table got locked.
However if i try to change the returned result to 100,000 rows by changing script to
Insert Into sqltblA(col1, col2, col3)
Select col1, col2, col3
From OpenQuery('mysql', 'Select col1, col2, col3
From mytblB Limit 100000')
The SP could be created without any problem and running the SP could get the data in table sqltblA.
But that's not what I want, I need all rows instead of a certain amount of rows.
Does anyone know what's going on there when I try to CREATE that SP and any solution to it?
Plus I tried to use SSIS as well. When I'm configuring the DataReader source, which uses ADO.NET's ODBC option to connect to mysql, if its sqlcommand is "select * from mytblB" without the Limit key word, then the configuration page will hang there as well and table mytblB is not accessible by using mysql tool. I'm just sick of wasting time on that and that's why I chose to use SP istead of SSIS. But same result. :-(
View 11 Replies
View Related
Jul 23, 2005
Hello group,i am relatively new to SQL-Server database, but i have lots ofexperience with DB2 and Oracle Database. One of my tasks is setting upa replication between a Mysql-Database running on Linux and one of ourSQL-Servers.How do i achieve this ?If i understand the documentation correctly you have to program thereplication mechanism for yourself or you have to use some third partytool.Could anyone please outline, how to set up the replication mechanism(pointing me to some web-site should be enough) and also tell me ifthere is any third party tool.Thanks in advance and greetings from ViennaUli
View 1 Replies
View Related
Jul 20, 2005
Hi all.I need to set a oneway replication of some data from MSSQL (running underWindows 2000 server) to MYSQL (running under Linux).Do you have some ideas to solve the problem?Thank youLuca
View 1 Replies
View Related
Feb 27, 2007
Good Morning
the available oledb providers for mysql don't seem to work with sqlserver 2005.
So whats the best way these days of exposing data from within sql server from a mysql data base.
What I wanted to do was create a linked server connection to the mysql server using either oledb or odbc, but neither seem to work.
There is a .net provider for mysql, but that won't work to create a linked server connection.
any ideas appreciated.
What I want to do is write some scheduled proceedual sql from within sql server to query some tables in mysql and update some sqlserver tables.
thanks
David Hills
View 5 Replies
View Related
Feb 13, 2008
Please help - I am dealing with data transfer from multiple tables to multiple tables - what is the best practice to get this done? So far I have my connection to MySql figured out and I am using a DataReader source to get the data. What is the approriate Data Flow Transformation to pump data into three different tables in MS Sql 2005 database from three different tables in MySlq database? So far I was able to figure out how to do this for one table only...
Thanks,
Galina
View 12 Replies
View Related
Aug 22, 2006
I'm attempting to create a new GUI for an existing MySQL database I have. I would like to program this application using Visual Studio 2005 using the Visual C++ or C# language.
I'm having trouble connecting to the database though. When I attempt to add it as a data source I get the following error: "Could not retrieve schema information for table or view"
I'm using the MySQL ODBC driver version 3.51 and MySQL versoin 5.0. Visual Studio 2005 Professional Edition.
Can someone help me get this project started? How do I connect to my database?
Thanks!
View 4 Replies
View Related
Sep 7, 2007
I need to export tables to a MySQL database. I created an ODBC data source for the MySQL database however not sure how to develop a package to export SQL Server data to MySQL.
Any suggestions?
Thanks
View 3 Replies
View Related
Aug 29, 2006
I have created a SSIS package that transfer data from a Foxpro database to an instance of SQL Server 2005 Express. I used the wizard to create the package but I load and execute the package within a custom application that I have written in C#.
The way the custom application is intended to work is that the user can have the database in any location on the computer and all he has to do is specify the location then the application programatically changes the location of the source on the package that it has loaded and then execute it. When I initially run the package the first time (using the original path), it works fine and transfers the data. However, every subsequent time I run the application and specify a different path, the database on the SQL Server side gets created as expected but the data is not transfered!
Where am I going wrong? Do I need to save the package after I modify the source then reload and run it again or do i need to change something else in the Data Flow to make this work?
View 4 Replies
View Related
Nov 26, 2015
I am newbie to MDS of SQL,want to know how we can transfer tables from two different SQL Databases to MDS.Suggest me the steps to proceed with any examples.
View 2 Replies
View Related
Apr 17, 2007
hey guys... i have some problem here... i am trying to display data out on the text field and these are the codes that i have added... i have a few pages with the same codes but onli this particular page can't work...
when the webpage first load, it will load all the username onto ListBox1... when the user choose a data from ListBox1 and click button3, it will show all the data of that particular user that the user had selected and display them on the text fields provide... but the data could not display the data... is there something wrong with my codings??
These are my coding:
Imports System.Data
Imports System.Data.SqlClient
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs) Handles Me.Load
Label6.Text = Session("Un")
Dim connSel As New SqlConnection("data source=localhost; initial catalog=Sourcing; integrated security=true")
Dim adapSel As SqlDataAdapter
Dim mySQL As String
mySQL = "select UserName from Users "
adapSel = New SqlDataAdapter(mySQL, connSel)
connSel.Open()
Dim dsSel As New DataSet
adapSel.Fill(dsSel)
ListBox1.DataSource = dsSel
ListBox1.DataTextField = "UserName"
ListBox1.DataValueField = "UserName"
ListBox1.DataBind()
connSel.Close()
End Sub
Protected Sub Button3_Click(ByVal sender As Object, ByVal e As System.EventArgs) Handles Button3.Click
Dim conn As New SqlConnection("data source=localhost; initial catalog=Sourcing;" & "integrated security=true")
Dim cmd As New SqlCommand("select * from Users where UserName = '" & ListBox1.SelectedValue & "'", conn)
conn.Open()
Dim dr As SqlDataReader
dr = cmd.ExecuteReader()
Do While dr.Read()
UserTxt.Text = dr("UserName")
PwdTxt.Text = dr("Password")
BranchTxt.Text = dr("Branch")
CountryTxt.Text = dr("Country")
PriTxt.Text = dr("Priority")
Loop
dr.Close()
conn.Close()
End Sub
End Class
View 4 Replies
View Related
