I have an Access database that updates each 5 minutes with data from a weather station. As you can imagine the access database is becomming huge, so I would like to get that data into SQl Express to make queries faster and better connectivity with visual webdeveloper.
There is no way I can get the data directly into the SQL Express database, as the vendor only supplies a tool for MySQL and access through odbc.
Is there a way to sync the access database and my SQL Express each 5 minutes?
And off course not manual
This has been happening to me since I started using Configuration files. I use one XML config file that stores Machine Specific settings and one connection string to my Metadata database. The problem is the database connection.
When I set the conection in the Configuation file, save, close and reopen the package, a dialog box opens with the title "Synchronize Connection Strings".
To reproduce the problem:
1. Ceate New SSIS Project 2. New Data Source Localhost.Adventureworks 3. In Package.dtsx create an New Connection from Data Source... 4. Choose AdventureWorks 5. Save Package 6. Close Package 7. Open Package
There is no problem at this point.
8. Enable Package Configurations 9. Create a new XML Configuration File 10. Give it a name and a location 11. Click Next 12. Under Connection Managers Click Adventure Work 13. Click Next 14. Give it a Name 15. Click Finish
16. Save 17. Close 18. Open
Uh-Oh!
"Synchronize Connection Strings" Dialog Box Hare is what it tells me.
Connection Adventure Works
Data Source Adventure Works
Old Connection String Data Source=.;User ID=;Initial Catalog=AdventureWorks;Integration Security=True;
Old Connection String
Data Source=.;Initial Catalog=AdventureWorks;Integated Security=True
19. Press OK
20. Save Package 21. Close 22. Open
Uh-Oh, still there.
Has anyone else run into this? If so, how can I get around it?
I have two customer tables in SQL Server, but some of the field names are not the same, that I need to synchronize. Here is how they are structured: (Table 1 is old and Table 2 is new)
1. First I need to find out what records exist in Table 1 but not in Table 2 and add them to Table 2.
2. Secondly, I need to then find all records in Table 1 that match the records in Table 2 and update the Email address in Table 2 with the data from Table 1.
I am tryign to sync two tables that are in two different databases. It is suppuse to update the record in the [orgloc] table if the customer ship to name has changed in the [opcshto] table. The cust_code would be the unique identifier. in both tables.
this is what I have:
UPDATE [r2lprospector].[dbo].[orgloc] SET [r2lprospector].[dbo].[orgloc].[custshiptoname] = [cimpro1].[dbo].[OPCSHTO].[cust_shipto_name] from [cimpro1].[dbo].[OPCSHTO], [r2lprospector].[dbo].[orgloc] WHERE [cimpro1].[dbo].[OPCSHTO].[cust_code] = [r2lprospector].[dbo].[orgloc].[custcode]
I keep getting an error though. The error is: Server: Msg 8152, Level 16, State 9, Line 1 String or binary data would be truncated. The statement has been terminated.
I have a SQL database in my server. One Software is using this database for editing /add / remove items in the database. I would like to put this database in the net (using ASP).
How can I synchronize the SQL database in my server with the same one in remote?
Hello, I have 3 tables with their columns: [Articles] > ArticleId, ArticleText [Categories] > CategoryId, CategoryText [CategoriesInArticles] > ArticleId, CategoryId I created a stored procedure that has the following inputs: ArticleId, ArticleCategories ArticleCategories is of type NVARCHAR(Max) and has categories in CSV format: "Category A, Category B, Category C" I have a function, CSVTable, that creates a table with all the categories. I need to make a kind of synchronization: > Update all categories for the given ArticleId. If any Category is no longer associated with any ArticleId (In CategoriesInArticles) then remove it from table Categories.
Note: Since Business category is no longer used by any other article then it is also deleted from Categories.
The new Tech category is then created and associated with the updated article as well as the existing category Sports.
Finally I would delete it:
EXEC DeleteArticle @ArticleId = "3"
The tables would become:
Articles Table
ArticleId ArticleText
1 Game ended 1-1
2 Book Review
Categories Table CategoryId CategoryText
1 Sports
2 Entertainment
CategoriesInArticles Table
ArticleId CategoryId
1 1
2 2
Note: Since Tech category is no longer used by any other article then it is also deleted from Categories.
The Sports category is not deleted from Categories since it is used by Article with Id=1
Well, I hope I didn't miss anything and I explained it well.
I have been trying my code, either by creating a separate procedure named SynchronizeCategories or inside the Create, Delete and Update procedure.
Until now I was not able to make this work.
Here is the code I use in my SynchronizeCategories procedure:
INSERT INTO CategoriesInArticles(CategoryId, ArticleId) SELECT c.CategoryId, @ArticleId FROM Categories c INNER JOIN CSVTable(@ArticleCategories) ac ON c.CategoryText = ac.String LEFT JOIN CategoriesInArticles cia ON c.CategoryId= cia.CategoryId WHERE cia.CategoryId IS NULL
INSERT INTO Categories(CategoryId, CategoryText) SELECT cia.CategoryId, NULL FROM CategoriesInArticles cia JOIN [Categories] c ON c.CategoryId = cia.CategoryId INNER JOIN CSVTable(@ArticleCategories) ac ON ac.String = c.CategoryText WHERE c.CategoryId IS NULL
DELETE c FROM Categories c INNER JOIN CSVTable(@ArticleCategories) ac ON ac.String = c.CategoryText LEFT JOIN CategoriesInArticles cia ON c.CategoryId = cia.CategoryId WHERE cia.CategoryId IS NULL
Our company has an enterprize site (a very large one). From time to time we need to make changes in it. In other words, we had to synchronize one database (local where we make all changes) and database on hosting. So, we did it manually (wrote scripts and inserted them in database on hosting). But as the databases grew it became impossible to synchronize everything manually. So we need some tool which could cope with this task. The problem is that, as I know, there are many tools which can do it, but we are tight in time and can't evaluate them all. Please share your ideas on what tool is worth evaluating?
Please we need help in the next Scenario:- - Head office SQL Server 2000 including main database (huge db for about 8 systems). - 8-10 branches with small database (for 3 systems only). - No connection available between all offices. 1- In daily basis we need to transfer all transaction updates done in all offices to update the main database in head office. 2- After updating head office we need to transfer the last case in 2 or 3 tables to all offices again. 3- There are some common tables, managed in head office only (usually not changed), in case this tables changed for enhancement or anything else, we need to transfer this change to all offices.
NOTE: No connection available every where, therefore we need hand carry solutions as soon as possible and please tell me in details as you can because the time is too short.
Using a web interface, I am placing text into a SQL database. From timeto time, I would like to synchronize one of my other tables in thedatabase with the table that I am inserting content into. What is theSQL command to synchronize these tables? I will be initiating thiscommand through a web interface, so I cannot use enterprise manager.Thank you very much!
I want to replicate my database with table like this:+-----------------+ | Table | +-----------------+ | ID | | Distributor ID | | Total Sales | | ... | +-----------------+
At table above you can see that I have a field called Distributor ID. The scene like this, I have 4 distributor that have replication of my database. Each day they synchronize database from distributor (lets call they A, B, C, D) into my server. So at the server have data with Distributor ID A, B, C, D. But if an distributor want to download its data from my server, they only have data with their ID, for example distributor A have synchronize their data with me and now want to download the data from me, so I only send data that only contains Distributor ID A, so that A can not see data from other distributor (B, C, D) that rule also applied for B, C, and D.
The summary simple like this, I have all Distributor data (data from A, B, C, D) but each distributor only have their own data if they download from me, A only have A data, B only have B data, so on).
I am attempting to follow the example from VB.NET 2005 on synchronizing and SQL Database and an SQL Mobile 2005 db.
I have verified that the PALM device (Treo running WM 5) when the device is connected to my desk top by using IE on the Palm to browse to the shared Folder I set up with IIS and the Configuration Web Synchronization Wizard.
The error I get is "An incorrect or unsupported HTTP function call was made." and I have not been able to find any referiences to this error directly related to SQL M 05.
I have a little problem. I need to synchronize data from two tables with different table structures meaning they may or may not have the same column name and/or table name. I have read a lot of midware tools which I can use but is there a way inside sql server where I can do this? And this synchronization should be automated. Like when I update one table, it will automatically update the other table with the data that was changed. I know I can manually update the records but is there an automated way that I can do this? I have also read about integration technologies supported by sql server like ssis and replication but it seems complicated and I dont have the luxury of time to learn these. But if these can be the answer to my questions then I guess I dont have a choice. Please help. Newbie in sql. Thanks!
I made application (using .NET) to transfer data using PDA via GPRS and then upload data to database server. The data not update old data but make new insert new data to database server.
If we use USB to synchronize data from PDA to database server, we can use merge replication. But i still confused how to synchronize data, if we transfer data from PDA via GPRS, then insert to database server???
I made application (using .NET) to transfer data using PDA via GPRS and then upload data to database server. The data not update old data but make new insert new data to database server.
If we use USB to synchronize data from PDA to database server, we can use merge replication. But i still confused how to synchronize data, if we transfer data from PDA via GPRS, then insert to database server???
First post on the site, yippee! So first of all I'm not a DB pro but occasionally need to hire someone, and to do this properly I need to understand the basic workflow.
Could really use some advice on comparing and synchronizing 2 different SQL databases in different geographical locations..... need updates from website A SQL database to be automatically updated to website B in as close to real time as possible. The whole database doesn't need to be transferred every time, only specific information regarding personal profiles and their activity on the other site. The end result would be that users can login to their profiles any time on either website and see up-to-date reports on their activities/results.
I know it would be much easier to host both databases on the same server but for various reasons this is not an option.
The past day was research into all the various SQL DB synch software. Having a hard time finding unbiased viewpoints...
First of all is there any reliable and secure open source alternatives? I searched sourceforge and found 'SQL Server DB Compare and Synchronize', but it doesn't seem to have full automation.
Also found a few paid for solutions through other forums such as 'Red Gate' products but they would cost upward of $3-500
I need something that is secure and reliable, don't mind a bit of customization but would prefer a solution out of the box.
any advice/articles/reading material/recommendations would be greatly appreciated
I have the following scenario: There are 3 web applications in a local network which all have a local copy of the same database. Each of them can alter their local database (just the data, not the structure), and every time that happens the databases of the other applications should be updated immediately. Are there any solutions out there for that? I found that most tools like slony only mirror one master database to multiple slaves, but I want every database to be able to be the starting point. There could also be a central sync server, like in subversion..
I have a scenario which I need to implement at my work.
I need to maintain one Central SQL Server DB and multiple non central SQL Server DBs at different locations. Here the same DB schema is maintained at Center & non Central SQL Servers. The requirement is: each non central DB has to synchronize with the central DB and has to update the Central DB with the changes made locally.
Here the challenge is the intermittent connectivity between the DBs. The connection is not guaranteed to be alive 24 hours a day. It may go down frequently also. I would like to know the possible ways to handle my situation (i.e. synchronization). And also please suggest me if there is any support with the SQL Server DB itself.
db1 gets 150k records every hour. db2 is like the backup of db1. db2 is used to retrieve records to create reports using reporting services. what is the best way to synchronize db2 with db1? is it to create a dts package and set up a job that runs every hour?
off topic question. what kind of language does reporting services use to create the reports?
i have 2 db's that are totally different except that they both have a table users and I want to make it that anytime the user table is updated or added to in one db - that it is copied over to the other db.
Hi, anybody can help me.How can i synchronize 2 tables on 2 different sql servers 2000i mean TABLE1(col1, col2, col3, col4) andTABLE1(col1, col2, col3, col4, col5, col6)the first 3 colums are the same in rwo tables.Thanks--Message posted via http://www.sqlmonster.com
What is the easiest way to synchronize all data and database objects between my development machine and hosting server? Is there any SSIS free script I can use?
I have decided to use CLR Triggers to synchronize data between two different tables but I have a problem. The scenario is this. I do an insert in Table1. Table1 firest the trigger which then inserts a record in Table2. The trigger in Table2 fires a trigger which does an insert to Table1 again.
I need to find a way to disable the trigger so that it will not go in an infinite loop when I insert a record in either of the tables. What I have done so far is to disable Table2's trigger before I commit my insert to Table2 so that Table2's trigger won't fie. I will then enable the trigger after the insert is committed. Also, I have a webservice which manages the inserts/updates/deletes. I call webmethods from this webservice in my clr triggers.
What is the best way to have native win32 code tell SQL Server 2005 Express to synchronize for merge replication? What API should I use? Should I exec the distrib.exe and/or replmerg.exe command line utilities? Should I use "Windows Synchronization Manager"? Are they other options?
I was wondering if the following is possible: I have 2 SQL Express servers on different machines. One holds the production and one the development database. On a request basis I'd like mirror all the data of the production database to the development database. Right now I have to stop the sql engine, zip the mdf, send it over, attach it to database, etc. and that's quite cumbersome. So, is there an easier way to do this? If not with SQL Express, is it possible with the full version?
Next week I have a database going into production and now I need to set up a separate reporting database. This is no problem except that I'll probably need to load data daily from production into the reporting database.
My questions:
1) Can I trust the EM transfer manager to refresh the data nightly in the reporting database? Will it truncate the pre-existing data.
2) Must I be logged into the reporting database(destination) always or should I incorporate that into a script? How?
3) Has any one experienced any problems using transfer manager for this purpose?
I have tried to synchronize master..sysxlogins table from production server to a testing server. All the databases in the testing server will be loaded from the production server. In order to save drop and recreate the database's users in every database restore, I have tried to find out a quick way to synchronize the sysxlogins table. However, when I load the sysxlogins from the production server onto the tempdb in the testing server, I get the following error :
Server: Msg 213, Level 16, State 5, Line 1 Insert Error: Column name or number of supplied values does not match table definition.
Any comment and suggestion is highly appreciated. Thanks
The table structures (output of sp_help) of the temporary table and master..sysxlogins are as follows :
1. sp_help testjoe4
Name Owner Type Created_datetime -------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------- ------------------------------- --------------------------- testjoe4 dbo user table 2002-02-19 15:27:31.930
Column_name Type Computed Length Prec Scale Nullable TrimTrailingBlanks FixedLenNullInSource Collation -------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------- ----------------------------------- ----------- ----- ----- ----------------------------------- ----------------------------------- ----------------------------------- -------------------------------------------------------------------------------------------------------------------------------- srvid smallint no 2 5 0 yes (n/a) (n/a) NULL sid varbinary no 85 yes no no NULL xstatus smallint no 2 5 0 no (n/a) (n/a) NULL xdate1 datetime no 8 no (n/a) (n/a) NULL xdate2 datetime no 8 no (n/a) (n/a) NULL name sysname no 256 yes (n/a) (n/a) SQL_Latin1_General_Pref_CP1_CI_AS password varbinary no 256 yes no no NULL dbid smallint no 2 5 0 no (n/a) (n/a) NULL language sysname no 256 yes (n/a) (n/a) SQL_Latin1_General_Pref_CP1_CI_AS isrpcinmap smallint no 2 5 0 yes (n/a) (n/a) NULL ishqoutmap smallint no 2 5 0 yes (n/a) (n/a) NULL selfoutmap smallint no 2 5 0 yes (n/a) (n/a) NULL
Identity Seed Increment Not For Replication -------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------- ---------------------------------------- ------------------- No identity column defined. NULL NULL NULL
RowGuidCol -------------------------------------------------------------------------------------------------------------------------------- No rowguidcol column defined.
No foreign keys reference this table. No views with schema binding reference this table.
2. sp_help master..sysxlogins
Name Owner Type Created_datetime -------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------- ------------------------------- --------------------------- sysxlogins dbo system table 2000-08-06 01:29:12.500
Column_name Type Computed Length Prec Scale Nullable TrimTrailingBlanks FixedLenNullInSource Collation -------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------- ----------------------------------- ----------- ----- ----- ----------------------------------- ----------------------------------- ----------------------------------- -------------------------------------------------------------------------------------------------------------------------------- srvid smallint no 2 5 0 yes (n/a) (n/a) NULL sid varbinary no 85 yes no no NULL xstatus smallint no 2 5 0 no (n/a) (n/a) NULL xdate1 datetime no 8 no (n/a) (n/a) NULL xdate2 datetime no 8 no (n/a) (n/a) NULL name sysname no 256 yes (n/a) (n/a) SQL_Latin1_General_Pref_CP1_CI_AS password varbinary no 256 yes no no NULL dbid smallint no 2 5 0 no (n/a) (n/a) NULL language sysname no 256 yes (n/a) (n/a) SQL_Latin1_General_Pref_CP1_CI_AS isrpcinmap smallint yes 2 5 0 yes (n/a) (n/a) NULL ishqoutmap smallint yes 2 5 0 yes (n/a) (n/a) NULL selfoutmap smallint yes 2 5 0 yes (n/a) (n/a) NULL
Identity Seed Increment Not For Replication -------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------- ---------------------------------------- ------------------- No identity column defined. NULL NULL NULL
RowGuidCol -------------------------------------------------------------------------------------------------------------------------------- No rowguidcol column defined.
index_name index_description index_keys -------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ncsysxlogins nonclustered located on PRIMARY srvid, sid sysxlogins clustered, unique located on PRIMARY srvid, name, sid
No constraints have been defined for this object.
No foreign keys reference this table. Table is referenced by views --------------------------------------------------------------------------------------------------------------------------------
Could anyone please let me know which is the best way to Synchronise a Sybase database with a MS SQL Server 2000 database.That is , the changes made in the Sybase database should be reflected in the SQL Server database.
I have to synchronize 2 databases hourly but am having difficulty maintaining foreign key relations. These tables use auto-increment columns as primary keys, with child records in other tables related with foreign keys. I can't change the way the local software uses primary or foreign keys as it is hardcoded in the local app. (microsoft retail management system)..(however the web-remote app is easily customized). I am using CDB synchronizer to sync the two databases because the remote one is mysql.
Example tables layout: Items table has auto-increment primary key 'id' TransactionEntry table has its own auto-increment primary key 'id' and a foreign key 'item_id'
Example of how remote and local database foreign key relations are incorrect after sync using CDB synchronizer: 8:00am -first installation of database-'item' tables auto-increment 'id' columns match with id last record value of '6'
locally the following products are added:
11001 short sleeve t---gets added with primary key in 'item' table 'id' of '7'
11002 long sleeve t----gets added with primary key in 'item' table 'id' '8'
remotely the following products are added:
21001 hipster jeans- --gets added with primary key in 'item' table 'id' of '7'
31001 overalls---gets added with primary key in 'item' table 'id' '8'
remotely someone orders 21001..so TransactionEntry table records sale of "item_id" of '7', but after synch with our local server,
product with "item_id" of '7' is "short sleeve t".
9:00 -synch takes place...item_id foreign key isn't accurate because of independent auto-increment values..
whenever a product is ordered, the TransactionEntry table will record the product's ID column thats available in it's own local copy... after synch, the 'item_id' field will not match the 'Item' table id field and the data about the transaction's product is lost.
I have read of solutions involving staging/temporary tables to cascade update foreign keys before synching into main database, but hopefully there is a more elegant solution for this. If this is only way, will it be reliable? foreign key mix-match seems like could cause havoc.
Greeting guys, does anyone here experience the problem that I had currently. I did set up a mirroring for my db for 1 month + and work perfectly. However, due to lack of stability on line connection on the principal database side, so makes mirror side get disconnected frequently. I found that once the principal side get back smooth, the mirroring status shows 'synchronizing' status and I thought it gets fine again.
However, after 2 days (which more than 48 hours) and I check back the status, it still showing 'synchronizing' and synchronize slowly. It's impossible that the mirror side takes more than 2 days for synchonizing. ( Size on principal size is around 1.2GB and mirror side around 800MB) Is there any solution on it ? Is it have to re-set up the mirroring session again? I don't think is line connection issue because I did set up another mirroring session between these two servers and work fine. Hope you guys can help me out asap. Thx.