Hi Everybody,
I'm working on a new database of 25GB in size with an expected 25% growth per year and an estimated 1000 TPS. Since I need to retain the old data for atleast 7 years. I would like to know whether I should Archive the database or is there any other means of storing the data, which will be used just to generate reports. Also pl. do let me know the advantages/disadvantages.
Thanks
Kishore
Hi Everybody,
I'm working on a new database of 25GB in size with an expected 25% growth per year and an estimated 1000 TPS. Since I need to retain the old data for atleast 7 years. I would like to know whether I should Archive the database or is there any other means of storing the data, which will be used just to generate reports. Also pl. do let me know the advantages/disadvantages.
Thanks
Kishore
I want to replicate to an archive database. This means that the subscriber will have data that has been removed from the publisher. In my reading, I haven't seen any discussion of this specific scenario.
Here's what I imagine the solution might be:
EXEC sp_addpublication_snapshot
@publication = N'My_Publication',
@frequency_type = 1 -- only create the snapshot once
GO
...
EXEC sp_addarticle
@publication = N'My_Publication',
@article = N'My_Table',
@source_owner = N'dbo',
@source_object = N'My_Table',
@del_cmd = 'NONE',
GO
I set the publication snapshot to only execute once, that would be during the maintenance window when it is initially installed. Then, on the tables that will contain archived data, I specify that deletes aren't replicated.
Here's my concern: aren't there times when you need to resync?
If you could push a new snapshot that dropped the tables on the subscriber and built the thing up from scratch, then things would sync-up just fine. But in this scenario if you drop the subscriber tables then you've just lost your archive.
What's the best way to handle this?
Thanks,
-=michael=-
Hi
For strange reasons, I am now unable to backup (archive) any of the databases in Analysis Service. :eek:
When I try to archive, I get a dialog box with the following error:
"[MicroSoft][ODBC Driver Manager] Data source name not found and no default driver specified"
I am able to process my cubes and dimensions and am totally lost as to why I'm getting this problem :S
Will appreciate your help.
Thanks.
I have the requirement to implement archiving of some database old data.
The database is not used to store files, just table with text/numeric data, some data modification logs.
Which strategies do you usually use to archive old records from a database?
Do you move old/unused data to another similar database in another server?
The data needs to be accessible for read access, even when archived.
Apparently the query analyser of sql server does not recognise adatabase with a point in it, likemail.archive.mdfI receive the following error when I use it:Server: Msg 911, Level 16, State 1, Line 1Could not locate entry in sysdatabases for database 'mail'. No entryfound with that name. Make sure that the name is entered correctly.Please help, thanksPrem
View 2 Replies View RelatedI am wondering if it is possible to archive records out of a SQL Server Database. The records would then be removed from the original database. This process should be able to be run multiple times (with user interface).
View 2 Replies View Relatedhi,
I need a script to deletes records from my DB older than 30 days.
is their anywhere a script that can help me ?
how should i write ?
using some quesy tool ?
thanks
idan
Project assigned to me called ''Archive off old data''.As SQL DBA the best way to archive large table is data Partitioning. But one table does not enough in terms of size to do partition and plus table has 32 other tables,view,sps dependencies.The data from that table needs to archive off every week to different database on different server. My question are
1) what is the best way to archive data ?
2) what are steps I need to follow ? Do I need to remove dependencies first and then take out data?.
Hello, everyone:
What does "data archive" mean in SQL Server? Is it same thing as archiving in Oracle?
Thanks.
ZYT
A client of mine just asked about Archiving and Purging their data (based on different time constraints). For isntance, certain data would get archived after 3 years over to a different database, others purged all together. My thoughts off the bat are store procedures run on a job schedule.
Any other thoughts or ideas?
Is there a way to archive my databases which are not in use so that i can reduce my disk space and i should be able to use them sometime in future?
let me know
thanks
My SP looks like this that originally populates the record set.
CREATE PROCEDURE dbo.sp_insert_file
@KBID int,@rev int,@filename nvarchar(50),@moddate datetime,@owner nvarchar(50),@author nvarchar(50)
As
INSERT INTO KBFile (KBID, rev, filename, moddate, owner, author)VALUES (@KBID,@rev,@filename,@moddate,@owner, @author)GO
I need to have a stored procedure that will select a recordset based on KBID(PK) and archive the entire record set to another table. I then need to be able to UPDATE the individual records for this record set in the KBFile table.
Can someone point me in the right direction?
Hi Folks,
We have transactional replication setup to replicate data from production across to a reporting server.
We want to ARCHIVE production, but don't want the ARCHIVE duplicated on the reporting server.
Does anyone know of a way that the reporting server can be stopped from replicating these changes, and continue to hold the FULL history of the database?
Cheers,
David
Hi Folks,
We have transactional replication setup to replicate data from production across to a reporting server.
We want to ARCHIVE production, but don't want the ARCHIVE duplicated on the reporting server.
Does anyone know of a way that the reporting server can be stopped from replicating these changes, and continue to hold the FULL history of the database?
Cheers,
David
Does anybody have a project plan template I can use for an archive of a datatbase?
View 3 Replies View RelatedI have a table called customers that store information about the particular customer. I would like to have a table called Archive so that when I delete a Customer that have not been active for a specific time then the deleted information will be automatically be inserted into the Archive table. Do I need to create the archive table with the same numbers of columns as exactly as the customer table?
I need some basic idea about how this should be implemented.
Any input will be appreciated.
Thanks in advance
Hi all,
I am pretty new MS SQL server,
I am actaully working as an SAP BASIS ADMIN and 1 of our client is on MS SQL 2005 with SP1 as the DB and Win 2003 as the server.
I just wanted to know
1) How can we login to the dbase from the command prompt?
2) How to alter the database to NON-ARCHIVE mode and back to ARCHIVE MODE ?
I just wanted to execute few SAP activities for which i dont want the database to generate the archive logs, so i need some assistance.
Hoping to START GOOD here in this forum...
Thanks a million in advance to all
Waiting to hear from all the SQL gurus.
Regards
Hunky
Hi all,
Is there any regulation or law specify how long to keep archived data? 5 years?
or where can i find those info? Thank you
cheers
I have a table contains huge rows of data. Performance issue raised. I amthinking archive some data so that the table will not be that big. The mostconvience way is move it to another table. The problem is: will this solvemy performance problem? or I need to move it to another database to reducethe database size?Regards,TrueNo
View 2 Replies View RelatedMy SP looks like this that originally populates the record set.
CREATE PROCEDURE dbo.sp_insert_file
@KBID int,
@rev int,
@filename nvarchar(50),
@moddate datetime,
@owner nvarchar(50),
@author nvarchar(50)
As
INSERT INTO KBFile
(KBID, rev, filename, moddate, owner, author)
VALUES (@KBID,@rev,@filename,@moddate,@owner, @author)
GO
I need to have a stored procedure that will select a recordset based on KBID(PK) and archive the entire record set to another table. I then need to be able to UPDATE the individual records for this record set in the KBFile table.
I am trying to create an 'audit' trail while maintaining previous records.
Can someone point me in the right direction?
Hello:
The purchased-application mssql 6.5, sp 4 that I am working on has one large table has 13m illion. It the largest table considering thenextlatgest table is only1.75 million rows.
Thew vnedor has made a change to this largest table in recommending changing a data type -- char to varchar. To make this change easier to do,
I want to "archive" older data not necessary for the current year or current processing to another table.
What is the best way to do this archiving?
Any information you can provide will be greatly appreciated. Thanks.
David Spaisman
Hi Guru's,
It takes me a long time to view in EM under Mangement/SQL Server Logs/current file. Is there a way I can shorten that file so it won't take so long to view the current file?
Thanks in advance. :eek:
I would like to create a command line tools in SSIS which can be used to archive files.
I have 6 files in a dir and i like to zip them up and them move them to an archive dir.
The 6 files all have the same name but the extension is different.
Total SQL newbie here. Hope I'm posting in the correct forum.
I have a Exchange 2003 server that archives all email to a large(55GB) SQL database. I have a situation where I have to export several emails from that database. However at this point I am clueless on how to accomplish this.
Hi,
I currently have one table that lists all projects and tasks within the organisation. One of the table fields is the task status, open or closed. I would like to be able to have a process by which the tasks that are completed are removed from the table and placed into another (archive) table. The same records then being removed from the original table. which then only contains the incomplete tasks. This process could be run at given times during the day or at the point when the status of a task is changed from open to closed, either way each time the process is run it would need to append the rows removed into the archive table. Anyone any ideas on the best way to do this?.
Thanks
Hi all,
I have a report that gets sent to an email alias every morning at 8:00. The subscription is set to send it as a web archive. The report contains a nice wide table, roughly 12". I have the interactive size on the report set to 0,0 and the report renders fine on the website, but in the email the table is only about 1/3rd the width that it ought to be.
This makes the report look like *** in the email. I have other reports that don't seem to have this problem. I have tried setting the interactive width to 12" and this did not help.
Any ideas on what is going on here?
Thanks,
Allen
Hi,
In a project with SQL Servcer 2005 the customer is interested to save (archive) content of a table frequently. They want to have possibility to restore the table content as before. I have suggested to export the table every day to a text file and save the file in Visual source safe. If they need there will be possibility to import the text file later. Now I wonder, is there any other way to do archiving of the table content in SQL Server 2005?
Best regards
I searched the forum, but I was unable to find an answer to this. What I want to do is remove the page breaks (horizontal lines) from the web archive, but I've been unable to find anything on the internet about it.
Does anyone have any advice/suggestions? Thanks in advance.
Hi,
I have a design question.
So, I am designing an web application that will store lots of data.
Because of that we need to allow administrator users to archive some of the data.
However, the user needs the ability to view the archive data (just to know that it is there)
The administrator user can restore the data by using the web application.
My design includes 2 databases, one for the actual data, and the second for the archive data, and I manipulate it by moving data from one database to the other. What do you think about that?
Another thing is the fact that every month administrator will want to empty the archive database and save it on a disk. What is the best way of doing so? and lets say i want to take one of these backup file and restore several records from it into the archive database, what method should I be using?
Finally is there any best practices articles for this kind of issues?
Thanks,
I have two tables say A and Archive. After a certain period of time some records are to be sent to archive table.To copy records to archive table I am using SqlBulkCopy operations.Now I have to delete the records from A Table. I was thinking of sending a Comma seperated id's of rows that are to be deleted to a stored procedure.Are there any better techniques to move data to archive table and to remove data from main table.?Thanks.
View 9 Replies View RelatedI am using SQL 2012 SE. I have 2 databases say A and B with same structure and relationships. There are 65 tables in each database. A is already replicating data to database C for 35 tables. Now I need to move data from A to B which is greater than getdate()-1 everyday for all the tables and once the move is done I need to delete this data from A. And the same thing the next day and everyday. Since this is for 65 tables its challenging to identify the insert order. Once the insert order is identified the delete order will be the reverse of it.
Is there a tool or any SP that could generate the insert order script? The generate scripts data only is generating the entire data and these databases are almost 400GB. Some tables have 200Mil+ rows. So it takes forever.
I'm looking for a process to archive data through replication. I have nightly job that purge records in few source tables(publisher) retaining only 3 yrs data. I have archive database (subscriber) that contains prior 3 yrs data and current 3 yrs data.
Before nightly job DELETES records in Source table i want to STOP replication so that the delete is not replicated in archive database. After the job completes i would like to TURN ON replication so that any new inserts and updates in Source will ONLY be replicated in archive database.
My DBA tested this but after last step of turning replication back ON archive database is sync'd with source table.
There are around 70 tables where 30 of them are transactional tables that needs record purge. Developing ETL process is possible but tedious.