Large Database Problems

Dec 10, 2006

Hi All, please forgive me if I am in the wrong forum.

I have a pretty good size (~6400 table and 700 Mb) single user application. It runs on XP home with office 2000.

It is a financial application (stocks and mutual funds). Each symbol has it's own table. The app ran fine when we were monitoring about 1800 symbols. Now that we are up to 3200, I am getting some odd messages from Access. It can't find tables and also says that tables are opened exclusively by other processes.

Although I do not use explicit transactions, it is like I need a "commit" or refresh of the user table catalog.

Each table has 312 rows (52 weeks / year * 6 years of historical data). So, for half the tables (3200) I do 312 Inserts ("Insert into tablename (col1, col2, etc) values (val1, val2, etc)".

Is there a transaction log that needs clearing? Is there a setting in Access that I need to change?

Any thoughts on my situation?

Thanks in advance

View Replies


ADVERTISEMENT

Very Large Database, Not Working

Jun 25, 2005

Hi
Many thanxs for replies, Like the idea of compacting.
We are traveling down the path of setting up a delete query.
This will hopefully delete the records but not the structure.
We are networked and a computer Warp2, writes data at Midnight to the sever, and then we use access on Windows NT to view the data.

We can then compact to maintain the database and not allow it to grow to 1.6 GB again.

Any ideas on the delete query thingy would be greatly appreciated.
:cool:
Many thanks for reading this post from a new starter.

View 2 Replies View Related

Large Database Query

Jun 1, 2006

Hi,

I am currently using a large Access 2002 database in order to generate various reports.

My two main tables are despatches and returns from which they hold around 1,200,000 records and 100,000 records respectively.

The problem I have is that the reports use various expressions within various queries to generate a single result (percentages per channel etc.)
This is obviously very time consuming and it may take up to around 10 to 15 minutes to get a result from a chain of around 5 queries.

Can anyone suggest alternative methods to generate similar results in quicker time?
(Please note that the tables can not be downsized and records can not be archived)

Many thanks
:)

View 6 Replies View Related

Organising Large Database

Jul 12, 2005

Hi
I have a large database with many tables, forms, queries repost etc. These are stored named and displayed alphabetically, is there a way to place them in folders within access so it is easier to organise and locate as i am developing. Or do i just need to rename them all with a section title as the first part of the name?

Thanks

View 1 Replies View Related

Copying Down A Column In A Large Database.

Jan 5, 2005

Is there a simple way of copying the same data down a column in Access similar to Excel with its Fill Down Column. I have tryed copying down a column and it only goes one cell at a time or if I copy 5 cells with the same data, I can copy it to 5 empty cells.

View 2 Replies View Related

Changing Field Length In Large Database.

Feb 6, 2006

I am trying to change a field lenght of a large database (access 97) It is at 50 right now and want to change it to 25. When I try to change it and save the table I get a error when the bar is about 3/4 the way accross the bottom.

Microsoft can't change the data type - there isn't enough disk space or memory.

then

not enough space on temporary disk

This is error 3183. In the help it says that the TEMP DOS enviroment variable location doesn't have enough space. (summerising). Now I have a 100+gb drive that isn't close to being full. I also changed the MaxLocksPerFile registry dword to 8,000,000 as my table has around over 3 million records. I have tried this on a xp and 2000 machine same results. Next I am going to try it on a 98 machine. I could do it by breaking up the table into 2 differnt ones and do each one individually but there is an autonumber field used as a reference number (I know I know). So that would screw up the numbering scheem (Yes I know there are ways arund that also). this database is about 400MB

Couple of questions
1. Is there a way around this? I have not found a solution on line yet.
2. Will lowering the field length make the database smaller (the data that is in there now is less than 25 charecters and the field is set to 50.) I have gotten mixed info on this. there are a few fields I would like to reduce.

Thanks
sam

View 2 Replies View Related

Problem With Large Database & Pivot Tables

Apr 12, 2007

Hi there,
I've developed over the past 3-4 years a database holding data relating to workload figures for my place of work. It has grown to a large size (eg. one table holds 1-2 million records). I've been trying to run a particular pivot table based on the sql query below:

SELECT Tests.Test, Year([DAUTH])+(Month([DAUTH])<4) AS FYear
FROM Sets INNER JOIN Tests ON Sets.SET = Tests.[Set Code]
WHERE (((Sets.DAUTH) Between #4/1/2003# And #3/31/2007#));

When I try producing a pivot table using the above query it takes forever - has it running for over 8 hours last night - then access closed down with a runtime error. Does MS access have a problem with large databases? Is there any way I can improve the efficiency / speed of access with a download add-on? Or, will I have to resort to using something like MySQL on a LINUX OS which has fewer demands on system resources when using large databases.

Any help would be much appreciated. Thanks for reading.

View 1 Replies View Related

Trouble! Replacing Characters In A Large Access Database

Jun 1, 2007

Howdy,

I am trying to clean up one field of a large database. Currently this field has many records that are listed as "XXXX, Inc.". I am trying to find a way to change all of those to "XXXX Inc" in the entire database.

I saw raskews code snippet on changing multiple characters in a string, but I have to admit I have only use VBA in Excel before and having a hard time with the basics.

Does anyone have some code or ideas on how to do this or something similar?
:confused:

Thanks,
Will

View 4 Replies View Related

Modules & VBA :: Optimizing Tree View Of Large Database

Oct 24, 2014

I have a form with a Treeview in. I have it populated from a self-referencing database using the following code.

Code:
Private Sub Form_Load()
Const strTableQueryName = "SELECT * FROM tblHierarchy ORDER BY tblHierarchy.Function_Parent;"
Dim db As DAO.Database, rst As DAO.Recordset
Set db = CurrentDb
Set rst = db.OpenRecordset(strTableQueryName, dbOpenDynaset, dbReadOnly)

[Code] ....

The database this is referencing is about 30000 lines and it takes ~4 minutes to populate this way. I know Treeview isn't really supposed to be used in this way however it's what is required.

Now I have come up with the theory that I will populate each node with children as its clicked to be expanded.

Uploaded my current treeview example ....

View 4 Replies View Related

Large Field Size = Larger Overall Database Size?

Aug 29, 2005

Will keeping your field size shorter result in a smaller MDB file?

Or does Access only use as much space as there is real data in its fields.

Way back in the dBASE III days, dBASE would pad all your "real" information with as many spaces as necessary to fill up your field. I suspect that the MDB structure is probably smarter than that.


Another question on the same topic - I believe there is a maximum number of characters in a record (4000?). Can your field sizes add up to more than 4000, as long as the actual data, all combined, never totals 4000...?
Thanks............
..dc

View 3 Replies View Related

One Large Table? Or Two Different Ones?

Jan 14, 2007

I have two datasets that I am using. They start off with similar information: sitename, siteprovince, sitecoordinates. They also have 5 more fields that have the same type of information. After that there are about 10 more fields with no overlap.

In the original dBase program they came from they were treated as one dataset.

The current structure I am using is Company, CompanyContact, Transaction, SiteDetails (the dataset I am asking about).

Is it better design to breakup the SiteDetails into SiteTypeA and SiteTypeB? I have everything working in one table, but I thought it might be more effecient to have two.

View 2 Replies View Related

Large Front End Not Much There

Jul 13, 2007

I have a split database, the front end is showing to be 20.5 megs in size but there are only 4 forms and about 6 querys. Can someone tell me how to find what is making it so large?

I did a compact and repair but it did not reduce the size??

Thanks..
Fen

View 14 Replies View Related

Property Value Too Large

Jul 17, 2007

I'd like to create a table with 240 fields. I know that the max is 255, however, I'm getting a message "property value too large" after I've created 114. Any ideas? All the number fields are byte size. Thanks!

View 10 Replies View Related

How Large Can A Query Be?

Dec 19, 2005

I am currently operating queries in my A2K DB that are 35458 characters (~11 full sheets of A4 paper with 12pt).

It takes roughly ½ second for the form to load due to the heavy query that is also calling functions (calc'd fields) from within, but it works fine.

Are there any problems in this?

I think I heard somewhere that queries have a max length of about 2000 characters or so ... :o

View 1 Replies View Related

Property Value Is Too Large

Nov 14, 2005

I guess I have too many columns in my database and I'm getting the error message "Property value is too large" when trying to open the database table. When I was using Access 2000, I was still able to open the database but using Access 2003, the database will not open. Is there a way around this so I can open the table to fix it?

View 14 Replies View Related

How To Get A Large TXT File

Nov 6, 2014

How to get a large .txt file into Access. I know it has too many columns so I selected about 30 columns that I don't need to be 'skipped'. However it is just giving me the error that my file has more than 255 columns - with the 30 selected for skip - it should have about 230 columns.

View 7 Replies View Related

Large Scale Corruption!

Jul 12, 2005

Hi all, apologies for the long post but this is a long nightmare!

Using A2k on Win2k...Due to roll out a DB today, just made my final tweaks and decided to compact/backup as have done many times before. It's not a split DB but it is secure so I copied the mdw onto my desktop and accessed it using a special compact shortcut which points to the desktop copy DB not the one on the network. When I compacted though Access went about it's business for a while and then threw up the dreaded "Network connection may be Lost" error message (roughly translates as "your database is nicely corrupt now") which I have had in the past when I tried to compact on the network. I've never had this error before compacting locally but anyway I tried again and same error message. I tried opening some forms and stuff and sure enought the DB was corrupt. No probs I thought, I can just go back to the original and start the process again. I used the normal shorcut to open the original DB just to check everything was ok and the same error message appeared with same problems. Minor panic ensued and I thought i'd got the shortcuts mixed up or something... I hadn't, Both DB's were affected.

Next option. Create a new DB and import all the objects. I did that and re-set all the permissions and the "Network Connection Lost" message dissapeared but some really strange things were happening. Forms opened but the buttons on them would do nothing. Then the forms Close button didn't work and the database wouldn't close.

I forced my way out of the DB and re-started my machine. Couldn't even log in to windows. Now at another machine and can log in to windows but DB is still having same problems. My instict tells me that the problem is something to do with the workgroup file becuase how else could compacting a copy corrupt the original? The only common link is the mdw.

Should I re-create the mdw and then try opening/importing the DB objects again? Or is there any way I can un-secure the DB and then re-secure it later?

Any thoughts would be much appreciated.

Thanks, Tom

View 4 Replies View Related

Dealing With Large Times

Oct 12, 2005

I have a database that keeps track of training hours for each employee. The Training Length is formated as Short Time. I just figured out that short time can only go up to 23:59:59. Some of my trainings will be over that. Does anyone know a way to get around other than splitting up my hours and Mins in the table?

View 1 Replies View Related

Code Too Large For Procedure

Mar 8, 2006

I have a large search form, in which I am building a query in the code.

I went to compile the code, and was suprised to receive the error "Code too long for procedure". I had no idea there was a limit, but now I know.

So, I believe I will have to break this code up into chunks, stored on at least one if not more code modules, and call the functions.

To do this, I would have to pass the values entered into the form, to the code module. Build that portion of the query Where Clause, and then return that string value back to the code on the Search form.

Has anyone attempted this before? If so, could you give me a small example of how to pass a value from a form, to a code module, process it on the code module, then pass a resulting value from the code module back to the code in the form.

Thank you for your time!

T.J.

View 6 Replies View Related

Records To Large Error

Aug 19, 2004

I am using MS Access(2000) as a front end to a MS SQL2000 DB. I set up a table link to one of the tables in the SQL server. The table I am linking to has 242 Fields in it. The table shows 21888 rows of data.

In Access, when I set the record source in a Form to this linked table and go to run (Form) view, I get a "Record to Large" error.

In the SQL table - there is one varchar field that is 17 in length. There are about 5 char fields and the rest are numeric or date.

My questions are:
What is causing this error?
What would be a good work around or other possible solutions?

Thanks.

View 7 Replies View Related

Number Too Large For Field

Mar 28, 2006

This number is too large [220020220020] for a field in my table. I currently have it set to Long Integer. What's the proper setting for a number this large?

Thanks

View 3 Replies View Related

Access To Large - Anyway To Change It?

Jun 22, 2006

Hello. My database has around 6000 products, and as time has gone by, the database has got bigger and bigger, more and more text - its now a rather large 16MB. Now, everytime i make a small change to it and upload to the server, it takes me about 8 min uploadeing it. Not that bad, but if i have to change 3-4 times a day? Also, it wipes out the website during the upload, which is not that great. Is there someway to compact the access database somehow? Thanks.

View 5 Replies View Related

Access File Became Very Large During Updating

Mar 16, 2007

I am writing a vba procedure to updating some records in another Access database.

rsAccess.Open "SELECT * FROM AI_Table",conAccess, adOpenForwardOnly, adLockPessimistic

rsAccess!OCRExist = "Exist"
rsAccess.Update

it has about 3 millions of records in that AI_Table. In the procedure, I perform some calculation and put the result into a TEXT(50) field in the AI_TABLE. As it was updating the records, I could see the size of the Access database file (the one contained AI_Table) grew very quickly, almost 1 MB/sec. I am pretty sure I am not adding that much data. If I stop the procedure and packed the database, it shrunk a lot.

I am just wondering if there is anything wrong with the way I am locking or updating the records.

Thanks,
pggsB

View 2 Replies View Related

Save Error In Large Table

Jan 18, 2005

I have a table with 140 fields (I know, this is too many). I have a date field that intermittently will not allow data to be entered. There is a pattern to the data it will not accept, but it seems to only occur in certain records and what it will or will not allow seems different in each case. The error I get when I try to save a record is: The search key was not found in any record. I've isolated the error to the level of the table. Have tried compact/repair, removing the index on the field, deleting and recreating the field. Nothing works. Help! :confused:

View 5 Replies View Related

Splitting A Large Table Into Many Smaller Ones

Mar 17, 2005

Hi,

To avoid the mind-numbing tedium of have to use make-table queries loads of times, is there a quick (probably VBA-related) way to split a large Access table, of about 350000 records, down into 93 smaller tables, based on a key code field that identifies each group of records e.g. GBW102, GBE999, etc?

Any help much appreciated.

thanks,

Alex

View 7 Replies View Related

Property Value Is Too Large. (Error 3309)

Jul 11, 2005

I have developed a Tax Assessment solution using Access 2003, I already have in excess of 150k records, I have 7 tables; 55 queries; 30 forms.

My main table "Transact" has over 175 fields (yep I know its large, but I need all these fields and dont want to create 100's of tables). Since last week I cannot save any definition changes to my table, I keep receiving error 3309. I have searched all discussion groups but cannot find any decent solution.
1. I have not changed the index's, of no duplicates
2. I do not have more than 255 columns in table
3. I have increased the maxlocks substantially
4. run a compact & repair succesfully

What else can I try, as mentioend I am reluctant to split Transact into smaller tables.
Regards
Gto

View 7 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved