Large Data Imports Expanding File Size
Dec 7, 2007
Morning all,
I'm having a problem with mdb file size. I'm importing a large amount of data from a number of tab delimited text files via a simple transfertext function. The process goes: empty the tables in the database, then import the data into the tables.
All this works fine, but the file size rockets to over 1.5Gb. When I then compact and repair, it goes down to 420Mb. I'm not deleting and recreating the tables, and at no point is there 1.5Gb worth of real data, so what's causing this?
N.B. I realise I can call compact and repair following the import, but this is going to take too long as they are user-initiated imports.
View Replies
ADVERTISEMENT
Aug 29, 2005
Will keeping your field size shorter result in a smaller MDB file?
Or does Access only use as much space as there is real data in its fields.
Way back in the dBASE III days, dBASE would pad all your "real" information with as many spaces as necessary to fill up your field. I suspect that the MDB structure is probably smarter than that.
Another question on the same topic - I believe there is a maximum number of characters in a record (4000?). Can your field sizes add up to more than 4000, as long as the actual data, all combined, never totals 4000...?
Thanks............
..dc
View 3 Replies
View Related
Nov 6, 2014
How to get a large .txt file into Access. I know it has too many columns so I selected about 30 columns that I don't need to be 'skipped'. However it is just giving me the error that my file has more than 255 columns - with the 30 selected for skip - it should have about 230 columns.
View 7 Replies
View Related
Mar 16, 2007
I am writing a vba procedure to updating some records in another Access database.
rsAccess.Open "SELECT * FROM AI_Table",conAccess, adOpenForwardOnly, adLockPessimistic
rsAccess!OCRExist = "Exist"
rsAccess.Update
it has about 3 millions of records in that AI_Table. In the procedure, I perform some calculation and put the result into a TEXT(50) field in the AI_TABLE. As it was updating the records, I could see the size of the Access database file (the one contained AI_Table) grew very quickly, almost 1 MB/sec. I am pretty sure I am not adding that much data. If I stop the procedure and packed the database, it shrunk a lot.
I am just wondering if there is anything wrong with the way I am locking or updating the records.
Thanks,
pggsB
View 2 Replies
View Related
Dec 21, 2004
I hope someone can help with this.
I have a large file, more than 2 million records. I am accessing it from a form using parameters supplied from a combo box. There are 79 different parameters in the combo box that each normally access their proportionate number of records, about 40,000 each. This works well. With the table properly indexed, I get the 40,000 records selected within two or three seconds.
However, sometimes I want to access all records. In this case the operation takes forever. So, if I use the criteria in the query:
[Forms]![CriteriaPassingForm]![Criteria] the records are returned very quickly.
But, if I use the criteria:
Like "*" & [Forms]![CriteriaPassingForm]![Criteria] the return of records takes minutes instead of seconds.
Within the combo box I have one criteria which is 'null'. This does not match anything in the query, so according to the 'Like "*"' all records should be returned, which they are. But why does it take so much longer?
I'm thinking it has something to do with the operation of the index on the field I am querying.
Any ideas?
View 5 Replies
View Related
Feb 3, 2013
I have a large .dat file which is run through an Access macro to produce reports. After a recent system change at work the format of the .dat has changed and now includes an additional bit of data which disrupts the macro.
I tried changing the extension of the file from dat to mdb to see if I could remove the additional column in access. I also tried changing it to a csv file as well but the file has a few hundred thousand lines and the csv file cuts most of it out.
Are there any other ways I can open this file in Access to remove this additional column of data?
View 3 Replies
View Related
Feb 11, 2014
I am importing a delimited .txt file that has a number field. A value for a record coming in is 36,767 and Access is not accepting it. If I redefine the field as long integer or as double, I can manually update the record, but as soon as the file containing the record is imported, the field reverts back to integer.
How do I format the field with VBA so that Access will accept the value and not revert to integer?
View 3 Replies
View Related
Jul 22, 2013
I am attempting to create a metrics analysis table from another table. What I would like to do is copy the structure (only) from table 1 into a new table. Change all the fields in the new table to text (except for an ID field which would be an autonumber). Then run a seperate group by query against each column, counting the values in each group (i.e. first query would have two fields The grouped column and the column count.
Once I have these values I would like to concatenate them (with the count in parens) and then push these values back into the new table under the appropriate column.
My code does this. I basically loop through a recordset that runs to each column/field groups and counts and then Edits the new table with the concatenated data.
My first table is 170 fields and 38K records. The issue is that it's too much for Access to handle and it blows up (on field 123) Telling me the File is too large. The file does explode to 1G. Then I can shrink it back down to 67mb by running a repair and compact... and then run the the data for the rest of the fields in that table. When I compact again I get about 80Mb.
So now I have two tables, both with an ID field... so I try to link them together (via a make table query) and meld them into one table... but it keep running into that "File Too Large" issue.
How can I have two tables in a database file with a combined size of 80Mb, but when linked together are too large for the database file? Does it have something to do with having all text fields?
I looked up the limits to MS Access and the field count doesn't appear to be an issue since it's nowhere near 255... So what's the problem here?
View 10 Replies
View Related
Jul 2, 2014
The file was converted from excel. It is in Datasheet view. I select the first column and clip on the Ascending choice under the Home Tab. It works but leaves a large gab of blank rows. I go to the Database Tools tab and check Compact and Repair Database. The file returns to the original unorganized list.
View 1 Replies
View Related
Feb 18, 2014
I am trying to find a way to extract an email from a large text file that is an output from our email system. I would like to be able to extract the email address using a query or collection of queries. I have been able to extract all of the text that contains the @ symbol. From their I created a query expression:
Mid([field1],InStrRev([field1]," ")) that captures some but not everything I need.
View 6 Replies
View Related
Mar 16, 2005
hi all,
on a form i have 2 fields
one for import a file with the filedialog
2e for the size of that file
how can i have te size from the file in that field
can someone help me with that code
thanks
View 1 Replies
View Related
Jan 17, 2006
Hello all,
I would like, from a form, to get the file size of a particular file.
I would really like something like: FileSize("C: estfile.exe")
I am sure I have had something like this before, but cannot for the life of me find the answer I originally got!
Thanks!
View 3 Replies
View Related
May 15, 2006
Hi, I was recently searching on the site for information leading to the compiling of an .exe file from the Access database. What I come to realize is that this is not possible. I was led to the MS Visual Studio 2005 for MS office studio and the MS Office Access 2003 Developer Extensions for it to use the Access runtime (As I came to understand) without having to install Access. If I am at all wrong up to this point please let me know. I was just wondering about that for clarification, my real concern is regarding the size of my database and the problem making it into an MDE.
As of now, my program is at roughly 30 mb, which I did not think was too incredibly large. However, Access will not allow me to create the MDE file. Where I think my problem is lying is that I have images scanned into the DB and then text boxes on top allowing me to essentially type a form and print it out.
Is there a better, more size efficient way of doing this? I have a hunch that it is the images that are not allowing for the MDE export, but I did not think they were all too large in size. If anyone has any comments that may help I would be very appreciative. Thanks in advance.
-Bob
View 5 Replies
View Related
Jul 17, 2006
Hi all,
I have developed a Access program which import excel tables into the the database and queries some data and writes it into an excel file...
The problem I am having is that after the program is loaded... the file size of my mdb file increase by more than 3 mb..
I tried deleting all the objects in the file.. and the size doesnt reduce at all,
When I import tables, I delete the previous one.. so I don't think it would be that...
The only thing I think the problem mite be is the life line of the variables..
Is it that after I run the program... the Variables stays there and ocupies space...??
afaik, the variables "dies" after the program is finished loading....
if not, is there a way to "kill" the variable at the end of the program?
so far, at the end of the program, I have set my objects = nothing.. to release them... but doesnt seem to help at all
any idea on what this problem mite be??
Thanks in advance..
View 2 Replies
View Related
Aug 17, 2007
Hi,
i am new to access. Anyone know why my .mdb file size Growing. Even when i delete the data from table and done with the compact and repair. i am doing my first small project with one table and 10 querys and 5 repots. each time i edit the query or report the file the size goes on increasing.
i have not more then 100 records in my database. i only edit my records when ever i edit my records .mdb file size grows so any one could help me to make it constant.
plz help
View 11 Replies
View Related
Oct 2, 2007
Yesterday my DB was 5MB. Today its 50MB. I haven't embeded any images etc... I can't see any reason why the DB would expand like this. The only thing I can think of is that perhaps there is a variable somewhere that allocates memory. What should I be looking for??
Any ideas are much appreciated.
View 6 Replies
View Related
Jun 24, 2006
Hi
I have created a db and am having serious problems, the size of the complete db is 3mb, and when split its 500k, the trouble I am having is that when putting the db on the network server and you try and open it based from home it takes so long for both the full db and the split.
The main db has one page that all staff need to see and have a quick response when opening on VPN client.
The form I want to open has a combo box that lets the employee select the company and all the information updates on the form.
I tried making a page in acces to do the same thing but having problems
Is this possible what I am trying to do or is there an easy faster option.
Thanks for your help
View 8 Replies
View Related
Jan 23, 2007
I had a massive Access file of almost a GB in size. and I deleted all records off the tables hoping it would shrink and my purpose was to have the tables alone in their structures. However despite deleting all records, the database file size seems to stay the same. anybody knows why this is so? I don't think we can "commit" changes to databases done in access as it is done in other databases. anybody knows why this is so?
View 3 Replies
View Related
Aug 29, 2005
I have a strange issue. First off I have a front end in Access 2000 as a MDE file linked to a mdb data file.
Issue number 1: The MDE file almost doubles in size daily. Yes, the mde file not mdb (it grows slowly and expectedly as data is added and deleted) . I expected the MDE file to stay a static size. Is this normal, what causes this?
Issue number 2: I had on 3 occasions a query in the mde file suddenly pop up with a ”cannot repeat table name ‘Nameoftable’ in FROM clause”. I go into the mde file, SQL query view and delete the extra table name and all is fine for awhile. After the second time I did away with that quey and rewrote the query for my form a different way. It’s come back once again now for anther table. Has anyone heard of Access doing this?
I also note that the modified date of the file keeps changing. I am wondering if someone is tampering. My client that has this software is very naïve.
The MS site has no information regarding either behaviour.
Any ideas?
Jim
View 2 Replies
View Related
Feb 17, 2005
A quick question that I'm sure one of you guys will be able to answer without any trouble, but I'm having difficulty with...
I have a form on which I would like to have a text box which returns the size of a file on my PC. The file path will not change.
Any ideas would be appreciated.
Thanks in advance.
View 1 Replies
View Related
Aug 27, 2004
I have some databases that I am importing data into but the records are so large (over 4 to 6 million) that they are making the file reached the 2 gig maximum.
Questions:
1) I have the imput tables broken down in to thirds of a month (i.e. Day 1 to Day 10, Day 11 to Day 20, Day 21 to Day 31) so what I was thinking is that there might be a way to just like three different databases together or four and have one be the master puller of the other three?
2) Currently, I have reports and queries that pull from one large table. So how would I set up the query reports etc. to pull from all three databases into one reports or query. Or is this not possible.
If you think of a better way to arrange or work around this problem then I am surely open to suggestions.
Thanks,
beachdude
View 5 Replies
View Related
Apr 4, 2006
Hi,
I am trying to send a "EMP" table in an excel format using "SendObject". User clicks the "Send Mail" button to email the table in excel file. The user then clicks on the "Exit" button to exit. This wipes out the data in the table "EMP" as was expected. Every thing goes fine..... but the size of my database increases by more than 100 MB. (Note that the table in the data has been deleted & the data is around 59 MB).
Any suggestions on what could be causing this increase in file size.
Thx in advance,
Jatz
View 5 Replies
View Related
Feb 24, 2014
Is it possible (using the menu or VBA code) to find out the size of the objects in an Access database file?For example if the .accdb file is 300Mb, is there any way of comparing the size of the numerous tables/forms/reports/queries etc, that make up the database?(I know that if I created a new access file and imported the objects from the working database that could give an indication but that would be quite a repetitive process).
View 4 Replies
View Related
Apr 3, 2014
when I open a pdf through access weather it is by hyperlink or attachment it always opens the full size of my monitor, if I open a pdf outside access then they open ok , how do I set the size that access opens the pdf the size I want.
View 2 Replies
View Related
Jun 27, 2006
I'd read a few places that embedding pics wasnt the greatest of ideas, but I thought that 1 JPG embedded onto 2 forms would be ok and would prevent the pic from being deleted or moved. (Theyre always screwing with the server here.) But it's making my DB huge.
No pics embedded
Size: 808kB
1 Pic Embedded into 2 forms
Pic Size: 156k JPG
DB Size: 135 MB
Is this normal? I could understand a 156k pic adding somewhere around 156k to my DB, but 134 megs? Anyone have any insight?
View 4 Replies
View Related
Feb 14, 2008
I have been using access 2003 at my work place.
When I bring back my access 2003 project from work back home, i open the project at home, I am using access 2002 or 2000 format.
Then I notice if I save a copy of my work using access 2002, while initially using an access 2003 database, the file size decresaseas dramatically, from like 3mb to 800 kb?
any reason why?
No data seems 2 be lost.
Cheers!
View 4 Replies
View Related
