Hi ,
We need to upload over 100 GB file into SQL Server using SSIS. I want to know whether SSIS can upload such huge file in to a table. If yes, How ?. If not is there any work around to achieve this.
Expecting some solutions ASAP
Thanks
Regards
Pandithurai K
Singapore
Hi,
any1 know how many records can be stored in a table in sql server? is there any way to maximise it? will table capacity (number of records) vary due to our table stucture or database structure? is there any documentation bout tis?
Cheerslife's Ng
hi, can any one tell me what is the meaning of capacity planning and where do I get info about it,and how does this help me in sql server admin role
thanks
Ahmed
What si capacity planning?
Where can i find more stuff on it?
Hi Everybody,
Our development team is doing some stuff in ASP. They are interested only in char and varchar
data types. They clearly told us that they are not going with text and image data types.
Is it possible to make a row size behind 8060 bytes in a table without text and image data types?.
tks in advance,
Sri.
Hi!
I got two questions and please forward all your suggestions:
1: Is there any document for capacity planning of SQL Server 6.5 database?
2: Is there a way to find out total number of transactions per day in SQL Server?
Thanks in advance!
Hi Everybody,
Can anybody explain me, what is Capacity Planning and what is Load Balancing?
tks in advance
sri
I have a flat file with about 2000 fields and 2 million records. I can reorganize the data any way I want and have a unique id field for each record.
Is SQL Server a suitable solution do you think, and also how many fields will a table take (I think access takes 255)?
If you think there may be a better solution for me to look at I would be glad to hear.
Thanks for any help
Hi All,
We need to do capacity planning for our SQL server database server. Capacity planning is interms of CPU usage, Memory usage and disk usage.
Can anybody help me with how should I start and what are the guidlines to do it? I have started executing perfmon utility with some counters but still not sure what to do next. Please help me. Thanks in advance.
Regards
Sachin
Don't sit back because of failure. It will come back to check if you still available. -- Binu
Hi,
I€™m working in a DWH project the source system have data from passed 30 years and the total number of records from the source system is 10 million.
I€™m need to do the estimation for the data base for the up coming 10 years of data.
As I can predict that the 30 year of data is 10 million then expected data for 10 years would not be more then 3 million.
The ETL tool I€™m using is SQL Server Integration services and the reporting tool is Business Objects.
Can any one guide me on the implementation plan, mean memory taken for ETL jobs (As SSIS use large amount of memory) database and business objects.
Hey - I know that xp_fixeddrives gives me the amount of free space on a drive. Is there a similar (xp) function that will give me the capacity of a drive??? Any help is appreciated. Even if you can just point me in the right direction. Thanx in advance. Billy
View 1 Replies View RelatedDoes any one know where I can locate a document or template for database capacity planning on the web? Any help would be greatly appreciated. thanks.
View 1 Replies View Relatedhello,
I just completed my graduation and eventually i got a proposal from a company to develop a software for database management. I have some doubts about licensing the back-end database. My doubts are:
1. If I'm using Sql Server as the backend and the .sql file placed on the server where this .sql file will be accessed by about 20 clients, will the customer (company) have to purchase a license for the sql server? If yes, how this can be done? Does the company have to purchase a license for each client and server for accessing contents of the .sql file? Actually, there will be only 1 server and abt 20 clients.
2. Does the developer need to purchase a seperate license for distributing the .sql file?
3. Also, wat is the maximum capacity of an sql database size? I'm asking this because as per my requirements, the company will be using the database at a rate of 1GB per month. So, by end of a year, it will be 12 GB.
NOTE: No Sql Server Software will be installed on client machines.
In brief, my doubt is: Do we need license for reading and writting to .mdb or .sql file contents and do we need seperate license for distributing them?
Please, somebody can help me for the licensing information and also for the database size?
Thank you.
hello,
I dnt know if this is the right place. I'm sorry for that.
WEll, I just completed my graduation and eventually i got a proposal from a company to develop a software for database management. I have some doubts about licensing the back-end database. My doubts are:
1. If I'm using Sql Server as the backend and the .sql file placed on the server where this .sql file will be accessed by about 20 clients, will the customer (company) have to purchase a license for the sql server? If yes, how this can be done? Does the company have to purchase a license for each client and server for accessing contents of the .sql file? Actually, there will be only 1 server and abt 20 clients.
2. Does the developer need to purchase a seperate license for distributing the .sql file?
3. Also, wat is the maximum capacity of an sql database size? I'm asking this because as per my requirements, the company will be using the database at a rate of 1GB per month. So, by end of a year, it will be 12 GB.
NOTE: No Sql Server Software will be installed on client machines.
In brief, my doubt is: Do we need license for reading and writting to .mdb or .sql file contents and do we need seperate license for distributing them?
Please, somebody can help me for the licensing information and also for the database size? the database will be also used for remote access.
Thank you.
Hi there,
We are currently developing a E-Com research site where subscribed members can conduct market research. The web site is developed and ready to go, however we are undecided what is required on the Database side and could do with some of your expert help.
Users will be conducting research on our MS SQL database. The database holds every product sale made by a select number of consumer good companies. The database holds 12 million records at any one time, however overall the database is very static and is not updated online. We intend to only store 1 months data, therefore on a weekly basis we delete old & add new records.
We are offering three categories of searches on the DB.
1. By Seller
2. By Category (i.e. Hair Care, Laundry etc)
3. By Sale.
The first two searches are not performance intensive as they are compiled and stored in the database - therefore no need for calculation online. Our main concern is the 3rd report. This report is where we allow the user to search for a specified search string. Therefore in the main table that holds all the sales, we have a full-text index for the field "Product Description".
What we are unclear on is the Capacity requirements regarding providing such functionality. I.e What server do we require?
We have researched many articles and have absorbed all the information regarding multiple disk controllers, lots of memory etc.. etc.. However we still have not been able to obtain an idea on what Server would serve our purposes. For example: would the following server do the job?
2 x 2.4Ghz Hyper-threading Xeon CPUs with 512Kb Cache and 400MHz System Bus
2GB Samsung RAMBUS 800-45 Memory (RIMMS / RDRAM)
A lot is determined by the usage, i.e. how many queries are executed per minute etc. At present we do not have a clear idea on the number of users. However we are not truely concerned about this as the 3rd report needs to execute and return within a short period of time. That is our main concern.
Therefore our question is as follows: If you were going to host a database that consisted of 12 million records & full-text indexing which had to be queried in a few seconds, what would you purchase?
We ask you to consider that funds are extremely tight and although the new latest server may do the job, it is most likely out of our budget. We are looking for the most cost effective solution but still statisfying the purpose.
Kind regards
Angus
Hello,
I have been working on SQL Server Capacity Planning for a few weeks now and have gathered a lot of materials, but non of thes materials contain recommended best practices on SQL Server capacity planning and also they do not contain operational guidelines.
I would be glad if anyone can recommend a website or book that contain information on SQL Server Capacity Planning Best Practices.
Thanks,
Jide
Hi Friends,
I am Gokul, I am using SQL Server MSEE 2005 (Free ware). Currently I am involved in the development of an application where I am using SQL Server MSEE 2005 and VB.Net. My incomming data size ranges from 5 GB to 7 GB per day. Can I use SQL Server MSEE 2005 as Data base with any licensing or have to get any license for storing larger capacity data.
Can any body please help me.
Thanks,
Gokul.G
I want to know how it calculates CPU utilization percentage (we see in Task Manager).
Further how can we find total capacity of our CPU in ms/sec....
I am just starting to build my apps in asp.net 2.0. I have build apss in v. 1.x before using sql server 2000. However, before i make the shift, I would like to know the advantages and disadvantages of using the sql server 2005 express edition then using the sql server 2000.
for example;+ How many data can it store?+ How many concurrent users it supports.+ Advantages and disadvantages of using sql server 2005 express ed.+ Any other relevant information that developers should know / beware / watch out for when using sql server 2005 express edition.
Note: I am not asking about the actual SQL Server 2005 but the express edition!
Regards and thanks in advance
Hi Everybody:
4 -5 years ago, I started my career as a translator translating the MetaTexis CAT (Computer Aided Translation Software).
It's amazing to see all the improvements that have been made until now, but recently I found some problems regarding
databases:
I heard that ACCESS databases volume is limited up to 2 GB and that SQL 2005 databases volume is limited up to 4 GB, but I think this information is wrong, or at least I was only able to import 10% of that amount.
Speaking in words, 2 GB doesn't represent a database with a volume of 125,000 segments/sentences (for ACCESS) and 4 GB a volume of 250,000 (for SQL 2005).
Concrete, my "mega.mxtm" database has "only" 359 MB and suddenly I refuses to import more sentences. Is that normal? (MICROSOFT SQL 2005)
Question: Is the new SQL 2008 also limited? Is there any way to "free" or increase the volume capacity?
Point 2: As I updated the SQL 2005 into 2008 I am not able to open the "old" "mega.mxtm" anymore... : (
Regards!
De Sena Viegas
Hi all,
We are going to setup a new server,so for that How to Capacity Plan for CPU and Memory ,Hard Disk for a new SQL SERVER Setup.
Is there any specific criteria for capacity planning ?in which base we should do this part.
Thanks
Kumar
I have an existing Access database that I need to transfer over to a more powerful back-end due to the need for larger size capacity. We need to be able to have a backend that can exist up to just about any size due to us scanning in documents by ODBC. With Access I know I was limited to about 4gb size and when split onto my current SQL server I have heard I will be stuck at 10gb? If so can you recommend a better backend, but my question is about the front end. I hear Windows WPF can be linked into SQL server but does this limit the size as well?
View 3 Replies View RelatedMy SQL server disk space is getting close to full capacity which is causing certain reports that we run via the SQL server to time out because I don't think there is enough space on the server.
Any tips on cleaning out a SQL server? Are there any folders that can absolutely be deleted to clear space? I know on a local computer that the %temp% folder can be cleaned out. I know when dealing with servers you do not want to make to many changes because it can cause major problems down the road.
I am in the process of formulating recommendations with respect to the purchase of additional storage for our current SQL 2012 SharePoint (2013) instance. My recommendation is to purchase separate storage (i.e, 15k disks) for the TempDB and Tlogs respectively (two sets of raid 10 disks). Currently, this server is hosting several instances, including SP, using two arrays (one for database and the other for Tlogs).
I am attempting to find information/recommendations on how to go about projecting the amount of storage for each of these while factoring in for growth.
Additional Details:
how to best formulate a reasonable estimate. Our largest content database belongs to IT and is currently ~80GB. That said, this is currently an outlier. The remaining content databases are less than 10GB (most are less than 2-3 GB). However, SharePoint will be used for digital document imaging in addition to, eventually, replacing file shares as our primary document storage medium once we roll it out.
Our current tempDB is ~400MB, but the instance was recently started a few days ago, as we had to failover to our backup server for hardware maintenance. I do not have any historical data on TempDB growth at this time. Also, I don't know how useful this would be given we have not fully deployed yet.
I have a table with a column Capacity which is char(10) and gets populated from user files. I want to check records which have negative Capacity value. So i first checked if its numeric and then for negative.
select * from table WHERE ISNUMERIC(LTRIM(RTRIM(Capacity))) = 1 AND Capacity < 0
BUT still it checks for char fields too giving errors like - Conversion failed when converting the varchar value 'asdf ' to data type int.
Parameter
Access 2000/XP
SQL Server 7.0
SQL Server 2000
MSDE 2000
Number of instances per server
n/a
n/a
16
16
Number of databases per instance / server
n/a
32,767
32,767
32,767
Number of objects per database
32,768
2,147,483,647
2,147,483,647
2,147,483,647
Number of users per database
n/a
16,379
16,379
16,379
Number of roles per database
n/a
16,367
16,367
16,367
Overall size of database (excluding logs)
2 GB
1,048,516 TB
1,048,516 TB
2 GB
Number of columns per table
255
1024
1024
1024
Number of rows per table
limited by storage
limited by storage
limited by storage
limited by storage
Number of bytes per row
(Excluding TEXT/MEMO/IMAGE/OLE)
2 KB
8 KB
8 KB
8 KB
Number of columns per query
255
4,096
4,096
4,096
Number of tables per query
32
256
256
256
Size of procedure / query
64 KB
250 MB
250 MB
250 MB
Number of input params per procedure / query
199
1,024
2,100
2,100
Size of SQL statement / batch
64 KB
64 KB
64 KB
64 KB
Depth of subquery nesting
50
32
32
32
Number of indexes per table
32
250 (1 clustered)
250 (1 clustered)
250 (1 clustered)
Number of columns per index
10
16
16
16
Number of characters per object name
64
128
128
128
Number of concurrent user connections
255
32,767
32,767
5
running ssis package with ssis run time compoenents and sql server 2000...
Is it possible to run ssis packages that point to servers on sql server 2000
without installing sql server 2005 ?
Can we just install runtime for ssis and run the packages ?
Please explian with links if possible
thanks a lot
I want to achieve the following in (SSIS/SSDT for SQL 2012) -Â
I have a generic SSIS package which simply sends out email notifications using SMTP email task (this package is within its own project, and has project level input parameters).
I need to be able to call this package in the Event handler section of every package (numbering in about less than 60) that we have. These packages are within their own respective projects.
I thought I could use the "execute package task", but it turns out , using this, I cannot call a package that is part of some other project. I also cannot call a package that is stored in the CATALOG. Is there any way I can do this ?
When I call the child package , I should be able to send in parameters like - error information and package name of the Parent package.
I have an SSIS package (TransAgentMaster) that I recently modified to include a call to a child package via the file system. The child package creates a text file. When I run the package in dev studio then the child package/text file is produced.
I then imported the TransAgentMaster as a stored packagesfilesystem package into SQL SSIS and executed the package. The child package produced the text file.
I then ran the SQL Server Agent to see if the child package would work and it did not generate the text file. Thus after updating a SSIS package importing the package into SSIS the job that calls the package will not call the child package. Please not that the TransAgentMaster package calls 7 children packages €¦ just not my new one.
Any thoughts why the agent will not run the child newly crated childe package?
Run the SSIS import/export wizard.
(xls -> sql table)
Select the tasks created.
Copy.
Here is the error that occurs.
p.s. Does anyone have any needles I can borrow? I think sticking them in my eyes would be nicer than working with SSIS.
===================================
An error occurred while objects were being copied. SSIS Designer could not serialize the SSIS runtime objects. (Microsoft Visual Studio)
===================================
Could not copy object 'Preparation SQL Task' to the clipboard.
(Microsoft.DataTransformationServices.Design)
------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%u00ae+Visual+Studio%u00ae+2005&ProdVer=8.0.50727.762&EvtSrc=Microsoft.DataTransformationServices.Design.SR&EvtID=SerializeComponentsFailed&LinkId=20476
------------------------------
Program Location:
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
at Microsoft.DataTransformationServices.Design.ControlFlowClipboardCommandHelper.InternalMenuCopy(MenuCommand sender, CommandHandlingArgs args)
===================================
Invalid access to memory location. (Exception from HRESULT: 0x800703E6) (Microsoft.SqlServer.ManagedDTS)
------------------------------
Program Location:
at Microsoft.SqlServer.Dts.Runtime.PersistImpl.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.SqlServer.Dts.Runtime.DtsContainer.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
Hi. I need to import excel file in database. i first need to do an unpivot task. the column names are dates and SSIS seems to be unable to pick up the column name as it is replaced by F2 F3 F4etc Can you advise of a solution. thanks ken
View 1 Replies View RelatedHi,
I'm finding that the standard components often just don't quite meet my
needs, but would only need some fairly minor changes to save me and my team a lot of
work (and produce more elegant solutions). So I was just wondering whether the source code was available for the standard components that come with SSIS, or if there is anyway to extend their functionality?
Or do you just have to start form scratch?
Thanks,
Lawrie
I need to build an asp.net/C# application to read values from an Excel spreadsheet. Once the values are read from the spreadsheet, the C# code will do some elementary statistics on the values read. Then the values read and their computations will be written to a sql server database.
My manager suggested that SSIS might be a good candidate technology for doing this type of work. Does that sound correct? My only hesitation with using SSIS is that I want to keep the application as simple as possible, so that the code can be more portable. Maybe might argument is not a good one, but maybe someone can help me out here.
Ralph