Hi!I want to store some really big text in my database (for my articles). The approximate size will be from 500 to 40000 characters. I was thinking of using the database 'text' datatype.I have heard that reading these text fields is slower and decreases the performance. Moreover is it advisable to index this for searching purposes?
View 4 RepliesI'm sorry, but I'm a definite newbie. How can I store really long pieces of text other than as the 'text' datatype, which is too short in SQLS7?
Please help! It's key to my site admin system for importing third party wysiwyg-generated pages into our system....
Thanks,
John E.
OK, I imported 680 million records into an unindexed table. That went well.
Then, I went into Enterprise Manager and added a two column non-unique clustered index to that table to speed access.
It's been running for ~36 hours and I have no idea when it will complete. I have deadlines that I'm going to miss and am very nervous; what can I do?
SQL Server 2000 Enterprise Edition (8.00.818 - sp3 + hotfixes)
Dual 3Ghz Xeon (two physical CPUs each have HyperThreading enabled)
Windows 2000 SP4
4GB RAM (although I just noticed the 3GB OS switch wasn't on)
SCSI boot drive
tempdb, data, and transaction log are on a FibreChannel RAID SAN
Help! Thanks in advance!
I am using the following plumbing code to search a database column for a keyword. I can't use full-test indexing so I came up w/ this work around. But It has many flaws so I'm looking for a better way. Thx in advance.
'Open sql connection
SqlConnection1.Open()
Dim datareader2 As SqlClient.SqlDataReader
datareader2 = cmdFindRowsWithKeyword.ExecuteReader
Dim strMsg As String
Dim intRowToFlag As Integer
Dim strRowsToGet As String
Dim strKeywordAsTyped As String
Dim strKeywordAllCaps As String
Dim strKeywordAllLower As String
Dim strKeywordFirstLetterCap As String
Dim FirstLetter As String
While datareader2.Read
intRowToFlag = datareader2(0).ToString
strMsg = datareader2(1).ToString
'Assign keyword as typed to variable
strKeywordAsTyped = txtSearchFor.Text
'Assign keyword as typed to variable then convert it to all uppercase
strKeywordAllCaps = txtSearchFor.Text
strKeywordAllCaps = strKeywordAllCaps.ToUpper
'Assign keyword as typed to variable then convert it to all lowercase
strKeywordAllLower = txtSearchFor.Text
strKeywordAllLower = strKeywordAllLower.ToLower
'Assign keyword as typed to variable then convert it so just the first letter is in uppercase
strKeywordFirstLetterCap = txtSearchFor.Text
FirstLetter = strKeywordFirstLetterCap.Chars(0)
FirstLetter = FirstLetter.ToUpper
strKeywordFirstLetterCap = strKeywordFirstLetterCap.Remove(0, 1)
strKeywordFirstLetterCap = strKeywordFirstLetterCap.Insert(0, FirstLetter)
'If the string contains the keyword as typed in all caps all lowercase or w/ the 1st letter in caps then flag that row.
If strMsg.IndexOf(strKeywordAsTyped) <> -1 Or strMsg.IndexOf(strKeywordAllCaps) <> -1 Or strMsg.IndexOf(strKeywordAllLower) <> -1 Or strMsg.IndexOf(strKeywordFirstLetterCap) <> -1 Then
cmdFlagRowsWithKeyword.Parameters("@recid").Value = intRowToFlag
SqlConnection2.Open()
Dim datareader3 As SqlClient.SqlDataReader
datareader3 = cmdFlagRowsWithKeyword.ExecuteReader
datareader3.Close()
SqlConnection2.Close()
End If
End While
datareader2.Close()
Hi,
I have this page that upload's PFD's to a table. In principle this works fine.
Until I try to upload large files (3 to 4 MB)I need to even upload larger files than that. (Don't really know as of yet what users are going to come up with) I get TimeOut problems. Now some people say it is not possible to exceed a limit of about 4 MB. But that there is a workaround by changing something to the web.config file.Can somebody give me info about that, (I am quite a novice really)I tried to change it like this, but to no avail:
<system.web><httpRuntime maxRequestLength="102400"enable = "True"requestLengthDiskThreshold="102400" useFullyQualifiedRedirectUrl="True"executionTimeout="102400"/></system.web>
Thanks for any help!
I am developing a resume storage system, and don't know the best way to store the resumes that come in to our company in both MS Word and text files. Should I store the files in the original format they come in, and reference the file name in the databse that points to a directory where they are stored, or should I store the text of the resumes directy in the database. There are 2 things that I must follow.
1: I need to have the documents keep their formatting.
2: I also need the capibility of conducting a full text search to pull out key words from the documents.
What is the best way?
Hi,
I was wondering if any one could help me, I need to store large amounts of data in my database, at present I have it set to nvchar (8000), I've looked around and noticed you can use text which stores up to 2 million, but is slow in displaying the information.
Any ideas or points in the right directions would be great.
Thanks
I have a table that I'm inserting a file into and using the Image data type to store the binary object. Now the code below works fine for files around 1.5 MB, but anything larger and it's like the code won't even execute and I get a Page Not found error.
I'm in the process of running some traces to find out what's going on in the backend, but I'm assuming there's something amiss with my code. The Image data type should handle files that size with no problem but for some reason it isn't.
Does anyone see anything wrong?
Thanks
Dim iLength As Integer = CType(File1.PostedFile.InputStream.Length, Integer)
If iLength = 0 Then Exit Sub 'not a valid file
Dim sContentType As String = File1.PostedFile.ContentType
Dim sFileName As String, i As Integer
Dim bytContent As Byte()
ReDim bytContent(iLength) 'byte array, set to file size
'strip the path off the filename
i = InStrRev(File1.PostedFile.FileName.Trim, "")
If i = 0 Then
sFileName = File1.PostedFile.FileName.Trim
Else
sFileName = Right(File1.PostedFile.FileName.Trim, Len(File1.PostedFile.FileName.Trim) - i)
End If
conn = New SqlConnection(eco)
conn.Open()
cmd = New SqlCommand("INSERT INTO ECO_Attachments (ECOID, FromType, DocName,OldRev,NewRev,NtLogin,DisplayName, FileName, FileSize, FileData, ContentType) VALUES (@ECOID, @FromType,@DocName,@OldRev,@NewRev,@NtLogin,@DisplayName, @FileName, @FileSize, @FileData, @ContentType) ")
cmd.Connection = conn
Try
File1.PostedFile.InputStream.Read(bytContent, 0, iLength)
With cmd
.Parameters.Add("@ECOID", SqlDbType.Int)
.Parameters.Add("@FromType", SqlDbType.NVarChar, 50)
.Parameters.Add("@DocName", SqlDbType.NVarChar, 250)
.Parameters.Add("@OldRev", SqlDbType.NVarChar, 50)
.Parameters.Add("@NewRev", SqlDbType.NVarChar, 50)
.Parameters.Add("@NTLogin", SqlDbType.NVarChar, 100)
.Parameters.Add("@DisplayName", SqlDbType.NVarChar, 200)
.Parameters.Add("@FileName", SqlDbType.NVarChar, 255)
.Parameters.Add("@FileSize", SqlDbType.Real)
.Parameters.Add("@FileData", SqlDbType.Image)
.Parameters.Add("@ContentType", SqlDbType.NVarChar, 50)
.Parameters("@ECOID").Value = ECOID
.Parameters("@FromType").Value = From
.Parameters("@DocName").Value = DocName
.Parameters("@OldRev").Value = OldRev
.Parameters("@NewRev").Value = NewRev
.Parameters("@NTLogin").Value = NTLogon
.Parameters("@DisplayName").Value = DisplayName
.Parameters("@FileName").Value = sFileName
.Parameters("@FileSize").Value = iLength
.Parameters("@FileData").Value = bytContent
.Parameters("@ContentType").Value = sContentType
.ExecuteNonQuery()
'.ExecuteScalar()
End With
Catch ex As Exception
Response.Write(ex)
'Handle your database error here
conn.Close()
End Try
How do you all recommend storing ordered pairs in SQL Server 2005? I plan to add one record for every data point but this will generate many records and requires an extra field to relate the points together. Are there any better ways to do this? Can the data still be searchable or does it have to be unpacked first?
View 2 Replies View RelatedWe are in the middle of re-designing few tables (namely transaction tables) that would store very large data and would be hosted on cloud (Azure). The old design of this product breaks transaction tables into monthly tables. i.e. say ORDERS Table would be physically broke into twelve monthly tables over a year like ORDERS0115 (mmyy), ORDERS0215 and so on.
We are in the opinion that keeping the entire transactions in one Table is better. Would like to know what's the best practices for transaction tables like the one mentioned above? Is it better to use one table with partitions. I read somewhere that partitions can slow down SELECT queries if not designed and thought properly.Since this would be hosted on cloud (Azure), do you think some additional things are to be taken care? How a site like Amazon keeps their transactions tables?
Hello,Currently we have a database, and it is our desire for it to be ableto store millions of records. The data in the table can be divided upby client, and it stores nothing but about 7 integers.| table || id | clientId | int1 | int2 | int 3 | ... |Right now, our benchmarks indicate a drastic increase in performanceif we divide the data into different tables. For example,table_clientA, table_clientB, table_clientC, despite the fact thetables contain the exact same columns. This however does not seem veryclean or elegant to me, and rather illogical since a database existsas a single file on the harddrive.| table_clientA || id | clientId | int1 | int2 | int 3 | ...| table_clientB || id | clientId | int1 | int2 | int 3 | ...| table_clientC || id | clientId | int1 | int2 | int 3 | ...Is there anyway to duplicate this increase in database performancegained by splitting the table, perhaps by using a certain type ofindex?Thanks,Jeff BrubakerSoftware Developer
View 4 Replies View Relatedfull text indexing
Hi,
In SQL Server 2005, if I set full text indexing enables in column MyDesc and
1. use “Select * from MyTable where MyDesc LIKE ‘%abc%’� would this be using full text indexing? Or have to use Contains to get it be in use?
2. Once I create the full-text index, should I be setting it to populate periodically? Isn’t it populating itself?
right-click do on database and selected properties,selected files page check box "use full-text indexing" is disable.
how can enable check box above for sql server 2005 on windows xp?
thanks,mohsen
How might it be possible to have on the fly full-text indexing utilizing the FREETEXT and CONTAINS statements so that when I enter a piece of data into the database it is immediatly searchable using the full-text indexing features?
View 4 Replies View RelatedHello,I wanna learn Full Text Indexing feature in MS SQL, Please let me know where could i have a good resource about it. I tried google but i didnt find what i need.regards
View 4 Replies View RelatedRecently the full text catalogs no longer work on my sql server. We have tried a lot of different things to get them working and all have failed. I am totally at a loss. The service is running under the local admin and the local admins have sysadmin permissions. We have removed the catalogs and re-added them. We have removed the catalogs changed the DB to disable full text indexing. Checked the registry for the left over entries. Run sp_fulltext_service 'clean_up'. We have tried many difference combinations and tried restoring from backup. Nothing works. If anyone has ANY ideas I would greatly appreciate the help. We are running SQL 7.0 with SP3.
Scott
I have a SQL Server Instance on my workstation (Windows XP Pro) I'm trying to use the Full Text Indexing - but the stupid thing is greyed out in my enterprise manager. Any one know anything I can try?
View 2 Replies View RelatedI have a table of product inventory I want to be able to search using the CONTAINS and/or FREETEXT functions. There are actually 4 columns I want to be searchable: brand, product name, etc. Since the table can have only one full-text index, should I just define an index on all 4 columns? It would be large in relation to the table, but the table itself is small (~600 rows). The index would not exceed the 900 byte limit.
Will this give me problems in terms of workability or performance? Is there a better approach? I could also just use LIKE searching, but it's significantly less sophisticated.
Thanks in advance.
Hi,
I am working on programming a knowledge base using ASP and MS SQL and we're running into the problem of how to search it... In that past we've just had a type of like statement... but this isn't really a search function and isn't really doing the trick...
So, what I'm thinking is that we might be able to use the full-text indexing service on Microsoft SQL server and then somehow search the full-text index from an ASP page and then procede with the db interface from there.
Are there better ways of searching MS SQL databases which I'm not aware of? Is it possible to access the full-text index from an ASP page and how would you do this? Are there documents that people could recommend on how to setup full-text indexing on MS SQL Server?
Thank you in advance, ( )
Zakir
I'd like to incrmentally populate my products full text catalogue everytime a product is added, i'm using the following code:
exec msdb.dbo.sp_fulltext_catalog [ @ftcat = ] 'Products'
, [ @action = ] 'start_incremental'
[ , [ @path = ] 'C:Program FilesMicrosoft SQL ServerMssqlFtdata' ]
I get the syntax error Line 166: Line 166: Incorrect syntax near 'Products'.
what is wrong with the code? Any help would be appreciated
Dear experts,
what exactly is full text indexing? and how that was useful......
i've seen this concept while creating databases
Hello,Is there a query or a method that can return the list of all theindexed words in a column that has been full-text indexed in sqlserver 2000? I need to get the words returned above in aContainstable[] query on another column to get a rank that can suggesta degree of similarity between the two.Thanks,J
View 1 Replies View Relatedis there a way to enable full text indexing on SQL Server 2005 Express?
i know that the advanced edition can do so, but i am wondering if there is a registry hack or something that i can use instead of reinstalling.
any ideas?
thanks
Hello everyone,
My questions are about installation (setup) and perfromances.
I have seen that, by default, all database user's files are set to : Use full-text indexing.
If we don't use full-text search at all, would it be a good idea to turn it off?
It seem impossible to turn it off at database creation using the T-SQL : CREATE DATABASE statement. Is it?
Having this parameter set to ON by default must incur an overhead. Rigth?
Best regards.
Carl
I am using sql server express edition and when i try to apply full text indexing on the table - the setting is set to "NO" and i am unable to set it to Yes
please advise - thanks Jeff
Trying to make a full-text table of a few tables in SQL server 2000 using the SQL Server Managment Studio. I am getting the following error when I then try to view the columns using the table. The column it is having a problem with is just a varchar text column. I have tried a few different tables and each time it has a problem with one of the columns. It does not give me an error when creating the full-text table. Anyone have any information on this?
I check on a full text table I made a while ago and it is giving me the same error but searches on it seem to be working, but cannot tell if it is using the one column it is having an issue with.
Property TypeColumnName is not available for FullTextIndexColumn '[MyColumnName]'. This property may not exist for this object, or may not be retrievable due to insufficient access rights. (Microsoft.SqlServer.Smo)
I´m trying to enable full-text indexing in SQL Server Management Express 2005.
I can see the option is there (Database name - Properties - Files), but the options is blurred and I´m not able to select it.
How do I solve this problem?
Getting desperate trying now...
Hey guys,
I'm about to deploy full-text searching to complement
ASP.NET/C#.NET. I unfortunately have not had much experience in
Full-Text Indexing...
I will be creating catalogs for each table in the database (end-users
pretty much require that we are able to search by
anything). I see that there is a catalog population
schedule...typically, what is the best practice for updating the
catalogs? The database entries will most likely be updated
frequently, as it contains the end-users curriculum vitae. Would
once a day, say midnight, be a sufficient schedule?
And also, as it pertains to best practices, is the method I am applying
the best way to do this (a catalog per table)...I have about 30 tables
in a relational model...is there a better way to catalog the entire
thing instead of table by table?
Thanks a lot for the help!
Eric...
I'm getting the following error while trying to setup full-text searching.
"The Microsoft Search service cannot be administered under the present user account"
Search service is using "Local account" to start
I'm logged into the server w/ "sa" right now.
Thanks for any help
I was trying Full text indexing on my database. it seems to work fine on all databases except one. On one particular database it returns '0 results' immediately even though the table has a large number of records.
The search returns just fine if tried on the same table on a different database on a different server.
Does anyone have a faintest clue as to what could be wrong ?
please reply ASAP.
Thanks
Kedar
I am having a few tables in my database on which I am implementing
FullText Searching.
As the tables are huge, full population of the catalog takes a lot of time.
I want to go for incremental population but I did not have a timestamp column
for this purpose when I initially designed the database.
Is there any way to ensure incremental population without the timestamp column? Because of the design constraints I do not like to have a timestamp column and would like to avoid it if it is possible.
But with out that SQL performs a full population and it is taking more than two hours now for full population and I also have several databases on which I have to do the same but the structure is more or less the same.
What are the performance issues when users are accessing the database when full text catalog population is in progress?Does it slow down reads and writes?It is a web based application for the internet catalog for industrial suppliers and needs to be online with no performance degradation.
Any help and info on this is greatly appreciated.
Thanks
Sushruth Nanduri.
I'm attached to two different SQL 7 servers and neither one has the options enabled for full-text indexing. I am the DBO for those databases and the services are running.
Any ideas what's missing? I'm using SQL 7 clients tools on my NT Workstation.
Also, are there samples of using the index/search within ASP?
I've created a Full-Text index on a table using Enterprise Manager. I've followed all of the steps outlined in BOL but I can't seem to get it to populate. Any ideas on what I'm doing wrong.
Sidney Ives
Sentara Healthcare
Norfolk Virginia